Simd

SIMD - Wikipedia, the free encyclopedia
In computing, SIMD (Single Instruction, Multiple Data) is a technique employed ... The first era of SIMD machines was characterized by supercomputers like the Cray ...
en.wikipedia.org

The Society for Inherited Metabolic Disorders
Details about the 2008 SIMD Annual Meeting are available here. ... The SIMD is a non-profit professional organization whose purpose is to promote ...
www.simd.org

SIMD architectures: Page 1
This article focuses in on the SIMD, and ignores many of the important issues ... SIMD is about exploiting parallelism in the data stream, while superscalar SISD ...
arstechnica.com

Warning: mkdir() [function.mkdir]: Permission denied in /home/webs/affiliatelib2/CacheManager.php on line 12

Warning: mkdir() [function.mkdir]: No such file or directory in /home/webs/affiliatelib2/CacheManager.php on line 12

Warning: fopen(/home/templatecore2cache//*cluesnet.com/da/da6e951bb4d73827905b8c75c66c1b87c2cf5e60.tc2cache) [function.fopen]: failed to open stream: No such file or directory in /home/webs/affiliatelib2/CacheManager.php on line 130

Warning: fwrite(): supplied argument is not a valid stream resource in /home/webs/affiliatelib2/CacheManager.php on line 131

Warning: fclose(): supplied argument is not a valid stream resource in /home/webs/affiliatelib2/CacheManager.php on line 132

In computing, SIMD (Single Instruction, Multiple Data) is a technique employed to achieve data level parallelism, as in a vector processor or array processor. First made popular in large-scale supercomputers (as opposed to MIMD parallelization), smaller-scale SIMD operations have now become widespread in personal computer hardware. Today the term is associated almost entirely with these smaller units.

History The first era of SIMD machines was characterized by supercomputers such as the Cray X-MP. These machines were also called "vector processors." These machines operated on long vectors, for example adding two vectors of 100 numbers each. Supercomputing moved away from the SIMD approach as MIMD approaches became more powerful, and interest in SIMD waned. Later, personal computers became common, and became powerful enough to support real-time gaming. This created a mass demand for a particular type of computing power, and microprocessor vendors turned to SIMD to meet the demand. The first widely-deployed SIMD for gaming was Intel's MMX extensions to the x86 architecture. IBM and Motorola then added AltiVec to the POWER architecture, and there have been several extensions to the SIMD instruction sets for both architectures. All of these developments have been oriented toward support for real-time graphics, and are therefore oriented toward vectors of two, three, or four dimensions. When the older and newer SIMD architectures need to be distinguished, the newer architectures are referred to as "short-vector" architectures. A modern supercomputer is almost always a cluster of MIMD machines, each of which implements (short-vector) SIMD instructions. A modern desktop computer is often a multiprocessor MIMD machine where each processor can execute short-vector SIMD instructions.

DSPs A separate class of processors exist for this sort of task, commonly referred to as Digital Signal Processors, or DSPs. The main difference between SIMD-capable CPU's and DSP is that the latter are complete processors with their own (often difficult to use) instruction set, whereas SIMD-extentions rely on the general-purpose portions of the Central processing unit to handle the program details, and the SIMD instructions handle the data manipulation only. DSPs also tend to include instructions to handle specific types of data, sound or video for instance, whereas SIMD systems are considerably more general purpose. DSP's generally operate in Scratchpad RAM driven by DMA transfers initiated from the host system - and are unable to access external memory. Some DSP include SIMD instruction sets. The inclusion of SIMD units in general purpose processors has supplanted the use of DSP chips in computer systems, though they continue to be used in embedded applications. A sliding scale exists - the Cell's SPU's and the Ageia Physics Processing Unit could be considered half way between CPU's & DSP, in that they are optimized for numeric tasks & operate in local store, but they can autonomously control their own transfers so are in effect true CPU's.

Advantages An application that may take advantage of SIMD is one where the same value is being added (or subtracted) to a large number of data points, a common operation in many multimedia applications. One example would be changing the brightness of an image. Each pixel of an image consists of three values for the brightness of the red, green and blue portions of the color. To change the brightness, the R G and B values are read from memory, a value is added (or subtracted) from it, and the resulting value is written back out to memory.

With a SIMD processor there are two improvements to this process. For one the data is understood to be in blocks, and a number of values can be loaded all at once. Instead of a series of instructions saying "get this pixel, now get the next pixel", a SIMD processor will have a single instruction that effectively says "get lots of pixels" ("lots" is a number that varies from design to design). For a variety of reasons, this can take much less time than "getting" each pixel individually, as in a traditional CPU design.

Another advantage is that SIMD systems typically include only those instructions that can be applied to all of the data in one operation. In other words, if the SIMD system works by loading up eight data points at once, the add operation being applied to the data will happen to all eight values at the same time. Although the same is true for any superscalar processor design, the level of parallelism in a SIMD system is typically much higher.

Disadvantages

Many SIMD designers are hampered by design considerations outside their control. One of these considerations is the cost of adding processor register for holding the data to be processed. Ideally one would want the SIMD units of a CPU to have their own registers, but many are forced for practical reasons to re-use existing CPU registers - typically the floating point registers. These tend to be 64-bits in size, smaller than optimal for SIMD use, as well as leading to problems if the code attempts to use both SIMD and normal floating point instructions at the same time - at which point the units fight over the registers. Such a system was used in Intel's first attempt at SIMD, MMX, and the performance problems were such that the system saw very little use. However, recent x86 processor designs from Intel and AMD (as of November 2006, or several months prior) have eliminated the problems of shared SIMD and floating-point math registers, by providing a new, separate bank of SIMD registers. Still, in most cases the programmer doesn't know which processor model his code will be run on.

Packing and unpacking data to/from SIMD registers can be time-consuming in some applications, reducing the efficiency gained. If each datum (say, an 8-bit value) needs to be gathered/dispersed separately rather than loading an entire register in one operation, it is advisable to reorganize the data if possible, or consider not using SIMD at all.

Though recently there has been a flurry of research activities into techniques for efficient compilation for SIMD, much remains to be done. For that matter, the state-of-the-art for SIMD, from a compiler perspective, is hardly comparable to that for vector processing.
Because of the way SIMD works, the data in the registers must be well-aligned. Even for simple stream processing like convolution this can be a challenging task.

Not all algorithms suit vectorization.

Chronology The first use of SIMD instructions was in vector processor and was especially popularized by Cray in the 1970s.

Later machines used a much larger number of relatively simple processors. Some examples of this type of machine included:

ICL Distributed Array Processor (DAP), circa 1974
Burroughs Scientific Processor, circa 1976
Geometric-Arithmetic_Parallel_Processor, from Martin Marietta, starting in 1981, continued at Lockheed Martin, then at Teranex and Silicon Optix
Xplor, from Pyxsys, Inc., circa 2001
Connection Machine, models 1 and 2 (CM-1 and CM-2), from Thinking Machines Corporation, circa 1985
Zephyr DTC computer from Wavetracer, circa 1991
Goodyear_MPP (MPP), from NASA/Goddard Space Flight Center, circa 1983-1991

There were many others from this era as well.

Hardware Small-scale (64 or 128 bits) SIMD has become popular on general-purpose CPUs, starting in 1989 with the introduction of the Digital Equipment Corporation VAX Vector instructions in the Rigel system and continuing through 1994 and later with HP's PA-RISC Multimedia Acceleration eXtensions instruction set. SIMD instructions can be found to one degree or another on most CPUs, including the IBM's AltiVec and Signal Processing Engine for PowerPC, HP's Motion Video Instructions for DEC Alpha, Intel's MMX, Streaming SIMD Extensions, SSE2, SSE3 and SSSE3, AMD's 3DNow!, ARC_International's ARC Video subsystem, SPARC's Visual Instruction Set, Sun Microsystem's MAJC, HP's Multimedia Acceleration eXtensions for PA-RISC family, ARM Holdings's ARM architecture#NEON technology, MIPS architecture' MIPS Digital Media Extension(MaDMaX) and MIPS-3D. The Cell Processor's Synergistic Processing Units's instruction set is heavily SIMD based.

The instruction sets generally include a full set of vector instructions, including multiply, invert and trace. These are particularly useful for processing 3D graphics, although modern graphics cards with embedded SIMD have largely taken over this task from the CPU. Some systems also include permute functions that re-pack elements inside vectors, making them particularly useful for data processing and compression.

Modern GPU are often very wide SIMD implementations, capable of branches, loads, and stores on 128 or 256 bits at a time.

Software Adoption of SIMD systems in personal computer software has been slow, due to a number of problems. One was that many of the early SIMD instruction sets tended to slow overall performance of the system due to the re-use of existing floating point registers. Other systems, such as MMX and 3DNow!, offered support for data types that were not interesting to a wide audience and had expensive context switching instructions to switch between using the Floating_point_unit and MMX Processor_register. Compilers also often lacked support requiring programmers to resort to assembly language coding.

SIMD on x86 has had a slow start. The introduction of 3DNow! by AMD and Streaming_SIMD_Extensions by Intel confused matters somewhat, but today the system seems to have settled down (after AMD adopting SSE) and newer compilers should result in more SIMD-enabled software. Intel and AMD now both provide optimized math libraries that use SIMD instructions, and open source alternatives such as libSIMD and SIMDx86 have started to appear.

Apple Computer had somewhat more success, even though they entered the SIMD market later than the rest. AltiVec offered a rich system and can be programmed using increasingly sophisticated compilers from Motorola, IBM and GNU, therefore assembly is rarely needed. Additionally, many of the systems that would benefit from SIMD were supplied by Apple itself, for example iTunes and QuickTime. However, in 2006, Apple computers moved to Intel x86 processors. Apple's Application programming interfaces and Integrated Development Environment (XCode) were rewritten to use SSE2 and SSE3 instead of AltiVec. Apple was the dominant purchaser of PowerPC chips from IBM and Freescale Semiconductor, and even if they abandoned the platform further development of AltiVec is continued in several Power Architecture designs from Freescale, IBM and P.A. Semi.

Commercial applications Though it has generally proven difficult to find sustainable commercial applications for SIMD processors, one that has had some measure of success is the Geometric-Arithmetic Parallel Processor , which was developed by Lockheed Martin and taken to the commercial sector by their spin-off Teranex. The GAPP's recent incarnations have become a powerful tool in real-time digital image processing applications such as conversion between various video standards and frame rates (NTSC to/from PAL, NTSC to/from High-definition television formats, etc.), deinterlacing, image noise reduction, adaptive video compression, and image enhancement.

A more ubiquitous application for SIMD is found in video games: nearly every modern video game console since History of video game consoles (sixth generation) has incorporated a SIMD processor somewhere in its architecture. The Sony PlayStation 2 was unusual in that its vector-float units could function as autonomous DSPs executing their own instruction streams, or as coprocessors driven by ordinary CPU instructions. 3D graphics applications tend to lend themselves well to SIMD processing as they rely heavily on operations with 4-dimensional vectors. Microsoft Directx now chooses at runtime processor-specific implementations of its own math operations, including the use of SIMD-capable instructions.

One of the more recent processors to use vector processing is the Cell (microprocessor) developed by IBM in cooperation with Toshiba and Sony. It uses a number of SIMD processors (each with independent RAM and controlled by a general purpose CPU) and is geared towards the huge datasets required by 3D and video processing applications.

A larger scale SIMD processor comes from Stream Processors, Inc a company headed by computer architect Bill Dally. Their Storm-1 processor (2007) contains 80 SIMD cores controlled by a MIPS CPU.

External links

SIMD architectures (2000)
Cracking Open The Pentium 3 (1999)
Short Vector Extensions in Commercial Microprocessor
Article about Optimizing the Rendering Pipeline of Animated Models Using the Intel Streaming SIMD Extensions
SIMD history and performance comparison

SIMD - Wikipedia, the free encyclopedia
In computing, SIMD (S ingle I nstruction, M ultiple D ata) is a technique employed to achieve data level parallelism, as in a vector processor. First made popular in large-scale ...

Streaming SIMD Extensions from FOLDOC
Streaming SIMD Extensions < architecture > (SSE) Intel Corporation 's floating point SIMD extention of their Pentium microprocessor architecture. SSE was formerly know as KNI ...

The Society for Inherited Metabolic Disorders
Details about the 2008 SIMD Annual Meeting are available here. Applications for the SIMD North American Metabolic Academy have been closed as of July 15, 2008.

Scottish Index of Multiple Deprivation 2006 - Statistical Compendium
A compendium of analysis of the SIMD 2006 and, in particular, change in each of the domains between SIMD 2004 and SIMD 2006 by local authority.

Scottish Index of Multiple Deprivation 2004
... most deprived areas and their location within each local authority area and to see how each authority's share of the most deprived areas in Scotland has changed between the SIMD ...

SIMD - What does SIMD stand for? Acronyms and abbreviations by the ...
What does SIMD stand for? Definition of SIMD in the list of acronyms and abbreviations provided by the Free Online Dictionary and Thesaurus.

Strathclyde Institute Of Medical Devices - University of Strathclyde
The Strathclyde Institute of Medical Devices (SIMD) was launched in October 2006 in response to the recognition that effective innovation in medicine and healthcare technology is ...

Glasgow Health Technology Cooperative - University of Strathclyde
NHS Greater Glasgow & Clyde (NHSGG&C) and the Strathclyde Institute of Medical Devices (SIMD) at the University of Strathclyde have formed a new vehicle for collaborative research ...

SIMD - a reference guide from Electronicstalk
Looking for the latest SIMD-related news? Find it here on the Electronicstalk website with Laurence Marchini, Editor ... Laurence Marchini, Editor, writes: We see from your search ...

Deprivation
... or quintiles measured using postcode sectors. With the availability of data from the 2001 Census and the Neighbourhood Statistics Scottish Index of Multiple Deprivation (SIMD ...