Please enable JavaScript.
Coggle requires JavaScript to display documents.
Types of Parallel Processing - Coggle Diagram
Types of Parallel Processing
Single Instruction, Single Data (SISD)
A single processor is responsible for simultaneously managing a single algorithm as a single data source
A computer organisation having a control unit, a processing unit and a memory unit is represented by SISD
Instructions are carried out sequentially
Sequentially carried-out instructions may cross over throughout their execution phases
Multiple Instruction, Single Data (MISD)
Multiple processors are standard in computers that use this
While using several algorithms, all processors share the same input data
MISD computers can simultaneously perform many operations on the same batch of data
As expected, the number of operations is impacted by the number of processors available
The MISD structure consists of many processing units, each operating under its instructions and over a comparable data flow
One processor's output becomes the input for the following processor
Single Instruction, Multiple Data (SIMD)
Have multiple processors that carry out identical instructions
However, each processor supplies the instructions with its unique collection of data
SIMD computers apply the same algorithm to several data sets
All of these components fall under the supervision of a single control unit
While processing numerous pieces of data, each processor receives the same instruction from the control unit
Multiple modules included in the shared subsystem aid in simultaneous communication with every CPU
This is further separated into organisations that use bit-slice and word-slice modes
Multiple Instruction, Multiple Data (MIMD)
Characterised by presence of multiple processors, each capable of independently accepting its instruction stream
These kinds of computers have many processors
Additionally, each CPU draws data from a different data stream
A MIMD computer is capable of running many tasks simultaneously
Although MIMD computers are more adaptable than SIMD or MIMD computers, developing the sophisticated algorithms that power these machines is more challenging.
Since all memory flows are changed from the shared data area transmitted by all processors, a MIMD computer organisation incorporates interactions between the multiprocessors
The multiple SISD operation is equivalent to a collection of separate SISD systems if the many data streams come from various shared memories
Single Program, Multiple Data (SPMD)
Subset of MIMD
Although constructed similarly, each of its processors is responsible for carrying out the same instructions
SPMD is a message passing programming used in distributed memory computer systems
A group of separate computers, effectively called nodes, make up a distributed memory computer
Each node launches its application and uses send/receive routines to send and receive messages when interacting with other nodes
Systems can also use messages to provide barrier synchronisation
It is possible to transfer the messages via a wide range of communication techniques, such as TCP/IP
Massively Parallel Processing (MPP)
Made to manage the coordinated execution of program operations by numerous processors
With each CPU using its OS and memory, this coordinated processing can be applied to different program sections
As a result, MPP databases can handle enormous amounts of data and deliver analyses based on large datasets considerably faster
MPP processors typically communicate through a messaging interface and can have up to 200 or more processors working on an application
It functions by enabling the transmission of messages between processes via a set of corresponding data links
The most common types of computers used in parallel processing systems are SIMD and MIMD
Although SISD computers can't run in parallel on their own, a cluster can be created by connecting many of them
In a more extensive parallel system, the CPU of each computer can function as a processor