What is the main difference between parallel and distributed computing?
Parallel computing uses multiple processors in one machine, while distributed computing uses multiple machines.
What is the key limitation of sequential computing?
It can't keep up with the demand for faster processing; single processors can only be so fast before they overheat.
What are the advantages of parallel computing?
Saves time and money by performing tasks concurrently; scales more effectively than sequential solutions.
What are the advantages of distributed computing?
Solves problems that are too big for a single computer; harnesses the power of multiple devices working together.
What limits the speedup in parallel computing?
Sequential portions of the program; some steps must be done in order and cannot be parallelized.
What is the effect of diminishing returns in parallel computing?
Adding more processors eventually provides less speedup due to sequential steps and communication overhead.
Define sequential computing.
Instructions are processed one after another.
Define parallel computing.
A program is broken into smaller operations, some of which are done simultaneously using multiple processors.
Define distributed computing.
Multiple devices (computers) work together to run a program, often communicating over a network.
Define speedup in parallel computing.
Speedup quantifies how much faster a parallel solution is compared to a sequential one.
