[Optimization] Parallel Computing, Concurrent Computing and Threading
Parallel Computing =/= Concurrent Computing. What is threading? Parallel computing is a type of computation in which many calculations or the execution of processes are carried out simultaneously . Large problems can often be divided into smaller ones, which can then be solved at the same time. There is no taking turns, they are advanced at the same time. Naturally this is not possible with single-core CPU, but multiple-core architecture is required instead. It can be said that if computation is parallel it is also concurrent (but not necessarily the other way around) - since parallel computation also fulfills the definition of concurrent computation. Concurrent computing is a form of computing in which several computations are executed during overlapping time periods — concurrently —instead of sequentially (one completing before the next starts). This is not exactly same as Parallel computing . Concurrent operation means that two computations can both make progress an