While the fastest computers are large parallel clusters today, programming them remains a challenge. The best algorithm and their implementation could be quite different than the sequential counterpart on a parallel platform. Programmer needs to consider multiple issues like how to load balance and how to effectively use multiple levels of caches and the communication network. Today parallel computing is every- where, it is not only the fastest computers, but also from your laptop to cellphone, most devices contain multiple processors. This course will focus on the architecture of the modern parallel computing platforms and the design, analysis and implementation of parallel algorithms for solving large scale science and engineering problems.