Today parallel computing is everywhere, it is not only the fastest computers, but also from your laptop to cellphone, most devices contain parallel processors. While the fastest computers are large parallel clusters today, programming them remains a challenge. Programmer needs to consider multiple issues like how to load balance and how to effectively use multiple levels of caches and the communication network which are not independent from the architecture being used. This course will start with high performance aspects of sequential computing, and continue with parallel computing platforms, parallel algorithms and their applications.