COMP 422/534 Parallel Computing Spring 2020 Lecture Notes and Handouts

---

• 01/14/2020 Lecture 1 - Introduction
• 01/16/2020 Lecture 2 - Principles of Parallel Algorithm Design - Concurrency and Decomposition
• 01/21/2020 Lecture 3 - Principles of Parallel Algorithm Design - Concurrency and Mapping
• 01/23/2020 Lecture 4 - Shared-memory Parallel Programming with Cilk Plus
• 01/{28,30}/2020 Lectures 5-6 - More Shared-memory Parallel Programming with Cilk Plus
  
  • On NOTS, see /projects/comp422/cilkplus-examples for fib, race detection, and reducers examples discussed in class.
  • See /projects/comp422/cilkplus-features-tutorial for additional examples related to reducers and array notation.
    
• 02/04/2020 Lecture 7 - Programming Shared-memory Platforms with OpenMP
• 02/06/2020 Lecture 8 - Using HPCToolkit to Measure and Analyze the Performance of GPU-Accelerated Applications
• 02/11/2020 Lecture 9 - Programming Shared-memory Platforms with Pthreads
• 02/{18,20}/2020 Lectures 10-11 - Parallel Computing Platforms - Shared Memory Coherence and Synchronization
• 02/25/2020 Lecture 12 - Parallel Computing Platforms: Control Structures and Memory Hierarchy
• 02/27/2020 Lecture 13 - Parallel Computing Platforms - Network Topologies
• 03/{03,05}/2020 Lecture 14-15 - Parallel Computing Platforms - Routing and Embedding
• 03/09/2020 Lecture 16 - Collective Communication
  Self study materials: R. van de Geijn and J. Traff. Collective Communication. Encyclopedia of Parallel Computing, David Padua, Editor. Pages 318-332. 2011. [Article] (article accessible from Rice network and Rice VPN)
• 03/{11,24}/2020 Lectures 17-18 - Message Passing and MPI
  Self study materials: Argonne Training Program for Extreme-scale Computing (ATPESC): MPI for Scalable Computing [Slides, Video, Code Examples]
  Self study materials: Tutorials on MPI and collective communication [Website]

---

Last updated 09 March 2020