Parallel Programming: Concepts and Practice

Parallel Programming: Concepts and Practice provides an upper level introduction to parallel programming. In addition to covering general parallelism concepts, this text teaches practical programming skills for both shared memory and distributed memory architectures. The authors’ open-source system for automated code evaluation provides easy access to parallel computing resources, making the book particularly suitable for classroom settings.

• Covers parallel programming approaches for single computer nodes and HPC clusters: OpenMP, multithreading, SIMD vectorization, MPI, UPC++
• Contains numerous practical parallel programming exercises
• Includes access to an automated code evaluation tool that enables students the opportunity to program in a web browser and receive immediate feedback on the result validity of their program
• Features an example-based teaching of concept to enhance learning outcomes

Table of Contents

Chapter 1 Introduction
Chapter 2 Theoretical Background
Chapter 3 Modern Architectures
Chapter 4 C++11 Multithreading
Chapter 5 Advanced C++11 Multithreading
Chapter 6 Openmp
Chapter 7 Compute Unified Device Architecture
Chapter 8 Advanced Cuda Programming
Chapter 9 Message Passing Interface
Chapter 10 Unified Parallel C++