Foundations of Parallel Programming

Using parallel machines is difficult because of their inherent complexity and because their architecture changes frequently. This book presents an integrated approach to developing software for parallel machines that addresses software issues and performance issues together. The author describes a methodology for software construction that is architecture-independent and intellectually abstract. The software can execute efficiently on a range of existing and potential hardware configurations. The approach is based on the construction of categorical data types, a generalization of abstract data types, and of objects. This work will be an outstanding reference for researchers in computing.

Table of Contents

1 The Key Idea
2 Approaches to Parallel Software Development
3 Architectural Background
4 Models and Their Properties
5 The Categorical Data Type of Lists
6 Software Development Using Lists
7 Other Operations on Lists
8 A Cost Calculus for Lists
9 Building Categorical Data Types
10 Lists, Bags, and Finite Sets
11 Trees
12 Arrays
13 Graphs
14 Conclusions
A C++ Library for Lists
B Historical Background