Intermediate and Advanced Applications
in Parallel Programming and MPI

1. MPI Exercises from William Gropp
   • List of Exercises
   • Advanced MPI Exercises
   • Performance Tuning MPI (scroll down)
   
   
2. Designing and Building Parallel Programs, by Ian Foster
   • Parallel Algorithm Examples, from Chap. 1
     Exercises 6-10, Chap 1, require you to design a parallel algorithm
   • Case Study: Atmosphere Model, Chap. 2
   • Case Study: Floorplan Optimization, Chap 2
   • Case Study: Computational Chemistry, Chap. 2
   • Exercises for Chap. 2
   • Case Study: Shortest Path Algorithms, Chap. 3
   • Matrix Multiplication, Chap. 4
   • Exercises from Chap 4
   • Case Study: Earth System Model, MPI, from Chap. 8
   • Parallel Merge Sort, Chap. 11
   • Hypercube Algorithm exercises, Chap. 11
   • Designing and Building Parallel Programs, by Ian Foster, main page
   
   
3. MPI Home Page - Argonne Lab
   • MPI Tutorials
   • Tuning MPI Applications for peak performance
   • Materials for Learning MPI
   
   
4. "MPI: The Complete Reference", Text Online - Scroll down for Contents
   • Jacobi iteraton example
   • Matrix Product, an application example
   
   
5. MPI Tutorial Slides, by Gropp
   
6. Edinburgh Computing Center Slides
   • Exercise: Ping Pong
   • Exercise: Rotating Information Around a Ring
   • Exercise: Derived Datatypes
   • Exercise: Torus
   • Case Study: Foxes and Rabbits
   • More Training Materials from the HKU
7. The Message Passing Interface Standard (from Argonne National Lab)
   
8. Syntax of MPI calls - Index for the Message Passing Interface Standard
   
9. MPI General Information
   
10. MPI Tutorial lists
    
11. "Six Function" MPI - syntax summary for C and C++ versions
    
12. One-Step Start LAM MPI
    
13. Getting Started with LAM/MPI
    
14. MPI Tutorial from LAM
    
15. Tutorial, Part 1, with slides and intro programs.
    
16. MPI Definitions (C, C++, Fortran) and MPI Function Index
    
17. LAM FAQ: Running LAM/MPI applications
    
18. MPI and Parallel Programming text by Pacheco