CSCI 3366 (Introduction to Parallel and Distributed Processing):
Sample Programs

MPI

• Sample makefile Makefile for compiling C and C++ programs. (See the Note About Makefiles below.)
• Sample list-of-machines file MPIhosts.
• Helpful hints: Using MPI on the Linux Lab Machines.
• "Hello, world" program: hello.c.
• "Hello, world" program with command-line arguments and hostname: fancy-hello.c.
• Trivial example of send/receive: send-recv.c.
• Simple send/receive with timing: time-msg.c.
• Generic "exchange messages with neighbors" program, contrasting different types of communication:
  • With regular sends/receives: exchange.c.
  • With regular sends/receives, improved (to not hang on large messages): exchange-alt.c.
  • With asynchronous communication: exchange-asynch.c.
  • With asynchronous communication: exchange-persistent.c.
• Program to compute pi by numerical integration:
  • Sequential version (using MPI timing function): num-int-seq.c.
  • Parallel version: num-int-par.c.
• Program for heat diffusion example:
  • Sequential version (using MPI timing function): heat-eqn-seq.c.
  • Parallel version: heat-eqn-par.c.
• Generic master/worker program:
  • Sequential version (using MPI timing function): master-worker-seq.c.
  • Parallel version (static assignment of tasks to workers): master-worker-par-static.c.
  • Parallel version (dynamic assignment of tasks to workers): master-worker-par.c.

OpenMP

• Sample makefile Makefile for compiling C and C++ programs. (See the Note About Makefiles below.)
• Helpful hints: OpenMP on the Linux Lab Machines.
• "Hello, world" program: hello.c.
• Simple example of synchronization among threads:
  • Without synchronization: synch-1.c.
  • Using critical section for synchronization: synch-2.c.
  • Using lock for synchronization: synch-3.c.
• Program to compute pi by numerical integration:
  • Sequential version (using OpenMP timing function): num-int-seq.c.
  • Parallel versions using OpenMP constructs with SPMD approach (see comments in code for differences among versions): num-int-par-spmd-1.c, num-int-par-spmd-2.c, num-int-par-spmd-3.c, num-int-par-spmd-4.c.
  • Parallel version using OpenMP constructs: num-int-par.c.
• Program for heat diffusion example:
  • Sequential version (using OpenMP timing function): heat-eqn-seq.c.
  • Parallel version: heat-eqn-par-1.c.
  • SPMD-style parallel version: heat-eqn-par-2.c.
• Generic master/worker program:
  • Sequential version (using OpenMP timing function): master-worker-seq.c.
  • Parallel version (static assignment of tasks to workers): master-worker-par-static.c.
  • Parallel version (dynamic assignment of tasks to workers): master-worker-par.c.

Java

• "Hello, world" program:
  • Version using anonymous inner class: Hello1.java.
  • Version using static inner class: Hello2.java.
  • Versions using Java 5.0 (a.k.a. 1.5) features: Hello3.java, Hello4.java.
• Simple example of synchronization among threads: HelloSynch.java.
• "Bounded buffer" class and test program, showing use of wait/notify synchronization and interrupts: BoundedBuffer.java, TestBoundedBuffer.java.
• Program to compute pi by numerical integration:
  • Sequential version: NumIntSeq.java.
  • Parallel version: NumIntPar.java.

Note About Makefiles