CSCI 3366 (Introduction to Parallel and Distributed Processing):
Sample Programs

Makefiles, scripts, etc.

• For the MPICH implementation of MPI:
  • Sample makefile Makefile for compiling C and C++ programs.
  • Sample script run-mpi for running MPI programs.
• For the LAM implementation of MPI:
  • Sample makefile Makefile for compiling C and C++ programs.
  • Sample script run-mpi for running MPI programs.
• For either implementation:
  • Script make-MPIhosts for generating a list of machines that are currently "up".
• For programs using the POSIX threads library:
  • Sample makefile Makefile for compiling C++ programs.

• To obtain a makefile, use your browser's download function; cutting and pasting will likely turn the tabs in the makefile into spaces and cause it to not work. All makefiles linked from this page begin with brief documentation on their use.
• To obtain and use a script, download the script and use chmod to mark it executable, e.g., chmod u+x run-mpi. All scripts linked from this page begin with brief documentation on their use.
• Also see Tips for Using MPI on the CS Linux Machines.

Message-passing programs (using MPI)

• "Hello, world" program:
  • In C: hello.c.
  • In C++: hello++.cpp.
  • In C++ but using C bindings for MPI routines: hello+-.cpp.
• Trivial example of send/receive:
  • In C: send-recv.c.
  • In C++: send-recv++.cpp.
  • In C++ but using C bindings for MPI routines: send-recv+-.cpp.
• Trivial example of send/receive with timing:
  • In C: time-msg.c.
  • In C++: time-msg++.cpp.
  • In C++ but using C bindings for MPI routines: time-msg+-.cpp.
• "Hello, world" program also displaying command-line arguments:
  • In C: show-args.c.
  • In C++: show-args++.cpp.
  • In C++ but using C bindings for MPI routines: show-args+-.cpp.
• Program to add lots of numbers (based on example in section 2.2.3 of textbook):
  • Version 1, using broadcast: add-numbers-v1.cpp.
  • Version 2, using scatter: add-numbers-v2.cpp.
• Program to solve 1D heat-distribution problem (1D version of problem in section 6.3.2 of textbook):
  • heat-eqn.cpp.

Multi-threaded programs (using POSIX threads in C++)

• "Hello, world" program:
  • Without interthread synchronization: pthreads-hello-1.cpp.
  • Without explicit interthread synchronization, relying on thread-safety of "<<" operator: pthreads-hello-2.cpp.
  • With explicit interthread synchronization: pthreads-hello-3.cpp.
  • With explicit interthread synchronization, using C++ classes to package things more neatly: pthreads-hello-4.cpp. Requires header files pthreads-lock.h and pthreads-threadmgr.h.
• Program to add numbers:
  • Version with global variables: pthreads-sum-1.cpp. Requires header file timer.h.
  • Version using C++ classes to package some things more neatly: pthreads-sum-2.cpp. Requires header files timer.h, pthreads-threadmgr.h, and pthreads-lock.h.
  • Version using more C++ classes to package more things neatly: pthreads-sum-3.cpp. Requires header files timer.h, pthreads-threadmgr.h, and pthreads-lock.h.
• Program to solve 1D heat-distribution problem (1D version of problem in section 6.3.2 of textbook):
  • Version in which the main program controls the looping, starting up new threads and waiting for them to finish on each iteration: pthreads-heat-eqn-1.cpp. Requires header files timer.h and pthreads-threadmgr.h.
  • Version in which the main program just starts up new threads once and waits for them to finish, and the looping is done within each thread, with barrier synchronization: pthreads-heat-eqn-2.cpp. Requires header files timer.h, pthreads-threadmgr.h, and pthreads-barrier.h.
• Class for "bounded buffer" (with appropriate synchronization) and program showing its use:
  • Bounded buffer class pthreads-bbuffer.h. Requires header files pthreads-semaphore.h and (if debug output is desired) pthreads-lock.h.
  • Program pthreads-bbuffer.cpp. Requires header files pthreads-lock.h, pthreads-threadmgr.h, pthreads-bbuffer.h, and pthreads-sharedVar.h.
  • Alternative implementation of bounded buffer class pthreads-bbuffer-cond.h. Requires header file pthreads-lock.h (if debug output is desired). To compile the test program using this implementation, rename the file to pthreads-bbuffer.h, or make appropriate changes to the #include line of the test program.

Multi-threaded programs (using Java)

• "Hello, world" program:
  • Without interthread synchronization: ThreadsHello1.java.
  • With explicit interthread synchronization: ThreadsHello2.java.
  • With explicit interthread synchronization, in a somewhat more Java-esque style: ThreadsHello3.java. Requires additional class definition ThreadManager.java.
• Program to add numbers:
  • Version using static variables (analogous to first C++ version): ThreadsSum1.java. Requires additional class definitions SimpleReader.java and Timer.java.
  • More Java-esque version (analogous to second C++ version): ThreadsSum2.java. Requires additional class definitions SimpleReader.java, Timer.java, and ThreadManager.java.
• Class for "bounded buffer" (with appropriate synchronization) and program showing its use:
  • Bounded buffer class BoundedBuffer.java.
  • Test program TestBoundedBuffer.java. Requires additional class definitions SharedInt.java and ThreadManager.java.