Distributed and High-Performance Computing References

High-Performance Computing and Parallel Computing

• Parascope: A Listing of Parallel Computing Web Sites
• Educational material for computational science and parallel computing from Syracuse University.
• "High Performance Computing", Kevin Dowd, O'Reilly, 1993.
• Supercomputing conference
• Publications of the U.S. High Performance Computing and Communications program, such as the HPCC Blue Book, give information on HPCC projects in the U.S.
• Other U.S. initiatives include the National Partnership for Advanced Computing Infrastructure (NPACI), National Computational Science Alliance (NCSA), and the Accelerated Strategic Computing Initiative (ASCI).
• "Introduction to Parallel Computing", T. G. Lewis and H. El-Rewini, Prentice-Hall, 1992.
• "Past, Present, Parallel: A Survey of Parallel Computing at the Beginning of the 1990s", Greg Wilson ed., Springer Verlag, 1992.

Architectures

• ``Computer Architecture: A Quantitative Approach'' 2nd edition, J.L. Hennessy and D.A. Patterson, Morgan Kaufmann, 1996.
• "Parallel Computers 2", R.W. Hockney and C.R. Jesshope, Adam Hilger, 1988.
• Computational Science Education Project course on computer architecture.
• "Computer Architecture and Parallel Processing", K. Hwang and F.A. Briggs, McGraw-Hill, 1984.
• "Architecture of High-Performance Computers, Vols. I and II", R.N. Ibbett and N.P. Topham, Macmillan, 1989.
• Overview of Recent Supercomputers, by Aad van der Steen and Jack Dongarra
• Cray HPC Systems, including the Cray (formerly Tera) MTA mutithreaded architecture machine
• SGI Origin servers, and information on ccNUMA architecture.
• Sun Enterprise 10000 SMP, and high-performance computing at Sun
• Compaq AlphaServers

Cluster Computing and Beowulfs

• Cluster Computing Resources
• Parallel Processing with Linux
• Clustering with NT
• DHPC group Beowulf links
• Gregory F. Pfister, "In Search of Clusters", Prentice Hall, ISBN 0-13-899709-8.
• Daniel Ridge, Donald Becker, Phillip Merkey, Thomas Sterling Becker, Phillip Merkey, "Beowulf: Harnessing the Power of Parallelism in a Pile-of-PCs", Proceedings, IEEE Aerospace, 1997.
• Donald J. Becker, Thomas Sterling, Daniel Savarese, John E. Dorband, Udaya A. Ranawak, Charles V. Packer, "Beowulf: A Parallel Workstation for Scientific Computation", Proceedings, International Conference on Parallel Processing, 1995.

Performance Modelling and Benchmarking

• "The Science of Computer Benchmarking", R.W. Hockney, SIAM, 1996.
• "High Performance Computing", Kevin Dowd, O'Reilly, 1993.
• BenchWeb
• PARKBENCH (PARallel Kernels and BENCHmarks)
• Top 500 Supercomputers

Applications and Algorithms

• "Solving Problems on Concurrent Processors, Vols. I and II", G. Fox et al., Prentice Hall, 1988.
• "Parallel Computing Works!", Geoffrey C. Fox, Roy. D. Williams, Paul C. Messina, Morgan Kaufmann, 1994.
• "Parallel and Distributed Computation: Numerical Methods", D.P. Bertsekas and J.N. Tsitsiklis, Prentiss Hall, 1989.
• Algorithms for high-performance computing from Syracuse University.

Parallel Languages and Parallel Programming

• Designing and Building Parallel Programs: Concepts and Tools for Parallel Software Engineering, Ian Foster, Addison Wesley.
• "Principles of concurrent and distributed programming", M. Ben-Ari, Prentice Hall, 1990.

• "The High Performance Fortran Handbook", Charles H. Koelbel, David B. Loveman, Robert S. Schreiber, Guy L. Steele Jr., and Mary E. Zosel, MIT Press, 1993.
• "Programmer's Guide to Fortran 90", Brainerd, Goldberg and Adams, McGraw-Hill.
• "Fortran 90/95 Explained", Michael Metcalf and John Reid, Oxford University Press, 1996.
• Educational materials for Fortran 90 and HPF from Syracuse University
• HPF programming course from Edinburgh Parallel Computing Centre.
• PGI HPF compiler reference manual gives overviews of HPF directives and Fortran 90 intrinsic functions

• "Using MPI: Portable Parallel Programming with the Message-Passing Interface", William Gropp, Ewing Lusk and Anthony Skjellum, MIT Press, 1994.
• "MPI: The Complete Reference", Marc Snir et al, MIT Press, 1996.
• "RS/6000 SP: Practical MPI Programming", Y. Aoyama and J. Nakona, IBM (local copy).
• MPI resources from Argonne National Laboratory.
• Educational materials for MPI from Syracuse University.
• MPI programming course from Edinburgh Parallel Computing Centre.
• MPI section of the book "Designing and Building Parallel Programs", by Ian Foster.
• Introduction to MPI from the University of New Mexico.
• Descriptions of all MPI routines

• An Introduction to Programming with Threads, Andrew D. Birrell, Digital Systems Research Center.
• Doing Two or More Tasks At Once: Threads, The Java Tutorial.
• Concurrent Programming: The Java Programming Language, Stephen J. Hartley, Oxford University Press, 1998.
• Concurrent Programming in Java: Design Principles and Patterns, Doug Lea, Addison-Wesley, 1999 (second edition).
• "Java Threads", Scott Oaks, Henry Wong, Mike Loukides (Editor) O'Reilly & Associates, 1999.
• OpenMP Home Page
• OpenMP: An Industry-Standard API for Shared-Memory Programming, Leonardo Dagum and Ramesh Menon, IEEE Computational Science & Engineering, Vol. 5, No. 1, January/March 1998.

Distributed Computing

- DCE

• The Open Group DCE Web page
• DCE FAQ
• ``Understanding DCE, OSF Distributed Computing Environment'', Ward Rosenberry, David Kenney and Gerry Fisher, O'Reilly and Associates, 1992, ISBN 1-56592-005-8.
• ``Guide to Writing DCE Applications, OSF Distributed Computing Environment'', John Shirley, Wei Hu and David Magid, O'Reilly and Associates, 1992, ISBN 1-56592-045-7.

- CORBA

• Ben-Natan, R., ``CORBA: A Guide To Common Object Request Broker Architecture'', McGraw-Hill, 1995.
• Object Management Group Home Page
• CORBA Home Page
• CORBA for Beginners
• Digital's ObjectBroker Home Page
• SUN's NEO Home Page
• DSTC's CORBA Trader
• Visibroker Home Page
• OrbixWeb Home Page
• Curtis, D., "Java, RMI and CORBA", OMG White Paper.
• R. Orfali, D. Harki and J. Edwards, "CORBA, Java, and the Object Web", BYTE MAgazine, October 1997.
• Vogel, A., Duddy, K., ``Java Programming with CORBA'', Wiley, 1997.
• Orfali, R., Harkey, D., ``Client/Server Programming with JAVA and CORBA'', Wiley, 1997.

- Java

• Java home page
• Java Resources is a comprehensive list of information about Java, including a list of tutorials.
• Educational materials for Java from Syracuse University
• Java Remote Method Invocation (RMI)
• Getting started with RMI
• RMI tutorial

Metacomputing

- Grid Computing

• Grid Computing Info Centre
• The Global Grid Forum
• Globus
• Legion
• Ian Foster and Carl Kesselman eds., ``The Grid: Blueprint for a New Computing Infrastructure'', Morgan Kaufmann, 1998.
• A. Grimshaw et al., "The Legion Vision of a Worldwide Virtual Computer", Comm. ACM 40(1), Jan 1997.

- Cluster Management Systems

• Cluster Computing Resources
• Review of Cluster Management Software, Mark A. Baker, Geoffrey C. Fox and Hon W. Yau.
• Condor
• PBS
• Sun Grid Engine

- Internet Computing

• Internet-based Distributed Computing Projects
• Great Internet Mersenne Prime Search (GIMPS)
• SETI@HOME
• Distributed.net
• Peer-to-Peer Working Group
• A collection of Internet computing links

Technical Writing

• References for essay and thesis writing from University of Adelaide library.
• Online Textbook for Technical Writing
• 10 Tips on writing essays
• Checklist for Writing Scientific Papers