DHPC Adelaide

DHPC Technical Report DHPC-027

DISCWorld: An Integrated Data Environment for Distributed High-Performance Computing

K.A.Hawick, A.L.Brown, P.D.Coddington, J.F.Hercus, H.A.James, K.E.Kerry, K.J.Maciunas, J.A.Mathew, C.J.Patten, A.J.Silis, F.A.Vaughan

Archived: 19 January 1998

Published in Proc. of the 5th IDEA Workshop, Fremantle, February 1998.

Abstract

We present some software architecture ideas for a distributed control and storage management environment, specifically for providing high-level services across wide area networks of high-performance computing resources. We describe the driving applications for our system such as geographic information systems and digital libraries and the particular design criteria they require. We discuss: scalable architectural design through peer-to-peer protocols; the execution paradigm, resource description, job scheduling and mapping; the specification and interface management of high level services; multiple networks for control and bulk data transfer; legacy application support mechanisms; distributed data repository design, data layout and compression support; user query support and cached product support.

HTML version

PDF version

PostScript version (gzip compressed)


[ DHPC Adelaide | DHPC Bangor | Contacts | People | Projects | Reports ]

webmaster@dhpc.adelaide.edu.au