DHPC Talk DHPCT-041

Towards a Scalable Metacomputing Storage Service

Craig Patten

Archived: 8 July 1999

Presented at High Performance Computing and Networking '99, Amsterdam, April 1999.
See also the accompanying technical paper.

Abstract

We describe a prototypical storage service through which we are addressing some of the open storage issues in wide-area distributed high-performance computing. We discuss some of these issues, such as latency-tolerance, heterogeneity, adaptive communications and storage utilisation, tertiary storage integration, and support for legacy and commercial applications. Existing systems addressing these issues in high-performance computing environments are either ad-hoc or focus narrowly on the simple client-server case. The storage service which we are developing as part of the DISCWorld metacomputing infrastructure will provide high-performance access to a global ``cloud'' of storage resources in a manner which is scalable, secure, adaptive, and portable, requiring no application or operating system modifications. Our system design is such that it provides flexible, modular and user-extensible access to arbitrary storage mechanisms, and on-demand data generation and transformations. We describe our current prototype's status, other related research and our future plans for the system.


[ DHPC Home | Projects | People | Organisations | Reports | Talks | Research | Education ]

webmaster@dhpc.adelaide.edu.au