Managing distributed storage media across wide areas poses an interesting challenge for present distributed computing technologies. There are a number of complex tradeoffs to be considered when managing the storage and delivery of bulk datasets which can not easily be duplicated at different sites.
We are developing software for managing the storage and delivery of bulk data. This work takes the form of a number of prototype component systems which will eventually be incorporated into the DISCWorld metacomputing environment software.
DWorFS is the DISCWorld file system prototype, a software system for supporting applications in a distributed file systems environment, but with a covert control channels allowing the DISCWoorld infrastructure software to communicate with the file system directly, to insulate legacy applications codes from the fact they are running as DISCWorld services.
Hierarchical file stores (HFS) involve smart software that can manage
the caching of data that is stored on a mix of slow (cheap) media such
as tape silos and tape libraries, and fast (but more expensive) media
such as disks and disk arrays. We are developing HFS software that
will integrate with the DISCWorld system in providing a distributed
hierarchy of storage systems, acessible from a DISCWorld service
application.
For more information, contact
Ken Hawick.