Distributed Objects and Applications, International Symposium on (2000)
Sept. 21, 2000 to Sept. 23, 2000
Omran Bukhres , Purdue University
Zina Ben Miled , Purdue University
Eric Lynch , Purdue University
Lola Olsen , NASA/Goddard Space Flight Center
Zahir Tari , RMIT
This paper presents an information retrieval system for use by the Global Change Master Directory. The GCMD is a repository that contains Earth Science data collected by various agencies worldwide. The GCMD does not house the actual data; it contains descriptions of the data including the location of the actual data set. The GCMD also provides search services to locate these data descriptor files. For data to be included in the GCMD database, it must be submitted to the GCMD in the Directory Interchange Format (DIF). Data collectors manually submitting the DIF to the GCMD currently do this DIF submission, but this manual system cannot keep pace with the amount of data being collected. Our proposed solution to keep pace with data being collected is to design and develop a data access system for the GCMD to automate the DIF creation process. Our data access system will be capable of autonomously searching web sites for Earth Science data sets, extracting the metadata from these data sets, and creating a DIF for the file. This paper describes our prototype system that uses a URL pool to direct its search for Hierarchical Data Format (HDF) files. The HDF file is a self-describing format and contains metadata describing the contents of the files. This metadata is extracted and mapped to the DIF format. We present examples of DIFs created by our prototype to demonstrate that our approach is feasible, and discuss the need for a metadata standard among scientific data sets and how such a standard would enhance the effectiveness of our system and others in the Earth Science community.
O. Bukhres, E. Lynch, Z. Tari, Z. B. Miled and L. Olsen, "Effective Standards for Metadata in the GCMD Data Access System," Distributed Objects and Applications, International Symposium on(DOA), Antwerp, Belgium, 2000, pp. 155.