The Community for Technology Leaders
RSS Icon
Issue No.03 - May-June (2013 vol.15)
pp: 32-42
Milena Ivanova , Netherlands eScience Center
Martin Kersten , Centrum Wiskunde and Informatica
Stefan Manegold , Centrum Wiskunde and Informatica
Yagiz Kargin , Centrum Wiskunde and Informatica
Current data-management systems and analysis tools fail to meet scientists' data-intensive needs. A "data vault" approach lets researchers effectively and efficiently explore and analyze information.
Data storage systems, Query processing, Database languages, Data warehouses, Scientific computing, Network architecture, scientific computing, data warehouse and repository, scientific databases, database architectures, scientific file repositories, data ingestion on demand
Milena Ivanova, Martin Kersten, Stefan Manegold, Yagiz Kargin, "Data Vaults: Database Technology for Scientific File Repositories", Computing in Science & Engineering, vol.15, no. 3, pp. 32-42, May-June 2013, doi:10.1109/MCSE.2013.17
1. T. Hey, S. Tansley, and E.K. Tolle, The Fourth Paradigm: Data-Intensive Scientific Discovery, Microsoft Research, 2009.
2. J. Gray et al., “Scientific Data Management in the Coming Decade,” SIGMOD Record, vol. 34, no. 4, 2005, pp. 34–41.
3. Y. Zhang et al., “SciQL: Bridging the Gap between Science and Relational DBMS,” Proc. 5th Int'l. Database Eng. and Application Symp., ACM, 2011, pp. 124–133.
4. E. Stolte et al., “Scientific Data Repositories: Designing for a Moving Target,” Proc. 32nd Ann. Conf. Sigmod, ACM, 2003, pp. 349–360.
5. K. Kunchithapadam et al., “Oracle Database Filesystem,” Proc. 30th Ann. Conf. Sigmod, ACM, 2011, pp. 1149–1160.
6. ISO/IEC 9075-9:2008, Information Technology—Database Languages—SQL—Part 9: Management of External Data (SQL/MED), Am. Nat'l Standards Inst. (ANSI), 2008.
7. P. Baumann et al., “The Multidimensional Database System RasDaMan,” SIGMOD Record, vol. 27no. 2, 1998, pp. 575–577.
8. The SciDB Development Team, “Overview of SciDB: Large Scale Array Storage, Processing and Analysis,” Proc. 39th Ann. Sigmod, ACM, 2010, pp. 963–968.
9. M. Ivanova, M.L. Kersten, and S. Manegold, “Data Vaults: A Symbiosis between Database Technology and Scientific File Repositories,” Proc. 24th Int'l Conf. Scientific and Statistical Database Management, LNC S 7338, Springer, 2012, pp. 485–494.
10. Y. Kargin et al., “Instant-On Scientific Data Warehouse—Lazy ETL for Data-Intensive Research,” Proc. 6th Int'l Workshop on Business Intelligence for the Real Time Enterprise, 2012; .
11. M. Ivanova et al., “An Architecture for Recycling Intermediates in a Column-store,” ACM Trans. Database Syst., vol. 35, no. 4, Nov. 2010, p. 24.
12. SEED Reference Manual, Standard for the Exchange of Earthquake Data, Incorporated Research Inst. for Seismology (IRIS), 2010; .
13. M. Taylor, STILTS—Starlink Tables Infrastructure Library Tool Set Version 2.5, user note, Oct. 2011; .
10 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool