Issue No. 01 - January-February (1997 vol. 9)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/69.567062
<p><b>Abstract</b>—An approach to organizing storage in database systems is presented that, under a wide range of conditions, saves both storage space and processing time. Text values in a database are replaced by short, fixed-length, rank-preserving numeric tokens. The actual values are stored in separate, nonredundant storage. Database operations that depend only on the relative magnitude of data values can be performed directly on the tokens. Tokenization is shown to improve database performance most in situations where there are a lot of ad hoc queries and a low volume of database insertions relative to other operations.</p>
Abstract data types, database management, design, file organization, performance, tokenization.
C. Wagner and R. C. Goldstein, "Database Management with Sequence Trees and Tokens," in IEEE Transactions on Knowledge & Data Engineering, vol. 9, no. , pp. 186-192, 1997.