Issue No.05 - May (2010 vol.22)
Yunhao Liu , Hong Kong University of Science and Technolgy, Hong Kong
Xiangyang Li , Hangzhou Dianzi University, Hangzhou and Illinois Institute of Technology, Chicago
Panlong Yang , P.L.A. University of Science and Technology, Nanjing
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TKDE.2009.209
Bloom filter is effective, space-efficient data structure for concisely representing a data set and supporting approximate membership queries. Traditionally, researchers often believe that it is possible that a Bloom filter returns a false positive, but it will never return a false negative under well-behaved operations. By investigating the mainstream variants, however, we observe that a Bloom filter does return false negatives in many scenarios. In this work, we show that the undetectable incorrect deletion of false positive items and detectable incorrect deletion of multiaddress items are two general causes of false negative in a Bloom filter. We then measure the potential and exposed false negatives theoretically and practically. Inspired by the fact that the potential false negatives are usually not fully exposed, we propose a novel Bloom filter scheme, which increases the ratio of bits set to a value larger than one without decreasing the ratio of bits set to zero. Mathematical analysis and comprehensive experiments show that this design can reduce the number of exposed false negatives as well as decrease the likelihood of false positives. To the best of our knowledge, this is the first work dealing with both the false positive and false negative problems of Bloom filter systematically when supporting standard usages of item insertion, query, and deletion operations.
Bloom filter, false negative, multichoice counting Bloom filter.
Yunhao Liu, Xiangyang Li, Panlong Yang, "False Negative Problem of Counting Bloom Filter", IEEE Transactions on Knowledge & Data Engineering, vol.22, no. 5, pp. 651-664, May 2010, doi:10.1109/TKDE.2009.209