The Community for Technology Leaders
RSS Icon
Subscribe
Toronto, ON
June 25, 2007 to June 27, 2007
ISBN: 0-7695-2837-3
pp: 37
Omar Benjelloun , Stanford University
Hector Garcia-Molina , Stanford University
Heng Gong , Stanford University
Hideki Kawai , Stanford University
Tait E. Larson , Stanford University
David Menestrina , Stanford University
Sutthipong Thavisomboon , Stanford University
ABSTRACT
Entity Resolution (ER) matches and merges records that refer to the same real-world entities, and is typically a compute-intensive process due to complex matching functions and high data volumes. We present a family of algorithms, D-Swoosh, for distributing the ER workload across multiple processors. The algorithms use generic match and merge functions, and ensure that new merged records are distributed to processors that may have matching records. We perform a detailed performance evaluation on a testbed of 15 processors. Our experiments use actual comparison shopping data provided by Yahoo!. (keywords: Entity Resolution, Information Integration, Data Cleaning)
INDEX TERMS
orig-research
CITATION
Omar Benjelloun, Hector Garcia-Molina, Heng Gong, Hideki Kawai, Tait E. Larson, David Menestrina, Sutthipong Thavisomboon, "D-Swoosh: A Family of Algorithms for Generic, Distributed Entity Resolution", ICDCS, 2007, 27th International Conference on Distributed Computing Systems (ICDCS '07), 27th International Conference on Distributed Computing Systems (ICDCS '07) 2007, pp. 37, doi:10.1109/ICDCS.2007.96
25 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool