Ninth International Conference on Parallel and Distributed Systems (ICPADS'02)
Scalability and Reliability in a Distributed Search Engine
Taiwan, ROC
December 17-December 20
ISBN: 0-7695-1760-9
We have developed distributed search engine, called Cooperative Search Engine (CSE), in order to retrieve fresh information. In CSE, a local search engine located in each Web server makes an index of local pages. And, a meta search server integrates these local search engines in order to realize a global search engine. In such a way, the communication delay occurs at retrieval time. So, it is thought to be difficult to search fast. However, we have developed several speedup techniques in order to realize real time retrieval. In addition, the meta server is single point of failure in CSE. So, we propose redundancy of meta search servers in order to increase availability of CSE. In this paper, we describe scalability and reliability of CSE and their evaluations.
Citation:
Nobuyoshi SATO, Minoru UDAGAWA, Minoru UEHARA, Yoshifumi SAKAI, Hideki MORI, "Scalability and Reliability in a Distributed Search Engine," icpads, pp.57, Ninth International Conference on Parallel and Distributed Systems (ICPADS'02), 2002