Search Engine Coverage of the OAI-PMH Corpus

	This Article
	Subscribers, please Login Purchase article: $19 PDF HTML IEEE Xplore Subscribers RSS feed
	Share
	Email this Article to a friend
	Bibliographic References
	ASCII Text BibTex RefWorks Procite/RefMan/Endnote
	Add to:
	Digg Furl Spurl Blink Simpy Google Del.icio.us Y!MyWeb
	Search
	Similar Articles Articles by Frank McCown Articles by Xiaoming Liu Articles by Michael L. Nelson Articles by Mohammad Zubair

March/April 2006 (vol. 10 no. 2)

pp. 66-73

	ASCII Text	x
	Frank McCown, Xiaoming Liu, Michael L. Nelson, Mohammad Zubair, "Search Engine Coverage of the OAI-PMH Corpus," IEEE Internet Computing, vol. 10, no. 2, pp. 66-73, March/April, 2006.

	BibTex	x
	@article{ 10.1109/MIC.2006.41, author = {Frank McCown and Xiaoming Liu and Michael L. Nelson and Mohammad Zubair}, title = {Search Engine Coverage of the OAI-PMH Corpus}, journal ={IEEE Internet Computing}, volume = {10}, number = {2}, issn = {1089-7801}, year = {2006}, pages = {66-73}, doi = {http://doi.ieeecomputersociety.org/10.1109/MIC.2006.41}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, }

	RefWorks Procite/RefMan/Endnote	x
	TY - MGZN JO - IEEE Internet Computing TI - Search Engine Coverage of the OAI-PMH Corpus IS - 2 SN - 1089-7801 SP66 EP73 EPD - 66-73 A1 - Frank McCown, A1 - Xiaoming Liu, A1 - Michael L. Nelson, A1 - Mohammad Zubair, PY - 2006 KW - OAI PMH KW - search engines KW - indexing KW - deep web VL - 10 JA - IEEE Internet Computing ER -

Frank McCown, Old Dominion University

Xiaoming Liu, Los Alamos National Laboratory

Michael L. Nelson, Old Dominion University

Mohammad Zubair, Old Dominion University

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/MIC.2006.41

Having indexed much of the "surface" Web, search engines are now using various approaches to index the "deep" Web. At the same time, institutional repositories and digital libraries are adopting the Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) to expose their holdings. The authors harvested nearly 10 million records from OAI-PMH repositories. From these records, they extracted 3.3 million unique resource URLs and then conducted searches on samples from this collection to determine how much of the OAI-PMH corpus the three major search engines have indexed.

Index Terms:

OAI PMH, search engines, indexing, deep web

Citation:

Frank McCown, Xiaoming Liu, Michael L. Nelson, Mohammad Zubair, "Search Engine Coverage of the OAI-PMH Corpus," IEEE Internet Computing, vol. 10, no. 2, pp. 66-73, Mar./Apr. 2006, doi:10.1109/MIC.2006.41

Peer Review Notice | Give Us Feedback

Usage of this product signifies your acceptance of the Terms of Use.