2008 Seventh IEEE International Symposium on Network Computing and Applications Discovering New Trends in Web Robot Traffic Through Functional Classification July 10-July 12 ISBN: 978-0-7695-3192-2
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/NCA.2008.47
This paper proposes a novel functional classification scheme to understand and analyze web robot traffic. The scheme is rooted in the recognition that the crawling behavior of a robot on a site is primarily governed byits intended purpose or functionality. We apply the classification rules to analyze web server access logs from the University of Connecticut School of Engineering domain. The analysis results indicate how the classification scheme can provide insights into the robot traffic based on their functionality.
Index Terms:
Web robots, classification, functional classification
Citation:
Derek Doran, Swapna S. Gokhale, "Discovering New Trends in Web Robot Traffic Through Functional Classification," nca, pp.275-278, 2008 Seventh IEEE International Symposium on Network Computing and Applications, 2008 Usage of this product signifies your acceptance of the Terms of Use. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||