The Community for Technology Leaders
RSS Icon
Subscribe
Cap Esterel, Cote d'Azur, France
Aug. 26, 2006 to Aug. 28, 2006
ISBN: 0-7695-2649-7
pp: 16
Athena Stassopoulou , Intercollege, Cyprus
Marios D. Dikaiakos , University of Cyprus, Cyprus
ABSTRACT
In this paper, we introduce a probabilistic modeling approach for addressing the problem of Web robot detection from Web-server access logs. More specifically, we construct a Bayesian network that classifies automatically access-log sessions as being crawler- or human-induced, by combining various pieces of evidence proven to characterize crawler and human behavior. Our approach uses machine learning techniques to determine the parameters of the probabilistic model. We apply our method to real Web-server logs and obtain results that demonstrate the robustness and effectiveness of probabilistic reasoning for crawler detection.
CITATION
Athena Stassopoulou, Marios D. Dikaiakos, "Crawler Detection: A Bayesian Approach", ICISP, 2006, Internet Surveillance and Protection, International Conference on, Internet Surveillance and Protection, International Conference on 2006, pp. 16, doi:10.1109/ICISP.2006.7
280 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool