This Article 
 Bibliographic References 
 Add to: 
Experimental Methodology in Pervasive Computing
April-June 2011 (vol. 10 no. 2)
pp. 94-96

Pervasive computing sits at the interface of computer science, social sciences, psychology, and engineering. As a consequence, consistent standards and guidelines for empirical evaluation are elusive. Thus, in most key conferences and journals in the field (including IEEE Pervasive Computing), "lack of adequate evaluation" is the most common reason for rejecting a submission. At the same time, the evaluation's quality is often the subject of heated discussion among reviewers and program committee members. IEEE Pervasive Computing's "Experimental Methodology" department will look at specific problems, practices, and recommendations related to empirical research in pervasive computing. The department is motivated by the increasing awareness that the field needs to mature, moving from visions of what could be done toward real-world systems that quantitatively prove what can be done in a reproducible, objective way.

1. M.V. Zelkowitz and D.R. Wallace, "Experimental Models for Validating Technology," Computer, vol. 31, no. 5, 2002, pp. 23–31.
2. W.F. Tichy et al., "Experimental Evaluation in Computer Science: A Quantitative Study," J. Systems Software, vol. 28, no. 1, Jan. 1995, pp. 9–18.
3. S. Neely et al., "Evaluating Pervasive and Ubiquitous Systems," IEEE Pervasive Computing, vol. 7, no. 3, July–Sept. 2008, pp. 85–88.
4. J. Ward, P. Lukowicz, and H. Gellersen, "Performance Metrics for Activity Recognition," ACM Trans. Intelligent Systems and Technology, vol. 2, no. 1, 2011, article no. 6.
5. E.M. Tapia, S.S. Intille, and K. Larson, "Activity Recognition in the Home Using Simple and Ubiquitous Sensors," Proc. Pervasive Computing, LNCS 3001, Springer, 2004, pp. 158–175.
6. R.P. Feynman, Surely You're Joking Mr. Feynman, W.W. Norton, 1985.

Index Terms:
experimental design, benchmarking, methodology, standards
Paul Lukowicz, Stephen Intille, "Experimental Methodology in Pervasive Computing," IEEE Pervasive Computing, vol. 10, no. 2, pp. 94-96, April-June 2011, doi:10.1109/MPRV.2011.25
Usage of this product signifies your acceptance of the Terms of Use.