Advanced Learning Technologies, IEEE International Conference on (2012)
Rome, Italy Italy
July 4, 2012 to July 6, 2012
The collection of learner events within a server-client architecture occurs either at server, client or both complementarily. Such collection may be incomplete due to various factors, particularly for client-based monitoring, where learners can disable, delete or even modify their event logs due to privacy policies. The quality and accuracy of any analysis based on such data collections depends critically on the quality of the subjacent dataset. We propose three initial metrics to evaluate the completeness of a learning dataset: client-to-server ratio, event-to-activity ratio and subjective ratio. These metrics provide a glimpse on the coverage rate of the monitoring and can be applied to distinguish subsets of data with a minimum level of reliability to be used in a learning analytics study.
Measurement, Servers, Monitoring, Reliability, Browsers, Least squares approximation, Context, completeness, learning analytics, metric, coverage
Derick Leony, Raquel M. Crespo, Mar Perez-Sanagustin, Hugo A. Parada G., Luis de la Fuente Valentin, Abelardo Pardo, "Coverage Metrics for Learning-Event Datasets Based on Client-Side Monitoring", Advanced Learning Technologies, IEEE International Conference on, vol. 00, no. , pp. 652-653, 2012, doi:10.1109/ICALT.2012.199