Over the years business researchers have been challenged in their quest to develop evaluation models and instruments to evaluate Information and Communication Technology (ICT) effectiveness. In the current era in which ICT4D (ICT for Development) has been firmly entrenched on the social and development agenda, researchers have been confronted with the same challenge. This paper reports on the design of an investigation for the evaluation of socio economic outcomes of a national programme of community-based telecentres. The paper describes the challenges that were encountered in developing a suitable design frame to conduct the study. In presenting the research design, we discuss the rationale, and motivations for various design decisions. Additionally the paper highlights the short sightedness of implementers of ICT4D projects in incorporating monitoring and evaluation strategies during the conceptualization and implementation of ICT interventions.