In this paper, a lifecycle-based within stakeholder-oriented approach is introduced. In order to provide a conceptual understanding of the evaluation of collaborative systems to support development of a virtual enterprise, a case study was carried out within DIECoM (Distributed Integrated Environment for Configuration Management), an EC Framework V project. With the lessons learned from DIECoM, a need for further improvement in the approach is indicated. The lifecycle-based approach is therefore revised and a sequence derived: defining an evaluation plan, user requirements analysis, designing instruments, implementing the evaluation instruments, using feedback from users to modify the instruments and follow up. Moreover, it highlights needs to be addressed by further research.