This Article 
 Bibliographic References 
 Add to: 
Workflow and End-User Quality of Service Issues in Web-Based Education
July/August 1999 (vol. 11 no. 4)
pp. 673-687

Abstract—The option of obtaining education over networks is quickly becoming a reality for all those who have access to the Internet and the World Wide Web (WWW). However, at present, network-based education (NBE) over the WWW and the Internet in general faces a number of pitfalls. The problems range from inadequate end-user quality of service (QoS), to inadequate materials, to shortcomings in learning paradigms, and to missing or inappropriate student assessment and feedback mechanisms. In this paper, we discuss some major issues that, although mostly solved for NBE, still face Web-based education (WBE). These include the required workflow-oriented technological and quality of service support. In discussing the issues, we use examples from a wide-area NBE/WBE system called NovaNET and a WBE system called Web Lecture System (WLS). We recommend that WBE system developers construct operational user (workflow) profiles before building their content and interfaces. Our experience is that, especially for synchronous WBE systems, user-level round-trip keystroke delays should not exceed about 250 ms and the overall availability of the system (including network-related service failures) should be at least 0.95. We also suggest that a successful WBE system will have a sound auto-adaptive knowledge assessment component, a “virtual” laboratory capability, and a set of strong collaborative functions. Until WBE systems match teacher/instructor and student workflows both technologically (as an appliance) and pedagogically, WBE, except in its most primitive form, will not be an effective educational tool.

[1] Asynchronous Learning Networks, URL: magazinemaga_v2_i2.htm.
[2] D. Alpert and D.L. Bitzer, “Advances in Computer-Based Education,” Science, vol. 167, pp. 1,582-1,590, Mar. 1970.
[3] S.J. Andriole, “Requirements-Driven Course Design, Development, Delivery, and Evaluation,” J. ALN, vol. 1, no. 2, Aug. 1997; URL: .
[4] Association for Supervision and Curriculum Development (ASCD), Alexandria, Va.; URL:http:/
[5] R.A. Avner, “Measuring Reliability of Networked Educational Computer Systems,” CERL Evaluation Report, Univ. of Illinois, Urbana-Champaign, Aug. 1993.
[6] R. Balay and M.A. Vouk, “A Lightweight Software Bus for Prototyping Problem Solving Environments,” Proc. 11th Int'l Conf. Systems Eng., Las Vegas, Nev., pp. 626-630, 1996.
[7] B. D'Arcy and D. Meg, “The Impact of Student Verbal/Visual Learning Style Preference on Implementing Groupware in the Classroom,” J. ALN, vol. 2, no. 2, Sept. 1998; URL: .
[8] Bellcore, Network Switching Element Outage Performance Monitoring Procedures, SR-TSY-000963, Issue 1, Apr. 1989.
[9] M. Birenbaum, A.E. Kelly, and K.K. Tatsuoka, “Diagnosing Knowledge States in Algebra Using the Rule-Space Model,” J. Research in Math. Education, vol. 24, no. 5, pp. 442-459, 1993.
[10] D.L. Bitzer, “Versatile Display Teaching System,“ U.S. Patent 3,405,457, Oct. 1968.
[11] M.D. Bitzer and D.L. Bitzer, “Teaching Nursing by Computer: An Evaluation Study,“ Computers in Biology and Medicine, vol. 3, pp. 187-204, 1973.
[12] BlackBoard Networks, 1998; URL:http://members.blackboard. com/bbnhpage.htm .
[13] J.R. Bourne, E. McMaster, J. Rieger, and J.O. Campbell, “Paradigms for On-Line Learning: A Case Study in the Design and Implementation of an Asynchronous Learning Network (ALN) Course,” J. ALN, vol. 1, no. 2, Aug. 1997; .
[14] G.W. Bracey, “Taking a Reading on TIMSS,” 1998;
[15] P.W. Brewer, “Methods for Concept Mapping in Computer-Based Education,” MS thesis, North Carolina State Univ., 1996.
[16] “Collaboratory is a Very Common Paradigm, There are Many Web Sites that Support It,” (e.g., search for collaboratory on AltaVista), see description of principles in A. Barua, R. Chellappa, and A.B. Whinston, “Creating a Collaboratory in Cyberspace: Theoretical Foundation and an Implementation,” 1996; URL: joc.html.
[17] Proc. Conf. Computer Support for Collaborative Learning, Lawrence Erlbaum Assoc., Mahwah, N.J., 1995.
[18] P. Dixit, M.A. Vouk, D.L. Bitzer, and C. Alix, “Availability of NovaNET—A Wide-Area Network-Based Education System,” Proc. ISSRE, IEEE CS Press, pp. 213-218, Oct. 1996.
[19] P. Dixit, “Quality of Service Modeling for Wide Area Network-Based Systems,” PhD thesis, North Carolina State Univ., May 1998.
[20] “How the Brain Learns,” Educational Leadership, vol. 56, no. 3, Nov. 1998.
[21] S.R. Hiltz, “Impacts of College-Level Courses via Asynchronous Learning Networks: Some Preliminary Results,” J. ALN, vol. 1, no. 2, Aug. 97; URL: .
[22] G.-J. Hwang, “A Tutoring Strategy Supporting System for Distance Learning on Computer Networks,” IEEE Trans. Education, vol. 41, no. 4,Rapid Publication Supplement, Nov. 1998.
[23] J. Asychronous Learning Networks, URL: .
[24] E. Jensen, “How Julie's Brain Learns,” Educational Leadership, vol.56, no. 2, Nov. 1998; URL: brainextjensen.html.
[25] L.M. Jones, D. Kane, B.A. Sherwood, and R.A. Avner,“A Final-Exam Comparison Involving Computer-Based Instruction,” Am. J. Physics, vol. 51, no. 6, pp. 533-538, 1983.
[26] W. Jones and M.A. Vouk, “Software Reliability Field Data Analysis,” Handbook of Software Reliability Eng., M. Lyu, ed., McGraw-Hill, pp. 439-489, 1996.
[27] P.K. Kauer, “An Analysis of North Carolina State University's Network Performance,” MS thesis, Dept. of Computer Science, North Carolina State Univ., 1995.
[28] R.L. Klevans and M.A. Vouk, “Automatically Generated Multimedia Presentations,” WebNet '96, San Francisco, Calif., Oct. 1996.
[29] “Software Fault-Tolerance,” M.R. Lyu, ed., Trends in Software book series, Wiley, 1994.
[30] K. Maly et al., "Interactive Distance Learning over Intranets," IEEE Internet Computing, vol 1, no. 1, Jan./Feb. 1997, pp. 60-71.
[31] S. McCanne and V. Jacobson, "vic: A Flexible Framework for Packet Video," Proc. ACM Multimedia '95,San Franscisco, Calif., pp. 511-522, Nov. 1995.
[32] J. Moonen, “The Efficiency of Telelearning,” J. ALN, vol. 1, no. 2, Aug. 1997; URL: .
[33] J.D. Musa, "Operational Profiles in Software Reliability Engineering," IEEE Software, vol. 10, no. 2, pp. 14-32, 1993.
[34] J.J. Hoey, J.M. Pettitt, C.E. Brawner, and S.P. Mull, Project 25: First Semester Assessment, Jan. 1998; URL: .
[35] “NovaNET Total System Reliability,” reports online since 1985.
[36] NovaNEToriginally developed by Computer-Based Education Research Lab, Univ. of Illinois; currently owned and operated by NovaNET Learning Inc.;
[37] B. O'Keefe, “Virtual Classrooms and Distributed Education,” link collection, 1998; URL: /.
[38] R.C. Overbaugh, “Research-Based Guidelines for Computer-Based Instruction Development,” J. Research Computing Education, vol. 27, no. 1, pp. 29-47, 1994.
[39] D.M. Raineri, B.G. Mehrtens, and A.W. Hübler, “CyberProf—An Intelligent Human-Computer Interface for Interactive Instruction on the World Wide Web,” J. ALN, vol. 1, no. 2, Aug. 1997; URLs: ,http://loner.ccsr.uiuc.educyberprof/.
[40] RealNetworks, 1998, URL:http:/
[41] A. Rindos, M. Vouk, S. Woolet, J. Hines, and J. Lester, “ATM Technology Enabling Educational Applications Across the North Carolina Information Highway, Proc. TeleCom '95 Forum Technology Summit, ITU, Geneva, pp. 519-522, 1995.
[42] J. Sellers, “An Empirical Evaluation of a Fault-Tolerant Approach to Computer-Assisted Teaching of Binary Relations,” MS thesis, North Carolina State Univ., 1998.
[43] C. Severance, Sync-O-Matic 3000, 1998; URL:http://www.egr. /.
[44] M. Singh and M. Huhns,“Automating Workflows for Service Provisioning: Integrating AI and Database Technologies,” IEEE Expert, vol. 9, pp. 19-23, 1994.
[45] E.R. Steinberg, Computer-Assisted Instruction—Synthesis of Theory, Practice and TechnologyI, Lawrence Erlbaum Assoc., Hollsdale, N.J., 1991.
[46] J.M. Stroud, “The Fine Structure of Psychological Time,” Annals of the New York Academy of Sciences, vol. 138,Article 2, pp. 623-631, 1967.
[47] M. Taagepera, F. Potter, and G.E. Miller, “Mapping Students' Thinking Patterns by the Use of the Knowledge Space Theory,” Int'l J. Science Education, vol. 19, pp. 283-302, Mar. 1997.
[48] K.K. Tatsuoka, “Rule Space: An Approach for Dealing with Misconceptions Based on Item Response Theory,” J. Educational Measurement, vol. 20, no. 4, pp. 345-354, 1983.
[49] “Third International Mathematics and Science Study (TIMSS) Study Center,” Center for the Study of Testing Evaluation and Education Policy; URL:, 1998.
[50] IEEE Trans. Education, IEEE Education Soc.
[51] M.A. Vouk and M.P. Singh, “Quality of Service and Scientific Workflows,” The Quality of Numerical Software: Assessment and Enhancements, R. Boisvert, ed., Chapman and Hall, pp. 7-89, 1997.
[52] WebCT, URL:http:/
[53] “Web Lecture System (WLS),” NorthCarolina State Univ. Regional Training Center for Parallel Processing; URLs:,http:/

Index Terms:
Network-based education, end-user quality of service, Web lecture system, NovaNET, education workflows, distance education, computer-based training, system reliability, keystroke response time, Web-based instruction.
Mladen A. Vouk, Donald L. Bitzer, Richard L. Klevans, "Workflow and End-User Quality of Service Issues in Web-Based Education," IEEE Transactions on Knowledge and Data Engineering, vol. 11, no. 4, pp. 673-687, July-Aug. 1999, doi:10.1109/69.790839
Usage of this product signifies your acceptance of the Terms of Use.