Subscribe

Issue No.03 - July-September (2011 vol.4)

pp: 209-221

Pokpong Songmuang , Fac. of Human Sci., Waseda Univ., Tokyo, Japan

M. Ueno , Dept. of Social Intell. & Inf., Univ. of Electro-Commun., Tokyo, Japan

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TLT.2010.29

ABSTRACT

The purpose of this research is to automatically construct multiple equivalent test forms that have equivalent qualities indicated by test information functions based on item response theory. There has been a trade-off in previous studies between the computational costs and the equivalent qualities of test forms. To alleviate this problem, we propose an automated system of test construction based on the Bees Algorithm in parallel computing. We demonstrate the effectiveness of the proposed system through various experiments.

INDEX TERMS

parallel processing, educational computing, parallel computing, bees algorithm, multiple test forms construction, e-testing, item response theory, Construction industry, Computational efficiency, Cities and towns, Approximation algorithms, Approximation methods, Parallel processing, Optimization, parallel computing., E-testing, multiple test forms, test construction, Bees algorithm

CITATION

Pokpong Songmuang, M. Ueno, "Bees Algorithm for Construction of Multiple Test Forms in E-Testing",

*IEEE Transactions on Learning Technologies*, vol.4, no. 3, pp. 209-221, July-September 2011, doi:10.1109/TLT.2010.29REFERENCES

- [1] F. Lord,
Application of Item Response Theory to Practical Testing Problems. Lawrence Erlbaum Associates, 1980.- [2] T.J.J.M. Theunissen, "Binary Programming and Test Design,"
Psychometrika, vol. 50, no. 4, pp. 411-420, Dec. 1985.- [3] T.J.J.M. Theunissen, "Some Applications of Optimization Algorithms in Test Design and Adaptive Testing,"
Applied Psychological Measurement, vol. 10, no. 4, pp. 381-389, 1986.- [4] F.B. Baker, A.S. Cohen, and R.S. Barmish, "Item Characteristics of Tests Constructed by Linear Programming,"
Applied Psychological Measurement, vol. 12, no. 2, pp. 189-199, 1988.- [5] W.J. van der Linden and E. Boekkooi-Timminga, "A Zero-One Programming Approach to Gulliksen's Matched Random Subtests Method,"
Applied Psychological Measurement, vol. 12, no. 2, pp. 201-209, 1988.- [6] W.J. van der Linden and E. Boekkooi-Timminga, "A Maximin Model for Test Design with Practical Constraints,"
Psychometrika, vol. 54, pp. 237-247, 1989.- [7] T.A. Ackerman, "An Alternative Methodology for Creating Parallel Test Forms Using the IRT Information Function,"
Proc. Paper Presented at the Ann. Meeting of the Nat'l Council on Measurement in Education, Mar. 1989.- [8] J. Adema, "Implementations of the Branch-and-Bound Method for Test Construction Problems," Technical Report 89-6, Project Psychometric Aspects of Item Banking, Dept. of Education, Univ. of Twente, 1989.
- [9] J. Adema, "Models and Algorithms for the Construction of Achievement Tests," PhD thesis, Univ. of Twente, 1990.
- [10] J. Adema, "The Construction of Customized Two-Stage Tests,"
J. Educational Measurement, vol. 27, no. 3, pp. 241-253, http://doc.utwente.nl58414, Sept. 1990.- [11] J. Adema, "Methods and Models for the Construction of Weakly Parallel Tests,"
Applied Psychological Measurement, vol. 16, pp. 53-63, 1992.- [12] J.J. Adema, E. Boekkooi-Timminga, and W.J. van der Linden, "Achievement Test Construction Using 0-1 Linear Programming,"
European J. Operations Research, vol. 55, pp. 103-111, 1998.- [13] W.J. van der Linden and J.J. Adema, "Simultaneous Assembly of Multiple Test Forms,"
J. Educational Measurement, vol. 35, no. 3, pp. 185-198, 1998.- [14] R.D. Armstrong, D. Jones, and I.-L. Wu, "An Automated Test Development of Parallel Tests from a Seed Test,"
Psychometrika, vol. 57, no. 2, pp. 271-288, June 1992.- [15] E. Boekkooi-Timminga, "Simultaneous Test Construction by Zero-One Programming,"
Methodika, vol. 1, pp. 101-112, 1987.- [16] E. Boekkooi-Timminga, "The Construction of Parallel Tests from Irt-Based Item Banks,"
J. Educational Statistics, vol. 15, no. 2, pp. 129-145, 1990.- [17] R.B. Fletcher, "A Review of Linear Programming and Its Application to the Assessment Tools for Teaching and Learning (aaTTle) Projects," Technical Report 5, Univ. of Auckland, www.tki.org.nz/r/asttle/pdf/technical-reports techreport05.pdf, 2000.
- [18] W.J. van der Linden, "Automated Test Construction Using Minimax Programming,"
IRT-Based Test Construction, W.J. van der Linden, ed., pp. 1-16, Dept. of Education, Univ. of Twente 1987.- [19] W.J. van der Linden,
Linear Models for Optimal Test Design, first ed. Springer, 2005.- [20] T. Ishii, P. Songmuang, and M. Ueno, "A Method to Extract the Maximum Number of Test Forms Using Maxclique,"
Proc. 23rd Ann. Conf. Japanese Soc. for Artificial Intelligence, 2009.- [21] H. Jeng and S. Shih, "A Comparison of Pair-Wise and Group Selections of Items Using Simulated Annealing in Automated Construction of Parallel Tests,"
Psychological Testing, vol. 44, no. 2, pp. 195-210, 1997.- [22] R. Luecht, "Computer-Assisted Test Assembly Using Optimization Heuristics,"
Applied Psychological Measurement, vol. 12, no. 3, pp. 224-236, 1998.- [23] J. Adema, "A Revised Simplex Method for Test Construction Problems," Technical Report 90-5, Dept. of Education, Univ. of Twente, 1989.
- [24] J.J. Adema and W.J. van der Linden, "Algorithms for Computerized Test Construction Using Classical Item Parameters,"
J. Educational Statistics, vol. 14, pp. 279-290, 1989.- [25] L. Swanson and M.L. Stocking, "A Model and Heuristic for Solving Very Large Item Selection Problems,"
Applied Psychological Measurement, vol. 17, no. 2, pp. 151-166, 1993.- [26] R.D. Armstrong, D.H. Jones, and Z. Wang, "Automated Parallel Test Construction Using Classical Test Theory,"
J. Educational Statistics, vol. 19, pp. 73-90, 1992.- [27] R.D. Armstrong, D.H. Jones, and Z. Wang, "Optimization of Classical Reliability in Test Construction,"
J. Educational and Behavioral Statistics, vol. 23, no. 1, pp. 1-17, 1998.- [28] K.-T. Sun, "A Greedy Approach to Test Construction Problems,"
Proc. Nat'l Science Council, vol. ROC-Part D 11, no. 2, pp. 78-87, 2001.- [29] G.J. Hwang, P.Y. Yin, and S.H. Yeh, "A Tabu Search Approach to Generating Test Sheets for Multiple Assessment Criteria,"
IEEE Trans. Education, vol. 49, no. 1, pp. 88-97, Feb. 2006.- [30] D. Belov and R.D. Armstrong, "Monte Carlo Test Assembly for Item Pool Analysis and Extension,"
Applied Psychological Measurement, vol. 29, no. 4, pp. 239-261, 2005.- [31] A.J. Verschoor, "Genetic Algorithms for Automated Test Assembly," PhD dissertation, Univ. of Twente, http://doc.utwente.nl60710, Apr. 2007.
- [32] K. Sun, Y. Chen, S. Tsai, and C. Cheng, "Creating IRT-Based Parallel Test Forms Using the Genetic Algorithm Method,"
Applied Measurement in Education, vol. 2, no. 21, pp. 141-161, 2008.- [33] K. He, L. Zheng, S. Dong, L. Tang, J. Wu, and C. Zheng, "PGO: A Parallel Computing Platform for Global Optimization Based on Genetic Algorithm,"
Computers & Geosciences, vol. 33, no. 3, pp. 357-366, 2007.- [34] P. Borovska, "Solving the Travelling Salesman Problem in Parallel by Genetic Algorithm on Multicomputer Cluster,"
Proc. Int'l Conf. Computer Systems and Technologies, pp. II.11-1-II.11-6, 2006.- [35] H. Pirim, E. Bayraktar, and B. Eksioglu,
Tabu Search: A Comparative Study, pp. 1-27, http://intechweb.orgbook.php?id=35, 2008.- [36] X.-S. Yang,
Engineering Optimizations via Nature-Inspired Virtual Bee Algorithms, vol. 3562. Springer, 2005.- [37] L.P. Wong, M.Y.H. Low, and C.S. Chong, "A Bee Colony Optimization Algorithm for Traveling Salesman Problem,"
Proc. Second Asia Int'l Conf. Modelling & Simulation (AMS '08), pp. 818-823, 2008.- [38] D. Pham, A. Ghanbarzadeh, E. Koc, S. Otri, S. Rahim, and M. Zaidi, "The Bees Algorithm, a Novel Tool for Complex Optimisation Problem,"
Proc. Second Int'l Virtual Conf. Intelligent Production Machines and Systems (IPROMS '06), pp. 454-461, 2006.- [39] X.-S. Yang,
Nature-Inspired Metaheuristic Algorithms, first ed. Luniver, 2008.- [40] F. Solis and R. Wets, "Minimization by Random Search Techniques,"
Math. of Operations Research, vol. 6, no. 1, pp. 19-30, 1981.- [41] P. Hansen and N. Mladenovi, "Variable Neighborhood Search: Principles and Applications,"
European J. Operational Research, vol. 130, no. 3, pp. 449-467, May 2001.- [42]
Java Parallel Processing Framework, http:/www.jppf.org, 2009.- [43]
The Information Technology Engineers Examination (ITEE), Japan Information-Technology Engineers Examination Center (JITEC), 16th Floor, Bunkyo Green Court, 2-28-8, Hon-Komagome, Bunkyo-ku, Tokyo, Japan, pp. 113-6591, http:/www.ipa.go.jp, 2008.- [44]
IBM ILOG CPLEX Optimizer, 2010.- [45] P. Songmuang and M. Ueno, "Development of Practice of and Integrative e-Testing System,"
Japanese Test Soc., vol. 4, no. 1, pp. 53-64, 2008. |