The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.03 - March (2011 vol.33)
pp: 433-445
Hubert Cecotti , University of Bremen, Bremen
Axel Gräser , University of Bremen, Bremen
ABSTRACT
A Brain-Computer Interface (BCI) is a specific type of human-computer interface that enables the direct communication between human and computers by analyzing brain measurements. Oddball paradigms are used in BCI to generate event-related potentials (ERPs), like the P300 wave, on targets selected by the user. A P300 speller is based on this principle, where the detection of P300 waves allows the user to write characters. The P300 speller is composed of two classification problems. The first classification is to detect the presence of a P300 in the electroencephalogram (EEG). The second one corresponds to the combination of different P300 responses for determining the right character to spell. A new method for the detection of P300 waves is presented. This model is based on a convolutional neural network (CNN). The topology of the network is adapted to the detection of P300 waves in the time domain. Seven classifiers based on the CNN are proposed: four single classifiers with different features set and three multiclassifiers. These models are tested and compared on the Data set II of the third BCI competition. The best result is obtained with a multiclassifier solution with a recognition rate of 95.5 percent, without channel selection before the classification. The proposed approach provides also a new way for analyzing brain activities due to the receptive field of the CNN models.
INDEX TERMS
Neural network, convolution, gradient-based learning, spatial filters, brain-computer interface (BCI), electroencephalogram (EEG), P300.
CITATION
Hubert Cecotti, Axel Gräser, "Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 3, pp. 433-445, March 2011, doi:10.1109/TPAMI.2010.125
REFERENCES
[1] B.Z. Allison, E.W. Wolpaw, and J.R. Wolpaw, "Brain-Computer Interface Systems: Progress and Prospects," Expert Rev. Medical Devices, vol. 4, no. 4, pp. 463-474, 2007.
[2] N. Birbaumer and L.G. Cohen, "Brain-Computer Interfaces: Communication and Restoration of Movement in Paralysis," J. Physiology—London, vol. 579, no. 3, pp. 621-636, 2007.
[3] A. Kostov and M. Polak, "Parallel Man-Machine Training in Development of EEG-Based Cursor Control," IEEE Trans. Rehabilitation Eng., vol. 8, no. 2, pp. 203-205, June 2000.
[4] N. Birbaumer, N. Ghanayim, T. Hinterberger, I. Iversen, B. Kotchoubey, A. Kübler, J. Perelmouter, E. Taub, and H. Flor, "A Spelling Device for the Paralysed," Nature, vol. 398, pp. 297-298, 1999.
[5] B. Blankertz, G. Dornhege, S. Lemm, M. Krauledat, G. Curio, and K.-R. Müller, "The Berlin Brain-Computer Interface: EEG-Based Communication without Subject Training," IEEE Trans. Neural Systems and Rehabilitation Eng., vol. 14, no. 2, pp. 147-152, June 2006.
[6] F. Lotte, M. Congedo, A. Lecuyer, F. Lamarche, and B. Arnaldi, "A Review of Classification Algorithms for EEG-Based Brain-Computer Interfaces," J. Neural Eng., vol. 4, pp. R1-R13, 2007.
[7] K.-R. Müller, M. Krauledat, G. Dornhege, G. Curio, and B. Blankertz, "Machine Learning Techniques for Brain-Computer Interfaces," Biomedical Technology, vol. 49, no. 1, pp. 11-22, 2004.
[8] K.-R. Müller, M. Tangermann, G. Dornhege, M. Krauledat, G. Curio, and B. Blankertz, "Machine Learning for Real-Time Single-Trial EEG-Analysis: From Brain-Computer Interfacing to Mental State Monitoring," J. Neuroscience Methods, vol. 167, no. 1 pp. 82-90, 2008.
[9] C.W. Anderson, S.V. Devulapalli, and E.A. Stolz, "Determining Mental State from EEG Signals Using Parallel Implementations of Neural Networks," Proc. IEEE Workshop Neural Networks for Signal in Processing, pp. 475-483, 1995.
[10] H. Cecotti and A. Gräser, "Time Delay Neural Network with Fourier Transform for Multiple Channel Detection of Steady-State Visual Evoked Potential for Brain-Computer Interfaces," Proc. European Signal Processing Conf., 2008.
[11] T. Felzer and B. Freisieben, "Analyzing EEG Signals Using the Probability Estimating Guarded Neural Classifier," IEEE Trans. Neural Systems and Rehabilitation Eng., vol. 11, no. 4, pp. 361-371, Dec. 2003.
[12] E. Haselsteiner and G. Pfurtscheller, "Using Time Dependent Neural Networks for EEG Classification," IEEE Trans. Rehabilitation Eng., vol. 8, no. 4, pp. 457-463, Dec. 2000.
[13] N. Masic and G. Pfurtscheller, "Neural Network Based Classification of Single-Trial EEG Data," Artificial Intelligence in Medicine, vol. 5, no. 6, pp. 503-513, 1993.
[14] N. Masic, G. Pfurtscheller, and D. Flotzinger, "Neural Network-Based Predictions of Hand Movements Using Simulated and Real EEG Data," Neurocomputing, vol. 7, no. 3, pp. 259-274, 1995.
[15] B. Blankertz, G. Curio, and K.-R. Müller, "Classifying Single Trial EEG: Towards Brain Computer Interfacing," Advances in Neural Information Processing Systems, T.G. Diettrich, S. Becker, and Z. Ghahramani, eds., vol. 14, pp. 157-164, MIT Press, 2002.
[16] A. Rakotomamonjy and V. Guigue, "BCI Competition III: Data Set II—Ensemble of SVMs for BCI p300 Speller," IEEE Trans. Biomedical Eng., vol. 55, no. 3, pp. 1147-1154, Mar. 2008.
[17] B. Obermaier, C. Guger, C. Neuper, and G. Pfurtscheller, "Hidden Markov Models for Online Classification of Single Trial EEG data," Pattern Recognition Letters, vol. 22, no. 12, pp. 1299-1309, 2001.
[18] S. Zhong and J. Gosh, "HMMs and Coupled HMMs for Multi-Channel EEG Classification," Proc. IEEE Int'l Joint Conf. Neural Networks, vol. 2, pp. 1154-1159, 2002.
[19] A. Hiraiwa, K. Shimohara, and Y. Tokunaga, "EEG Topography Recognition by Neural Networks," IEEE Eng. in Medicine and Biology Magazine, vol. 9, no. 3, pp. 39-42, Sept. 1990.
[20] Y. Bengio and Y. LeCun, "Scaling Learning Algorithms towards AI," Large-Scale Kernel Machines, L. Bottou, O. Chapelle, D. DeCoste, and J. Weston, eds., MIT Press, 2007.
[21] P.Y. Simard, D. Steinkraus, and J.C. Platt, "Best Practices for Convolutional Neural Networks Applied to Visual Document Analysis," Proc. Seventh Int'l Conf. Document Analysis and Recognition, pp. 958-962, 2003.
[22] S. Sukittanon, A.C. Surendran, J.C. Platt, and C.J.C. Burges, "Convolutional Networks for Speech Detection," Proc. Eighth Int'l Conf. Spoken Language Processing, pp. 1077-1080, 2004.
[23] D.J. Krusienski, E.W. Sellers, D. McFarland, T.M. Vaughan, and J.R. Wolpaw, "Toward Enhanced P300 Speller Performance," J. Neuroscience Methods, vol. 167, pp. 15-21, 2008.
[24] E. Donchin, K.M. Spencer, and R. Wijesinghe, "Assessing the Speed of a P300-Based Brain-Computer Interface," IEEE Trans. Neural Systems and Rehabilitation Eng., vol. 8, no. 2, pp. 174-179, June 2000.
[25] L. Farwell and E. Donchin, "Talking Off the Top of Your Head: Toward a Mental Prosthesis Utilizing Event-Related Brain Potentials," Electroencephalography and Clinical Neurophysiology, vol. 70, pp. 510-523, 1988.
[26] B. Blankertz, K.-R. Müller, D.J. Krusienski, G. Schalk, J.R. Wolpaw, A. Schlögl, G. Pfurtscheller, J.R. Millán, M. Schröder, and N. Birbaumer, "The BCI Competition. III: Validating Alternative Approaches to Actual BCI Problems," IEEE Trans. Neural Systems and Rehabilitation Eng., vol. 14, no. 2, pp. 153-159, June 2006.
[27] G. Schalk, D.J. McFarland, T. Hinterberger, N. Birbaumer, and J. Wolpaw, "BCI2000: A General-Purpose Brain-Computer Interface (BCI) System," IEEE Trans. Biomedical Eng., vol. 51, no. 6, pp. 1034-1043, June 2004.
[28] G.-E. Sharbrough, R.P. Chatrian, H. Lesser, M. Luders, T.W. Nuwer, and T.W. Picton, "American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature," J. Clinical Neurophysiology, vol. 8, pp. 200-202, 1991.
[29] L. Breiman, "Bagging Predictors," Machine Learning, vol. 26, no. 2 pp. 123-140, 1996.
[30] U. Hoffmann, G. Garcia, J.-M. Vesin, K. Diserens, and T. Ebrahimi, "Boosting Approach to p300 Detection with Application to Brain-Computer Interfaces," Proc. IEEE Conf. Neural Eng., pp. 97-100, 2005.
[31] Y. LeCun, F.-J. Huang, and L. Bottou, "Learning Methods for Generic Object Recognition with Invariance to Pose and Lighting," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2004.
[32] Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-Based Learning Applied to Document Recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
[33] Y. LeCun, L. Bottou, G. Orr, and K.-R. Müller, "Efficient Backprop," Neural Networks: Tricks of the Trade, G. Orr and K. Muller, eds., Springer, 1998.
[34] J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas, "On Combining Classifiers," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 226-239, Mar. 1998.
[35] K. Chellapilla, S. Puri, and P.Y. Simard, "High Performance Convolutional Neural Networks for Document Processing," Proc. 10th Int'l Workshop Frontiers in Handwriting Recognition, 2006.
[36] R.J. Meuth and D.C. Wunsch, "Approximate Dynamic Programming and Neural Networks on Game Hardware," Proc. Int'l Joint Conf. Neural Networks, 2007.
[37] H. Serby, E. Yom-Toy, and G.F. Inbar, "An Improved P300-Based Brain-Computer Interface," IEEE Trans. Neural Systems and Rehabilitation Eng., vol. 13, no. 1, pp. 89-98, Mar. 2005.
[38] J.R. Wolpaw, N. Birbaumer, D.J. McFarland, G. Pfurtscheller, and T.M. Vaughan, "Brain-Computer Interfaces for Communication and Control," Clinical Neurophysiology, vol. 113, pp. 767-791, 2002.
[39] C.E. Shannon and W. Weaver, The Mathematical Theory of Communication. Univ. of Illinois Press, 1964.
[40] B. Blankertz, "BCI Competition III—Final Results," http://ida.first.fraunhofer.de/projects/ bci/competition_iiiresults/, 2008.
[41] U. Hoffmann, G. Garcia, J.M. Vesin, and T. Ebrahimi, "Application of the Evidence Framework to Brain-Computer Interfaces," Proc. Conf. IEEE Eng. Medicine and Biology Soc., vol. 1, pp. 446-449, 2004.
[42] N. Liang and L. Bougrain, "Averaging Techniques for Single-Trial Analysis of Oddball Event-Related Potentials," Proc. Fourth Int'l BCI Workshop and Training Course, pp. 44-49, 2008.
[43] B. Blankertz, "BCI Competition III Webpage," http://ida.first. fraunhofer.de/projects/ bcicompetition_iii, 2008.
[44] B. Blankertz, K.-R. Müller, G. Curio, T.M. Vaughan, G. Schalk, J.R. Wolpaw, A. Schlögl, C. Neuper, G. Pfurtscheller, T. Hinterberger, M. Schröder, and N. Birbaumer, "The BCI Competition 2003: Progress and Perspectives in Detection and Discrimination of EEG Single Trials," IEEE Trans. Biomedical Eng., vol. 51, no. 6, pp. 1044-1051, June 2004.
12 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool