The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.02 - Feb. (2013 vol.35)
pp: 286-299
Heung-Il Suk , Dept. of Comput. Sci. & Eng., Korea Univ., Seoul, South Korea
Seong-Whan Lee , Dept. of Brain & Cognitive Eng., Korea Univ., Seoul, South Korea
ABSTRACT
As there has been a paradigm shift in the learning load from a human subject to a computer, machine learning has been considered as a useful tool for Brain-Computer Interfaces (BCIs). In this paper, we propose a novel Bayesian framework for discriminative feature extraction for motor imagery classification in an EEG-based BCI in which the class-discriminative frequency bands and the corresponding spatial filters are optimized by means of the probabilistic and information-theoretic approaches. In our framework, the problem of simultaneous spatiospectral filter optimization is formulated as the estimation of an unknown posterior probability density function (pdf) that represents the probability that a single-trial EEG of predefined mental tasks can be discriminated in a state. In order to estimate the posterior pdf, we propose a particle-based approximation method by extending a factored-sampling technique with a diffusion process. An information-theoretic observation model is also devised to measure discriminative power of features between classes. From the viewpoint of classifier design, the proposed method naturally allows us to construct a spectrally weighted label decision rule by linearly combining the outputs from multiple classifiers. We demonstrate the feasibility and effectiveness of the proposed method by analyzing the results and its success on three public databases.
INDEX TERMS
Electroencephalography, Optimization, Feature extraction, Machine learning, Estimation, Probability density function, Brain computer interfaces,motor imagery classification, Discriminative feature extraction, spatiospectral filter optimization, Brain-Computer Interface (BCI), ElectroEncephaloGraphy (EEG)
CITATION
Heung-Il Suk, Seong-Whan Lee, "A Novel Bayesian Framework for Discriminative Feature Extraction in Brain-Computer Interfaces", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 2, pp. 286-299, Feb. 2013, doi:10.1109/TPAMI.2012.69
REFERENCES
[1] G. Pfurtscheller and C. Neuper, "Motor Imagery and Direct Brain-Computer Communication," Proc. IEEE, vol. 89, no. 7, pp. 1123-1134, July 2001.
[2] R. Palaniappan and D. Mandic, "Biometric from the Brain Electrical Activity: A Machine Learning Approach," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 4, pp. 738-742, Apr. 2007.
[3] H. Cecotti, "A Self-Paced and Calibration-Less SSVEP-Based Brain-Computer Interface Speller," IEEE Trans. Neural Systems and Rehabilitation Eng., vol. 18, no. 2, pp. 127-133, Apr. 2010.
[4] H. Cecotti and A. Gräser, "Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 3, pp. 433-445, Mar. 2011.
[5] G. Dornhege, J. Millán, T. Hinterberger, D. McFarland, and K.-R. Müller, Toward Brain-Computer Interfacing. MIT Press, 2007.
[6] F. Lotte, M. Cngedo, A. Lecuyer, F. Lamarche, and B. Armaldi, "A Review of Classification Algorithm for EEG-Based Brain-Computer Interfaces," J. Neural Eng., vol. 4, no. 2, pp. R1-R13, June 2007.
[7] H. Ramoser, J. Müller-Gerking, and G. Pfurtscheller, "Optimal Spatial Filtering of Single Trial EEG during Imagined Hand Movement," IEEE Trans. Rehabilitation Eng., vol. 8, no. 4, pp. 441-446, Dec. 2000.
[8] A. Bashashati, M. Fatourechi, R. Ward, and G. Birch, "A Survey of Signal Processing Algorithms in Brain-Computer Interfaces Based on Electrical Brain Signals," J. Neural Eng., vol. 4, no. 2, pp. R32-57, June 2007.
[9] H.-I. Suk and S.-W. Lee, "A Probabilistic Approach to Spatio-Spectral Filters Optimization in Brain-Computer Interface," Proc. IEEE Int'l Conf. Systems, Man, and Cybernetics, pp. 19-24, Oct. 2011.
[10] M. Dalponte, F. Bovolo, and L. Bruzzone, "Automatic Selection of Frequency and Time Intervals for Classification of EEG Signals," Electronics Letters, vol. 43, no. 25, pp. 1406-1408, Dec. 2007.
[11] K. Thomas, C. Guan, L. Tong, and V. Prasad, "An Adaptive Filter Bank for Motor Imagery Based Brain Computer Interface," Proc. 30th Ann. IEEE Int'l Conf. Eng. in Medicine and Biology Soc., pp. 1104-1107, Aug. 2008.
[12] H.-I. Suk and S.-W. Lee, "Subject and Class Specific Frequency Bands Selection for Multi-Class Motor Imagery Classification," Int'l J. Imaging Systems and Technology, vol. 21, no. 2, pp. 123-130, June 2011.
[13] B. Blankertz, R. Tomioka, S. Lemm, M. Kawanabe, and K.-R. Müller, "Optimizing Spatial Filters for Robust EEG Single-Trial Analysis," IEEE Signal Processing Magazine, vol. 25, no. 1, pp. 44-56, Jan. 2008.
[14] B. Blankertz, M. Kawanabe, R. Tomioka, F. Hohlefeld, V. Nikulin, and K.-R. Müller, "Invariant Common Spatial Patterns: Alleviating Nonstationarities in Brain-Computer Interfacing," Advances in Neural Information Processing Systems, vol. 20, pp. 113-120, 2008.
[15] H. Wang and W. Zheng, "Local Temporal Common Spatial Patterns for Robust Single-Trial EEG Classification," IEEE Trans. Neural Systems and Rehabilitation Eng., vol. 16, no. 2, pp. 131-139, Apr. 2008.
[16] F. Lotte and C. Guan, "Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms," IEEE Trans. Biomedical Eng., vol. 58, no. 2, pp. 355-362, Feb. 2011.
[17] M. Krauledat, M. Tangermann, B. Blankertz, and K.-R. Müller, "Towards Zero Training for Brain-Computer Interfacing," PLoS One, vol. 3, no. 8, p. e2967, Aug. 2008.
[18] S. Fazli, C. Grozea, M. Danóczy, F. Popescu, B. Blankertz, and K.-R. Müller, "Subject Independent EEG-Based BCI Decoding," Advances in Neural Information Processing Systems, vol. 22, pp. 513-521, 2009.
[19] K. Ang, Z. Chin, H. Zhang, and C. Guan, "Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface," Proc. Int'l Joint Conf. Neural Networks, pp. 2391-2398, June 2008.
[20] S. Lemm, B. Blankertz, G. Curio, and K.-R. Müller, "Spatio-Spectral Filters for Improving the Classification of Single Trial EEG," IEEE Trans. Biomedical Eng., vol. 52, no. 9, pp. 1541-1548, Sept. 2005.
[21] G. Dornhege, B. Blankertz, M. Grauledat, F. Losch, G. Curio, and K.-R. Müller, "Combined Optimization of Spatial and Temporal Filters for Improving Brain-Computer Interfacing," IEEE Trans. Biomedical Eng., vol. 53, no. 11, pp. 2274-2281, Nov. 2006.
[22] R. Tomioka and K.-R. Müller, "A Regularized Discriminative Framework for EEG Analysis with Application to Brain-Computer Interface," NeuroImage, vol. 49, no. 1, pp. 415-432, 2010.
[23] W. Wu, X. Gau, B. Hong, and S. Gau, "Classifying Sing-Trial EEG During Motor Imagery by Iterative Spatio-Spectral Patterns Learning (ISSPL)," IEEE Trans. Biomedical Eng., vol. 55, no. 6, pp. 1733-1743, June 2008.
[24] K. Thomas, C. Guan, C. Lau, A. Vinod, and K. Ang, "A New Discriminative Common Spatial Pattern Method for Motor Imagery Brain-Computer Interfaces," IEEE Trans. Biomedical Eng., vol. 56, no. 11, pp. 2730-2733, Nov. 2009.
[25] H. Zhang, Z. Chin, K. Ang, C. Guan, and C. Wang, "Optimum Spatio-Spectral Filtering Network for Brain-Computer Interface," IEEE Trans. Neural Network, vol. 22, no. 1, pp. 52-63, Jan. 2011.
[26] L. Haiping, E. How-Lung, G. Cuntai, K. Plataniotis, and A. Venetsanopoulos, "Regularized Common Spatial Pattern with Aggregation for EEG Classification in Small-Sample Setting," IEEE Trans. Biomedical Eng., vol. 57, no. 12, pp. 2936-2946, Dec. 2010.
[27] U. Grenander, Y. Chow, and K. Keenan, A Pattern Theoretical Study of Biological Shapes. Springer-Verlag, New York, 1991.
[28] C. Andrieu, "An Introduction to MCMC for Machine Learning," Machine Learning, vol. 50, no. 1, pp. 5-43, Jan. 2003.
[29] A. Doucet, N. De Freitas, and N. Gordon, Sequential Monte Carlo Methods in Practice. Springer, 2001.
[30] M. Isard and A. Blake, "CONDENSATION-Conditional Density Propagation for Visual Tracking," Int'l J. Computer Vision, vol. 29, no. 1, pp. 5-28, 1998.
[31] T. Lan, E. Erdogmus, A. Adami, M. Pavel, and S. Mathan, "Salient EEG Channel Selection in Brain Computer Interfaces by Mutual Information Maximization," Proc. 27th Ann. IEEE Int'l Conf. Eng. in Medicine and Biology Soc., pp. 7064-7067, Sept. 2006.
[32] F. Oveisi and A. Erfanian, "A Minimax Mutual Information Scheme for Supervised Feature Extraction and Its Application to EEG-Based Brain-Computer Interfacing," EURASIP J. Advances in Signal Processing, vol. 2008, pp. 1-8, Jan. 2008.
[33] N. Kwak and C.-H. Choi, "Input Feature Selection by Mutual Information Based on Parzen Window," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 12, pp. 1667-1671, Dec. 2002.
[34] H. Peng, F. Long, and C. Ding, "Feature Selection Based on Mutual Information: Criteria of Max-Dependency, Max-Relevance, and Min-Redundancy," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 8, pp. 1226-1238, Aug. 2005.
[35] J. Leiva-Murillo and A. Artés-Rodríguez, "Maximization of Mutual Information for Supervised Linear Feature Extraction," IEEE Trans. Neural Networks, vol. 18, no. 5, pp. 1433-1441, Sept. 2007.
[36] E. Parzen, "On Estimation of a Probability Density Function and Mode," Annals of Math. Statistics, vol. 33, pp. 1065-1076, Sept. 1962.
[37] C. Burges, "A Tutorial on Support Vector Machines for Pattern Recognition," Data Mining and Knowledge Discovery, vol. 2, no. 2, pp. 121-167, June 1998.
[38] https://wiki.ml.tu-berlin.de/wiki/MainSS09_AnalysisOf NeuronalData , 2012.
[39] G. Dornhege, B. Blankertz, G. Curio, and K.-R. Müller, "Boosting Bit Rates in Non-Invasive EEG Single-Trial Classifications by Feature Combination and Multi-Class Paradigms," IEEE Trans. Biomedical Eng., vol. 51, no. 6, pp. 993-1002, June 2004.
[40] C. Brunner, R. Leeb, G. Müller-Putz, A. Schlógl, and G. Pfurtscheller, "BCI Competition 2008—Graz Data Set a," Laboratory of Brain-Computer Interfaces, Inst. for Knowledge Discovery, Graz Univ. of Technology, http://www.bbci.de/competition/iv#dataset2a , 2008.
[41] D. Garrett, D. Peterson, C. Anderson, and M. Thaut, "Comparison of Linear, Nonlinear, and Feature Selection Methods for EEG Signal Classification," IEEE Trans. Neural Systems and Rehabilitation Eng., vol. 11, no. 2, pp. 141-144, June 2003.
[42] G. Garcia, T. Ebrahimi, and J.-M. Vesin, "Support Vector EEG Classification in the Fourier and Time-Frequency Correlation Domains," Proc. First IEEE Int'l EMBS Conf. Neural Eng., pp. 591-594, Mar. 2003.
[43] K.-R. Müller, M. Krauledat, G. Dornhege, G. Curio, and B. Blankertz, "Machine Learning Techniques for Brain-Computer Interfaces," Biomedical Technology, vol. 49, pp. 11-22, Dec. 2004.
[44] C. Babiloni, F. Garducci, F. Cincotti, P. Rossini, C. Neuper, G. Pfurtscheller, and F. Babiloni, "Human Movement-Related Potentials versus Desynchronization of EEG Alpha Rhythm: A High-Resolution EEG Study," NeuroImage, vol. 10, no. 6, pp. 658-665, Dec. 1999.
[45] G. Dornhege, B. Blankertz, G. Curio, and K.-R. Müller, "Combining Features for BCI," Advances in Neural Information Processing Systems, vol. 15, pp. 1115-1122, 2003.
79 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool