• Publication
  • 2005
  • Issue No. 5 - May
  • Abstract - A Fuzzy-Set-Based Reconstructed Phase Space Method for Idenitification of Temporal Patterns in Complex Time Series
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
A Fuzzy-Set-Based Reconstructed Phase Space Method for Idenitification of Temporal Patterns in Complex Time Series
May 2005 (vol. 17 no. 5)
pp. 601-613
The new time series data mining framework proposed in this paper applies Reconstructured Phase Space (RPS) to identify temporal patterns that are characteristic and predictive of significant events in a complex time series. The new framework utilizes the fuzzy set and the Gaussian-shaped membership function to define temporal patterns in the time-delay embedding phase space. The resulting objective function represents not only the overall value of the event function, but also the weight of the vector in the temporal pattern cluster to which it contributes. Also, the new objective function is continuously differentiable so the gradient descent optimization such as quasi-Newton's method can be applied to search the optimal temporal patterns with much faster speed of convergence. The computational stability is significantly improved over the genetic algorithm originally used in our early framework. A new simple but effective two-step optimization strategy is proposed which further improves the search performance. Another significant contribution is the use of mutual information and false neighbors methods to estimate the time delay and the phase space dimension. We also implemented two experimental applications to demonstrate the effectiveness of the new framework with comparisons to the original framework and to the neural network prediction approach.

[1] R.J. Povinelli and X. Feng, “A New Temporal Pattern Identification Method for Characterization and Prediction of Complex Time Series Events,” IEEE Trans. Knowledge and Data Eng., vol. 15, no. 2, Mar./Apr. 2003.
[2] R.J. Povinelli and X. Feng, “Improving Genetic Algorithms Performance By Hashing Fitness Values,” Proc. Artificial Neural Networks in Eng., pp. 399-404, 1999.
[3] R.J. Povinelli and X. Feng, “Data Mining of Multiple Nonstationary Time Series,” Proc. Conf. Artificial Neural Networks in Eng., pp. 511-516, 1999.
[4] R.J. Povinelli and X. Feng, “Temporal Pattern Identification of Time Series Data Using Pattern Wavelets and Genetic Algorithms,” Proc. Artificial Neural Networks in Eng., pp. 691-696, 1998.
[5] F. Takens, “Detecting Strange Attractors in Turbulence,” Lecture Notes in Math., vol. 898, New York: Springer, 1981.
[6] F. Takens, “Detecting Strange Attractors in Turbulence,” Proc. Symp. Dynamical Systems and Turbulence, Univ. of Warwick, 1979-1980.
[7] M.B. Kennel, R. Brown, and H.D.I. Abarbanel, “Determining Embedding Dimension for Phase-Space Reconstruction Using a Geometrical Construction,” Physical Rev., A 45, p. 3403, 1993.
[8] R.J. Povinelli, “Identifying Temporal Patterns for Characterization and Prediction of Financial Time Series Events,” Interim Proc. Int'l Workshop Temporal, Spatial and Spatio-Temporal Data Mining, pp. 46-61, 2000.
[9] R.J. Povinelli, “Using Genetic Algorithms to Find Temporal Patterns Indicative of Time Series Events,” Proc. GECCO 2000 Workshop: Data Mining with Evolutionary Algorithms, pp. 80-84, 2000.
[10] H.D.I. Abarbanel, Analysis of Observed Chaotic Data. New York: Springer, 1996.
[11] E. Bradley, “Analysis of Time Series,” An Introduction to Intelligent Data Analysis, M. Berthold and D. Hand, eds., pp. 167-194, New York: Springer, 1999.
[12] A.M. Albano, A.I. Mees, G.C. de Guzman, and P.E. Rapp, “Data Requirements for Reliable Estimation of Correlation Dimensions,” Chaos in Biological Systems, New York: Plenum Press, 1987.
[13] A.M. Albano, A.I. Mees, G.C. de Guzman, and P.E. Rapp, “Data Requirements for Reliable Estimation of Correlation Dimensions,” Chaos in Biological Systems, New York: Plenum Press, 1987.
[14] H. Kantz and T. Schreiber, Nonlinear Time Series Analysis. Cambridge Univ. Press, 1997.
[15] D.E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning. Reading, Mass.: Addison-Wesley, 1989.
[16] J.-S. Jang and C.-T. Sun, Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Prentice Hall, 1997.
[17] R. Battiti, “First and Second Order Methods for Learning: Between Steepest Descent and Newton's Method,” Neural Computation, vol. 4, no. 2, pp. 141-166, 1992.
[18] L.A. Zadeh, “Outline of a New Approach to the Analysis of Complex Systems and Decision Processes,” IEEE Trans. Systems, Man, and Cybernetics, vol. 3, no. 1, pp. 28-44, Jan. 1973.
[19] S.L. Chiu, “Fuzzy Model Identification Based on Cluster Estimation,” J. Intelligent and Fuzzy Systems, vol. 2, no. 3, 1994.
[20] R. Fletcher, Practical Methods of Optimization: Unconstrained Optimization. New York: John Wiley & Sons, 1980.
[21] D. Goldfarb, “A Family of Variable Metric Methods Derived by Variational Means,” Math. Computation, pp. 23-26, 1970.
[22] A.M. Fraser and H.L. Swinney, “Independent Coordinates for Strange Attractors from Mutual Information,” Physical Rev., A 33, pp. 1134-1146, 1986.
[23] P. Armand, J.C. Gilbert, and S.J. Jegou, “A Feasible BFGS Interior Point Algorithm for Solving Strongly Convex Minimization Problems,” Institut National de Recherche en Infomatique et en Automatique, 1998.
[24] X. Chen, “Convergence of the BFGS Method for LC1 Convex Constrained Optimization,” SIAM J. Control and Optimization, vol. 34, no. 6, pp. 2051-2063, Nov. 1996
[25] E.W. Saad, D.V. Prokhorov, and D.C. Wunsch, “Advanced Neural-Network Training Methods for Low False Alarm Stock Trend Prediction,” Proc. IEEE Int'l Conf. Neural Networks, pp. 2021-2026, June 1996.
[26] M.T. Hagan, H.B. Demuth, and M.H. Beale, Neural Network Design. Boston: PWS Publishing, 1996.
[27] D.W. Marquardt, “An Algorithm for Least Squares Estimation of Nonlinear Parameters,” J. SIAM, vol. 11, pp. 431-441, 1963.
[28] K. Levenberg, “A Method for the Solution of Certain Problems in Least Squares,” Quarterly Applied Math., vol. 2, pp. 164-168, 1974.
[29] T. Sauer, J. Yorke, and M. Casdagli, “Embedology,” J. Statistical Physics, vol. 65, p. 579, 1991.
[30] E.W. Saad, D.V. Prokhorov, and D.C. Wunsch, “Comparative Study of Stock Trend Prediciton Using Time Delay, Recurrent, and Probabilistic Neural Networks,” IEEE Trans. Neural Networks, vol. 9, no. 6, pp. 1456-1469, Nov. 1998.
[31] M. Casdagli, S. Eubank, J.D. Farmer, and J. Gibson, “State Space Reconstruction in the Presence of Noise,” Physica, pp. 51-52, Dec. 1991.

Index Terms:
Fuzzy sets, gradient methods, optimization, Reconstructured Phase Space (RPS), temporal pattern identification, time series data mining.
Citation:
Xin Feng, Hai Huang, "A Fuzzy-Set-Based Reconstructed Phase Space Method for Idenitification of Temporal Patterns in Complex Time Series," IEEE Transactions on Knowledge and Data Engineering, vol. 17, no. 5, pp. 601-613, May 2005, doi:10.1109/TKDE.2005.68
Usage of this product signifies your acceptance of the Terms of Use.