This Article 
 Bibliographic References 
 Add to: 
Inference of Biological S-System Using the Separable Estimation Method and the Genetic Algorithm
July-Aug. 2012 (vol. 9 no. 4)
pp. 955-965
Fang-Xiang Wu, Dept. of Mech. Eng., Univ. of Saskatchewan, Saskatoon, SK, Canada
Li-Zhi Liu, Dept. of Mech. Eng., Univ. of Saskatchewan, Saskatoon, SK, Canada
W. J. Zhang, Dept. of Mech. Eng., Univ. of Saskatchewan, Saskatoon, SK, Canada
Reconstruction of a biological system from its experimental time series data is a challenging task in systems biology. The S-system which consists of a group of nonlinear ordinary differential equations (ODEs) is an effective model to characterize molecular biological systems and analyze the system dynamics. However, inference of S-systems without the knowledge of system structure is not a trivial task due to its nonlinearity and complexity. In this paper, a pruning separable parameter estimation algorithm (PSPEA) is proposed for inferring S-systems. This novel algorithm combines the separable parameter estimation method (SPEM) and a pruning strategy, which includes adding an ℓ1 regularization term to the objective function and pruning the solution with a threshold value. Then, this algorithm is combined with the continuous genetic algorithm (CGA) to form a hybrid algorithm that owns the properties of these two combined algorithms. The performance of the pruning strategy in the proposed algorithm is evaluated from two aspects: the parameter estimation error and structure identification accuracy. The results show that the proposed algorithm with the pruning strategy has much lower estimation error and much higher identification accuracy than the existing method.

[1] N. Friedman, M. Linial, I. Nachman, and D. Pe'er, "Using Bayesian Networks to Analyze Expression Data," J. Computational Biology, vol. 7, pp. 601-620, 2000.
[2] D. Husmeier, "Sensitivity and Specificity of Inferring Genetic Regulatory Interactions from Microarray Experiments with Dynamic Bayesian Networks," Bioinformatics, vol. 19, pp. 2271-2282, 2003.
[3] T. Akutsu, S. Miyano, and S. Kuhara, "Identification of Genetic Networks from a Small Number of Gene Expression Patterns under the Boolean Network Model," Proc. Pacific Symp. Biocomputing, pp. 17-28, 1999.
[4] S. Liang, S. Fuhrman, and R. Somogyi, "Reveal: A General Reverse Engineering Algorithm for Inference of Genetic Network Architectures," Proc. Pacific Symp. Biocomputing, pp. 18-29, 1998.
[5] S. Martin, Z. Zhang, A. Martino, and J.L. Faulon, "Boolean Dynamics of Genetic Regulatory Networks Inferred from Microarray Time Series Data," Bioinformatics, vol. 23, pp. 866-874, 2007.
[6] I. Shmulevich, E.R. Dougherty, S. Kim, and W. Zhang, "Probabilistic Boolean Networks: A Rule-Based Uncertainty Model for Gene Regulatory Networks," Bioinformatics, vol. 18, pp. 261-274, 2002.
[7] H. de Jong, "Modeling and Simulation of Genetic Regulatory Systems: A Literature Review," J. Computational Biology, vol. 9, pp. 67-103, 2002.
[8] T.S. Gardner, D. di Bernardo, D. Lorenz, and J.J. Collins, "Inferring Genetic Networks and Identifying Compound Mode of Action via Expression Profiling," Science, vol. 4, pp. 102-105, 2003.
[9] H. de Jong and M. Page, "Search for Steady States of Piecewise-Linear Differential Equation Models of Genetic Regulatory Networks," IEEE/ACM Trans. Computational Biology and Bioinformatics, vol. 5, no. 2, pp. 208-222, Apr.-June 2008.
[10] R. Xu, D.C. Wunsch II, and R.L. Frank, "Inference of Genetic Regulatory Networks with Recurrent Neural Network Models Using Particle Swarm Optimization," IEEE/ACM Trans. Computational Biology and Bioinformatics, vol. 4, no. 4, pp. 681-692, Oct.-Dec. 2007.
[11] A. Tenenhaus, V. Guillemot, X. Gidrol, and V. Frouin, "Gene Association Networks from Microarray Data Using a Regularized Estimation of Partial Correlation Based on PLS Regression," IEEE/ACM Trans. Computational Biology and Bioinformatics, vol. 7, no. 2, pp. 251-262, Apr.-June 2010.
[12] R. Ram and M. Chetty, "A Markov-Blanket-Based Model for Gene Regulatory Network Inference," IEEE/ACM Trans. Computational Biology and Bioinformatics, vol. 8, no. 2, pp. 353-367, Mar./Apr. 2011.
[13] S. Mitra, R. Das, and Y. Hayashi, "Genetic Networks and Soft Computing," IEEE/ACM Trans. Computational Biology and Bioinformatics, vol. 8, no. 1, pp. 94-107, Jan./Feb. 2011.
[14] L. Cheng, Z.G. Hou, Y.Z. Lin, M. Tan, W.J. Zhang, and F.X. Wu, "Recurrent Neural Network for Non-Smooth Convex Optimization Problems with Application to the Identification of Genetic Regulatory Networks," IEEE Trans. Neural Networks, vol. 22, no. 5, pp. 714-726, May 2011.
[15] I.C. Chou and E.O. Voit, "Recent Developments in Parameter Estimation and Structure Identification of Biochemical and Genomic Systems," Math. Biosciences, vol. 219, pp. 57-83, 2009.
[16] F.X. Wu, Z.K. Shi, and L. Mu, "Estimating Parameters in the Caspase Activated Apoptosis System," Int'l J. Biomedical Eng. and Technology, vol. 4, pp. 338-354, 2010.
[17] E.O. Voit and J. Almeida, "Decoupling Dynamical Systems for Pathway Identification from Metabolic Profiles," Bioinformatics, vol. 20, pp. 1670-1681, 2004.
[18] S. Kikuchi, D. Tominaga, M. Arita, K. Takahashi, and M. Tomita, "Dynamic Modeling of Genetic Networks Using Genetic Algorithm and S-System," Bioinformatics, vol. 19, pp. 643-650, 2003.
[19] T. Daisuke and P. Horton, "Inference of Scale-Free Networks from Gene Expression Time Series." J. Bioinformatics and Computational Biology, vol. 4, pp. 503-514, 2006.
[20] S. Kimura, M. Hatakeyama, and A. Konagaya, "Inference of S-System Models of Genetic Networks from Noisy Time-Series Data," Chem-Bio Informatics J., vol. 4, pp. 1-14, 2004.
[21] S. Kimura, K. Ide, A. Kashihara, M. Kano, M. Hatakeyama, R. Masui, N. Nakagawa, S. Yokoyama, S. Kuramitsu, and A. Konagaya, "Inference of S-System Models of Genetic Networks Using A Cooperative Coevolutionary Algorithm," Bioinformatics, vol. 21, pp. 1154-1163, 2005.
[22] S.Y. Ho, C.H. Hsieh, F. chieh Yu, and H.L. Huang, "An Intelligent Two-Stage Evolutionary Algorithm for Dynamic Pathway Identification from Gene Expression Profiles," IEEE/ACM Trans. Computational Biology and Bioinformatics, vol. 4, no. 4, pp. 648-704, Oct.-Dec. 2007.
[23] K.Y. Tsai and F.S. Wang, "Evolutionary Optimization with Data Collocation for Reverse Engineering of Biological Networks," Bioinformatics, vol. 21, pp. 1180-1188, 2005.
[24] D.Y. Cho, K.H. Cho, and B.T. Zhang, "Identification of Biochemical Networks by S-Tree Based Genetic Programming," Bioinformatics, vol. 22, pp. 1631-1640, 2006.
[25] I.C. Chou, H. Martens, and E. Voit, "Parameter Estimation in Biochemical Systems Models with Alternating Regression," Theoretical Biology and Medical Modelling, vol. 3, p. 25, 2006.
[26] M. Vilela, I.C. Chou, S. Vinga, A.T.R. Vasconcelos, E.O. Voit, and J.S. Almeida, "Parameter Optimization in S-System Models," BMC Systems Biology, vol. 2, article 35, 2008.
[27] W. Tucker and V. Moulton, "Parameter Reconstruction for Biochemical Networks Using Interval Analysis," Reliable Computing, vol. 12, pp. 389-402, 2006.
[28] F.X. Wu and L. Mu, "Separable Parameter Estimation Method for Nonlinear Biological Systems," Proc. Third Int'l Conf. Bioinformatics and Biomedical Eng. (ICBBE), 2009.
[29] E.O. Voit, Computational Analysis of Biochemical Systems : A Practical Guide for Biochemists and Molecular Biologists. Cambridge Univ. Press, 2000.
[30] S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge Univ. Press, 2004.
[31] R.L. Haupt and S.E. Haupt, Practical Genetic Algorithm, second ed. Wiley-Interscience, 2004.

Index Terms:
time series,bioinformatics,genetic algorithms,molecular biophysics,nonlinear differential equations,parameter estimation,structure identification accuracy,biological S-system,separable estimation method,biological system reconstruction,time series data,systems biology,nonlinear ordinary differential equations,ODE,molecular biological systems,system dynamics,system structure,pruning separable parameter estimation algorithm,separable parameter estimation method,pruning strategy,ℓ1 regularization term,continuous genetic algorithm,parameter estimation error,Kinetic theory,Parameter estimation,Mathematical model,Biological system modeling,Biological systems,Time series analysis,Genetic algorithms,genetic algorithm.,Separable parameter estimation,structure identification,biological systems,S-system,\ell_1 regularization
Fang-Xiang Wu, Li-Zhi Liu, W. J. Zhang, "Inference of Biological S-System Using the Separable Estimation Method and the Genetic Algorithm," IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 9, no. 4, pp. 955-965, July-Aug. 2012, doi:10.1109/TCBB.2011.126
Usage of this product signifies your acceptance of the Terms of Use.