This Article 
 Bibliographic References 
 Add to: 
Adjoint Systems for Models of Cell Signaling Pathways and their Application to Parameter Fitting
July-September 2007 (vol. 4 no. 3)
pp. 322-335
The paper concerns the problem of fitting mathematical models of cell signaling pathways. Such models frequently take the form of sets of nonlinear ordinary differential equations. While the model is continuous in time, the performance index used in the fitting procedure, involves measurements taken at discrete time moments. Adjoint sensitivity analysis is a tool, which can be used for finding the gradient of a performance index in the space of parameters of the model. In the paper a structural formulation of adjoint sensitivity analysis called the Generalized Backpropagation Through Time (GBPTT) is used. The method is especially suited for hybrid, continuous-discrete time systems. As an example we use the mathematical model of the NF-kB regulatory module, which plays a major role in the innate immune response in animals.

[1] A. Arkin, J. Ross, and H.A. McAdams, “Stochastic Kinetic Analysis of Developmental Pathway Bifurcation in Phage Lambda-Infected Escherichia Coli Cells,” Genetics, vol. 149, pp. 1633-1648, 1998.
[2] H. Bock, “Numerical Treatment of Inverse Problems in Chemical Reaction Kinetics,” Modeling of Chemical Reaction Systems, K. Ebert, P. Deuflhard, and W. Jager, eds., vol. 18, pp. 102-125, 1981.
[3] H. Bock, “Recent Advances in Parameter Identification for Ordinary Differential Equations,” Progress in Scientific Computing, P. Deuflhard and E. Hairer, eds., vol. 2, pp. 95-121, 1983.
[4] J. Bodrewijk, “Inter-Reciprocity Applied to Electrical Networks,” Applied Scientific Research, vol. 6B, pp. 1-74, 1956.
[5] R.E. Crochiere and A.V. Oppenheim, “Analysis of Linear Digital Networks,” Proc. IEEE, vol. 63, no. 4, pp. 581-595, 1975.
[6] H. de Jong, “Modeling and Simulation of Genetic Regulatory Systems: A Literature Review,” J. Computational Biology, vol. 9, no. 1, pp. 67-103, 2002.
[7] A. Fettweiss, “A General Theorem for Signal-Flow Networks,” Archiv für Elektronik un d Übertragungstechnik, vol. 25, no. 12, pp.557-561, Dec. 1971.
[8] K. Fujarewicz, “Optimal Control of Nonlinear Systems Using Generalized Back Propagation through Time,” Proc. 18th IASTED Conf. Modelling, Identification, and Control, pp. 468-471, Feb. 1999.
[9] K. Fujarewicz and A. Galuszka, “Generalized Backpropagation through Time for Continuous Time Neural Networks and Discrete Time Measurements,” Lecture Notes in Computer Science, pp. 190-196, 2004.
[10] K. Fujarewicz, M. Kimmel, and A. Swierniak, “On Fitting of Mathematical Models of Cell Signaling Pathways Using Adjoint Systems,” Math. Biosciences and Eng., vol. 2, no. 3, pp. 527-534, 2005.
[11] K. Fujarewicz, “Generalized Backpropagation through Time for Continuous-Time Neural Models Identification,” Proc. Industrial Simulation Conf., pp. 178-181, June 2006.
[12] “Automatic Differentiation of Algorithms: Theory, Implementation and Application,” Proc. First SIAM Workshop Automatic Differentiation, A. Griewank and G. Coliss, eds., 1991.
[13] J. Hasty, D. McMillen, F. Isaacs, and J.J. Collins, “Computational Studies of Gene Regulatory Networks: In Numero Molecular Biology,” Nature Rev. Genetics, vol. 2, pp. 268-279, 2001.
[14] A. Hoffman, A. Levchenko, M.L. Scott, and D. Baltimore, “The ${\rm I}\kappa{\rm B}-{\rm NF}-\kappa{\rm B}$ Signaling Module: Temporal Control and Selective Gene Activation,” Science, vol. 298, pp. 1241-1245, 2002.
[15] T. Kailath, Linear Systems. Prentice Hall, 1980.
[16] E.G. Lee, D.L. Boone, S. Chai, S.L. Libby, M. Chien, J.P. Lodolce, and A. Ma, “Failure to Regulate TNF-Induced NF-$\kappa{\rm B}$ and Cell Death Responses in A20-Deficient Mice,” Science, vol. 289, pp.2350-2354, 2000.
[17] T. Lipniacki, P. Paszek, A.R. Brasier, B. Luxon, and M. Kimmel, “Mathematical Model of NF-$\kappa{\rm B}$ Regulatory Module,” J. Theoretical Biology, vol. 228, pp. 195-215, 2004.
[18] L. Ljung and T. Glad, “On Global Identifiability for Arbitrary Model Parametrizations,” Automatica, vol. 30, pp. 265-276, 1994.
[19] A. Oppenheim and R. Zoppoli, Digital Signal Processing. Prentice Hall, 1989.
[20] K. Schittkowski, “Parameter Estimation in Systems of Nonlinear Equations,” Numerical Math., vol. 68, pp. 129-142, 1994.
[21] B. Srinivasan, U.R. Prasad, and N.J. Rao, “Backpropagation through Adjoints for the Identification of Non Linear Dynamic Systems Using Recurrent Neural Models,” IEEE Trans. Neural Networks, pp. 213-228, Mar. 1994.
[22] P. Smolen, D.A. Baxter, and J.H. Byrne, “Modeling Transcriptional Control in Gene Networks: Methods, Recent Results, and Future Directions,” Bull. Math. Biology, vol. 62, pp. 247-292, 2000.
[23] D. Tellegen, “A General Network Theorem, with Applications,” Philips Research Report, vol. 7, pp. 259-269, 1952.
[24] J. Timmer, T.G. Müller, I. Swameye, O. Sandra, and U. Klingmüller, “Modeling the Nonlinear Dynamics of Cellular Signal Transduction,” Int'l J. Bifurcation and Chaos, vol. 14, no. 6, pp. 2069-2079, 2004.
[25] J.J. Tyson, K.C. Chen, and B. Novak, “Sniffers, Buzzers, Toggles and Blinkers: Dynamics of Regulatory and Signaling Pathway in the Cell,” Current Opinions in Cell Biology, vol. 15, pp. 221-231, 2003.
[26] S. Vajda, K. Godfrey, and H. Rabitz, “Similarity Transformation Approach to Identifiability of Nonlinear Compartmental Models,” Math. Bioscience, vol. 93, pp. 217-248, 1989.
[27] B. van Domselaar and P. Hemker, “Nonlinear Parameter Estimation in Initial Value Problems,” Technical Report NW 18/75, Math. Centre Amsterdam, 1975.
[28] E. Wan and F. Beaufays, “Diagrammatic Derivation of Gradient Algorithms for Neural Networks,” Neural Computation, vol. 8, no. 1, pp. 182-201, Jan. 1996.
[29] P.J. Werbos, “Backpropagation through Time: What It Does and How to Do It,” Proc. IEEE, vol. 78, pp. 1550-1560, 1990.

Index Terms:
Biology and genetics, modeling, ordinary differential equations, parameter learning
Krzysztof Fujarewicz, Marek Kimmel, Tomasz Lipniacki, Andrzej Świerniak, "Adjoint Systems for Models of Cell Signaling Pathways and their Application to Parameter Fitting," IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 4, no. 3, pp. 322-335, July-Sept. 2007, doi:10.1109/tcbb.2007.1016
Usage of this product signifies your acceptance of the Terms of Use.