This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
The Parallel Complexity of Embedding Algorithms for the Solution of Systems of Nonlinear Equations
April 1993 (vol. 4 no. 4)
pp. 458-465

Embedding algorithms used to solve nonlinear systems of equations do so by constructing a continuous family of systems and solving the given system by tracking the continuous curve of solutions to the family. Solving nonlinear equations by a globally convergent embedding algorithm requires the evaluation and factoring of a Jacobian matrix at many points along the embedding curve. Ways to optimize the Jacobian matrix on a hypercube are described. Several static and dynamical strategies for assigning components of the Jacobian to processors on the hypercube are investigated. It is found that a static rectangular grid mapping is the preferred choice for inclusion in a robust parallel mathematical software package. The static linear mapping is a viable alternative when there are many common subexpressions in the component evaluation, and the dynamic assignment strategy should only be considered when there is large variation in the evaluation times for the components, leading to a load imbalance on the processors.

[1] E. Allgower and K. Georg, "Simplicial and continuation methods for approximating fixed points,"SIAM Rev., vol. 22, pp. 28-85, 1980.
[2] D. C. S. Allison, A. Chakraborty, and L. T. Watson, "Granularity issues for solving polynomial systems via globally convergent algorithms on a hypercube", inProc. Third Conf. Hypercube Concurrent Comput. and Appl., Pasadena, CA, 1988, pp. 1463-1472.
[3] D. C. S. Allison, S. Harimoto, and L. T. Watson, "The granularity of parallel homotopy algorithms for polynomial systems of equations,"Int. J. Comput. Math., vol. 29, pp. 21-37, 1989.
[4] D. C. S. Allison, S. Harimoto, and L. T. Watson, "The granularity of parallel homotopy algorithms for polynomial systems of equations," inProc. 1988 Int. Conf. Parallel Processing, Vol. III, D. H. Bailey, Ed., St. Charles, IL, 1988, pp. 165-168.
[5] D. C. S. Allison, A. Chakraborty, and L. T. Watson, "Granularity issues for solving polynomial systems via globally convergent algorithms on a hypercube,"J. Supercomput., vol. 3, pp. 5-20, 1989.
[6] S. C. Billups, "An augmented Jacobian matrix algorithm for tracking homotopy zero curves," M.S. thesis, Dep. Comput. Sci., VPI&SU, Blacksburg, VA, 1985.
[7] C. H. Bischof, "QR factorization algorithms for coarse-grained distributed systems," Tech. Rep. CS-88-539, Comput. Sci. Dip., Cornell Univ., 1988.
[8] C. H. Bischof, "A parallel QR factorization algorithm with controlled local pivoting," inProc. Fourth Conf. Hypercube Concurrent Comput. and Appl., J. Gustafson, Ed. Monterey, CA: ACM, 1989, pp. 635-641.
[9] R. H. Byrd, R. B. Schnabel, and G. A. Shultz, "Using parallel function evaluation to improve Hessian approximation for inconstrained optimization," Tech. Rep. CS-CU-361-87, Dep. Comput. Sci., Univ. Colorado, Boulder, CO 80309, 1987.
[10] A. Chakraborty, D. C. S. Allison, C. J. Ribbens, and L. T. Watson, "Parallel orthogonal decompositions of rectangular matrices for curve tracking on a hypercube," inProc. Fourth Conf. Hypercube Concurrent Comput. and Appl., J. Gustafson, Ed. Monterey, CA: ACM, 1989, pp. 651-654.
[11] A. Chakraborty, D. C. S. Allison, C. J. Ribbens, and L. T. Watson, "Parallel homotopy curve tracking on a hypercube," inParallel Processing for Scientific Computing, J. Dongarra,et al., Eds. Philadelphia: SIAM, 1990, pp. 149-153.
[12] A. Chakraborty, D. C. S. Allison, C. J. Ribbens, and L. T. Watson, "Note on unit tangent vector computation for homotopy curve tracking on a hypercube,"Parallel Comput., vol. 17, pp. 1385-1395, 1991.
[13] E. Chu and A. George, "QR factorization of a dense matrix on a Hypercube multiprocessor,"SIAM J. Sci. Stat. Comput., vol. 11, pp. 990-1028, 1990.
[14] T. Coleman and P. Plassmann, "Solution of nonlinear least-squares problems on a multiprocessor," Tech. Rep. CS-88-923, Comput. Sci. Dep., Cornell Univ., 1988.
[15] C. deSa, K. M. Irani, C. J. Ribbens, L. T. Watson, and H. F. Walker, "Preconditioned iterative methods for homotopy curve tracking,"SIAM J. Sci. Stat. Comput., vol. 13, pp. 30-46, 1992.
[16] S. Harimoto and L. T. Watson, "The granularity of homotopy algorithms for polynomial systems of equations," inParallel Processing for Scientific Computing, G. Rodrigue, Ed. Philadelphia, PA: SIAM, 1989, pp. 115-120.
[17] K. M. Irani, M. P. Karnat, C. J. Ribbens, H. F. Walker, and L. T. Watson, "Experiments with conjugate gradient algorithms for homotopy curve tracking,"SIAM J. Optim., vol. 1, no. 2, pp. 222-251, May 1991.
[18] S. L. Johnsson and C. T. Ho, "Algorithms for matrix transposition on BooleanN-cube configured ensemble architectures,"SIAM J. Matrix Anal. Applic., vol. 9, pp. 419-454, 1988.
[19] K. Unnikrishnan, J. Hopfield, and D. Tank, "Connected-digit speakerdependent speech recognition using a neural network with time-delayed connections,"IEEE Trans. Signal Processing, vol. 39, pp. 698-713, Mar. 1991.
[20] A. P. Morgan and L. T. Watson, "Solving polynomial systems of equations on a hypercube", inHypercube Multiprocessors 1987, M. T. Heath, Ed. Philadelphia, PA: SIAM, 1987, pp. 501-511.
[21] A. P. Morgan and L. T. Watson, "Solving nonlinear equations on a hypercube," inSuper and Parallel Computers and Their Impact on Civil Engineering, M. P. Kamat, Ed. New Orleans, LA: ASCE Structures Congress '86, 1986, pp. 1-15.
[22] W. Pelz and L. T. Watson, "Message length effects for solving polynomial systems on a hypercube,"Parallel Comput., vol. 10, pp. 161-176, 1989.
[23] W. C. Rheinboldt and J. V. Burkardt, "Algorithm 596: A program for a locally parameterized continuation process,"ACM Trans. Math. Software, vol. 9, pp. 236-241, 1983.
[24] R. B. Schnabel, "Concurrent function evaluations in local and global optimization,"Comput. Methods Appl. Mech. Engrg., vol. 64, pp. 537-552, 1987.
[25] C. Y. Wang, "Buoyant rotating disc," manuscript and private communication, 1988.
[26] L. T. Watson, "Numerical linear algebra aspects of globally convergent homotopy methods,"SIAM Rev., vol. 28, pp. 529-545, 1986.
[27] L. T. Watson, S. C. Billups, and A. P. Morgan, "Algorithm 652: HOMPACK: A suite of codes for globally convergent homotopy algorithms,"ACM Trans. Math. Software, vol. 13, pp. 281-310, 1987.

Index Terms:
Index Termsparallel complexity; embedding algorithms; nonlinear equations; Jacobian matrix;hypercube; static rectangular grid mapping; mathematical software package; dynamicassignment; computational complexity; nonlinear equations; parallel algorithms
Citation:
A. Chakraborty, D.C.S. Allison, C.J. Ribbens, L.T. Watson, "The Parallel Complexity of Embedding Algorithms for the Solution of Systems of Nonlinear Equations," IEEE Transactions on Parallel and Distributed Systems, vol. 4, no. 4, pp. 458-465, April 1993, doi:10.1109/71.219760
Usage of this product signifies your acceptance of the Terms of Use.