This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Computational Fluid Dynamics Simulations Using Many Graphics Processors
May/June 2012 (vol. 14 no. 3)
pp. 10-19
Ali Khajeh-Saeed, University of Massachusetts, Amherst
J. Blair Perot, University of Massachusetts, Amherst

In this scenario, computational fluid dynamics simulations of turbulence are performed with 64 GPUs and an optimized CFD algorithm using communication/computation overlapping. Detailed timings reveal that the GPUs' internal calculations are so efficient that operations related to data exchange between compute nodes now cause a scaling bottleneck on all but the largest problems.

1. J.B. Perot and J. Gadebusch, "A Stress Transport Equation Model for Simulating Turbulence at Any Mesh Resolution," Theoretical and Computational Fluid Dynamics, vol. 23, no. 4, 2009, pp. 271–286.
2. J.B. Perot, "An Analysis of the Fractional Step Method," J. Computational Physics, vol. 108, no. 1, 1993, pp. 183–199.
3. W. Chang, F. Giraldo, and J.B. Perot, "Analysis of an Exact Fractional Step Method," J. Computational Physics, vol. 180, no. 1, 2002, pp. 183–189.
4. J.B. Perot and V. Subramanian, "Discrete Calculus Methods for Diffusion," J. Computational Physics, vol. 224, no. 1, 2007, pp. 59–81.
5. J.B. Perot, "Conservation Properties of Unstructured Staggered Mesh Schemes," J. Computational Physics, vol. 159, no. 1, 2000, pp. 58–89.
6. J.B. Perot, "Discrete Conservation Properties of Unstructured Mesh Schemes," Ann. Rev. Fluid Mechanics, vol. 43, 2011, pp. 299–318.
7. J.B. Perot, "Determination of the Decay Exponent in Mechanically Stirred Isotropic Turbulence," AIP Advances, vol. 1, no. 2, 2011; doi:10.1063/1.3582815.
8. P. Micikevicius, "3D Finite Difference Computation on GPUs Using CUDA," Proc. 2nd Workshop General Purpose Processing on Graphics Processing Units, ACM, 2009, pp. 79–84.
1. A. Khajeh-Saeed, S. Poole, and J.B. Perot, "Acceleration of the Smith-Waterman Algorithm Using Single and Multiple Graphics Processors," J. Computational Physics, vol. 229, no. 11, 2010, pp. 4247–4258.
2. A. Khajeh-Saeed and J.B. Perot, "GPU-Supercomputer Acceleration of Pattern Matching," GPU Computing Gems: Emerald Edition, ch. 13, Morgan Kaufmann, 2011, pp. 185–198.
3. T. McGuiness and J.B. Perot, "Parallel Graph Analysis and Adaptive Meshing Using Graphics Processing Units," Proc. 18th Ann. Conf. CFD Soc. Canada, CFD Soc. Canada, 2010; www.ecs.umass.edu/mie/tcfd/ConferencePapers GPU_Graph_Analysis.pdf.
4. J. Krüger and R. Westermann, "A GPU Framework for Solving Systems of Linear Equations," GPU Gems 2, Addison-Wesley, 2005, pp. 703–718.
5. E. Elsen, P. LeGresley,, and E. Darve, "Large Calculation of the Flow over a Hypersonic Vehicle Using a GPU," J. Computational Physics, vol. 227, no. 4, 2008, pp. 10148–10161.
6. A. Corrigan et al., "Running Unstructured Grid-Based CFD Solvers on Modern Graphics Hardware," Int'l J. Numerical Methods in Fluids, vol. 66, no. 2, 2011, pp. 221–229.
7. P. Micikevicius, "3D Finite Difference Computation on GPUs Using CUDA," Proc. 2nd Workshop on General Purpose Processing on Graphics Processing Units, ACM, 2009, pp. 79–84.
8. D. Rossinelli et al., "GPU Accelerated Simulations of Bluff Body Flows Using Vortex Particle Methods," J. Computational Physics, vol. 229, no. 9, 2010, pp. 3316–3333.
9. D.A. Jacobsen, J.C. Thibault, and I. Senocak, "An MPI-CUDA Implementation for Massively Parallel Incompressible Flow Computations on Multi-GPU Clusters," Proc. 48th AIAA Aerospace Sciences, American Inst. Aeronautics and Astronautics (AIAA), 2010; http://works.bepress.com/inanc_senocak3.
10. W. Ran et al., "GPU Accelerated CESE Method for 1D Shock Tube Problems," J. Computational Physics, vol. 230, no. 24, 2011, pp. 8797–8812.
11. J. Stam, "A Simple Fluid Solver Based on the FFT," J. Graphics Tools, vol. 6, no. 2, 2001, pp. 43–52.

Index Terms:
Computational fluid dynamics, CFD, multi-GPU, conjugate gradient, Laplacian, scientific computing
Citation:
Ali Khajeh-Saeed, J. Blair Perot, "Computational Fluid Dynamics Simulations Using Many Graphics Processors," Computing in Science and Engineering, vol. 14, no. 3, pp. 10-19, May-June 2012, doi:10.1109/MCSE.2011.117
Usage of this product signifies your acceptance of the Terms of Use.