|
| This Article | ||
| ||
| Share | ||
| Bibliographic References | ||
| Add to: | ||
| | ||
| Search | ||
| ||
2010 IEEE Sixth International Conference on e-Science
Design and Implementation of GXP Make -- A Workflow System Based on Make
Brisbane, Queensland Australia
December 07-December 10
ISBN: 978-0-7695-4290-4
| ASCII Text | x | ||
| Kenjiro Taura, Takuya Matsuzaki, Makoto Miwa, Yoshikazu Kamoshida, Daisaku Yokoyama, Nan Dun, Takeshi Shibata, Choi Sung Jun, Jun'ichi Tsujii, "Design and Implementation of GXP Make -- A Workflow System Based on Make," eScience, IEEE International Conference on, pp. 214-221, 2010 IEEE Sixth International Conference on e-Science, 2010. | |||
| BibTex | x | ||
| @article{ 10.1109/eScience.2010.43, author = {Kenjiro Taura and Takuya Matsuzaki and Makoto Miwa and Yoshikazu Kamoshida and Daisaku Yokoyama and Nan Dun and Takeshi Shibata and Choi Sung Jun and Jun'ichi Tsujii}, title = {Design and Implementation of GXP Make -- A Workflow System Based on Make}, journal ={eScience, IEEE International Conference on}, volume = {0}, year = {2010}, isbn = {978-0-7695-4290-4}, pages = {214-221}, doi = {http://doi.ieeecomputersociety.org/10.1109/eScience.2010.43}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, } | |||
| RefWorks Procite/RefMan/Endnote | x | ||
| TY - CONF JO - eScience, IEEE International Conference on TI - Design and Implementation of GXP Make -- A Workflow System Based on Make SN - 978-0-7695-4290-4 SP214 EP221 A1 - Kenjiro Taura, A1 - Takuya Matsuzaki, A1 - Makoto Miwa, A1 - Yoshikazu Kamoshida, A1 - Daisaku Yokoyama, A1 - Nan Dun, A1 - Takeshi Shibata, A1 - Choi Sung Jun, A1 - Jun'ichi Tsujii, PY - 2010 VL - 0 JA - eScience, IEEE International Conference on ER - | |||
This paper describes the rational behind designing workflow systems based on the Unix make by showing a number of idioms useful for workflows comprising many tasks. It also demonstrates a specific design and implementation of such a workflow system called GXP make. GXP make supports all the features of GNU make and extends its platforms from single node systems to clusters, clouds, supercomputers, and distributed systems. Interestingly, it is achieved by a very small code base that does not modify GNU make implementation at all. While being not ideal for performance, it achieved a useful performance and scalability of dispatching one million tasks in approximately 16,000 seconds (60 tasks per second, including dependence analysis) on an 8 core Intel Nehalem node. For real applications, recognition and classification of protein-protein interactions from biomedical texts on a supercomputer with more than 8,000 cores are described.
Citation:
Kenjiro Taura, Takuya Matsuzaki, Makoto Miwa, Yoshikazu Kamoshida, Daisaku Yokoyama, Nan Dun, Takeshi Shibata, Choi Sung Jun, Jun'ichi Tsujii, "Design and Implementation of GXP Make -- A Workflow System Based on Make," escience, pp.214-221, 2010 IEEE Sixth International Conference on e-Science, 2010
Usage of this product signifies your acceptance of the Terms of Use.
