The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.06 - November/December (2011 vol.37)
pp: 805-825
Xiao Liu , Swinburne University of Technology, Melbourne
Yun Yang , Anhui University, Hefei and Swinburne University of Technology, Melbourne
Yuanchun Jiang , Hefei University of Technology, Hefei and University of Pittsburgh, Pittsburgh
Jinjun Chen , University of Technology, Sydney and Swinburne University of Technology, Melbourne
ABSTRACT
Due to the dynamic nature of the underlying high-performance infrastructures for scientific workflows such as grid and cloud computing, failures of timely completion of important scientific activities, namely, temporal violations, often take place. Unlike conventional exception handling on functional failures, nonfunctional QoS failures such as temporal violations cannot be passively recovered. They need to be proactively prevented through dynamically monitoring and adjusting the temporal consistency states of scientific workflows at runtime. However, current research on workflow temporal verification mainly focuses on runtime monitoring, while the adjusting strategy for temporal consistency states, namely, temporal adjustment, has so far not been thoroughly investigated. For this issue, two fundamental problems of temporal adjustment, namely, where and how, are systematically analyzed and addressed in this paper. Specifically, a novel minimum probability time redundancy-based necessary and sufficient adjustment point selection strategy is proposed to address the problem of where and an innovative genetic-algorithm-based effective and efficient local rescheduling strategy is proposed to tackle the problem of how. The results of large-scale simulation experiments with generic workflows and specific real-world applications demonstrate that our temporal adjustment strategy can remarkably prevent the violations of both local and global temporal constraints in scientific workflows.
INDEX TERMS
Workflow management, exception handling, reliability, software verification, statistical methods.
CITATION
Xiao Liu, Yun Yang, Yuanchun Jiang, Jinjun Chen, "Preventing Temporal Violations in Scientific Workflows: Where and How", IEEE Transactions on Software Engineering, vol.37, no. 6, pp. 805-825, November/December 2011, doi:10.1109/TSE.2010.99
REFERENCES
[1] W.M.P. Van Der Aalst, K.M.V. Hee, and H.A. Reijers, "Analysis of Discrete-Time Stochastic Petri Nets," Statistica Neerlandica, vol. 54, pp. 237-255, 2000.
[2] D. Ardagna and B. Pernici, "Adaptive Service Composition in Flexible Processes," IEEE Trans. Software Eng., vol. 33, no. 6, pp. 369-384, June 2007.
[3] G. Bucci, L. Sassoli, and E. Vicario, "Correctness Verification and Performance Analysis of Real-Time Systems Using Stochastic Preemptive Time Petri Nets," IEEE Trans. Software Eng., vol. 31, no. 11, pp. 913-927, Nov. 2005.
[4] P.A. Buhr and W.Y.R. Mok, "Advanced Exception Handling Mechanisms," IEEE Trans. Software Eng., vol. 26, no. 9, pp. 820-836, Sept. 2000.
[5] F. Casati, S. Castano, M. Fugini, I. Mirbel, and B. Pernici, "Using Patterns to Design Rules in Workflows," IEEE Trans. Software Eng., vol. 26, no. 8, pp. 760-785, Aug. 2000.
[6] Nat'l Meteorological Data Center, China Meteorological Data Sharing Service System, http://cdc.cma.gov.cnindex.jsp, May 2010.
[7] C. Chatfield, The Analysis of Time Series: An Introduction, sixth ed., Chapman and Hall/CRC, 2004.
[8] J. Chen and Y. Yang, "Multiple States Based Temporal Consistency for Dynamic Verification of Fixed-Time Constraints in Grid Workflow Systems," Concurrency and Computation: Practice and Experience, vol. 19, no. 7, pp. 965-982, 2007.
[9] J. Chen and Y. Yang, "A Taxonomy of Grid Workflow Verification and Validation," Concurrency and Computation: Practice and Experience, vol. 20, no. 4, pp. 347-360, 2008.
[10] J. Chen and Y. Yang, "Temporal Dependency Based Checkpoint Selection for Dynamic Verification of Fixed-Time Constraints in Grid Workflow Systems," Proc. 30th Int'l Conf. Software Eng., pp. 141-150, 2008.
[11] J. Chen and Y. Yang, "Temporal Dependency Based Checkpoint Selection for Dynamic Verification of Temporal Constraints in Scientific Workflow Systems," ACM Trans. Software Eng. and Methodology, vol. 20, no. 3,article 9, 2011.
[12] J. Chen and Y. Yang, "Adaptive Selection of Necessary and Sufficient Checkpoints for Dynamic Verification of Temporal Constraints in Grid Workflow Systems," ACM Trans. Autonomous and Adaptive Systems, vol. 2, no. 2, 2007.
[13] K. Cooper, A. Dasgupta, K. Kennedy, C. Koelbel, and A. Mandal, "New Grid Scheduling and Rescheduling Methods in the GrADS Project," Proc. 18th Int'l Parallel and Distributed Processing Symp., pp. 199-206, Apr. 2004.
[14] J. Eder, E. Panagos, and M. Rabinovich, "Time Constraints in Workflow Systems," Proc. 11th Int'l Conf. Advanced Information Systems Eng., pp. 286-300, 1999.
[15] B. Fechner, U. Honig, J. Keller, and W. Schiffmann, "Fault-Tolerant Static Scheduling for Grids," Proc. IEEE Int'l Symp. Parallel and Distributed Processing, pp. 1-6, Apr. 2008.
[16] I. Foster and C. Kesselman, The Grid: Blueprint for a New Computing Infrastructure, second ed. Morgan Kaufmann, 2004.
[17] Machine Learning Group, Dept. of Computer Science, Univ. of Sheffield, GA Toolkits, http://www.dcs.shef.ac.uk/mlsoftware. html , May 2010.
[18] C. Hagen and G. Alonso, "Exception Handling in Workflow Management Systems," IEEE Trans. Software Eng., vol. 26, no. 10, pp. 943-958, Oct. 2000.
[19] J.W. Han and M. Kamber, Data Mining: Concepts and Techniques, second ed. Elsevier, 2006.
[20] R. Hwanga, M. Genb, and H. Katayamaa, "A Comparison of Multiprocessor Task Scheduling Algorithms with Communication Costs," J. Computers and Operations Research, vol. 35, pp. 976-993, 2008.
[21] K.H. Kim, R. Buyya, and J. Kim, "Power Aware Scheduling of Bag-of-Tasks Applications with Deadline Constraints on DVS-Enabled Clusters," Proc. Seventh IEEE Int'l Symp. Cluster Computing and the Grid, pp. 541-548, May 2007.
[22] Y. Kwok and I. Ahmad, "Static Scheduling Algorithms for Allocating Directed Task Graphs to Multiprocessors," ACM Computing Surveys, vol. 31, no. 4, pp. 406-471, 1999.
[23] A.M. Law and W.D. Kelton, Simulation Modelling and Analysis, fourth ed. McGraw-Hill, 2007.
[24] Z. Liangzhao, B. Benatallah, A.H.H. Ngu, M. Dumas, J. Kalagnanam, and H. Chang, "QoS-Aware Middleware for Web Services Composition," IEEE Trans. Software Eng., vol. 30, no. 5, pp. 311-327, May 2004.
[25] X. Liu, J. Chen, K. Liu, and Y. Yang, "Forecasting Duration Intervals of Scientific Workflow Activities Based on Time-Series Patterns," Proc. Fourth IEEE Int'l Conf. e-Science, pp. 23-30, Dec. 2008.
[26] X. Liu, J. Chen, and Y. Yang, "A Probabilistic Strategy for Setting Temporal Constraints in Scientific Workflows," Proc. Sixth Int'l Conf. Business Process Management, pp. 180-195, Sept. 2008.
[27] X. Liu, Z. Ni, J. Chen, and Y. Yang, "A Probabilistic Strategy for Temporal Constraint Management in Scientific Workflow Systems," Concurrency and Computation: Practice and Experience, vol. 23, no. 16, pp. 1893-1919, 2011.
[28] X. Liu, Y. Yang, J. Chen, Q. Wang, and M. Li, "Achieving On-Time Delivery: A Two-Stage Probabilistic Scheduling Strategy for Software Projects," Proc. Int'l Conf. Software Process: Trustworthy Software Development Processes, 2009.
[29] O. Marjanovic and M.E. Orlowska, "On Modelling and Verification of Temporal Constraints in Production Workflows," Knowledge and Information Systems, vol. 1, no. 2, pp. 157-192, 1999.
[30] A. Martinez, F.J. Alfaro, J.L. Sanchez, F.J. Quiles, and J. Duato, "A New Cost-Effective Technique for QoS Support in Clusters," IEEE Trans. Parallel and Distributed Systems, vol. 18, no. 12, pp. 1714-1726, Dec. 2007.
[31] M. Miller, Cloud Computing: Web-Based Applications That Change the Way You Work and Collaborate Online. Que, Aug. 2008.
[32] M. Moore, "An Accurate Parallel Genetic Algorithm to Schedule Tasks on a Cluster," Parallel Computing, vol. 30, pp. 567-583, 2004.
[33] S. Nadarajah and S. Kotz, "Exact Distribution of the Max/Min of Two Gaussian Random Variables," IEEE Trans. Very Large Scale Integration Systems, vol. 16, no. 2, pp. 210-212, Feb. 2008.
[34] J. Oh and C. Wu, "Genetic-Algorithm-Based Real-Time Task Scheduling with Multiple Goals," J. Systems and Software, vol. 71, pp. 245-258, 2004.
[35] H. Pozewaunig, J. Eder, and W. Liebhart, "ePERT: Extending PERT for Workflow Management Systems," Proc. First East-European Symp. Advances in Database and Information Systems, 1997.
[36] R. Prodan and T. Fahringer, "Overhead Analysis of Scientific Workflows in Grid Environments," IEEE Trans. Parallel and Distributed Systems, vol. 19, no. 3, pp. 378-393, Mar. 2008.
[37] N. Russell, W.M.P. Van Der Aalst, and A.H.M. ter Hofstede, "Exception Handling Patterns in Process-Aware Information Systems," Technical Report BPM-06-04, BPM Center, 2006.
[38] N. Russell, W.M.P. Van Der Aalst, and A.H.M. ter Hofstede, "Workflow Exception Patterns," Proc. 18th Int'l Conf. Advanced Information Systems Eng., pp. 288-302, 2006.
[39] E.A. Stout, R.W. Carey, C.M. Estes, J.M. Fisher, L.J. Lagin, D.G. Mathisen, C.A. Reynolds, and R.J. Sanchez, "CORBA-Based Distributed Software Framework for the NIF Integrated Computer Control System," Fusion Eng. and Design, vol. 83, pp. 535-538, 2008.
[40] K.A. Stroud, Engineering Mathematics, sixth ed. Palgrave Macmillan, 2007.
[41] D.B. Tracy, J.S. Howard, and B. Noah, "Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems," J. Parallel and Distributed Computing, vol. 61, no. 6, pp. 810-837, 2001.
[42] L. Virine and M. Trumper, Project Decisions: The Art and Science. Management Concepts, Oct. 2007.
[43] A.S. Wu, H. Yu, S.Y. Jin, K. Lin, and G. Schiavone, "An Incremental Genetic Algorithm Approach to Multiprocessor Scheduling," IEEE Trans. Parallel and Distributed Systems, vol. 15, no. 9, pp. 824-834, Sept. 2004.
[44] J. Xu, A. Romanovsky, and B. Randell, "Concurrent Exception Handling and Resolution in Distributed Object Systems," IEEE Trans. Parallel and Distributed Systems, vol. 11, no. 10, pp. 1019-1032, Oct. 2000.
[45] Y. Yang, K. Liu, J. Chen, J. Lignier, and H. Jin, "Peer-to-Peer Based Grid Workflow Runtime Environment of SwinDeW-G," Proc. Third Int'l Conf. e-Science and Grid Computing, pp. 51-58, Dec. 2007.
[46] J. Yu and R. Buyya, "A Taxonomy of Workflow Management Systems for Grid Computing," J. Grid Computing, no. 3, pp. 171-200, 2005.
[47] J. Yu and R. Buyya, "Scheduling Scientific Workflow Applications with Deadline and Budget Constraints Using Genetic Algorithms," Scientific Programming, vol. 14, no. 3, pp. 217-230, Dec. 2006.
[48] J. Yu and R. Buyya, "Workflow Scheduling Algorithms for Grid Computing," Technical Report GRIDS-TR-2007-10, Computing and Distributed Systems Laboratory, The Univ. of Melbourne, May 2007.
[49] Z. Yu and W. Shi, "An Adaptive Rescheduling Strategy for Grid Workflow Applications," Proc. IEEE Int'l Symp. Parallel and Distributed Processing, pp. 115-122, Mar. 2007.
[50] D. Yuan, Y. Yang, X. Liu, and J. Chen, "A Cost-Effective Strategy for Intermediate Data Storage in Scientific Cloud Workflow Systems," Proc. 24th IEEE Int'l Parallel and Distributed Processing Symp., 2010.
[51] D. Zhang and J.P. Tsai, Machine Learning Applications in Software Engineering. World Scientific, 2005.
[52] H. Zhuge, T. Cheung, and H. Pung, "A Timed Workflow Process Model," J. Systems and Software, vol. 55, no. 3, pp. 231-243, 2001.
[53] H. Zhuge, X. Sun, J. Liu, E. Yao, and X. Chen, "A Scalable P2P Platform for the Knowledge Grid," IEEE Trans. Knowledge and Data Eng., vol. 17, no. 12, pp. 1721-1736, Dec. 2005.
33 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool