The Community for Technology Leaders
2012 ACM/IEEE/SCS 26th Workshop on Principles of Advanced and Distributed Simulation (2010)
Atlanta, GA
May 17, 2010 to May 19, 2010
ISBN: 978-1-4244-7292-5
pp: 1-9
Cheng-Hong Li , T.J. Watson Res. Center, IBM Res., Yorktown Heights, NY, USA
Alfred J Park , T.J. Watson Res. Center, IBM Res., Yorktown Heights, NY, USA
Nobuyuki Ohba , IBM Res., Tokyo Res. Lab., Yamato, Japan
Ravi Nair , T.J. Watson Res. Center, IBM Res., Yorktown Heights, NY, USA
Ayal Zaks , Haifa Res. Lab., Haifa Univ., Haifa, Israel
Eugen Schenfeld , T.J. Watson Res. Center, IBM Res., Yorktown Heights, NY, USA
Uzi Shvadron , Haifa Res. Lab., Haifa Univ., Haifa, Israel
ABSTRACT
Stream processing is an important emerging computational model for performing complex operations on and across multi-source, high volume, unpredictable dataflows. We present Flow, a platform for parallel and distributed stream processing system simulation that provides a flexible modeling environment for analyzing stream processing applications. The Flow stream processing system simulator is a high performance, scalable simulator that automatically parallelizes chunks of the model space and incurs near zero synchronization overhead for stream application graphs that exhibit feed-forward behavior. We show promising multi-threaded and multi-process event rates exceeding 80 million events per second on a cluster with 256 processor cores.
INDEX TERMS
near zero synchronization, stream processing system simulator, data flows, distributed stream processing system simulation, parallel stream processing system simulation, Flow stream processing system simulator, multiprocess event rates, feed-forward behavior, multithreaded event rates
CITATION
Cheng-Hong Li, Alfred J Park, Nobuyuki Ohba, Ravi Nair, Ayal Zaks, Eugen Schenfeld, Uzi Shvadron, "Flow: A Stream Processing System Simulator", 2012 ACM/IEEE/SCS 26th Workshop on Principles of Advanced and Distributed Simulation, vol. 00, no. , pp. 1-9, 2010, doi:10.1109/PADS.2010.5471658
98 ms
(Ver 3.3 (11022016))