Event Based Systems in Iași

Real-time social network graph analysis using StreamMine3G
André Martin (TU Dresden)

• Friday, 5 May 2017, 12:00, C308 (Faculty of Computer Science, C Building, UAIC)—map

In this talk, we present our approach for solving the DEBS Grand Challenge 2016 using StreamMine3G, a distributed, highly scalable,
elastic and fault tolerant event stream processing (ESP) system. We first provide an overview about StreamMine3G with regards to its
programming model and architecture, followed by thorough description of the implementation for the two queries that provide up-to-date
information about (i) the top-3 active posts and (ii) the top-k comments with the largest maximum cliques. Novel aspects of our implementation include (i) highly optimized data structures that lower the amount of lookups and traversals, and a (ii) deterministic data partitioning and processing scheme that allows the system to scale without bounds in an elastic fashion while still guaranteeing semantic transparency. In order to better utilize nowadays many-core machines, we furthermore propose a pipelining scheme in addition to data partitioning. Finally, we present a brief performance evaluation of our system.

André Martin is a post-doctoral researcher at the Systems Engineering Group at TU Dresden, Germany since January 2016. He holds a PhD (2015) and a Diploma (2008) in Computer Science both from the Technical University of Dresden. His research interests is in distributed systems and cloud computing with a focus in large scale data processing systems and fault tolerance.

Back to EBSIS Events section.