STREAMSTORE's targeted scientific breakthrough is the improved integration and coordinaton of stateful stream processing and key-value storage systems, delivering an efficient and rapidly recoverable platform overall. This was achieved by extending state-of-the-art software techniques, such as incremental elasticity, measurement-based performance prediction and control, and lightweight state checkpointing, in the context of distributed stream processing and key-value storage, and aligning them with novel hardware capabilities of emerging micro-server clusters and RDMA networks.
The project has so far resulted in the following publications
-
Model Predictive Control of Internet Servers using Quantum Annealing
Efthymios Papageorgiou, George T. Stamatiou and Kostas Magoutis
In Proceedings of the 5th IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS'24), September 16-20, 2024, Aarhus, Denmark [pdf]
-
Quantum-Enhanced Control of a Tandem Queue System
George T. Stamatiou and Kostas Magoutis
in Proceedinigs of the 16th EAI International Conference on Performance Evaluation Methodologies and Tools (VALUETOOLS 2023), September 6-7, 2023, Crete, Greece [pdf]
- Discovery of Breakout Patterns in Financial Tick Data via Parallel Stream Pprocessing with In-order Guarantees
Stefanos Kalogerakis and Kostas Magoutis
in Proceedings of the 17th ACM International Conference on Distributed and Event-based Systems (DEBS 2023), June 27-30, 2023, Neuchatel, France [pdf]
- Efficient Processing of High-Volume Tick Data with Apache Flink for the DEBS 2022 Grand Challenge
Stefanos Kalogerakis, Antonis Papaioannou and Kostas Magoutis
in Proceedings of the 16th ACM International Conference on Distributed and Event-based Systems (DEBS 2022), June 27-30, 2022, Copenhagen, Denmark [pdf, video]
- Amoeba: Aligning Stream Processing Operators with Externally-Managed State
Antonis Papaioannou and Kostas Magoutis
in Proceedings of the 14th IEEE/ACM International Conference on Utility and Cloud Computing (UCC 2021), December 6-9, Leicester, UK [pdf]
- Addressing the read-performance impact of reconfigurations in replicated key-value stores
Antonis Papaioannou and Kostas Magoutis
in IEEE Transactions on Parallel and Distributed Systems (TPDS) [pdf]
- The Case for Better Integrating Scalable Data Stores and Stream-Processing Systems
Antonis Papaioannou, Chrysostomos Zeginis and Kostas Magoutis
in Proceedings of 2020 IEEE International Conference on Cluster Computing (CLUSTER 2020), Kobe, Japan, September 14-17, 2020. poster paper [pdf, video]
STREAMSTORE builds upon previous research work in a number of technical areas:
- Rapid, smooth elasticity and monitoring in multi-layer systems
- Incremental elasticity for NoSQL data stores, Antonis Papaioannou and Kostas Magoutis. In 36th IEEE International Symposium on Reliable Distributed Systems (SRDS 2017), Hong Kong, China, September 26-29, 2017. [pdf]
- Towards cross-layer monitoring of multi-cloud service-based applications, Chrysostomos Zeginis, Kyriakos Kritikos, Panagiotis Garefalakis, Konstantina Konsolaki, Kostas Magoutis, and Dimitris Plexousakis. In Proceedings of European Conference on Cloud and Service Computing (ESOCC'13), Malaga, Spain, September 11-13, 2013. [pdf]
- Predicting performance under specific workload specifications
- A measurement-based approach to performance prediction in NoSQL systems, Flora Karniavoura and Kostas Magoutis. In 25th IEEE International Symposium on the Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS 2017), Banff, Canada, September 20-22, 2017. [pdf]
- Managing service performance in the Cassandra distributed storage system, Maria Chalkiadaki and Kostas Magoutis. In Proceedings of 5th IEEE International Conference on Cloud Computing Technology and Science (CloudCom 2013), Bristol, UK, December 2-5, 2013. [pdf]
- Rapid recovery of streaming operator state
- On the impact of log compaction on incrementally checkpointing stateful stream-procesing operators, Aris Chronarakis, Antonis Papaioannou and Kostas Magoutis. In Proceedings of 1st Workshop on Distributed and Reliable Storage Systems (DRSS'19); held in conjunction with SRDS 2019, Lyon, France, October 1-4, 2019.
- CEC: Continuous eventual checkpointing for data stream processing operators, Zoe Sebepou and Kostas Magoutis. In Proceedings of 41st IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'11), Hong Kong, China, June 27-30, 2011. [pdf]