Abstract
Our society is increasingly solving complex problems through the use of graph processing. Existing graph processing systems focus on performance, which allows addressing ever-larger and more complex problems. They also require uncommon expertise to properly deploy and utilize. To make graph processing generally accessible-to small and medium enterprises and institutions, to common research groups, to individuals-, in this work we design and implement the Graphless graph-processing system. Graphless is based on the serverless paradigm, which proposes to simplify computing by letting developers only focus on small, stateless functions, which are deployed and managed automatically. We address with Graphless the key challenge of combining the stateless functions assumed by serverless computing with the (opposite) data-intensive nature of graph processing. Graphless tackles this challenge through an architectural approach that allows it to deploy with push or with pull operation, and a collection of backend services, such as an orchestrator and a memory-as-a-service component. We implement Graphless and conduct with it real-world experiments using Amazon Lambda for cloud-based serverless resources. Using the LDBC Graphalytics benchmark, we analyze Graphless, and compare its performance and operational cost with the graph-processing systems Apache Giraph (big data domain) and GraphMat (HPC). Overall, we show evidence Graphless provides performance and cost-efficiency similar to Giraph, for algorithms that can benefit from fine-grained elasticity, and lower than GraphMat, but is architecturally easier to deploy, and provides both push and pull operation.
Original language | English |
---|---|
Title of host publication | Proceedings - 2019 18th International Symposium on Parallel and Distributed Computing (ISPDC) |
Subtitle of host publication | 3-7 June 2019 |
Editors | Alexandru Iosup, Radu Prodan, Alexandru Uta, Florin Pop |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 66-73 |
Number of pages | 8 |
ISBN (Electronic) | 9781728138008 |
DOIs | |
Publication status | Published - 8 Aug 2019 |
Event | 18th International Symposium on Parallel and Distributed Computing, ISPDC 2019 - Amsterdam, Netherlands Duration: 5 Jun 2019 → 7 Jun 2019 |
Conference
Conference | 18th International Symposium on Parallel and Distributed Computing, ISPDC 2019 |
---|---|
Country/Territory | Netherlands |
City | Amsterdam |
Period | 5/06/19 → 7/06/19 |
Keywords
- Elasticity
- Function as a Service
- Graph processing
- Serverless