FlashNet: Flash/network stack co-design

Animesh Trivedi, Nikolas Ioannou, Bernard Metzler, Patrick Stuedi, Jonas Pfefferle, Ioannis Koltsidas, Kornilios Kourtis, Thomas R. Gross

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

During the past decade, network and storage devices have undergone rapid performance improvements, delivering ultra-low latency and several Gbps of bandwidth. Nevertheless, current network and storage stacks fail to deliver this hardware performance to the applications, often due to the loss of IO efficiency from stalled CPU performance. While many efforts attempt to address this issue solely on either the network or the storage stack, achieving highperformance for networked-storage applications requires a holistic approach that considers both. In this paper, we present FlashNet, a software IO stack that unifies high-performance network properties with ash storage access and management. FlashNet builds on RDMA principles and abstractions to provide a direct, asynchronous, end-to-end data path between a client and remote ash storage. The key insight behind FlashNet is to codesign the stack's components (an RDMA controller, a ash controller, and a file system) to enable cross-stack optimizations and maximize IO efficiency. In micro-benchmarks, FlashNet improves 4kB network IOPS by 38:6% to 1:22M, decreases access latency by 43:5% to 50.4 μsecs, and prolongs the ash lifetime by 1:6-5:9× for writes. We illustrate the capabilities of FlashNet by building a Key-Value store, and porting a distributed data store that uses RDMA on it. The use of FlashNet's RDMA API improves the performance of KV store by 2×, and requires minimum changes for the ported data store to access remote ash devices.

Original languageEnglish
Title of host publicationSYSTOR 2017 - Proceedings of the 10th ACM International Systems and Storage Conference
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450350358
DOIs
Publication statusPublished - 22 May 2017
Externally publishedYes
Event10th ACM International Systems and Storage Conference, SYSTOR 2017 - Haifa, Israel
Duration: 22 May 201724 May 2017

Publication series

NameSYSTOR 2017 - Proceedings of the 10th ACM International Systems and Storage Conference

Conference

Conference10th ACM International Systems and Storage Conference, SYSTOR 2017
Country/TerritoryIsrael
CityHaifa
Period22/05/1724/05/17

Keywords

  • Netwoked flash
  • Operating systems
  • Performance
  • RDMA

Fingerprint

Dive into the research topics of 'FlashNet: Flash/network stack co-design'. Together they form a unique fingerprint.

Cite this