In this talk we discuss LSM compression for a KV store. In our KV store, we write to an underlying shared storage system that models data as named extents (up to 2GB) and variable-length fragments contained within the extent. Fragments are max of 1MB and are the atomic unit of read and write. Our KV store reads fragments into 64K... Read More

This talk is a summary of my soon to be released column in ACM Queue titled "Write Amplification versus Read Perspiration". In this short discussion, we observe that there is a strong pattern in which writing data incurs and obligation to do more work to make it easy to read that data later. We frequently talk about write amplification to... Read More

Applications have had an interesting evolution as they have moved into the distributed and scalable world. Similarly, storage and its cousin databases have changed side by side with applications. Many times, the semantics, performance, and failure models of storage and applications do a subtle dance as they change in support of changing business requirements and environmental challenges. Adding scale to... Read More