[DB Seminar] Fall 2017: Joy Arulraj

For the first time in 25 years, a new non-volatile memory (NVM) category is being created that is two orders of magnitude faster than current durable storage devices. The advent of NVM fundamentally changes the dichotomy between memory and durable storage in database systems. These new NVM devices are almost as fast as DRAM, but all writes to it are potentially persistent even after power loss. Existing database systems are unable to take full advantage of this technology because their internal architectures are predicated on the assumption that memory is volatile. With NVM, many of the components of legacy database systems are unnecessary and will degrade the performance of applications in several modern data-intensive domains.

In this talk, I will discuss the implications of NVM for database systems. Specifically, I will introduce a new logging and recovery algorithm, called write-behind logging, that increases the availability of the system by two orders of magnitude compared to the state-of-the-art write-ahead logging algorithm. Write-behind logging leverages the unique characteristics of NVM to improve the operational cost and performance of the database system. I will also present the design of a new indexing data-structure that runs seamlessly on both DRAM and NVM without requiring special-purpose recovery code, which greatly reduces the code development and maintenance costs. In drawing broader lessons from this work, I believe that these algorithms and data-structures significantly simplify the development of high-performance software systems for emergent NVM technologies.