[Vaccination 2021] HarperDB’s Data Storage Journey: From File System to LMDB (Kyle Bernhardy)

HarperDB is a distributed database with hybrid SQL and NoSQL functionality in one, accessed via a REST API. Known as a structured object store with SQL capabilities, or NewSQL. HarperDB leverages a logical structure enabling ACID compliant efficient storage and retrieval without inconsistency, race conditions, or utilizing in-memory indexing. HarperDB is fully indexed and runs on any device from edge to cloud.

In this talk we will cover HarperDB’s Data Storage Journey. Kyle will review the different steps along the way, discussing the journey from File System, to Key Value Store, to LMDB, and now enhancing LMDB with advanced indexing. This will include the pros and cons of each step, as well as technical decisioning and details. We’ll discuss where HarperDB started with design decisions around our data model, what drove our decisions, and how we initially implemented those decisions technically as our data model. This will be an interesting insight into the evolution of HarperDB’s technology, how it was chosen, and how it was implemented.

This talk is part of the Vaccination Database Tech Talk Seminar Series.

Bio:
Kyle is a co-founder and CTO of HarperDB. He has over 20 years of experience in the industry and has held leadership roles in product development, support, and consulting at companies ranging in size from startup to publicly traded. Kyle is the co-inventor of 2 patents. He is an expert in cloud architecture as well as multiple programming languages.

More Info: https://db.cs.cmu.edu/seminar2021/#db7