[Vaccination 2022] IO in PostgreSQL: Past, Present, Future (Andres Freund)

PostgreSQL traditionally has handled IO in a fairly minimal way, relying on the operating system more than most other databases. This talk will discuss why PostgreSQL mostly got away with that so far, why current hardware trends (NVMe with very high bandwidth / low latency, cloud storage with high latency but​ good random / concurrent read behaviour) require changing course and the path towards modernizing the IO stack in PostgreSQL to use asynchronous / direct IO. This talk is part Read More

[Vaccination 2022] RonDB: A Key-Value Store with SQL Capabilities and LATS Properties (Mikael Ronström)

RonDB is a key-value store with SQL capabilities and LATS (Latency/Availability/Throughput/ScalableStorage) properties. It is based on MySQL NDB Cluster that is used in extremely available applications such as universal data storage for mobile operators for many billions of subscribers. It is also used in gaming applications, financial applications and other areas. The main focus of RonDB in Hopsworks is as a platform for Machine Learning. RonDB handles the data storage for the Feature Store in Hopsworks, both the online Feature Read More

[Vaccination 2022] Velox: An Open-source Unified Execution Engine (Deepak Majeti)

Data keeps getting bigger, processing keeps getting more and more complex but the hardware does not get faster. We need to reconsider efficiency from the ground up. While these data processing systems handle various workloads (e.g. “batch”, “analytical”, “streaming”, “AI/ML”), they employ common features such as functions, joins, filter-pushdown, sorting, grouping, projections, etc… A shared library that provides optimized implementations of this common functionality and which can consolidate these data processing systems is desired. The Velox project is being developed Read More

[Vaccination 2022] QuestDB: Fast Open Source Time Series Database (Vlad Ilyushchenko)

In this talk, we will discuss major technical challenges developers face when dealing with time series data and QuestDB's design principles that are meant to solve these challenges. We will then go through QuestDB's performance focused architecture and cover topics like storage model, transactions, in-order and out-of-order ingestion, concurrency control, and network interfaces. This talk is part of the Vaccination Database (Booster) Tech Talk Seminar Series. Zoom Link: https://cmu.zoom.us/j/95002789605 (Passcode 982149) Read More

Hyperscale Data Processing with Network-centric Designs (Qizhen Zhang)

Today's largest data processing workloads are hosted in cloud data centers. Due to exponential data growth and the end of Moore's Law, these workloads have ballooned to the hyperscale level, encompassing billions to trillions of data items per query spread across hundreds to thousands of servers connected by the data center network. These massive scales fundamentally challenge the designs of both data processing systems and data center networks. My research rethinks the interactions between these two layers and seeks the Read More

[Vaccination 2022] Yellowbrick: An Elastic Data Warehouse on Kubernetes (Mark Cusack)

Yellowbrick is an elastic SQL data warehouse with a design centered on efficiency, high concurrency and performance. The database management system is composed from a set of Kubernetes-orchestrated containers. Kubernetes provides the single-source-of-truth for system configuration and state, and manages all warehousing lifecycle operations. In this session, I'll provide an overview of Yellowbrick and its microservices architecture, and focus on the work we've done in our query optimizer, workload management system and in the Linux kernel to drive high performance Read More

[Vaccination 2022] Design and Implementation of the RelationalAI Knowledge Graph Management System (Martin Bravenboer)

RelationalAI is the next-generation database platform for new intelligent data applications based on relational knowledge graphs. The Relational Knowledge Graph Management System (KGMS) complements the modern data stack by allowing data applications to be implemented relationally and declaratively, leveraging knowledge/semantics for reasoning, graph analytics, relational machine learning, and mathematical optimization workloads. RelationalAI as a relational and cloud native system fits naturally in the modern data stack, providing virtually infinite compute and storage capacity, versioning, and a fully managed system. RelationalAI Read More

[Vaccination 2022] Stardog Query Optimiser: Architecture and Cardinality Estimations for Graph Queries (Pavel Klinov)

Stardog is a commercial knowledge graph platform at the heart of which lies a graph database. It manages graph data in the form of RDF (Resource Data Framework) triples and natively implements SPARQL 1.1 graph query language. This talk will present the general architecture of the query engine and then will delve deep into the internals of the query optimiser, particularly, graph statistics and cardinality estimations for graph patterns. Differently from some early SPARQL systems Stardog is not built on Read More

[Vaccination 2022] Open-source Change Data Capture With Debezium (Gunnar Morling)

Change Data Capture (CDC) is one big enabler for your data; by reacting to changes in your database in "real-time", CDC comes in handy for implementing a wide range of use cases, such as low-latency data updates from OLTP data stores to OLAP systems, caches, or search indexes, data exchange between microservices, building audit logs, and many more. In this talk you'll learn about Debezium, a distributed open-source log-based CDC platform for a variety of databases, such as Postgres, MySQL, Read More

[Vaccination 2022] ApertureDB: Designing a Purpose-built System for Visual Data and Data Science (Vishakha Gupta)

Data science and ML techniques can help understand visual content and enable better customer experience across domains, in turn driving the exponential growth in the amount of visual data. Managing large amounts of visual data (images or videos) is extremely time consuming, frustrating, and inefficient due to a lack of data management solutions designed with visual data or data science in mind. In this talk, I will start by briefly highlighting why visual data needs special treatment now and how Read More