News & Events

[¡Databases! 2022] Odyssey: PostgreSQL Connection Proxy! (Andrey Borodin)

Sep 4, 2022

In hypertext world connection proxies is a must for many decades now. And in many cases this idea works for databases too! Today almost any busy OLTP Postgres instance have to use some sort of proxy: old but gold PgBouncer, scalable Odyssey or entirely new SPQR\PgCat. In this talk I'll discuss what allows proxies to be useful, what Postgres hackers do to fix this and architecture of proxy that I maintain - Odyssey. Odyssey is a scalable multi-threaded connection pooler Read More

[¡Databases! 2022] Snowflake Iceberg Tables, Streaming Ingest, and Unistore! (Ashish Motivala)

Sep 4, 2022

Why settle for 1 cool db talk when you can get 3? Snowflake is pushing the boundaries of what a unified cloud data platform can do. Today we'll talk about how Snowflake can be combined with open standards like Apache Iceberg, hard tech to stream data into Snowflake and bring transactional and analytical workloads together in a single platform. Apache Iceberg is an open source project that provides a way to represent a table as files on the cloud. Iceberg Read More

[¡Databases! 2022] Umbra: A Disk-Based System with In-Memory Performance (Thomas Neumann)

Sep 3, 2022

The increases in main-memory sizes over the last decade have made pure in-memory database systems feasible, and in-memory systems offer unprecedented performance. However, DRAM is still relatively expensive, and the growth of main-memory sizes has slowed down. In contrast, the prices for SSDs have fallen substantially in the last years, and their read bandwidth has increased to gigabytes per second. This makes it attractive to combine a large in-memory buffer with fast SSDs as storage devices, combining the excellent performance Read More

[Vaccination 2022] IO in PostgreSQL: Past, Present, Future (Andres Freund)

Apr 26, 2022

PostgreSQL traditionally has handled IO in a fairly minimal way, relying on the operating system more than most other databases. This talk will discuss why PostgreSQL mostly got away with that so far, why current hardware trends (NVMe with very high bandwidth / low latency, cloud storage with high latency but​ good random / concurrent read behaviour) require changing course and the path towards modernizing the IO stack in PostgreSQL to use asynchronous / direct IO. This talk is part Read More

[Vaccination 2022] RonDB: A Key-Value Store with SQL Capabilities and LATS Properties (Mikael Ronström)

Apr 18, 2022

RonDB is a key-value store with SQL capabilities and LATS (Latency/Availability/Throughput/ScalableStorage) properties. It is based on MySQL NDB Cluster that is used in extremely available applications such as universal data storage for mobile operators for many billions of subscribers. It is also used in gaming applications, financial applications and other areas. The main focus of RonDB in Hopsworks is as a platform for Machine Learning. RonDB handles the data storage for the Feature Store in Hopsworks, both the online Feature Read More

[Vaccination 2022] Velox: An Open-source Unified Execution Engine (Deepak Majeti)

Mar 31, 2022

Data keeps getting bigger, processing keeps getting more and more complex but the hardware does not get faster. We need to reconsider efficiency from the ground up. While these data processing systems handle various workloads (e.g. “batch”, “analytical”, “streaming”, “AI/ML”), they employ common features such as functions, joins, filter-pushdown, sorting, grouping, projections, etc… A shared library that provides optimized implementations of this common functionality and which can consolidate these data processing systems is desired. The Velox project is being developed Read More