[DB Seminar] JSON Relational Duality: Converging the worlds of Objects, Documents, and Relational

Speaker:

Tirthankar Lahiri

System:

Oracle

The "Object-Relational Impedance Mismatch" has been a multi-decade problem for developers, and past solutions have all had various tradeoffs that have compromised efficiency or consistency.  JSON Relational Duality is a breakthrough capability that combines the best aspects of the Document model and the Relational models without the drawbacks of either model. This session will provide an overview and deep dive... Read More

[Building Blocks] Accelerating Apache Spark workloads with Apache DataFusion Comet (Andy Grove)

Speaker:

Andy Grove

System:

DataFusion

Video:

YouTube

Apache Spark is one of the most widely-used distributed data analysis frameworks. However, its JVM-based and row-oriented query execution engine limits Spark’s performance and scalability. In this talk, we will introduce DataFusion Comet, an accelerator for Apache Spark designed to improve the efficiency of Spark queries by translating them into native queries that leverage Apache Arrow and Apache DataFusion. We... Read More

[Building Blocks] Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine (Andrew Lamb)

Speaker:

Andrew Lamb

System:

DataFusion

Video:

YouTube

Apache DataFusion is a fast, embeddable, and extensible query engine written in Rust that uses Apache Arrow as its memory model. In this talk we explain DataFusion in more detail and describe the types of data centric systems it is used to build. We will also review its high level architecture and feature set, discussing tradeoffs and performance between DataFusion's... Read More

Industry Affiliates Program Visit 2024 – Day 2

The second day of Carnegie Mellon University's Database Industry Affiliate Program (IAP) Visit Day, held in the Gates-Hillman Center, shifts focus to the industry side, featuring a series of informative sessions presented by member companies. These sessions offer companies the opportunity to showcase their latest innovations, products, and challenges in the database space, while also highlighting potential career opportunities for... Read More

Industry Affiliates Program Visit 2024 – Day 1

The first day of Carnegie Mellon University's Database Industry Affiliate Program (IAP) Visit Day takes place in the Gates-Hillman Center and is focused on showcasing cutting-edge research in the field of databases. The day is filled with a series of research talks delivered by faculty and students from the university's database group. These presentations provide an in-depth look at the... Read More

[Fall 2024] Advancing Database Performance and Capabilities at Snowflake

Speakers:

Dan Sotolongo, Bowei Chen

System:

Snowflake

This talk presents recent research and development at Snowflake aimed at pushing the boundaries of database performance and functionality. In the first section, we will introduce a series of optimizations designed to accelerate query execution within Snowflake’s platform. We will discuss the technical challenges associated with developing general-purpose optimizations and balancing performance improvements across a wide range of workloads. The... Read More

[Fall 2024] Databricks: Introduction to Mosaic AI Vector Search

Speaker:

Ankit Vij

System:

Databricks

This tech talk will deep dive into some of the most interesting challenges being solved at Databricks. Read More

LSM Management and Using LSM Immutability for Data Virtualization (Vaibhav Arora)

Speaker:

Vaibhav Arora

LSM (Log-Structured Merge) trees are now the bedrock of many storage engines and datastores like RocksDB, HBase, Cassandra etc. They provide the ability to avoid random-writes, and provide immutability. Data is organized in multiple-levels that are exponentially increasing in size. Each data mutation writes a new version of an object, and background processes named merge/compaction continuously remove the unused versions,... Read More

Leveraging Generative AI with Oracle AI Vector Search (Shasank Chavan)

Speaker:

Shasank Chavan

System:

Oracle

AI Vector Search in Oracle 23ai is a new, transformative way to intelligently search through your unstructured business data efficiently, and accurately, by using AI techniques to match on the semantics, or meaning, of the underlying data. With the inclusion of a new VECTOR datatype, new approximate search indexes, and new SQL operators and extensions, enterprise companies can quickly and... Read More

[Spring 2024] Beyond SQL: Dataframes in the Database (Devin Petersohn)

Speaker:

Devin Petersohn

System:

Modin

Dataframes are popular tools for interacting with and exploring data, but they are not as well understood nor as deeply studied as databases. Python's pandas. and Apache Spark are two of the most popular dataframes in use by data practitioners, but even these are extremely different from each other in terms of guarantees and user expectations. In this talk, we... Read More