Blockchains are decentralized ledgers that replace trusted central authorities with verifiable distributed consensus. This decentralization has resulted in blockchains effectively becoming ‘slow and expensive computers’, but there are huge opportunities for architectural optimization across the entire blockchain software stack. We begin this talk by outlining the scaling challenges from a systems researcher’s perspective, and discussing the bottlenecks faced in computation,... Read More

SQL has been extremely successful as the de facto standard language for working with data. Virtually all mainstream database-like systems use SQL as their primary query language. But SQL is an old language with significant design problems, making it difficult to learn, difficult to use, and difficult to extend. Many have observed these challenges with SQL, and proposed solutions involving... Read More

Apache Pinot is a distributed real-time OLAP database, part of a fast-growing segment designed for large-scale, user-facing analytics. Its primary query language is SQL, and it excels at low-latency queries, high throughput, and fresh data. Currently, Pinot supports two SQL dialects, and we are building a compatibility layer to enable pluggable time-series query languages, with Uber's M3 and PromQL as... Read More

The relational model has stood the test of time is the foundation of most database systems. But let's be honest -- its success is not because of SQL, but in spite of it. SQL's syntax is arcane, inconsistent, and bears little resemblance to the actual execution semantics of queries. Worse yet, SQL is not even a true standard -- every... Read More

No one uses SQL to write business logic. It's written in a programming language with libraries, tests, type safety, and expressive syntax. Traditionally this was the domain of a backend team, who’d try to build enough functionality to keep the frontend team happy without breaking the database. This model hasn’t kept up with the needs of full stack developers though,... Read More

Modern data analytics embrace a disaggregated architecture which decouples storage, cache, and compute into network-connected independent components. With disaggregated cache, a key design decision is whether to push down query predicates to the cache server. Without predicate pushdown, the cache must send all data to compute nodes, creating network bottlenecks. With predicate pushdown, the cache server evaluates predicates on cached... Read More

GreptimeDB uses Apache DataFusion and many other common building blocks in its implementation. This talk will focus on managing the query aspect of a (time-series) database across various parts. We have extended DataFusion to implemenet PromQL, add grammar candies to SQL, cooperate with external secondary indexes and write domain-specific optimizer rules etc. Each of above is extended in a different... Read More

Apache OpenDAL is an Open Data Access Layer that enables seamless interaction with diverse storage services, guided by its mission of "One Layer, All Storage" and core tenets of being open, solid, fast, and extensible to serve various users from infrastructure builders to application developers. In this talk, we will explain OpenDAL in more detail and describe the abstractions it... Read More

In 2013, Amazon Web Services revolutionized the data warehousing industry by launching Amazon Redshift, the first fully-managed, petabyte-scale, enterprise-grade cloud data warehouse. Amazon Redshift made it simple and cost-effective to efficiently analyze large volumes of data using existing business intelligence tools. This cloud service was a significant leap from the traditional on-premise data warehousing solutions, which were expensive, not elastic,... Read More

Apache Kafka and Apache Flink are powering a new category of data infrastructure called data streaming platform (DSP). This provides an opportunity for each enterprise to take actions on what’s happening in its business in real time. I will first provide an overview of DSP. DSP has both similarities and differences to database systems. I will show how existing database... Read More