Skip to content

Wind-Gone/awesome-olap-paper

BranchesTags

Repository files navigation

Awesome-OLAP-Paper 666

Awesome OLAP Paper visitor badge GitHub Repo stars GitHub Repo forks

Introduction

A curated paper list of awesome Online Analytical Processing database systems, theory, frameworks, resources, tools and other awesomeness, for database researchers/engineers.

Contributing

The repository is under construction. Welcome new PR, please conform to the committed rules:

paperName(with pdf link) (alias) [MeetingName Year] Github link if it has open-sourced code (optional)

Acknowledge

Thanks to all authors of the paper/repository I cite :D

Table of Content

Query-Aware Database Generation

  1. QAGen: Generating Query-Aware Test Databases [SIGMOD 07]
  2. Generating Targeted Queries for Database Testing [SIGMOD 08]
  3. Generating Databases for Query Workloads [VLDB 10]
  4. Data Generation using Declarative Constraints [SIGMOD 11]
  5. MyBenchmark: generating databases for query workloads [VLDB 14]
  6. Scalable and Dynamic Regeneration of Big Data Volumes [EDBT 18]
  7. Touchstone: Generating Enormous Query-Aware Test Databases [OSDI 18]
  8. Synthesizing Linked Data Under Cardinality and Integrity Constraints [SIGMOD 21]
  9. Projection-Compliant Database Generation [VLDB 22]
  10. SAM: Database Generation from Query Workloads with Supervised Autoregressive Models [SIGMOD 22]
  11. Mirage: Generating Enormous Databases for Complex Workloads [ICDE 24]
  12. Query Aware Database Generation for Match Operators [DASFAA 24]
  13. Controllable Tabular Data Synthesis Using Diffusion Models [SIGMOD 24]
  14. A Query-Aware Enormous Database Generator For System Performance Evaluation [SIGMOD 25]

Privacy

  1. PrivSyn: Differentially Private Data Synthesis [ATC 21]
  2. Synthesizing Linked Data Under Cardinality and Integrity Constraints [SIGMOD 21]
  3. Data Synthesis via Differentially Private Markov Random Fields [VLDB 21]
  4. PrivLava: Synthesizing Relational Data with Foreign Keys under Differential Privacy [SIGMOD 23]
  5. Privacy-Enhanced Database Synthesis for Benchmark Publishing [VLDB 25]

Survey

  1. Synthetic Data Generation for Enterprise DBMS [ICDE 23]

Query Schedule

  1. Self-Tuning Query Scheduling for Analytical Workloads [SIGMOD 21]
  2. Memory Efficient Scheduling of Query Pipeline Execution [CIDR 22]
  3. LSched: A Workload-Aware Learned Query Scheduler for Analytical Database Systems [SIGMOD 22]
  4. Rotary: A Resource Arbitration Framework for Progressive Iterative Analytics [ICDE 23]
  5. Laser: Buffer-Aware Learned Query Scheduling in Master-Standby Databases [VLDB 25]
  6. Improving DBMS Scheduling Decisions with Accurate Performance Prediction on Concurrent Queries [VLDB 25]

Query Optimization

  1. Sampling-Based Query Re-Optimization [SIGMOD 16]
  2. Leveraging Re-costing for Online Optimization of Parameterized Queries with Guarantees [SIGMOD 17]
  3. Adaptive Optimization of Very Large Join Queries [SIGMOD 18]
  4. Efficient Massively Parallel Join Optimization for Large Queries [SIGMOD 22]
  5. Leveraging Query Logs and Machine Learning for Parametric Query Optimization [VLDB 22]
  6. Rethink Query Optimization in HTAP Databases [SIGMOD 24]
  7. SPQO: Learning to Safely Reuse Cached Plans for Dynamic Workloads [DASFAA 24]
  8. Optimizing Nested Recursive Queries [SIGMOD 24]
  9. Efficient Enumeration of Recursive Plans in Transformation-based Query Optimizers [VLDB 24]
  10. Presto's History-based Query Optimizer [VLDB 24]
  11. RankPQO: Learning-to-Rank for Parametric Query Optimization [VLDB 25]

Robust Query Optimization

  1. Robust query processing through progressive optimization [SIGMOD 04]
  2. Robust Query Optimization Methods With Respect to Estimation Errors: A Survey [SIGMOD 15]
  3. Efficient Query Re-optimization with Judicious Subquery Selections [SIGMDO 23]
  4. ROME: Robust Query Optimization via Parallel Multi-Plan Execution [SIGMOD 24]

Query Rewrite

  1. QueryBooster: Improving SQL Performance Using Middleware Services for Human-Centered Query Rewriting [VLDB 23]
  2. SlabCity: Whole-Query Optimization using Program Synthesis [VLDB 23]
  3. GEqO: ML-Accelerated Semantic Equivalence Detection [SIGMOD 24]
  4. Proving Query Equivalence Using Linear Integer Arithmetic [SIGMOD 24]
  5. QED: A Powerful Query Equivalence Decider for SQL [VLDB 24]
  6. VeriEQL: Bounded Equivalence Verification for Complex SQL Queries with Integrity Constraints [OOPSLA 24]
  7. PoneglyphDB: Efficient Non-interactive Zero-Knowledge Proofs for Arbitrary SQL-Query Verification [SIGMOD 25]
  8. Query Weak Equivalence and Its Verification in Analytical Databases [ICDE 25]
  9. Proving Cypher Query Equivalence [ICDE 25]

Cardinality Estimation

Histogram

  1. Equi-Depth Histograms For Estimating Selectivity Factors For Multi-Dimensional Queries [None 87]
  2. Optimal Histograms for Limiting Worst-Case Error Propagation in the Size of Join Results [ACM Transactions on Database Systems 93]
  3. Selectivity Estimation Without the Attribute Value Independence Assumption (MHIST) [SIGMOD 97]
  4. On Rectangular Partitionings in Two Dimensions: Algorithms, Complexity, and Applications [ICDT 99]
  5. Approximating multi-dimensional aggregate range queries over real attributes (GENHIST) [SIGMOD 00]
  6. Independence is good: Dependency-based histogram synopses for high-dimensional data (DBHist) [SIGMOD 01]
  7. STHoles: a multidimensional workload-aware histogram [SIGMOD 01]
  8. Selectivity Estimation using Probabilistic Models[SIGMOD 01]
  9. A multi-dimensional histogram for selectivity estimation and fast approximate query answering [CASCON 03]
  10. The history of histograms (abridged) [VLDB 03]
  11. SASH: A Self-Adaptive Histogram Set for Dynamically Changing Workloads[VLDB 03]
  12. Selectivity estimators for multidimensional range queries over real attributes (GENHIST) [VLDB 03]
  13. ISOMER: Consistent histogram construction using query feedback [ICDE 06]
  14. Join Over Histograms [Alberto Dell'Era 07]
  15. Consistent Histograms In The Presence of Distinct Value Counts [VLDB 08]
  16. Lightweight Graphical Models for Selectivity Estimation Without Independence Assumptions [VLDB 11]
  17. Efficiently adapting graphical models for selectivity estimation [VLDB 13]
  18. Improving Accuracy and Robustness of Self-Tuning Histograms by Subspace Clustering [TKDE 15]
  19. TKHist: Cardinality Estimation for Join Queries via Histograms with Dominant Attribute Correlation Finding [arXiv 25]

Sampling

  1. Two-Level Sampling for Join Size Estimation [SIGMOD 17]
  2. Combining Aggregation and Sampling (Nearly) Optimally for Approximate Query Processing [SIGMOD 21]

Learn Data Distribution Function

  1. Self-Tuning, GPU-Accelerated Kernel Density Models for Multidimensional Selectivity Estimation [SIGMOD 15]
  2. Estimating Join Selectivities using Bandwidth-Optimized Kernel Density Models [VLDB 17]
  3. QuickSel: Quick Selectivity Learning with Mixture Models [SIGMOD 20]
  4. LHist: Towards Learning Multidimensional Histogram for Massive Spatial Data [ICDE 21]
  5. CoLSE: A Lightweight and Robust Hybrid Learned Model for Single-Table Cardinality Estimation using Joint CDF [ICDE 26]

Others

  1. Access path selection in a relational database management system [SIGMOD 79]
  2. Plan Bouquets: Query Processing without Selectivity Estimation [SIGMOD 14]
  3. Exact Cardinality Query Optimization with Bounded Execution Cost [SIGMOD 19]
  4. JoinSketch: A Sketch Algorithm for Accurate and Unbiased Inner-Product Estimation [SIGMOD 23]
  5. Efficient and Effective Cardinality Estimation for Skyline Family [SIGMOD 23]
  6. Cardinality Estimation for Having-Clauses [VLDB 25]
  7. Faper: Join Tree with Uncertainty Awareness for Faster, More Precise and Robust Cardinality Estimation [PAKDD 25]
  8. Downsizing Diffusion Models for Cardinality Estimation [arXiv 25]

Survey

  1. Synopses for Massive Data: Samples, Histograms, Wavelets, Sketches [A detailed book published in 2012]
  2. Preventing bad plans by bounding the impact of cardinality estimation errors [VLDB 09]
  3. Analyzing the Impact of Cardinality Estimation on Execution Plans in Microsof SQL Server [VLDB 23]
  4. The Accuracy of Cardinality Estimators: Unraveling the Evaluation Result Conundrum [VLDB 25]

Special Case

  1. Selectivity Estimation for Queries Containing Predicates over Set-Valued Attributes [SIGMOD 24]

Join Order

  1. Optimal Top-Down Join Enumeration [SIGMOD 07]
  2. A New, Highly Efficient, and Easy To Implement Top-Down Join Enumeration Algorithm [VLDB 11]
  3. Counter Strike: Generic Top-Down Join Enumeration for Hypergraphs [VLDB 13]
  4. Join Order Selection with Deep Reinforcement Learning: Fundamentals, Techniques, and Challenges [VLDB 23]
  5. Efficiently Computing Join Orders with Heuristic Search [SIGMOD 23]
  6. Ready to Leap (by Co-Design)? Join Order Optimisation on Quantum Hardware [SIGMOD 23]
  7. Quantum-Inspired Digital Annealing for Join Ordering [VLDB 24]
  8. POLAR: Adaptive and Non-invasive Join Order Selection via Plans of Least Resistance [VLDB 24]
  9. Sub-optimal Join Order Identification with L1-error [SIGMOD 24]
  10. DPconv: Super-Polynomially Faster Join Ordering [SIGMOD 25]
  11. Debunking the Myth of Join Ordering: Toward Robust SQL Analytics [SIGMOD 25]
  12. AJOSC: Adaptive join order selection for continuous queries on data streams [SIGMOD 25]

Join Algorithms

  1. Massively Parallel Sort-Merge Joins in Main Memory Multi-Core Database Systems [VLDB 12]
  2. Leapfrog Triejoin: a worst-case optimal join algorithm [International Conference on Database Theory 12]
  3. Lightning Fast and Space Efficient Inequality Joins [VLDB 15]
  4. An Experimental Comparison of Thirteen Relational Equi-Joins in Main Memory [SIGMOD 16]
  5. Worst-Case Optimal Join Algorithms: Techniques, Results, and Open Problems [SIGMOD 18]
  6. Adopting Worst-Case Optimal Joins in Relational Database Systems [VLDB 20]
  7. Free Join: Unifying Worst-Cast Optimal and Traditional Joins [arXiv 23]
  8. Reservoir Sampling over Joins [SIGMOD 24]
  9. Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries [CIDR 24]
  10. Efficiently Processing Joins and Grouped Aggregations on GPUs [SIGMOD 25]
  11. HoneyComb: A Parallel Worst-Case Optimal Join on Multicores [SIGMOD 25]
  12. SwiftSpatial: Spatial Joins on Modern Hardware [SIGMOD 25]
  13. Accelerate Distributed Joins with Predicate Transfer [SIGMOD 25]

Sub-Query

  1. Unnesting Arbitrary Queries [15]

Cost Model

  1. LEO – DB2’s LEarning Optimizer [VLDB 11]
  2. Predicting query execution time: are optimizer cost models really unusable? [ICDE 13]
  3. Towards Predicting Query Execution Time for Concurrent and Dynamic Database Workloads [VLDB 13]
  4. Forecasting the cost of processing multi-join queries via hashing for main-memory databases [SoCC 15]
  5. Query Performance Prediction for Concurrent Queries using Graph Embedding [VLDB 20]
  6. Efficient Deep Learning Pipelines for Accurate Cost Estimations Over Large Scale Query Workload [arXiv 21]
  7. Rethinking Learned Cost Models: Why Start from Scratch? [SIGMOD 24]
  8. Cackle: Analytical Workload Cost and Performance Stability With Elastic Pools [SIGMOD 24]

View

  1. Foreign Keys Open the Door for Faster Incremental View Maintenance [SIGMOD 23]

Survey

  1. How Good Are Query Optimizers, Really? [VLDB 15]
  2. Cardinality Estimation: An Experimental Survey [VLDB 17]
  3. Query optimization through the looking glass, and what we found running the Join Order Benchmark [VLDBJ 17]
  4. A Survey on Advancing the DBMS Query Optimizer: Cardinality Estimation, Cost Model, and Plan Enumeration [VLDB 21]
  5. Have query optimizers hit the wall? [VLDBJ 22]
  6. Cardinality Estimation in DBMS: A Comprehensive Benchmark Evaluation [VLDB 22]
  7. Data dependencies for query optimization: a survey [VLDBJ 22]
  8. Simple Adaptive Query Processing vs. Learned Query Optimizers: Observations and Analysis [VLDB 23]
  9. How to Optimize SQL Queries? A Comparison Between Split, Holistic, and Hybrid Approaches [VLDB 25]
  10. Workload Insights From The Snowflake Data Cloud: What Do Production Analytic Queries Really Look Like? [VLDB 25]

Index

  1. SQL Server Column Store Indexes [SIGMOD 11]
  2. The Adaptive Radix Tree: ARTful Indexing for Main-Memory Databases [ICDE 13]
  3. Column Sketches: A Scan Accelerator for Rapid and Robust Predicate Evaluation [SIGMOD 18]
  4. CUBIT: Concurrent Updatable Bitmap Indexing [VLDB 25]
  5. B-Trees Are Back: Engineering Fast and Pageable Node Layouts [SIGMOD 25]

Query Execution

  1. MonetDB/X100: Hyper-Pipelining Query Execution [CIDR 05]
  2. DSM vs. NSM: CPU performance tradeoffs in block-oriented query processing [DaMoN 08]
  3. Materialization Strategies in the Vertica Analytic Database: Lessons Learned [ICDE 13]
  4. Adaptive Query Processing in the Looking Glass [CIDR 15]
  5. Rethinking SIMD Vectorization for In-Memory Databases [SIGMOD 15]
  6. Efficient Processing of Window Functions in Analytical SQL Queries [VLDB 15]
  7. Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe? [SIGMOD 17]
  8. Looking Ahead Makes Query Plans Robust [VLDB 17]
  9. Building Advanced SQL Analytics From Low-Level Plan Operators [SIGMOD 21]
  10. SkinnerMT: Parallelizing for Efficiency and Robustness in Adaptive Query Processing on Multicore Platforms [VLDB 22]
  11. ChainedFilter: Combining Membership Filters by Chain Rule [SIGMOD 24]
  12. Saving Money for Analytical Workloads in the Cloud [VLDB 24]
  13. Adaptive and Robust Query Execution for Lakehouses at Scale [VLDB 24]
  14. DuckDB-SGX2: The Good, The Bad and The Ugly within Confidential Analytical Query Processing [DaMoN 24]
  15. The Key to Effective UDF Optimization: Before Inlining, First Perform Outlining [VLDB 25]
  16. High-Performance Query Processing with NVMe Arrays: Spilling without Killing Performance [SIGMOD 25]
  17. Data Chunk Compaction in Vectorized Execution [SIGMOD 25]
  18. FAAQP: Fast and Accurate Approximate Query Processing based on Bitmap-augmented Sum-Product Network [SIGMOD 25]
  19. OLTP in the Cloud: Architectures, Tradeoffs, and Cost [VLDB 25]

Data Dependency Search

  1. Discovering Functional Dependencies through Hitting Set Enumeration [SIGMOD 24]

Query Compilation

  1. How to Architect a Query Compiler [SIGMOD 16]
  2. Adaptive Execution of Compiled Queries [ICDE 18]

Bugs Detection

Functional Bug

Logical Bug

  1. Search-Based Test Data Generation for SQL Queries [ICSE 18]
  2. Finding Bugs in Database Systems via Query Partitioning [OOPSLA 20]
  3. Detecting Optimization Bugs in Database Engines via Non-Optimizing Reference Engine Construction [FSE 20]
  4. Testing Database Engines via Query Plan Guidance [ICSE 23]
  5. GDsmith: Detecting Bugs in Cypher Graph Database Engines [ISSTA 23]
  6. Snowcat: Efficient Kernel Concurrency Testing using a Learned Coverage Predictor [SOSP 23]
  7. Detecting Isolation Bugs via Transaction Oracle Construction [ICSE 23]
  8. Detecting Logic Bugs of Join Optimizations in DBMS [SIGMOD 23 Best Paper]
  9. Fonte: Finding Bug Inducing Commits from Failures [ICSE 23]
  10. Detecting Metadata-Related Logic Bugs in Database Systems via Raw Database Construction [VLDB 24]
  11. CONI: Detecting Database Connector Bugs via State-Aware Test Case Generation [ICSE 24]
  12. WINGFUZZ: Implementing Continuous Fuzzing for DBMSs [ATC 24]
  13. Keep It Simple: Testing Databases via Differential Query Plans [SIGMOD 24]
  14. Plume: Efficient and Complete Black-Box Checking of Weak Isolation Levels [OOPSLA2 2024]
  15. DBStorm: Generating Various Effective Workloads for Testing Isolation Levels [ISSTA 24]
  16. SQLaser: Detecting DBMS Logic Bugs with Clause-Guided Fuzzing [arXiv 24]
  17. Understanding and Detecting SQL Function Bugs [EuroSys 25]
  18. Understanding and Reusing Test Suites Across Database Systems [SIGMOD 25]
  19. Detecting Logic Bugs in Database Engines via Equivalent Expression Transformation [ATC 24]
  20. THANOS: DBMS Bug Detection via Storage Engine Rotation Based Differential Testing [ICSE 25]
  21. Semantic Conformance Testing of Relational DBMS [VLDB 25]
  22. Automatic Database Configuration Debugging using Retrieval-Augmented Language Models [SIGMOD 25]
  23. Finding Logic Bugs in Spatial Database Engines via Affine Equivalent Input [SIGMOD 25]
  24. Constant Optimization Driven Database System Testing [SIGMOD 25]
  25. Blackbox Fuzzing of Distributed Systems with Multi-Dimensional Inputs and Symmetry-Based Feedback Pruning [NDSS 25]
  26. Finding Logic Bugs in Graph-processing Systems via Graph-cutting [SIGMOD 25]
  27. Model Checking Guided Incremental Testing for Distributed Systems [ISSTA 25]
  28. Scaling Automated Database System Testing [arXiv 25]
  29. Testing Database Systems with Large Language Model Synthesized Fragments [arXiv 25]
  30. Detecting Schema-Related Logic Bugs in Relational DBMSs via Equivalent Database Construction [VLDB 25]
  31. Simple Testing Can Expose Most Critical Transaction Bugs: Understanding and Detecting Write-Specific Serializability Violations in Database Systems [VLDB 25]
  32. Detecting Isolation Anomalies in Relational DBMSs [ISSTA 25]
  33. Vbox: Efficient Black-Box Serializability Verification [arXiv 25]
  34. Fucci: Database Transaction Fuzzing via Random Conflict Construction and Multilevel Constraint Solving [VLDB 25]
  35. DDLUMOS: Understanding and Detecting Atomic DDL Bugs in DBMSs [ATC 25]
  36. Detecting Logic Bugs in DBMSs via Equivalent Data Construction [SIGMOD 25]
  37. SRS: Detecting Logic Bugs of Join Implementation in DBMSs via Set Relation Synthesis [SIGMOD 25]
  38. ARG: Testing Query Rewriters via Abstract Rule Guided Fuzzing [ASE 25]
  39. Anomaly Pattern-guided Transaction Bug Testing in Relational Databases [SIGMOD 26]

Crash Bug

  1. Sequence-Oriented DBMS Fuzzing [ICDE 23]
  2. DynSQL: Stateful Fuzzing for Database Management Systems with Complex and Valid SQL Query Generation [ATC 23]
  3. Sedar: Obtaining High-Quality Seeds for DBMS Fuzzing via Cross-DBMS SQL Transfer [ICSE 24]
  4. DepState: Detecting Synchronization Failure Bugs in Distributed Database Management Systems [ISSTA 25]
  5. Fawkes: Finding Data Durability Bugs in DBMSs via Recovered Data State Verification [SOSP 25]

Performance Bug

  1. APOLLO: automatic detection and diagnosis of performance regressions in database systems [VLDB 19]
  2. CERT: Finding Performance Issues in Database Systems Through the Lens of Cardinality Estimation [ICSE 24]
  3. PUPPY: Finding Performance Degradation Bugs in DBMSs via Limited-Optimization Plan Construction [ICSE 25]
  4. Hulk: Exploring Data-Sensitive Performance Anomalies in DBMSs via Data-Driven Analysis [ISSTA 25]

Survey

  1. A Comprehensive Survey on Database Management System Fuzzing: Techniques, Taxonomy and Experimental Comparison [arXiv 23]
  2. Survey on Database Management System Fuzzing Techniques [Journal of Software 24]

Static Analysis

  1. Enhancing Static Analysis for Practical Bug Detection: An LLM-Integrated Approach [PACMPL 24]

Casual Inference

  1. Substructure-aware Log Anomaly Detection [VLDB 25]
  2. From Logs to Causal Inference: Diagnosing Large Systems [VLDB 25]
  3. RCRank: Multimodal Ranking of Root Causes of Slow Queries in Cloud Database Systems [VLDB 25]
  4. OpDiag: Unveiling Database Performance Anomalies through Query Operator Attribution [TKDE 25]
  5. DBPecker: A Graph-Based Compound Anomaly Diagnosis System for Distributed RDBMSs [VLDB 25]

Code Location

  1. Fault Localization via Fine-tuning Large Language Models with Mutation Generated Stack Traces [arXiv 25]

Reduction

  1. SQLess: Dialect-Agnostic SQL Query Simplification [ISSTA 24]

Storage

  1. What Modern NVMe Storage Can Do, And How To Exploit It: High-Performance I/O for High-Performance Storage Engines [VLDB 23]
  2. An Empirical Evaluation of Columnar Storage Formats [VLDB 24]
  3. Leco: Lightweight compression via learning serial correlations [SIGMOD 24]
  4. Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine [SIGMOD 24]
  5. NULLS! Revisiting Null Representation in Modern Columnar Formats [DaMoN 24]
  6. Boosting OLTP Performance with Per-Page Logging on NVDIMM [SIGMOD 25]
  7. Data formats in analytical DBMSs: performance trade-offs and future directions [VLDBJ 25]
  8. Data chunk compaction in vectorized execution [SIGMOD 25]
  9. Lance: Efficient Random Access in Columnar Storage through Adaptive Structural Encodings [arXiv 25]
  10. Anarchy in the Database: A Survey and Evaluation of Database Management System Extensibility [VLDB 25]
  11. F3: The Open-Source Data File Format for the Future [SIGMOD 26]

LSM-Tree

  1. Dissecting, Designing, and Optimizing LSM-based Data Stores [SIGMOD 22 Tutorial]
  2. Magma: A High Data Density Storage Engine Used in Couchbase [VLDB 22]
  3. CaaS-LSM: Compaction-as-a-Service for LSM-based Key-Value Stores in Storage Disaggregated Infrastructure [SIGMOD 24]
  4. CAMAL: Optimizing LSM-trees via Active Learning [SIGMOD 25]
  5. Disco: A Compact Index for LSM-trees [SIGMOD 25]
  6. Randomized Sketches for Quantile in LSM-tree based Store [SIGMOD 25]
  7. Rethinking The Compaction Policies in LSM-trees [SIGMOD 25]
  8. DFlush: DPU-Offloaded Flush for Disaggregated LSM-based Key-Value Stores [SIGMOD 25]
  9. Rethinking LSM-tree based Key-Value Stores: A Survey [arXiv 25]
  10. How to Grow an LSM-tree? Towards Bridging the Gap Between Theory and Practice [SIGMOD 25]

Kd-Tree

  1. Parallel kd-tree with Batch Updates [SIGMOD 25]

Proxy

  1. Tigger: A Database Proxy That Bounces With User-Bypass [VLDB 23]

Data Transfer

  1. Fast and Scalable Data Transfer Across Data Systems [SIGMOD 25]

Data Loading

  1. ConnectorX: Accelerating Data Loading From Databases to Dataframes [VLDB 22]

Database Kernel

  1. Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics [CIDR 21]
  2. Disaggregated Database Systems [VLDB 23 Tutorial]
  3. GPU Database Systems Characterization and Optimization [VLDB 24]
  4. The Art of Latency Hiding in Modern Database Engines [VLDB 24]
  5. DoppelGanger++: Towards Fast Dependency Graph Generation for Database Replay [SIGMOD 24]
  6. Rapid Data Ingestion through DB-OS Co-design [SIGMOD 25]
  7. Practical DB-OS Co-Design with Privileged Kernel Bypass [SIGMOD 25]

Cloud

Survey

  1. OLTP in the cloud: architectures, tradeoffs, and cost [VLDBJ 25]

Optimization

  1. Principles and Methodologies for Serial Performance Optimization [OSDI 25]

Transactions

  1. Low-Latency Transaction Scheduling via Userspace Interrupts: Why Wait or Yield When You Can Preempt? [SIGMOD 25]
  2. Are database system researchers making correct assumptions about transaction workloads? [SIGMOD 25]
  3. BPF-DB: A Kernel-Embedded Transactional Database Management System For eBPF Applications [SIGMOD 25]
  4. Styx: Transactional Stateful Functions on Streaming Dataflows [SIGMOD 25]
  5. GTX: A Write-Optimized Latch-free Graph Data System with Transactional Support [SIGMOD 25]
  6. Wait and See: A Delayed Transactions Partitioning Approach in Deterministic Database Systems for Better Performance [SIGMOD 25]
  7. Moving on From Group Commit: Autonomous Commit Enables High Throughput and Low Latency on NVMe SSDs [SIGMOD 25]
  8. A Hybrid Approach to Integrating Deterministic and Non-deterministic Concurrency Control in Database Systems [VLDB 25]
  9. VerIso: Verifiable Isolation Guarantees for Database Transactions [VLDB 25]

Survey

  1. What Goes Around Comes Around... And Around... [SIGMOD 24]
  2. Cloud-Native Database Systems and Unikernels: Reimagining OS Abstractions for Modern Hardware [VLDB 24]
  3. Anarchy in the Database: A Survey and Evaluation of Database Management System Extensibility [VLDB 25]
  4. OLTP Through the Looking Glass 16 Years Later: Communication is the New Bottleneck [CIDR 25]

Others

Performance Optimization

  1. Principles and Methodologies for Serial Performance Optimization [OSDI 25]

MVCC

  1. Scalable Garbage Collection for In-Memory MVCC Systems [VLDB 13]
  2. Rethinking serializable multiversion concurrency control [VLDB 15]
  3. An Empirical Evaluation of In-Memory Multi-Version Concurrency Control [VLDB 17]
  4. Accelerating Analytical Processing in MVCC using Fine-Granular High-Frequency Virtual Snapshotting [SIGMOD 18]
  5. Long-lived Transactions Made Less Harmful [SIGMOD 20]
  6. Rethink the Scan in MVCC Databases [SIGMOD 21]
  7. Diva: Making MVCC Systems HTAP-Friendly [SIGMOD 22]
  8. Memory-Optimized Multi-Version Concurrency Control for Disk-Based Database Systems [VLDB 22]
  9. Scalable and Robust Snapshot Isolation for High-Performance Storage Engines [VLDB 23]
  10. One-shot Garbage Collection for In-memory OLTP through Temporality-aware Version Storage [SIGMOD 23]

HTAP

System Architecture

Linear Consistency
  1. HyPer: A Hybrid OLTP&OLAP Main Memory Database System Based on Virtual Memory Snapshots [ICDE 12]
  2. TiDB: A raft-based htap database [VLDB 20]
  3. OceanBase Paetica: A Hybrid Shared-Nothing/Shared-Everything Database for Supporting Single Machine and Distributed Cluster [VLDB 23]
  4. Perseus: Achieving Strong Consistency and High Data Freshness for Scalable Geo-distributed HTAP [SIGMOD 25]
  5. veDB-HTAP：a Highly Integrated， Efficient and Adaptive HTAP System [VLDB 25]
Sequential Consistency
  1. BatchDB: Efficient Isolated Execution of Hybrid OLTP+OLAP Workloads for Interactive Applications [SIGMOD 17]
  2. F1 Lightning: HTAP as a Service [VLDB 20]
  3. Retrofitting High Availability Mechanism to Tame Hybrid Transaction/Analytical Processing [ATC 21]
  4. ByteHTAP: ByteDance’s HTAP System with High Data Freshness and Strong Data Consistency [VLDB 22]
  5. Hermes: Off-the-Shelf Real-Time Transactional Analytics [VLDB 25]
Session Consistency
  1. PolarFS: An Ultra-low Latency and Failure Resilient Distributed File System for Shared Storage Cloud Database [VLDB 18]
  2. PolarDB-IMCI: A Cloud-Native HTAP Database System at Alibaba [SIGMOD 23]
Survey
  1. HTAP Databases: What is New and What is Next [SIGMOD 22]
  2. Data Sharing Model and Optimization Strategies in HTAP Database Systems [Journal of Software 23]
  3. HTAP Databases: A Survey [TKDE 24]
  4. A survey on hybrid transactional and analytical processing [VLDB Journal 24]
  5. Survey on Benchmarking Ability of HTAP Benchmarks [Journal of Software 24]

Kernel Optimization

  1. Adaptive HTAP through elastic resource scheduling [SIGMOD 20]
  2. Hybrid transactional/analytical processing amplifies io in lsm-trees [IEEE 22]
  3. Proteus: Autonomous Adaptive Storage for Mixed Workloads [SIGMOD 22]
  4. TiQuE: Improving the Transactional Performance of Analytical Systems for True Hybrid Workloads [VLDB 23]
  5. Deploying Computational Storage for HTAP DBMSs Takes More Than Just Computation Offloading [VLDB 23]
  6. Log Replaying for Real-Time HTAP: An Adaptive Epoch-based Two-Stage Framework [ICDE 24]
  7. Two Birds With One Stone: Designing a Hybrid Cloud Storage Engine for HTAP [VLDB 24]
  8. Twisted Twin: A Collaborative and Competitive Memory Management Approach in HTAP Systems [VLDB 25]
  9. PUSHtap: PIM-based In-Memory HTAP with Unified Data Storage Format [ASPLOS 25]

Result Replay

  1. DoppelGanger++: Towards Fast Dependency Graph Generation for Database Replay [SIGMOD 24]
  2. Fast Parallel Recovery for Transactional Stream Processing on Multicores [ICDE 24]

Benchmark

Survey

  1. Surprise Benchmarking: The Why, What, and How [DBTest 24]

AI

  1. TPCx-AI - An Industry Standard Benchmark for Artificial Intelligence and Machine Learning Systems [VLDB 23]

OLTP

  1. Dike: A Benchmark Suite for Distributed Transactional Databases [SIGMOD 23]
  2. DBPA: A Benchmark for Transactional Database Performance Anomalies [SIGMOD 23]

OLAP

  1. TPC-DS, Taking Decision Support Benchmarking to the Next Level [SIGMOD 02]
  2. Generating Thousands of Benchmark Queries in Seconds [VLDB 04]
  3. The Making of TPC-DS [VLDB 06]
  4. Why You Should Run TPC-DS: A Workload Analysis [VLDB 07]
  5. Introducing Skew into the TPC-H Benchmark [21]

HTAP

  1. How Good is My HTAP System? [SIGMOD 22]
  2. OLxPBench: Real-time, Semantically Consistent, and Domain-specific are Essential in Benchmarking, Designing, and Implementing HTAP Systems [ICDE 22]

Cloud

  1. Cloud Analytics Benchmark [VLDB 23]
  2. PBench: Workload Synthesizer with Real Statistics for Cloud Analytics Benchmarking [VLDB 25]
  3. CloudyBench: A Testbed for A Comprehensive Evaluation of Cloud-Native Databases [ICDE 25]
  4. Redbench: Workload Synthesis From Cloud Traces [VLDB 26]

Others

  1. M2Bench: A Database Benchmark for Multi-Model Analytic Workloads [VLDB 23]
  2. Pollock: A Data Loading Benchmark [VLDB 23]
  3. VeriBench: Analyzing the Performance of Database Systems with Verifiability [VLDB 23]
  4. TSM-Bench: Benchmarking Time Series Database Systems for Monitoring Applications [VLDB 23]
  5. CDSBen: Benchmarking the Performance of Storage Services in Cloud-native Database System at ByteDance [VLDB 23]
  6. FEBench: A Benchmark for Real-Time Relational Data Feature Extraction [VLDB 23]
  7. TPCx-AI - An Industry Standard Benchmark for Artificial Intelligence and Machine Learning Systems [VLDB 23]
  8. ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL Systems [VLDB 23]
  9. Why TPC Is Not Enough: An Analysis of the Amazon Redshift Fleet [VLDB 24]
  10. The LDBC Financial Benchmark: Transaction Workload [VLDB 25]

Time Series

  1. An Experimental Evaluation of Anomaly Detection in Time Series [VLDB 24]

Multi-Model

  1. Practical and Asymptotically Optimal Quantization of High-Dimensional Vectors in Euclidean Space for Approximate Nearest Neighbor Search [SIGMOD 25]
  2. MIRAGE-ANNS: Mixed Approach Graph-based Indexing for Approximate Nearest Neighbor Search [SIGMOD 25]
  3. UNIFY: Unified Index for Range Filtered Approximate Nearest Neighbors Search [VLDB 25]
  4. Attribute Filtering in Approximate Nearest Neighbor Search: An In-depth Experimental Study [SIGMOD 26]
  5. TigerVector: Supporting Vector Search in Graph Databases for Advanced RAGs [SIGMOD 26]

Multi-Modal

  1. Beyond Relational: Semantic-Aware Multi-Modal Analytics with LLM-Native Query Optimization [arXiv 25]

Survey & Benchmark

  1. Multi-model Databases: A New Journey to Handle the Variety of Data [CSUR 19]
  2. M2Bench: A Database Benchmark for Multi-Model Analytic Workloads [VLDB 23]
  3. MMSBench-Net: Scenario-Based Evaluation of Multi-Model Database Systems [23]
  4. MMDBench: A Benchmark for Hybrid Query in Multimodal Database [24]
  5. 𝑺𝒕𝒆𝒊𝒏𝒆𝒓-Hardness: A Query Hardness Measure for Graph-Based ANN Indexes [VLDB 24]
  6. Evaluating and Generating Query Workloads for High Dimensional Vector Similarity Search [KDD 25]
  7. Survey of Filtered Approximate Nearest Neighbor Search over the Vector-Scalar Hybrid Data [arXiv 25]
  8. SemBench: A Benchmark for Semantic Query Processing Engines [arXiv 25]

Vector Database

Survey

  1. Are There Fundamental Limitations in Supporting Vector Data Management in Relational Databases? A Case Study of PostgreSQL [ICDE 24]
  2. Survey of Vector Database Management Systems [VLDBJ 24]
  3. Vector Database Management Techniques and Systems [SIGMOD 24]
  4. BigVectorBench: Heterogeneous Data Embedding and Compound Queries are Essential in Evaluating Vector Databases [VLDB 25]
  5. 向量数据库及DB4LLM技术 [JOS 25]

Algorithm

  1. FlowWalker: A Memory-efficient and High-performance GPU-based Dynamic Graph Random Walk Framework [VLDB 24]
  2. Practical and Asymptotically Optimal Quantization of High-Dimensional Vectors in Euclidean Space for Approximate Nearest Neighbor Search [SIGMOD 25]

Distributed Systems

  1. Consistency in Non-Transactional Distributed Storage Systems [arXiv 15]
  2. NOC-NOC: Towards Performance-optimal Distributed Transactions [SIGMOD 24]
  3. Native Distributed Databases: Problems, Challenges and Opportunities [VLDB 24 Tutorial]

OLTP

Survey

  1. A survey on transactional stream processing [VLDBJ 23]
  2. Are Database System Researchers Making Correct Assumptions about Transaction Workloads? [SIGMOD 25]

AI4DB

Industry

Star History

Star History Chart

About

Paper related to OLAP database systems

Topics

database paper olap ecnu-dase ai4db

Resources

Readme

License

Apache-2.0 license
Activity

Stars

118 stars

Watchers

1 watching

Forks

15 forks
Report repository

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •