v1.2.853-nightly

What's Changed

Exciting New Features ✨

• feat: perf bitmap intersect by @KKould in #19041
• feat(query): speed up string→timestamp/date/timestamptz parsing via DayLUT fast path by @TCeason in #19045
• feat: improve scan IO profile metrics by @BohuTANG in #18975
• feat: impl bitmap_construct_agg by @KKould in #19053

Thoughtful Bug Fix 🔧

• fix(query): fix filter bug with small block-size by @sundy-li in #19047
• fix: Pruning multithreading without accumulating time by @KKould in #19044

Code Refactor 🎉

• refactor: bytes view calc total_bytes_len lazy. by @youngsofun in #19056

Build/Testing/CI Infra Changes 🔌

• ci: add benchmark for tpch1000 by @everpcpc in #19057
• ci: fix bendsql run for benchmark by @everpcpc in #19059
• ci: fix benchmark database by @everpcpc in #19060
• ci: adjust tpch1000 benchmark timeout by @everpcpc in #19061
• ci: fix tpch1000 benchmark timeout by @everpcpc in #19062
• ci: comment ignore ndjson files for benchmark by @everpcpc in #19065
• ci: update database for benchmark by @everpcpc in #19068

Others 📒

• chore: revert "fix: fix memory_size of sliced string view. (#19014)" by @youngsofun in #19051
• chore: map log target to short semantic categories by @forsaken628 in #18925

Full Changelog: v1.2.852-nightly...v1.2.853-nightly

v1.2.852-nightly

What's Changed

Exciting New Features ✨

• feat: improve runtime filter check via SIMD by @SkyFan2002 in #19039

Build/Testing/CI Infra Changes 🔌

• ci: add a flag to allow skip trim debug info by @dqhl76 in #19043

Others 📒

• chore: eliminate several unnecessary branches from the hot path of the aggregate function by @forsaken628 in #19028
• chore: improve explain perf to support flag inlined function by @dqhl76 in #19042

Full Changelog: v1.2.851-nightly...v1.2.852-nightly

v1.2.851-nightly

What's Changed

Exciting New Features ✨

• feat: better display of retained identity by @camilesing in #19029

Thoughtful Bug Fix 🔧

• fix(query): Fix inverted index matched score caused panic by @b41sh in #19032
• fix: implements bitmap comparison by @dantengsky in #19038
• fix(query): fix stack overflow errors thrown during serialization by @zhang2014 in #19040

Code Refactor 🎉

• refactor: Optimize timestamp/timestamptz function by DayLUT by @TCeason in #19031

Others 📒

• chore(query): set enable_experimental_virtual_column default as 0 by @b41sh in #19033

Full Changelog: v1.2.850-nightly...v1.2.851-nightly

v1.2.850-nightly

What's Changed

Exciting New Features ✨

• feat: add cost to explain pruning stats by @KKould in #19015
• feat: add column update_on for user functions table by @KKould in #19018
• feat(query): add DATE ± INTERVAL -> DATE function by @TCeason in #19022

Code Refactor 🎉

• refactor(query): decrease call tzdb parse by @TCeason in #19004

Full Changelog: v1.2.849-nightly...v1.2.850-nightly

v1.2.849-nightly

What's Changed

Exciting New Features ✨

• feat: support position column in common sql query by @KKould in #19012
• feat: improve runtime filter [Part 3] by @SkyFan2002 in #19006
• feat: enable Decimal64 handling in fuse table deserialization by @dantengsky in #19008
• feat(query): Inverted Index Top-N Pruning for ORDER BY + LIMIT Queries by @b41sh in #19016

Thoughtful Bug Fix 🔧

• fix: load of large zip file. by @youngsofun in #19010
• fix(rbac): forbiden grant create-ownership-object privilege to user by @TCeason in #18987
• fix: fix memory_size of sliced string view. by @youngsofun in #19014
• fix: runtime filters not work when probe keys are simple casts of non-nullable columns to nullable types by @SkyFan2002 in #19020

Code Refactor 🎉

• refactor(func): optimize function array_aggregate by @forsaken628 in #19005
• refactor: move aggregation spill logic into partial aggregate by @dqhl76 in #18999
• refactor(query): add the matcher id when calling the optimizer apply by @zhang2014 in #19017

Build/Testing/CI Infra Changes 🔌

• ci: ttc test with arrow body format. by @youngsofun in #18985
• ci: 'onlyif http'->'skipif mysql' to cover ttc tests by @youngsofun in #19011
• ci: refactor databend-go compat test. by @youngsofun in #19023

Full Changelog: v1.2.848-nightly...v1.2.849-nightly

v1.2.848-nightly

What's Changed

Thoughtful Bug Fix 🔧

• fix: unable to get field on rank limit when rule_eager_aggregation applied by @KKould in #19007
• fix: pivot extra columns on projection by @KKould in #18994

Code Refactor 🎉

• refactor: bump crates arrow* and parquet to version 56 by @dantengsky in #18997

Others 📒

• chore(ut): support for const columns as input to function unit tests by @forsaken628 in #19009
• chore(query): enable to cache the previous python import directory for python udf by @sundy-li in #19003

Full Changelog: v1.2.847-nightly...v1.2.848-nightly

v1.2.847-nightly

What's Changed

Others 📒

• chore: make query service start after meta by @everpcpc in #19002
• chore(query): Refresh virtual column support limit and selection by @b41sh in #19001

Full Changelog: v1.2.846-nightly...v1.2.847-nightly

v1.2.846-nightly

What's Changed

Thoughtful Bug Fix 🔧

• fix: Block::to_record_batch fail when a column is array of NULLs. by @youngsofun in #18989
• fix: desc password policy column types must match schema types. by @youngsofun in #18990

Code Refactor 🎉

• refactor(query): pass timezone by reference to avoid Arc churn by @TCeason in #18998
• refactor(query): remove potential performance hotspots caused by fetch_add by @zhang2014 in #18995

Others 📒

• chore(query): Accelerate vector index quantization score calculation with SIMD by @b41sh in #18957
• chore(query): clamp timestamps to jiff range before timezone conversion by @TCeason in #18996

Full Changelog: v1.2.845-nightly...v1.2.846-nightly

v1.2.845-nightly

What's Changed

Exciting New Features ✨

• feat: impl UDTF Server by @KKould in #18947
• feat(query):masking policy support rbac by @TCeason in #18982
• feat: improve runtime filter [Part 2] by @SkyFan2002 in #18955

Build/Testing/CI Infra Changes 🔌

• ci: upgrade k3s for meta chaos by @everpcpc in #18983

Others 📒

• chore: bump opendal to 0.54.1 by @dqhl76 in #18970

Full Changelog: v1.2.844-nightly...v1.2.845-nightly

v1.2.844-nightly

What's Changed

Others 📒

• chore: adjust the storage method of timestamp_tz so that the timestamp value is retrieved directly. by @KKould in #18974
• chore: add more logs to cover aggregate spill by @dqhl76 in #18980
• chore(query): Virtual column support external table by @b41sh in #18981

Full Changelog: v1.2.843-nightly...v1.2.844-nightly