Apache Arrow Go v18.5.0-rc0

18.5.0 RC0

v18.4.1

What's Changed

• fix(arrow/compute/exprs): Handle large types in expr handling by @zeroshade in #440
• chore: Bump github.com/klauspost/cpuid/v2 from 2.2.11 to 2.3.0 by @dependabot[bot] in #444
• chore: Bump golang.org/x/sync from 0.15.0 to 0.16.0 by @dependabot[bot] in #443
• chore: Bump golang.org/x/sys from 0.33.0 to 0.34.0 by @dependabot[bot] in #442
• fix(arrow/compute/exprs): fix literalToDatum for precision types by @zeroshade in #447
• chore: Bump golang.org/x/tools from 0.34.0 to 0.35.0 by @dependabot[bot] in #441
• fix(arrow/array): Fix RecordFromJSON perf by @zeroshade in #449
• fix(arrow/array): update timestamp json format by @zeroshade in #450
• refactor: switch golang.org/x/exp to standard library packages by @ufUNnxagpM in #453
• chore: Bump google.golang.org/grpc from 1.73.0 to 1.74.2 by @dependabot[bot] in #458
• fix(parquet/pqarrow): supress io.EOF in RecordReader.Err() by @ryanschneider in #452
• chore: Bump github.com/substrait-io/substrait-go/v4 from 4.3.0 to 4.4.0 by @dependabot[bot] in #459
• fix(array): add nil checks in Data.Release() for childData by @secfree in #456
• fix(arrow/compute): Fix scalar comparison batches by @zeroshade in #465
• chore: Bump actions/checkout from 4 to 5 by @dependabot[bot] in #471
• chore: Bump golang.org/x/tools from 0.35.0 to 0.36.0 by @dependabot[bot] in #467
• chore: Bump actions/download-artifact from 4.3.0 to 5.0.0 by @dependabot[bot] in #468
• chore: Bump google.golang.org/protobuf from 1.36.6 to 1.36.7 by @dependabot[bot] in #469
• refactor(arrow): rename Record to RecordBatch and add deprecated alias by @Mandukhai-Alimaa in #466
• refactor(arrow): migrate leaf packages to use RecordBatch by @Mandukhai-Alimaa in #473
• refactor(arrow): third increment of the Record -> RecordBatch migration by @Mandukhai-Alimaa in #478
• chore: Bump github.com/go-viper/mapstructure/v2 from 2.3.0 to 2.4.0 by @dependabot[bot] in #480
• ci(parquet/pqarrow): integration tests for reading shredded variants by @zeroshade in #455
• chore: Bump google.golang.org/grpc from 1.74.2 to 1.75.0 by @dependabot[bot] in #483
• chore: Bump github.com/stretchr/testify from 1.10.0 to 1.11.0 by @dependabot[bot] in #482
• Implement RLE dictionary decoder using generics by @daniel-adam-tfs in #477
• chore: Bump google.golang.org/protobuf from 1.36.7 to 1.36.8 by @dependabot[bot] in #481
• fix(parquet/internal/encoding): Fix typed dictionary encoding by @MasslessParticle in #479
• refactor(arrow): fourth increment of the Record -> RecordBatch migration by @Mandukhai-Alimaa in #486
• chore: bump version number by @zeroshade in #487

New Contributors

• @ufUNnxagpM made their first contribution in #453
• @ryanschneider made their first contribution in #452
• @secfree made their first contribution in #456
• @Mandukhai-Alimaa made their first contribution in #466
• @daniel-adam-tfs made their first contribution in #477

Full Changelog: v18.4.0...v18.4.1

Apache Arrow Go v18.4.1-rc0

18.4.1 RC0

v18.4.0

What's Changed

• feat(arrow/cdata): Add ReleaseCArrowArrayStream function by @karsov in #373
• chore: Bump golang.org/x/sync from 0.13.0 to 0.14.0 by @dependabot[bot] in #368
• fix: TestDeltaByteArray implementation and fix by @MetalBlueberry in #369
• chore: Bump golang.org/x/tools from 0.32.0 to 0.33.0 by @dependabot[bot] in #376
• chore: Bump actions/setup-go from 5.4.0 to 5.5.0 by @dependabot[bot] in #377
• chore: move .github/ISSUE_TEMPLATE/config.yaml to config.yml as currently does not work by @raulcd in #383
• chore: Bump google.golang.org/grpc from 1.72.0 to 1.72.1 by @dependabot[bot] in #381
• fix: list_columns.parquet testing by @MetalBlueberry in #378
• feat: Extend arrow csv writter by @MetalBlueberry in #375
• feat(parquet/pqarrow): parallelize SeekToRow by @zeroshade in #380
• chore: Use apache/arrow-js for JS in integration test by @kou in #389
• chore: Bump github.com/apache/thrift from 0.21.0 to 0.22.0 by @dependabot[bot] in #387
• feat(parquet): add variant encoder/decoder by @sfc-gh-mbojanczyk in #344
• chore: remove extra binary by @zeroshade in #391
• CI: add benchmark workflow and script by @singh1203 in #250
• chore: Bump actions/setup-python from 4 to 5 by @dependabot[bot] in #396
• feat(arrow/extensions): Add Variant extension type, array, and builder by @zeroshade in #395
• fix(parquet/pqarrow): Fix propagation of field-ids for Lists by @zeroshade in #397
• feat(arrow/_examples): enhance library examples by @kris-gaudel in #394
• chore: bump Windows GitHub hosted runner to windows-2022 by @raulcd in #407
• chore: Bump golang.org/x/tools from 0.33.0 to 0.34.0 by @dependabot[bot] in #398
• chore: Bump golang.org/x/sync from 0.14.0 to 0.15.0 by @dependabot[bot] in #400
• chore: Bump github.com/pterm/pterm from 0.12.80 to 0.12.81 by @dependabot[bot] in #402
• chore: Bump google.golang.org/grpc from 1.72.1 to 1.73.0 by @dependabot[bot] in #401
• ci(benchmark): Fix benchmark runs by @zeroshade in #409
• ci: fix flaky test by @zeroshade in #411
• ci: make additional checks to prevent flaky EOF by @zeroshade in #414
• refactor: update linter and run it by @zeroshade in #419
• chore: Bump github.com/stoewer/go-strcase from 1.3.0 to 1.3.1 by @dependabot[bot] in #423
• chore: Bump github.com/hamba/avro/v2 from 2.28.0 to 2.29.0 by @dependabot[bot] in #422
• feat: expose Payload.WritePayload to allow serializing into IPC format by @alvarowolfx in #421
• feat(parquet/variant): Parse JSON into variant by @zeroshade in #426
• chore: Bump github.com/go-viper/mapstructure/v2 from 2.2.1 to 2.3.0 by @dependabot[bot] in #427
• refactor(parquet/internal/encoding): Refactor parquet logic to use generics by @zeroshade in #428
• feat(arrrow/compute/expr): support substrait timestamp and decimal properly by @zeroshade in #418
• chore: Bump github.com/klauspost/cpuid/v2 from 2.2.10 to 2.2.11 by @dependabot[bot] in #431
• chore: Bump github.com/andybalholm/brotli from 1.1.1 to 1.2.0 by @dependabot[bot] in #432
• feat(parquet/examples): enhance library examples by @milden6 in #429
• feat(arrow/compute): support some float16 casts by @zeroshade in #430
• feat(parquet/pqarrow): Correctly handle Variant types in schema by @zeroshade in #433
• fix(arrow/avro-reader): bunch of types that didn't work by @Willem-J-an in #416
• feat(parquet/pqarrow): read/write variant by @zeroshade in #434
• build(deps): update to substrait-go v4.3.0 by @zeroshade in #438
• fix(arrow/flight/flightsql): drain channel in flightSqlServer.DoGet by @arnoldwakim in #437
• chore(arrow): Update PkgVersion by @zeroshade in #439

New Contributors

• @karsov made their first contribution in #373
• @MetalBlueberry made their first contribution in #369
• @sfc-gh-mbojanczyk made their first contribution in #344
• @kris-gaudel made their first contribution in #394
• @alvarowolfx made their first contribution in #421
• @milden6 made their first contribution in #429
• @Willem-J-an made their first contribution in #416
• @arnoldwakim made their first contribution in #437

Full Changelog: v18.3.0...v18.4.0

Apache Arrow Go v18.4.0-rc0

18.4.0 RC0

v18.3.1

What's Changed

• feat(arrow/cdata): Add ReleaseCArrowArrayStream function by @karsov in #373
• chore: Bump golang.org/x/sync from 0.13.0 to 0.14.0 by @dependabot in #368
• fix: TestDeltaByteArray implementation and fix by @MetalBlueberry in #369
• chore: Bump golang.org/x/tools from 0.32.0 to 0.33.0 by @dependabot in #376
• chore: Bump actions/setup-go from 5.4.0 to 5.5.0 by @dependabot in #377
• chore: move .github/ISSUE_TEMPLATE/config.yaml to config.yml as currently does not work by @raulcd in #383
• chore: Bump google.golang.org/grpc from 1.72.0 to 1.72.1 by @dependabot in #381
• fix: list_columns.parquet testing by @MetalBlueberry in #378

New Contributors

• @karsov made their first contribution in #373

Full Changelog: v18.3.0...v18.3.1

Apache Arrow Go v18.3.1-rc0

18.3.1 RC0

v18.3.0

What's Changed

• chore: Bump golang.org/x/sync from 0.11.0 to 0.12.0 by @dependabot in #308
• chore: Bump golang.org/x/net from 0.35.0 to 0.36.0 by @dependabot in #313
• feat(arrow/array): convert RecordReader and iterators by @zeroshade in #314
• refactor(arrow/array): replace some codegen with generics by @zeroshade in #315
• chore: Bump golang.org/x/tools from 0.30.0 to 0.31.0 by @dependabot in #317
• chore: Bump github.com/golang/snappy from 0.0.4 to 1.0.0 by @dependabot in #316
• feat(parquet/pqarrow): Add SeekToRow for RecordReader by @zeroshade in #321
• fix: go's atomic operations require 64bit alignment in structs on ARM by @sahib in #323
• feat(arrow/compute): implement "is_in" function by @zeroshade in #319
• fix(parquet/pqarrow): fix propagation of FieldIds for nested fields by @zeroshade in #324
• Fix: Handle null values in PlainFixedLenByteArrayEncoder gracefully by @singh1203 in #320
• fix(parquet/pqarrow): fix definition levels with non-nullable lists by @zeroshade in #325
• chore: Bump actions/upload-artifact from 4.6.1 to 4.6.2 by @dependabot in #331
• chore: Bump actions/setup-go from 5.3.0 to 5.4.0 by @dependabot in #332
• chore: Bump actions/download-artifact from 4.1.9 to 4.2.1 by @dependabot in #333
• chore: fix macOS Go 1.24 CI by @lidavidm in #334
• chore: Bump gonum.org/v1/gonum from 0.15.1 to 0.16.0 by @dependabot in #328
• chore: Bump google.golang.org/protobuf from 1.36.5 to 1.36.6 by @dependabot in #330
• chore: Bump actions/setup-python from 5.4.0 to 5.5.0 by @dependabot in #338
• feat(parquet/metadata): bloom filter implementation by @zeroshade in #336
• feat(parquet): Write/Read bloom filters from files by @zeroshade in #341
• fix: move from atomic.(Add|Load|Store) to atomic.Int64{} by @sahib in #326
• chore: Bump golang.org/x/sync from 0.12.0 to 0.13.0 by @dependabot in #347
• fix(parquet/file): restore goroutine safety for reader by @zeroshade in #343
• chore: Bump google.golang.org/grpc from 1.71.0 to 1.71.1 by @dependabot in #346
• chore: Bump golang.org/x/sys from 0.31.0 to 0.32.0 by @dependabot in #345
• chore: Enable GitHub discussions on arrow-go repository by @raulcd in #353
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.9.0 to 3.9.1 by @dependabot in #355
• chore: Bump golang.org/x/tools from 0.31.0 to 0.32.0 by @dependabot in #356
• Compress: add MarshalText and UnmarshalText by @jdemeyer in #357
• chore: Bump google.golang.org/grpc from 1.71.1 to 1.72.0 by @dependabot in #358
• fix(arrow/array): optional struct array with required field by @zeroshade in #359
• feat(parquet/schema): initial variant logical type by @zeroshade in #352
• chore: Bump actions/setup-python from 5.5.0 to 5.6.0 by @dependabot in #363
• chore: Bump actions/download-artifact from 4.2.1 to 4.3.0 by @dependabot in #364
• chore(arrow): remove most lock copies by @zeroshade in #362
• Fix panic when WriteDataPage fails by @ashishnegi in #366
• GH-46087: [FlightSQL] Allow returning column remarks in FlightSQL's CommandGetTables by @mateuszrzeszutek in #361
• chore: Bump golang.org/x/sys from 0.32.0 to 0.33.0 by @dependabot in #367

New Contributors

• @sahib made their first contribution in #323
• @jdemeyer made their first contribution in #357
• @ashishnegi made their first contribution in #366
• @mateuszrzeszutek made their first contribution in #361

Full Changelog: v18.2.0...v18.3.0

Apache Arrow Go v18.3.0-rc0

What's Changed

• chore: Bump golang.org/x/sync from 0.11.0 to 0.12.0 by @dependabot in #308
• chore: Bump golang.org/x/net from 0.35.0 to 0.36.0 by @dependabot in #313
• feat(arrow/array): convert RecordReader and iterators by @zeroshade in #314
• refactor(arrow/array): replace some codegen with generics by @zeroshade in #315
• chore: Bump golang.org/x/tools from 0.30.0 to 0.31.0 by @dependabot in #317
• chore: Bump github.com/golang/snappy from 0.0.4 to 1.0.0 by @dependabot in #316
• feat(parquet/pqarrow): Add SeekToRow for RecordReader by @zeroshade in #321
• fix: go's atomic operations require 64bit alignment in structs on ARM by @sahib in #323
• feat(arrow/compute): implement "is_in" function by @zeroshade in #319
• fix(parquet/pqarrow): fix propagation of FieldIds for nested fields by @zeroshade in #324
• Fix: Handle null values in PlainFixedLenByteArrayEncoder gracefully by @singh1203 in #320
• fix(parquet/pqarrow): fix definition levels with non-nullable lists by @zeroshade in #325
• chore: Bump actions/upload-artifact from 4.6.1 to 4.6.2 by @dependabot in #331
• chore: Bump actions/setup-go from 5.3.0 to 5.4.0 by @dependabot in #332
• chore: Bump actions/download-artifact from 4.1.9 to 4.2.1 by @dependabot in #333
• chore: fix macOS Go 1.24 CI by @lidavidm in #334
• chore: Bump gonum.org/v1/gonum from 0.15.1 to 0.16.0 by @dependabot in #328
• chore: Bump google.golang.org/protobuf from 1.36.5 to 1.36.6 by @dependabot in #330
• chore: Bump actions/setup-python from 5.4.0 to 5.5.0 by @dependabot in #338
• feat(parquet/metadata): bloom filter implementation by @zeroshade in #336
• feat(parquet): Write/Read bloom filters from files by @zeroshade in #341
• fix: move from atomic.(Add|Load|Store) to atomic.Int64{} by @sahib in #326
• chore: Bump golang.org/x/sync from 0.12.0 to 0.13.0 by @dependabot in #347
• fix(parquet/file): restore goroutine safety for reader by @zeroshade in #343
• chore: Bump google.golang.org/grpc from 1.71.0 to 1.71.1 by @dependabot in #346
• chore: Bump golang.org/x/sys from 0.31.0 to 0.32.0 by @dependabot in #345
• chore: Enable GitHub discussions on arrow-go repository by @raulcd in #353
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.9.0 to 3.9.1 by @dependabot in #355
• chore: Bump golang.org/x/tools from 0.31.0 to 0.32.0 by @dependabot in #356
• Compress: add MarshalText and UnmarshalText by @jdemeyer in #357
• chore: Bump google.golang.org/grpc from 1.71.1 to 1.72.0 by @dependabot in #358
• fix(arrow/array): optional struct array with required field by @zeroshade in #359
• feat(parquet/schema): initial variant logical type by @zeroshade in #352
• chore: Bump actions/setup-python from 5.5.0 to 5.6.0 by @dependabot in #363
• chore: Bump actions/download-artifact from 4.2.1 to 4.3.0 by @dependabot in #364
• chore(arrow): remove most lock copies by @zeroshade in #362
• Fix panic when WriteDataPage fails by @ashishnegi in #366
• GH-46087: [FlightSQL] Allow returning column remarks in FlightSQL's CommandGetTables by @mateuszrzeszutek in #361
• chore: Bump golang.org/x/sys from 0.32.0 to 0.33.0 by @dependabot in #367

New Contributors

• @sahib made their first contribution in #323
• @jdemeyer made their first contribution in #357
• @ashishnegi made their first contribution in #366
• @mateuszrzeszutek made their first contribution in #361

Full Changelog: v18.2.0-rc1...v18.3.0-rc0

v18.2.0

What's Changed

• fix(release): fix wrong upload path by @kou in #243
• chore: Bump google.golang.org/protobuf from 1.36.1 to 1.36.2 by @dependabot in #248
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.2.1 to 3.3.0 by @dependabot in #247
• chore: Bump actions/upload-artifact from 4.5.0 to 4.6.0 by @dependabot in #245
• fix(release): fix svn add command and add script to generate release notes by @zeroshade in #249
• fix(arrow/cdata): move headers into parent Go package by @zeroshade in #251
• chore: Bump google.golang.org/protobuf from 1.36.2 to 1.36.3 by @dependabot in #255
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.3.0 to 3.4.0 by @dependabot in #253
• chore: Add NOTICE.txt file by @singh1203 in #257
• chore: Bump google.golang.org/protobuf from 1.36.3 to 1.36.4 by @dependabot in #259
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.4.0 to 3.5.0 by @dependabot in #260
• chore: Bump actions/setup-go from 5.2.0 to 5.3.0 by @dependabot in #258
• chore: Bump google.golang.org/grpc from 1.69.2 to 1.70.0 by @dependabot in #262
• chore: Bump github.com/google/flatbuffers from 24.12.23+incompatible to 25.1.24+incompatible by @dependabot in #261
• chore: Update self-hosted arm runner to ubuntu-24.04-arm by @singh1203 in #268
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.5.0 to 3.6.0 by @dependabot in #272
• chore: Bump actions/setup-python from 5.3.0 to 5.4.0 by @dependabot in #266
• chore: Bump google.golang.org/protobuf from 1.36.4 to 1.36.5 by @dependabot in #270
• chore: Bump golang.org/x/tools from 0.29.0 to 0.30.0 by @dependabot in #273
• chore: Drop executable file bit of source files by @jas4711 in #274
• chore: Bump github.com/goccy/go-json from 0.10.4 to 0.10.5 by @dependabot in #264
• ci: update actions/cache by @zeroshade in #276
• fix(arrow/bitutil): fix bitmap ops on 32-bit platforms by @zeroshade in #277
• feat(internal/encoding): add Discard method to decoders by @zeroshade in #280
• feat(parquet/cmd/parquet_reader): Add command to dump the column and offset indices by @zeroshade in #281
• chore: Bump github.com/google/flatbuffers from 25.1.24+incompatible to 25.2.10+incompatible by @dependabot in #284
• fix(internal/utils): fix clobbering BP by @zeroshade in #288
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.6.0 to 3.7.0 by @dependabot in #287
• docs(license): update LICENSE.txt by @zeroshade in #290
• feat(parquet/file): Add SeekToRow for Column readers by @zeroshade in #283
• fix(parquet/pqarrow): propagate field id metadata for lists/maps by @zeroshade in #293
• feat: Add arrayApproxEqualString to handle null characters in string. by @singh1203 in #291
• feat(parquet): update comments for BufferedStreamEnabled by @joechenrh in #295
• chore: Bump actions/upload-artifact from 4.6.0 to 4.6.1 by @dependabot in #296
• chore: Bump github.com/klauspost/compress from 1.17.11 to 1.18.0 by @dependabot in #297
• chore: Bump github.com/hamba/avro/v2 from 2.27.0 to 2.28.0 by @dependabot in #285
• chore: Bump actions/download-artifact from 4.1.8 to 4.1.9 by @dependabot in #301
• fix(arrow/memory): Align allocations always by @lidavidm in #289
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.7.0 to 3.8.0 by @dependabot in #300
• chore: Bump github.com/klauspost/cpuid/v2 from 2.2.9 to 2.2.10 by @dependabot in #299
• feat(parquet): add byte buffer when disable buffered stream by @joechenrh in #302
• perf(overflow): Speed up overflow checks for small integers by @cbandy in #303
• chore: bump version by @zeroshade in #305
• fix(pqarrow): respect list element nullability during conversion by @zeroshade in #311
• chore(testing): Update testing submodules by @zeroshade in #312
• chore: Bump golang.org/x/sys from 0.30.0 to 0.31.0 by @dependabot in #309
• chore: Bump google.golang.org/grpc from 1.70.0 to 1.71.0 by @dependabot in #306
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.8.0 to 3.9.0 by @dependabot in #307

New Contributors

• @singh1203 made their first contribution in #257
• @jas4711 made their first contribution in #274
• @lidavidm made their first contribution in #289
• @cbandy made their first contribution in #303

Full Changelog: v18.1.0...v18.2.0