Skip to content

[v25.3.x] Include snapshot id and sequence number in coordinator state#29256

Merged
mmaslankaprv merged 7 commits intoredpanda-data:v25.3.xfrom
vbotbuildovich:backport-pr-29180-v25.3.x-629
Jan 15, 2026
Merged

[v25.3.x] Include snapshot id and sequence number in coordinator state#29256
mmaslankaprv merged 7 commits intoredpanda-data:v25.3.xfrom
vbotbuildovich:backport-pr-29180-v25.3.x-629

Conversation

@vbotbuildovich
Copy link
Copy Markdown
Collaborator

Backport of PR #29180

Signed-off-by: Michał Maślanka <michal@redpanda.com>
(cherry picked from commit 184a580)
Signed-off-by: Michał Maślanka <michal@redpanda.com>
(cherry picked from commit 6a4504c)
When executing transaction commit request over Iceberg REST catalog the
catalog returns the `CommitTrasnactionResponse` containing table
metadata. Changed the `iceberg::catalog` API to return the table
metadata from transaction commit method.

Signed-off-by: Michał Maślanka <michal@redpanda.com>
(cherry picked from commit dcdfd49)
Signed-off-by: Michał Maślanka <michal@redpanda.com>
(cherry picked from commit d8d9dd5)
When committing transaction Iceberg catalog creates a new snapshot and
updates the table current snapshot id. This commits adds a snapshot id
and last sequence number to iceberg coordinator state. The snapshot id
is going to be exposed to the clients in Admin API. This will allow
callers to correlate the Iceberg snapshot with Redpanda partition
offsets. The snapshot id together with last committed partition offsets
map are defining a 'stitching' point where older data are available in
Iceberg table and newer ones are in Redpanda partitions. By using
offsets and snapshot id the clients are guaranteed there are no
duplicated records read.

Signed-off-by: Michał Maślanka <michal@redpanda.com>
(cherry picked from commit dafd4bd)
Signed-off-by: Michał Maślanka <michal@redpanda.com>
(cherry picked from commit 64dbdd6)
Signed-off-by: Michał Maślanka <michal@redpanda.com>
(cherry picked from commit 71d43f0)
@vbotbuildovich vbotbuildovich added this to the v25.3.x-next milestone Jan 14, 2026
@vbotbuildovich vbotbuildovich added the kind/backport PRs targeting a stable branch label Jan 14, 2026
@vbotbuildovich
Copy link
Copy Markdown
Collaborator Author

Retry command for Build#79027

please wait until all jobs are finished before running the slash command

/ci-repeat 1
skip-redpanda-build
skip-units
skip-rebase
tests/rptest/tests/write_caching_fi_e2e_test.py::WriteCachingFailureInjectionE2ETest.test_crash_all@{"use_transactions":false}

@vbotbuildovich
Copy link
Copy Markdown
Collaborator Author

CI test results

test results on build#79027
test_class test_method test_arguments test_kind job_url test_status passed reason test_history
WriteCachingFailureInjectionE2ETest test_crash_all {"use_transactions": false} integration https://buildkite.com/redpanda/redpanda/builds/79027#019bbd32-c807-4eee-bad9-95c44f999d93 FLAKY 31/41 Test FAILS after retries.Significant increase in flaky rate(baseline=0.0743, p0=0.0023, reject_threshold=0.0100) https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=WriteCachingFailureInjectionE2ETest&test_method=test_crash_all

@mmaslankaprv
Copy link
Copy Markdown
Member

/ci-repeat 1

@mmaslankaprv mmaslankaprv merged commit ebb4b94 into redpanda-data:v25.3.x Jan 15, 2026
31 checks passed
@tyson-redpanda tyson-redpanda modified the milestones: v25.3.x-next, v25.3.6 Jan 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/build area/redpanda kind/backport PRs targeting a stable branch

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants