Skip to content

[v25.2.x] iceberg: couple logging improvements#27743

Merged
lf-rep merged 2 commits into
redpanda-data:v25.2.xfrom
andrwng:25-2-x-iceberg-log-tweak
Sep 28, 2025
Merged

[v25.2.x] iceberg: couple logging improvements#27743
lf-rep merged 2 commits into
redpanda-data:v25.2.xfrom
andrwng:25-2-x-iceberg-log-tweak

Conversation

@andrwng
Copy link
Copy Markdown
Contributor

@andrwng andrwng commented Sep 25, 2025

Backport of PR #27715

CONFLICT:

  • trivial conflict in rest_client/BUILD

It's very verbose as is.

(cherry picked from commit a493a7f)
CONFLICT:
- minor conflict in rest_client/BUILD

When there is an error returned from the REST catalog, we have very
little context about what we sent. This commit addresses this by
logging the logical contents of the request as JSON.

I considered logging at a lower level, and logging the entire HTTP
request payload (e.g. in perform_request() after signing and such), but
opted to place the at the callsite because the context we have there is
already const and available to be logged conditionally (vs in
perform_request(), the request is moved, making conditional logging
trickier).

(cherry picked from commit e315237)
@andrwng andrwng force-pushed the 25-2-x-iceberg-log-tweak branch from f6f6318 to 22e1536 Compare September 26, 2025 04:40
@vbotbuildovich
Copy link
Copy Markdown
Collaborator

vbotbuildovich commented Sep 26, 2025

Retry command for Build#73029

please wait until all jobs are finished before running the slash command

/ci-repeat 1
tests/rptest/tests/datalake/custom_partitioning_test.py::DatalakeCustomPartitioningTest.test_many_partitions@{"catalog_type":"rest_jdbc","cloud_storage_type":1}

@vbotbuildovich
Copy link
Copy Markdown
Collaborator

CI test results

test results on build#73029
test_class test_method test_arguments test_kind job_url test_status passed reason test_history
DatalakeCustomPartitioningTest test_many_partitions {"catalog_type": "rest_jdbc", "cloud_storage_type": 1} integration https://buildkite.com/redpanda/redpanda/builds/73029#0199846f-fbfc-4b34-a6a6-22686152ebc4 FLAKY 3/21 upstream reliability is '100.0'. current run reliability is '14.285714285714285'. drift is 85.71429 and the allowed drift is set to 50. The test should FAIL https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=DatalakeCustomPartitioningTest&test_method=test_many_partitions
MaintenanceTest test_maintenance_sticky {"use_rpk": true} integration https://buildkite.com/redpanda/redpanda/builds/73029#0199846d-0468-44f7-bf77-3bbadfffe9f1 FLAKY 20/21 upstream reliability is '100.0'. current run reliability is '95.23809523809523'. drift is 4.7619 and the allowed drift is set to 50. The test should PASS https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=MaintenanceTest&test_method=test_maintenance_sticky
RandomNodeOperationsTest test_node_operations {"cloud_storage_type": 1, "compaction_mode": "adjacent_merge", "enable_failures": true, "mixed_versions": false, "with_iceberg": false} integration https://buildkite.com/redpanda/redpanda/builds/73029#0199846d-0469-4416-8621-03bfca3bccc3 FLAKY 20/21 upstream reliability is '100.0'. current run reliability is '95.23809523809523'. drift is 4.7619 and the allowed drift is set to 50. The test should PASS https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=RandomNodeOperationsTest&test_method=test_node_operations
RandomNodeOperationsTest test_node_operations {"cloud_storage_type": 2, "compaction_mode": "sliding_window", "enable_failures": true, "mixed_versions": false, "with_iceberg": false} integration https://buildkite.com/redpanda/redpanda/builds/73029#0199846d-046d-4447-9fc8-e5d83988f19a FLAKY 19/21 upstream reliability is '100.0'. current run reliability is '90.47619047619048'. drift is 9.52381 and the allowed drift is set to 50. The test should PASS https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=RandomNodeOperationsTest&test_method=test_node_operations
TopicDeleteCloudStorageTest drop_lifecycle_marker_test {"cloud_storage_type": 1} integration https://buildkite.com/redpanda/redpanda/builds/73029#0199846f-fbfd-4631-9228-18351e014640 FLAKY 16/21 upstream reliability is '100.0'. current run reliability is '76.19047619047619'. drift is 23.80952 and the allowed drift is set to 50. The test should PASS https://redpanda.metabaseapp.com/dashboard/87-tests?tab=142-dt-individual-test-history&test_class=TopicDeleteCloudStorageTest&test_method=drop_lifecycle_marker_test

@lf-rep lf-rep merged commit e75d1e2 into redpanda-data:v25.2.x Sep 28, 2025
13 of 16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants