fix(tempest): Add more metrics, logs and spans for monitoring

[mujacica]

• Add more metrics, logs and spans for monitoring

[mujacica]

@sentry review

[mujacica]

@cursor review

[mujacica]

@cursor review

[mujacica]

@sentry review

[mujacica]

@cursor review

[tobias-wilfert]

Just left a couple comments, but overall nice should give us much better insight in what is actually happening.

[getsantry]

This issue has gone three weeks without activity. In another week, I will close it.

But! If you comment or otherwise update it, I will reset the clock, and if you remove the label Waiting for: Community, I will leave it alone ... forever!

---

"A weed is but an unloved flower." ― Ella Wheeler Wilcox 🥀

[cursor]

Cursor Bugbot has reviewed your changes and found 3 potential issues.

^{Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

[cursor]

Missing deleted-credentials guard in poll crashes implementation

Medium Severity

_poll_tempest_crashes_impl uses .get() to fetch credentials, while _fetch_latest_item_id_impl was updated to use .filter().first() with a graceful None check. If credentials are deleted between task scheduling and execution, .get() raises DoesNotExist outside the try/except block, causing an unhandled exception that propagates through the lock context and crashes the task without any metrics or logging.

Additional Locations (1)

• src/sentry/tempest/tasks.py#L85-L92

 

[github-actions]

Backend Test Failures

Failures on 98711f6 in this run:

tests/sentry/tempest/test_tempest.py::TempestTasksTest::test_fetch_latest_item_id_invalid_scope — log

tests/sentry/tempest/test_tempest.py:103: in test_fetch_latest_item_id_invalid_scope
    assert self.credentials.message == (
E   AssertionError: assert '' == 'Seems like t... wrong scope.'
E     
E     - Seems like the provided credentials have the wrong scope.