-
Notifications
You must be signed in to change notification settings - Fork 13k
500s when running evals workaround #23168
Copy link
Copy link
Closed
Labels
area/platformIssues related to Build infra, Release mgmt, Testing, Eval infra, Capacity, Quota mgmtIssues related to Build infra, Release mgmt, Testing, Eval infra, Capacity, Quota mgmtworkstream-rollupLabel used to tag epics and features that are associated with one of the three primary workstreamsLabel used to tag epics and features that are associated with one of the three primary workstreams🔒 maintainer only⛔ Do not contribute. Internal roadmap item.⛔ Do not contribute. Internal roadmap item.
Metadata
Metadata
Assignees
Labels
area/platformIssues related to Build infra, Release mgmt, Testing, Eval infra, Capacity, Quota mgmtIssues related to Build infra, Release mgmt, Testing, Eval infra, Capacity, Quota mgmtworkstream-rollupLabel used to tag epics and features that are associated with one of the three primary workstreamsLabel used to tag epics and features that are associated with one of the three primary workstreams🔒 maintainer only⛔ Do not contribute. Internal roadmap item.⛔ Do not contribute. Internal roadmap item.
Type
Fields
Give feedbackNo fields configured for issues without a type.
What happened?
come up with a way to handle these 500s gracefully without blocking PRs: https://github.com/google-gemini/gemini-cli/actions/runs/23311012118/job/67798598872
What did you expect to happen?
Right now the evals block PRs when there are 500s. It is not a proper behavior, we need to come up with a better solution.
Client information
N/A
Login information
No response
Anything else we need to know?
No response