Skip to content

500s when running evals workaround #23168

@alisa-alisa

Description

@alisa-alisa

What happened?

come up with a way to handle these 500s gracefully without blocking PRs: https://github.com/google-gemini/gemini-cli/actions/runs/23311012118/job/67798598872

What did you expect to happen?

Right now the evals block PRs when there are 500s. It is not a proper behavior, we need to come up with a better solution.

Client information

N/A

Login information

No response

Anything else we need to know?

No response

Metadata

Metadata

Assignees

Labels

area/platformIssues related to Build infra, Release mgmt, Testing, Eval infra, Capacity, Quota mgmtworkstream-rollupLabel used to tag epics and features that are associated with one of the three primary workstreams🔒 maintainer only⛔ Do not contribute. Internal roadmap item.

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions