Skip to content

reporting: aggregate probe as min#1218

Merged
leondz merged 2 commits intoNVIDIA:mainfrom
leondz:reporting/aggregate_probe_as_min
May 19, 2025
Merged

reporting: aggregate probe as min#1218
leondz merged 2 commits intoNVIDIA:mainfrom
leondz:reporting/aggregate_probe_as_min

Conversation

@leondz
Copy link
Collaborator

@leondz leondz commented May 19, 2025

probe-level results over multiple detectors were aggregated as mean in html report

this cuts too much signal out when detectors pick up failures

aggregate as minimum instead

e.g. when detectors report 100% and 0% pass, aggregate result on top line shows now minimum, 0%

image

@leondz leondz added the reporting Reporting, analysis, and other per-run result functions label May 19, 2025
Copy link
Collaborator

@erickgalinkin erickgalinkin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am very into this change.

@leondz leondz merged commit e3a89f6 into NVIDIA:main May 19, 2025
12 checks passed
@github-actions github-actions bot locked and limited conversation to collaborators May 19, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

reporting Reporting, analysis, and other per-run result functions

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants