Skip to content

stop forcing generation count for mini phrasing probes#1109

Merged
leondz merged 1 commit intoNVIDIA:mainfrom
leondz:update/phrasing_generations_unforce
Feb 26, 2025
Merged

stop forcing generation count for mini phrasing probes#1109
leondz merged 1 commit intoNVIDIA:mainfrom
leondz:update/phrasing_generations_unforce

Conversation

@leondz
Copy link
Collaborator

@leondz leondz commented Feb 24, 2025

minify in probes.phrasing forced generations to 1. Seemed like a good idea at the time but is actually unintiutive and hard to troubleshoot. undoing this

Verification

  • garak -m test.Blank -p phrasing.PastTenseMini -g 2 gives 400 and not 200 generations

@leondz leondz added the probes Content & activity of LLM probes label Feb 24, 2025
@leondz leondz merged commit ccb786d into NVIDIA:main Feb 26, 2025
10 checks passed
@github-actions github-actions bot locked and limited conversation to collaborators Feb 26, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

probes Content & activity of LLM probes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants