Skip to content

Actions: EleutherAI/lm-evaluation-harness

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
3,474 workflow runs
3,474 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Fix: #3293 (pybass UnboundLocalError on outputs in Exception Logging) Tasks Modified #6018: Pull request #3601 opened by lucafossen
17s lucafossen:main
lucafossen:main
17s
Fix: #3293 (pybass UnboundLocalError on outputs in Exception Logging) Unit Tests #5991: Pull request #3601 opened by lucafossen
4m 43s lucafossen:main
lucafossen:main
4m 43s
Fix: AIME prompt template and answer extraction Unit Tests #5990: Pull request #3600 synchronize by babyplutokurt
4m 52s babyplutokurt:fix_aime_prompt_ingest
babyplutokurt:fix_aime_prompt_ingest
4m 52s
Fix: AIME prompt template and answer extraction Tasks Modified #6017: Pull request #3600 synchronize by babyplutokurt
38s babyplutokurt:fix_aime_prompt_ingest
babyplutokurt:fix_aime_prompt_ingest
38s
Fix: AIME prompt template and answer extraction Tasks Modified #6016: Pull request #3600 synchronize by babyplutokurt
37s babyplutokurt:fix_aime_prompt_ingest
babyplutokurt:fix_aime_prompt_ingest
37s
Fix: AIME prompt template and answer extraction Unit Tests #5989: Pull request #3600 synchronize by babyplutokurt
4m 52s babyplutokurt:fix_aime_prompt_ingest
babyplutokurt:fix_aime_prompt_ingest
4m 52s
Fix: AIME prompt template and answer extraction Unit Tests #5988: Pull request #3600 synchronize by babyplutokurt
5m 10s babyplutokurt:fix_aime_prompt_ingest
babyplutokurt:fix_aime_prompt_ingest
5m 10s
Fix: AIME prompt template and answer extraction Tasks Modified #6015: Pull request #3600 synchronize by babyplutokurt
45s babyplutokurt:fix_aime_prompt_ingest
babyplutokurt:fix_aime_prompt_ingest
45s
Fix: AIME prompt template and answer extraction Unit Tests #5987: Pull request #3600 synchronize by babyplutokurt
4m 47s babyplutokurt:fix_aime_prompt_ingest
babyplutokurt:fix_aime_prompt_ingest
4m 47s
Fix: AIME prompt template and answer extraction Tasks Modified #6014: Pull request #3600 synchronize by babyplutokurt
41s babyplutokurt:fix_aime_prompt_ingest
babyplutokurt:fix_aime_prompt_ingest
41s
Fix: AIME prompt template and answer extraction Tasks Modified #6013: Pull request #3600 opened by babyplutokurt
37s babyplutokurt:fix_aime_prompt_ingest
babyplutokurt:fix_aime_prompt_ingest
37s
Fix: AIME prompt template and answer extraction Unit Tests #5986: Pull request #3600 opened by babyplutokurt
5m 13s babyplutokurt:fix_aime_prompt_ingest
babyplutokurt:fix_aime_prompt_ingest
5m 13s
fix: handle \[...\] display math delimiters in Hendrycks Math answer extraction Tasks Modified #6012: Pull request #3598 opened by ManasVardhan
Action required ManasVardhan:fix-hendrycks-math-extraction
ManasVardhan:fix-hendrycks-math-extraction
Action required
fix: handle \[...\] display math delimiters in Hendrycks Math answer extraction Unit Tests #5985: Pull request #3598 opened by ManasVardhan
Action required ManasVardhan:fix-hendrycks-math-extraction
ManasVardhan:fix-hendrycks-math-extraction
Action required
fix: Include model identity in response cache keys Unit Tests #5984: Pull request #3597 opened by bledden
Action required bledden:fix/cache-model-identity
bledden:fix/cache-model-identity
Action required
fix: Include model identity in response cache keys Tasks Modified #6011: Pull request #3597 opened by bledden
Action required bledden:fix/cache-model-identity
bledden:fix/cache-model-identity
Action required
Update BLiMP dataset path Unit Tests #5983: Pull request #3596 opened by jmichaelov
4m 57s jmichaelov:patch-6
jmichaelov:patch-6
4m 57s
Update BLiMP dataset path Tasks Modified #6010: Pull request #3596 opened by jmichaelov
43s jmichaelov:patch-6
jmichaelov:patch-6
43s
Update vLLM import of resolve_hf_chat_template Tasks Modified #6009: Pull request #3595 opened by DarkLight1337
10s DarkLight1337:update-resolve-hf-template
DarkLight1337:update-resolve-hf-template
10s
Update vLLM import of resolve_hf_chat_template Unit Tests #5982: Pull request #3595 opened by DarkLight1337
5m 14s DarkLight1337:update-resolve-hf-template
DarkLight1337:update-resolve-hf-template
5m 14s
fix(gpqa): remove bracket-stripping regex that corrupts scientific co… Unit Tests #5981: Pull request #3594 opened by maxidl
5m 10s maxidl:fix/gpqa-bracket-preprocessing
maxidl:fix/gpqa-bracket-preprocessing
5m 10s
fix(gpqa): remove bracket-stripping regex that corrupts scientific co… Tasks Modified #6008: Pull request #3594 opened by maxidl
38s maxidl:fix/gpqa-bracket-preprocessing
maxidl:fix/gpqa-bracket-preprocessing
38s
Hineni Tasks Modified #6007: Pull request #3506 synchronize by Kevinobote
Action required Kevinobote:hineni
Kevinobote:hineni
Action required
Hineni Unit Tests #5980: Pull request #3506 synchronize by Kevinobote
Action required Kevinobote:hineni
Kevinobote:hineni
Action required
Add llama 3 eval configs for GPQA, IFEval, MATH, MGSM, and HellaSwag Tasks Modified #6006: Pull request #3593 opened by ManasVardhan
Action required ManasVardhan:llama3-eval-configs
ManasVardhan:llama3-eval-configs
Action required