WIP by mnoukhov · Pull Request #1555 · allenai/open-instruct

mnoukhov · 2026-03-24T02:56:49Z

No description provided.

…/olmo3-rlzero

This reverts commit 100c27c.

…s_at_k

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

…o eval_pass_at_k

…-merge

github-actions · 2026-03-26T19:14:33Z

Documentation Changes Detected

📄 404.html

--- site-base/404.html	2026-03-26 19:14:32.479364959 +0000
+++ site-pr/404.html	2026-03-26 19:14:20.215211383 +0000
@@ -15,7 +15,7 @@
       
       
       <link rel="icon" href="/allenai/open-instruct/assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

📄 DGX_SPARK/index.html

--- site-base/DGX_SPARK/index.html	2026-03-26 19:14:32.479489834 +0000
+++ site-pr/DGX_SPARK/index.html	2026-03-26 19:14:20.215376783 +0000
@@ -17,7 +17,7 @@
       
       
       <link rel="icon" href="../assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

📄 ai2_internal/index.html

--- site-base/ai2_internal/index.html	2026-03-26 19:14:32.479581967 +0000
+++ site-pr/ai2_internal/index.html	2026-03-26 19:14:20.215488453 +0000
@@ -17,7 +17,7 @@
       
       
       <link rel="icon" href="../assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

📄 algorithms/dataset_transformation/index.html

--- site-base/algorithms/dataset_transformation/index.html	2026-03-26 19:14:32.473352422 +0000
+++ site-pr/algorithms/dataset_transformation/index.html	2026-03-26 19:14:20.207562978 +0000
@@ -21,7 +21,7 @@
       
       
       <link rel="icon" href="../../assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

📄 algorithms/dpo/index.html

--- site-base/algorithms/dpo/index.html	2026-03-26 19:14:32.453153911 +0000
+++ site-pr/algorithms/dpo/index.html	2026-03-26 19:14:20.184047624 +0000
@@ -21,7 +21,7 @@
       
       
       <link rel="icon" href="../../assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

Showing first 10 lines of diff for each changed file (up to 5 files, excluding search indices).

…-merge

github-actions · 2026-03-28T19:20:39Z

Documentation Changes Detected

📄 404.html

--- site-base/404.html	2026-03-28 19:20:38.059731661 +0000
+++ site-pr/404.html	2026-03-28 19:20:27.338636131 +0000
@@ -15,7 +15,7 @@
       
       
       <link rel="icon" href="/allenai/open-instruct/assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

📄 DGX_SPARK/index.html

--- site-base/DGX_SPARK/index.html	2026-03-28 19:20:38.142001111 +0000
+++ site-pr/DGX_SPARK/index.html	2026-03-28 19:20:27.338818853 +0000
@@ -17,7 +17,7 @@
       
       
       <link rel="icon" href="../assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

📄 ai2_internal/index.html

--- site-base/ai2_internal/index.html	2026-03-28 19:20:38.142119724 +0000
+++ site-pr/ai2_internal/index.html	2026-03-28 19:20:27.338902550 +0000
@@ -17,7 +17,7 @@
       
       
       <link rel="icon" href="../assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

📄 algorithms/dataset_transformation/index.html

--- site-base/algorithms/dataset_transformation/index.html	2026-03-28 19:20:38.137298298 +0000
+++ site-pr/algorithms/dataset_transformation/index.html	2026-03-28 19:20:27.334315626 +0000
@@ -21,7 +21,7 @@
       
       
       <link rel="icon" href="../../assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

📄 algorithms/dpo/index.html

--- site-base/algorithms/dpo/index.html	2026-03-28 19:20:38.062819692 +0000
+++ site-pr/algorithms/dpo/index.html	2026-03-28 19:20:27.323396809 +0000
@@ -21,7 +21,7 @@
       
       
       <link rel="icon" href="../../assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

Showing first 10 lines of diff for each changed file (up to 5 files, excluding search indices).

github-actions · 2026-03-30T00:46:15Z

Documentation Changes Detected

📄 404.html

--- site-base/404.html	2026-03-30 00:46:14.805366947 +0000
+++ site-pr/404.html	2026-03-30 00:46:03.046424996 +0000
@@ -15,7 +15,7 @@
       
       
       <link rel="icon" href="/allenai/open-instruct/assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

📄 DGX_SPARK/index.html

--- site-base/DGX_SPARK/index.html	2026-03-30 00:46:14.805480270 +0000
+++ site-pr/DGX_SPARK/index.html	2026-03-30 00:46:03.046539040 +0000
@@ -17,7 +17,7 @@
       
       
       <link rel="icon" href="../assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

📄 ai2_internal/index.html

--- site-base/ai2_internal/index.html	2026-03-30 00:46:14.805563616 +0000
+++ site-pr/ai2_internal/index.html	2026-03-30 00:46:03.046624690 +0000
@@ -17,7 +17,7 @@
       
       
       <link rel="icon" href="../assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

📄 algorithms/dataset_transformation/index.html

--- site-base/algorithms/dataset_transformation/index.html	2026-03-30 00:46:14.801016821 +0000
+++ site-pr/algorithms/dataset_transformation/index.html	2026-03-30 00:46:03.042026899 +0000
@@ -21,7 +21,7 @@
       
       
       <link rel="icon" href="../../assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

📄 algorithms/dpo/index.html

--- site-base/algorithms/dpo/index.html	2026-03-30 00:46:14.790468945 +0000
+++ site-pr/algorithms/dpo/index.html	2026-03-30 00:46:03.031394252 +0000
@@ -21,7 +21,7 @@
       
       
       <link rel="icon" href="../../assets/favicon.ico">
-      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.1">
+      <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.6">

Showing first 10 lines of diff for each changed file (up to 5 files, excluding search indices).

mnoukhov and others added 30 commits December 10, 2025 20:01

Merge branch 'main' of github.com:allenai/open-instruct into michaeln…

ea2dcf8

…/olmo3-rlzero

final script

217b25d

deepscaler comparison

d68df80

Merge branch 'main' of github.com:allenai/open-instruct into michaeln…

97a6554

…/olmo3-rlzero

rlzero final

218c999

max episodes 3k steps

966f9b8

scripts

e651b4d

4b

26cd5c2

single node mixed GPUs

f53cfc7

Merge branch 'main' of github.com:allenai/open-instruct into smolzero

e280d94

4 gpu

162127b

check in stuff

2a431b9

Merge branch 'main' of github.com:allenai/open-instruct into smolzero

eeb5dc1

User prompt transform

08b715a

pass at k for local eval

100c27c

Revert "pass at k for local eval"

0b5ddd1

This reverts commit 100c27c.

runeval script

1dd0e35

Merge branch 'main' of github.com:allenai/open-instruct into smolzero

4aba6d3

docker and makefile

78439de

4b script

9431e23

Add eval model-step drift metrics and queue safety

24a5ed2

Refine eval model-step drift metrics to diff-only

4dcf945

Remove user_prompt_transform wiring

22ca41a

Merge branch 'main' of github.com:allenai/open-instruct into eval_pas…

0978739

…s_at_k

cleanup

1d91b2d

weight sync trigger, cleaner

361c061

Apply suggestion from @gemini-code-assist[bot]

9de1c3c

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

undo change

621971a

Merge branch 'eval_pass_at_k' of github.com:allenai/open-instruct int…

7aadb5b

…o eval_pass_at_k

updates

8c5273a

mnoukhov added 3 commits March 26, 2026 17:16

switch to cuda 12.8 flash attn

bafc9f6

Merge branch 'main' of github.com:allenai/open-instruct into smolzero…

cd4c0fc

…-merge

fix

c92c190

mnoukhov added 9 commits March 26, 2026 19:17

tv use with vllm logprobs

8d0fed0

remove flash attention env

1e5456e

eval only working

38ac5dd

fa2

ed02646

fa2 and eval length correct

b02aca4

analysis

9f30e3c

Merge branch 'main' of github.com:allenai/open-instruct into smolzero…

1d0200c

…-merge

fa3 default

cc2274d

uv lock

1745f4c

add back flash-attn 2

0100092

mnoukhov and others added 14 commits March 30, 2026 15:33

clean scripts

17cf60f

dumb stuff

a6dd363

update scripts

172beee

fix script

2c1838a

token tv div

ea0eee0

filtered and unfiltered prompt dataset tracking

dfbfe2d

ngu

f8b7f5a

retry prompt id fix

d3fc60e

beaker update

69fe997

whatever

67a9de9

fix script

a763a5a

num gpus

86ded65

per dataset filtered logging

7d32b92

add back chat template

d5883e2

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

WIP#1555

WIP#1555
mnoukhov wants to merge 262 commits intomainfrom
smolzero-merge

mnoukhov commented Mar 24, 2026

Uh oh!

github-actions Bot commented Mar 26, 2026

Uh oh!

github-actions Bot commented Mar 28, 2026

Uh oh!

github-actions Bot commented Mar 30, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

mnoukhov commented Mar 24, 2026

Uh oh!

github-actions Bot commented Mar 26, 2026

Documentation Changes Detected

Uh oh!

github-actions Bot commented Mar 28, 2026

Documentation Changes Detected

Uh oh!

github-actions Bot commented Mar 30, 2026

Documentation Changes Detected

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants