[OPIK-5650] [BE/FE] feat: support evaluation suites in playground#6092

Merged

itamargolan merged 41 commits intomainfrom

itamarg/OPIK-5650/support-eval-suites-in-playground

Apr 9, 2026

Commits on Apr 7, 2026

fix: eliminate N+1 item evaluator queries and update dialog text

itamargolan
and
claude
committed
fix: remove dead eval-suite code from FE-orchestrated playground path

itamargolan
and
claude
committed
fix: add missing USER_NAME to reactive context for item-level evaluators

itamargolan
and
claude
committed
fix: address PR review comments and add eval suite polling support

itamargolan
and
claude
committed
fix: add @Builder and @NonNull to EvalSuiteAssertionSampler DTOs

itamargolan
and
claude
committed
fix: address 5 new baz reviewer comments

itamargolan
and
claude
committed
fix: add @NotNull to scoreNameMapping and datasetId, remove manual null checks

itamargolan
and
claude
committed
fix: externalize hardcoded constants to Dropwizard config

itamargolan
and
claude
committed
fix: refactor EvalSuiteAssertionSampler to stream API and add block timeout

itamargolan
and
claude
committed
fix: make service layer reactive, stream dataset items, remove bulk evaluator fetch

itamargolan
and
claude
committed
fix: add PythonTemplateParser and route PromptType through scoring pipeline

itamargolan
and
claude
committed
refactor: migrate experiment execution from in-process ExecutorService to Redis Streams

itamargolan
and
claude
committed
fix: use proper imports and mark experiments CANCELLED on finish failure

itamargolan
and
claude
committed
refactor: split ExperimentItemProcessor into focused components

itamargolan
and
claude
committed
fix: address PR review comments — DI, dead code, test quality

itamargolan
and
claude
committed
fix: address FE PR review comments for playground eval suite support

itamargolan
and
claude
committed
fix: rename schema fields to stable assertion_N keys for LLM structured output

itamargolan
and
claude
committed
Merge remote-tracking branch 'origin/main' into itamarg/OPIK-5650/support-eval-suites-in-playground
itamargolan
committed
fix: address PR review comments, add PromptType.PYTHON migration, fix playground refresh bug

itamargolan
and
claude
committed
fix(test): stub finishExperiments and update in EmptyDataset test

itamargolan
and
claude
committed
fix: add --comment and trailing newline to migration per convention

itamargolan
and
claude
committed
fix(test): set explicit DatasetType.DATASET in DatasetsResourceCreateFromSpansTest

itamargolan
and
claude
committed

Commits on Apr 8, 2026