[OPIK-4972] [BE] feat: update demo data to only create Opik Demo Agent Observability project by thiagohora · Pull Request #5861 · comet-ml/opik

thiagohora · 2026-03-25T17:28:01Z

Details

Simplifies demo data creation to a single project. Previously, four demo projects were created on signup: Opik Demo Agent Observability, Opik Demo Assistant, Opik Demo Optimizer, and playground. This change removes the three extra projects and keeps only "Opik Demo Agent Observability" as the single demo project.

Remove create_demo_evaluation_project, create_demo_optimizer_project, and create_demo_playground_project from the Python backend demo data generator
Clean up all now-unused imports and DemoDataContext dataclass fields
Update the DEMO_PROJECT_NAME frontend constant to match the single demo project name
Upgrade opik SDK to 1.10.56 (aligns with opik 2.0 SDK) in both opik-python-backend and opik-sandbox-executor-python, updating all pinned dependencies to their resolved versions
Add ENV LITELLM_MODE=PRODUCTION to the sandbox Dockerfile to prevent litellm from calling load_dotenv() at import time in a .pyc-only context

DemoData.java (Java backend BI exclusion list) is intentionally kept unchanged for backward compatibility with existing workspaces that already have the old demo projects.

Change checklist

User facing
Documentation update

Issues

OPIK-4972

AI-WATERMARK

AI-WATERMARK: yes

If yes:
- Tools: Claude Code
- Model(s): claude-sonnet-4-6
- Scope: full implementation
- Human verification: code review + manual testing

Testing

pytest tests/ — 69/69 Python backend tests passed
npm run test — 1254/1254 frontend tests passed (2 pre-existing failures in langchain/mapper.test.ts and openai/mapper.test.ts are unrelated: missing react-h5-audio-player dependency)
npm run lint — passed cleanly
Verified DEMO_PROJECT_NAME constant update is reflected in useDemoProject hook

Documentation

N/A

…t Observability project - Remove demo evaluation, optimizer, and playground project creation - Clean up unused imports and DemoDataContext fields in demo_data_generator.py - Update DEMO_PROJECT_NAME constant to match the single demo project name Implements OPIK-4972: [M3] Frontend: Update demo data with project-scoped, environment-tagged traces

apps/opik-frontend/src/constants/shared.ts

…from demo_data.py

github-actions · 2026-03-26T10:43:24Z

🔄 Test environment deployment process has started

Phase 1: Deploying base version 1.10.51-4655 (from main branch) if environment doesn't exist
Phase 2: Building new images from PR branch thiaghora/OPIK-4972-update-demo-data-single-project
Phase 3: Will deploy newly built version after build completes

You can monitor the progress here.

CometActions · 2026-03-26T10:51:26Z

✅ Test environment is now available!

To configure additional Environment variables for your environment, run [Deploy Opik AdHoc Environment workflow] (https://github.com/comet-ml/comet-deployment/actions/workflows/deploy_opik_adhoc_env.yaml)

Access Information

URL: https://pr-5861.dev.comet.com
Cluster: comet-ml-development
Namespace: pr-5861
Version: 1.10.51-5861-merge-1688
Application logs: View in Grafana

The deployment has completed successfully and the version has been verified.

github-actions · 2026-03-26T11:27:17Z

🔄 Test environment deployment process has started

Phase 1: Deploying base version 1.10.51-4655 (from main branch) if environment doesn't exist
Phase 2: Building new images from PR branch thiaghora/OPIK-4972-update-demo-data-single-project
Phase 3: Will deploy newly built version after build completes

You can monitor the progress here.

CometActions · 2026-03-26T11:34:51Z

✅ Test environment is now available!

To configure additional Environment variables for your environment, run [Deploy Opik AdHoc Environment workflow] (https://github.com/comet-ml/comet-deployment/actions/workflows/deploy_opik_adhoc_env.yaml)

Access Information

URL: https://pr-5861.dev.comet.com
Cluster: comet-ml-development
Namespace: pr-5861
Version: 1.10.51-5861-merge-1690
Application logs: View in Grafana

The deployment has completed successfully and the version has been verified.

aadereiko

The FE part looks good to go. Just make sure that Demo Project isn't queried from anywhere

CometActions · 2026-03-27T04:53:05Z

🌙 Nightly cleanup: The test environment for this PR (pr-5861) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

andrescrz

Please double check the open comment.

apps/opik-frontend/src/constants/shared.ts

CometActions · 2026-03-28T04:42:57Z

🌙 Nightly cleanup: The test environment for this PR (pr-5861) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

CometActions · 2026-03-29T04:56:47Z

🌙 Nightly cleanup: The test environment for this PR (pr-5861) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

CometActions · 2026-03-30T05:04:37Z

🌙 Nightly cleanup: The test environment for this PR (pr-5861) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

…project

github-actions · 2026-03-30T07:13:50Z

Python Backend Tests Results

165 tests 162 ✅ 3m 10s ⏱️
1 suites 3 💤
1 files 0 ❌

Results for commit f681bf7.

♻️ This comment has been updated with latest results.

CometActions · 2026-03-31T04:54:24Z

🌙 Nightly cleanup: The test environment for this PR (pr-5861) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

- Bump opik to 1.10.56 in opik-python-backend/requirements.txt - Upgrade all dependencies in opik-sandbox-executor-python/requirements.txt to exact versions resolved from opik==1.10.56 dependency graph (notable: litellm 1.83.0, openai 2.30.0, python-dotenv 1.2.2) - Add ENV LITELLM_MODE=PRODUCTION to sandbox Dockerfile to prevent litellm from calling load_dotenv() at import time; litellm defaults LITELLM_MODE to "DEV" and calls load_dotenv() in that mode, whose find_dotenv() uses frame inspection (sys._getframe) that fails in a .pyc-only context

…andbox Update pinned versions to match those resolved from opik==1.10.56: - certifi: 2024.12.14 -> 2026.2.25 - charset-normalizer: 3.4.1 -> 3.4.6 - click: 8.1.8 -> 8.3.1 - idna: 3.10 -> 3.11 - MarkupSafe: 3.0.2 -> 3.0.3 - packaging: 24.2 -> 26.0 - requests: 2.32.3 -> 2.33.1 - uuid6: 2024.7.10 -> 2025.0.1

apps/opik-python-backend/requirements.txt

…esult schema opik 1.10.56 added a category_name field to ScoreResult. Update the expected dicts in test_success parametrize to include category_name: None.

…None opik 1.10.56 added category_name to ScoreResult but the Docker image in CI may use an older opik version without it. Assert category_name is None when present and compare remaining fields, so both executor variants pass.

CometActions · 2026-04-01T05:04:57Z

🌙 Nightly cleanup: The test environment for this PR (pr-5861) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

CometActions · 2026-04-02T04:51:31Z

🌙 Nightly cleanup: The test environment for this PR (pr-5861) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

CometActions · 2026-04-03T04:51:13Z

🌙 Nightly cleanup: The test environment for this PR (pr-5861) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

CometActions · 2026-04-04T04:42:05Z

🌙 Nightly cleanup: The test environment for this PR (pr-5861) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

CometActions · 2026-04-05T04:57:07Z

🌙 Nightly cleanup: The test environment for this PR (pr-5861) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

CometActions · 2026-04-06T05:02:31Z

🌙 Nightly cleanup: The test environment for this PR (pr-5861) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

CometActions · 2026-04-07T04:53:40Z

🌙 Nightly cleanup: The test environment for this PR (pr-5861) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

andrescrz

LGTM, I recommend decoupling the PRs for the demo data and the upgrades and fixes on the images.

andrescrz · 2026-04-07T09:10:58Z

apps/opik-python-backend/requirements.txt

I recommend sending these changes below (dependencies, image changes) in a separated PR.

Not a blocker.

CometActions · 2026-04-08T04:57:02Z

🌙 Nightly cleanup: The test environment for this PR (pr-5861) has been cleaned up to free cluster resources. PVCs are preserved — re-deploy to restore the environment.

github-actions bot added python Pull requests that update Python code Frontend Backend typescript *.ts *.tsx labels Mar 25, 2026

github-actions bot assigned thiagohora Mar 25, 2026

baz-reviewer bot reviewed Mar 25, 2026

View reviewed changes

apps/opik-frontend/src/constants/shared.ts Outdated Show resolved Hide resolved

refactor(demo-data): remove unused experiment/dataset/optimizer data …

29fef99

…from demo_data.py

github-actions bot added the tests Including test files, or tests related like configuration. label Mar 25, 2026

thiagohora marked this pull request as ready for review March 25, 2026 17:39

thiagohora requested a review from a team as a code owner March 25, 2026 17:39

thiagohora added the test-environment Deploy Opik adhoc environment label Mar 26, 2026

thiagohora added test-environment Deploy Opik adhoc environment and removed test-environment Deploy Opik adhoc environment labels Mar 26, 2026

aadereiko reviewed Mar 26, 2026

View reviewed changes

CometActions removed the test-environment Deploy Opik adhoc environment label Mar 27, 2026

andrescrz reviewed Mar 27, 2026

View reviewed changes

apps/opik-frontend/src/constants/shared.ts Outdated Show resolved Hide resolved

Update shared.ts

fcce103

thiagohora requested review from aadereiko and andrescrz March 27, 2026 15:53

github-actions bot removed Frontend typescript *.ts *.tsx labels Mar 27, 2026

baz-reviewer bot approved these changes Mar 27, 2026

View reviewed changes

Merge branch 'main' into thiaghora/OPIK-4972-update-demo-data-single-…

f9ea1a9

…project

andrescrz previously approved these changes Mar 30, 2026

View reviewed changes

thiagohora dismissed andrescrz’s stale review via 94fa621 March 31, 2026 17:04

github-actions bot added dependencies Pull requests that update a dependency file Infrastructure labels Mar 31, 2026

baz-reviewer bot reviewed Mar 31, 2026

View reviewed changes

apps/opik-python-backend/requirements.txt Show resolved Hide resolved

thiagohora added 2 commits March 31, 2026 21:13

[OPIK-4972] [SDK] Fix test_success assertions for opik 1.10.56 ScoreR…

0bf6149

…esult schema opik 1.10.56 added a category_name field to ScoreResult. Update the expected dicts in test_success parametrize to include category_name: None.

baz-reviewer bot approved these changes Mar 31, 2026

View reviewed changes

andrescrz approved these changes Apr 7, 2026

View reviewed changes

thiagohora merged commit d3b3c4f into main Apr 8, 2026
11 checks passed

thiagohora deleted the thiaghora/OPIK-4972-update-demo-data-single-project branch April 8, 2026 14:19

Conversation

thiagohora commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Details

Change checklist

Issues

AI-WATERMARK

Testing

Documentation

Uh oh!

Uh oh!

github-actions bot commented Mar 26, 2026

Uh oh!

CometActions commented Mar 26, 2026

Access Information

Uh oh!

github-actions bot commented Mar 26, 2026

Uh oh!

CometActions commented Mar 26, 2026

Access Information

Uh oh!

aadereiko left a comment

Choose a reason for hiding this comment

Uh oh!

CometActions commented Mar 27, 2026

Uh oh!

andrescrz left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

CometActions commented Mar 28, 2026

Uh oh!

CometActions commented Mar 29, 2026

Uh oh!

CometActions commented Mar 30, 2026

Uh oh!

github-actions bot commented Mar 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Python Backend Tests Results

Uh oh!

CometActions commented Mar 31, 2026

Uh oh!

Uh oh!

CometActions commented Apr 1, 2026

Uh oh!

CometActions commented Apr 2, 2026

Uh oh!

CometActions commented Apr 3, 2026

Uh oh!

CometActions commented Apr 4, 2026

Uh oh!

CometActions commented Apr 5, 2026

Uh oh!

CometActions commented Apr 6, 2026

Uh oh!

CometActions commented Apr 7, 2026

Uh oh!

andrescrz left a comment

Choose a reason for hiding this comment

Uh oh!

andrescrz Apr 7, 2026

Choose a reason for hiding this comment

Uh oh!

CometActions commented Apr 8, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

thiagohora commented Mar 25, 2026 •

edited

Loading

github-actions bot commented Mar 30, 2026 •

edited

Loading