1.11.4

What's Changed

• [OPIK-5869] [SDK] Bugs in Connect and Endpoint Flow by @collincunn in #6229

Full Changelog: 1.11.3...1.11.4

1.11.3

[NA] [CI] fix: use rtCamp Slack action for vulnerability scan notific…

1.11.2

What's Changed

• [OPIK-5696][TS SDK] Align TS wizard to also save project_name to ~/.opik.config by @yaricom in #6134
• [OPIK-5731] [FE] Add unsaved changes warning to agent configuration editor by @YarivHashaiComet in #6151
• [OPIK-5184] [SDK] feat: Make Prompt and ChatPrompt resilient to backend sync failures by @petrotiurin in #6125
• [OPIK-5732] [FE] Add input validation to agent sandbox to prevent empty submissions by @thiagohora in #6140
• [OPIK-5656] [FE] fix: remove "Run an experiment" CTA from add-to-evaluation-suite toast by @YarivHashaiComet in #6085
• [OPIK-5650] [BE/FE] feat: support evaluation suites in playground by @itamargolan in #6092
• [OPIK-5455] [FE] feat: add Opik logo to v2 onboarding screens by @JetoPistola in #6156
• [OPIK-5758] [FE] fix: persist eval suite experiment state across page refresh by @itamargolan in #6158
• [OPIK-5596] [FE] Unify pairing codes between agent sandbox and Ollie sidebar by @miguelgrc in #6143
• [OPIK-5755] [FE] Remove All time option from v2 logs table time selector by @thiagohora in #6155
• [NA] [SDK] Add env to opik connect by @collincunn in #6144
• [OPIK-5664] [SDK][DOCS] feat: add batching warning docs page and suppress config by @alexkuzmik in #6149
• [OPIK-5733] Fix Online Scoring for traces completed via PATCH by @ldaugusto in #6141
• [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in #6157
• [OPIK-5750] [SDK] feat: add error visibility to runner TUI for crashes and crash loops by @petrotiurin in #6154
• [OPIK-5241] [BE] infra: auto-sync llm-models-default.yaml to CDN on model update by @obezpalko in #6126
• [OPIK-5647] [BE] fix: handle empty Redis stream messages in BaseRedisSubscriber by @andrescrz in #6161
• [NA] [SDK] fix: harden opik export against server-side 429 rate limiting by @dsblank in #6087
• [NA] [DOCS] update docs announcement banner by @cbordz in #6169
• [OPIK-4903] [SDK] feat: add attachment download/upload to opik export/import by @dsblank in #6090
• [NA] [BE] Update model prices file by @CometActions in #6174
• [OPIK-5754] [SDK] fix(runner): validate git repository before running SearchFiles by @petrotiurin in #6163
• [OPIK-5665] [FE] fix: allow collapsing Ollie sidebar in error state by @awkoy in #6159
• [OPIK-5766] [BE] feat: V2 workspace allowlist for gradual rollout by @andrescrz in #6175

Full Changelog: 1.11.1...1.11.2

1.11.1

What's Changed

• [OPIK-5665] [OPIK-5386] [FE] fix: Ollie sidebar error state, retry, and keepalive recovery by @awkoy in #6135
• [OPIK-5639] [FE] Fix nav sidebar not collapsing on resize when Ollie is expanded by @thiagohora in #6136
• [OPIK-5270] [BE][T SDK][P SDK] feat: add exclude support to search spans stream endpoint by @andrescrz in #6133
• [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in #6138
• [OPIK-5664] [E2E] fix: replace span.end() with end_time at creation by @alexkuzmik in #6139
• [OPIK-5664] [SDK] fix: improve batching warning with actionable alternatives by @alexkuzmik in #6142
• [OPIK-5657] [FE] fix: replace eval suite link with plain text on experiment page by @YarivHashaiComet in #6086

Full Changelog: 1.11.0...1.11.1

1.11.0

What's Changed

• [OPIK-5682] [FE] Wire agent config to sandbox run via mask_id by @miguelgrc in #6082
• [OPIK-5407] [FE] fix: rename Assertions to Custom assertions in eval suite items by @awkoy in #6111
• [NA] [FE] fix: bypass manifest fetch in dev mode for hot reload by @awkoy in #6110
• [issue-5397] [BE] Make ClickHouse health check timeout configurable by @dsblank in #5414
• [OPIK-5707] [BE] Fix eval suite dataset storing empty data for non-object trace input by @LifeXplorer in #6109
• [NA] [BE] [SDK] Opik Connect by @collincunn in #6108
• [NA] [BE][FE] chore: sync provider model definitions by @CometActions in #6118
• [NA] [BE] Update model prices file by @CometActions in #6117
• [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in #6121
• [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in #6116
• [OPIK-5704] [BE][SDK] fix: dataset items not returned for datasets created without project_name by @thiagohora in #6115
• [OPIK-5699] [P SDK] feat: inherit project_name from context for all Opik operations by @alexkuzmik in #6106
• [OPIK-5629] [SDK] feat: warn on unresolvable entrypoint parameter types by @petrotiurin in #6113
• [OPIK-5683] [P SDK] opik configure does NOT save project_name (Python) by @yaricom in #6093
• [OPIK-5270] [BE] perf: skip feedback score CTEs in SpanDAO when excluded by @andrescrz in #6124
• [OPIK-5716] [BE] feat: create new blueprint from mask changes delta by @BorisTkachenko in #6122
• [OPIK-5020] [BE] feat: wire model registry into provider routing and add remote refresh by @AndreiCautisanu in #5863
• [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in #6127
• [OPIK-5664] [SDK] feat: global client management API with context-wise propagation and batching warning by @alexkuzmik in #6123
• [OPIK-5633] [FE] Remove clickable link from trace count in experiments table by @miguelgrc in #6114
• [OPIK-5385]: create eval suites improvement; by @aadereiko in #6054
• [OPIK-4972] [BE] feat: update demo data to only create Opik Demo Agent Observability project by @thiagohora in #5861
• [OPIK-5689] [BE] fix: stop retrying rate-limited LLM calls and reduce log verbosity by @ldaugusto in #6132

Full Changelog: 1.10.60...1.11.0

1.10.60

What's Changed

• [OPIK-5655] [Evaluation Suite] Evaluation suite task should support returning just the agent output by @yaricom in #6073
• [OPIK-5270] [BE][T SDK][P SDK] feat: add exclude support to search traces stream endpoint by @andrescrz in #6098
• [OPIK-5399] [FE] fix: pass search params from assistant sidebar navigate events to router by @awkoy in #6099
• [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in #6102
• [NA] [BE] [SDK] Opik Connect by @collincunn in #6074
• Revert "[NA] [BE] [SDK] Opik Connect" by @Nimrod007 in #6103
• [NA] [DOCS] Add live reference deployment and ingestion best practices to scaling guide by @Nimrod007 in #6100
• [DND-843][HELM]Add custom podMetrics support to HPA template by @liyaka in #6094
• [OPIK-5372] [FE] Add searchable configuration selector in Agent Sandbox by @miguelgrc in #6089
• [OPIK-5270] [E2E][T SDK] test: add exclude parameter tests for search traces by @andrescrz in #6105
• [NA] [FE] Send project onboarding stats to assistant bridge by @Lothiraldan in #6067
• [OPIK-5270] [BE] perf: optimize feedback score CTE pipeline to reduce memory overhead by @andrescrz in #6107

Full Changelog: 1.10.59...1.10.60

1.10.59

What's Changed

• [NA] [TS SDK] feat: indexed keys in LLMJudge schema, reasoning_effort, and UX improvements by @alexkuzmik in #6011
• [OPIK-5452] [SDK] feat: warn when runner process exits without blocking by @petrotiurin in #6021
• [OPIK-5297] [OPTIMIZER SDK] Update BaseOptimizer._create_optimization_run() to pass project_name to the OpikClient by @yaricom in #5956
• [OPIK-5427] [FE] Prettify agent sandbox output with SyntaxHighlighter by @miguelgrc in #6009
• [OPIK-5491] [BE] feat: make intervalEnd optional for KPI cards endpoint by @BorisTkachenko in #6028
• [OPIK-5457] [BE] Local Runner pairing code TTLs default to 1 hour. by @collincunn in #6016
• [OPIK-5339] [BE] feat: add status filter to get local runners endpoint by @BorisTkachenko in #6001
• [OPIK-5553][FE]: fix a bug with experiments; by @aadereiko in #6032
• [NA] [BE] Fix high cost metrics calculation by @thiagohora in #5965
• [OPIK-5479] [FE] fix: clear cached pair code on runner connection by @ldaugusto in #6035
• [OPIK-5476] [OPIK-5443] [FE] feat: v2 sidebar & navigation UX reverts + workspace-level sidebar by @andriidudar in #6034
• [OPIK-5496] [SDK] configure(force=True) still prompts interactively for workspace by @yaricom in #6033
• [OPIK-000] [BE] Fix GeneratePairingCode.createsValidCode test by @BorisTkachenko in #6046
• [OPIK-5389] [FE] Disable "Use suite" button when evaluation suite is empty by @miguelgrc in #6010
• [OPIK-4647] [FE] Redesign Agent Runner UI by @miguelgrc in #6041
• [OPIK-5582][FE]: add avatars to projects; by @aadereiko in #6043
• [OPIK-5431] [BE] Fix IS_EMPTY/IS_NOT_EMPTY filters for DICTIONARY field type by @thiagohora in #6042
• [OPIK-5430] [FE] fix: grouping experiments by tags shows experiments from other projects by @thiagohora in #6040
• [OPIK-5882]: remove a separator for collapsed menu, and remove shrinking of icons; by @aadereiko in #6048
• [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in #6047
• [OPIK-5605] Fix duplicated Online Scoring evaluations for partial traces by @ldaugusto in #6049
• [OPIK-5614] [SDK] fix: use actual project name from backend when retrieving datasets by @alexkuzmik in #6050
• [OPIK-5482] [BE] [SDK] fix: return 200 with null body instead of 204 for next job endpoint by @BorisTkachenko in #6052
• [OPIK-5499] [SDK] update_current_trace not exported at top-level opik module by @yaricom in #6056
• [OPIK-5535] Fix 403 on get_blueprint() when resolving project by name by @ldaugusto in #6051
• [OPIK-5619] [BE] fix: add workspace-wide fallback header for dataset item streaming by @thiagohora in #6060
• [OPIK-5599] [BE] Fix experiment items not displayed after evaluation suite deletion by @thiagohora in #6053
• [OPIK-5500] [SDK] AgentConfigManager.update_blueprint() fails with TypeError on string values by @yaricom in #6063
• [OPIK-5624] [BE/FE] fix: restore assertion_results in experiment items after evaluation suite deletion by @thiagohora in #6064
• [OPIK-5495] [SDK] opik.configure() parameter url mismatches config file url_override by @yaricom in #6065
• [NA] [BE] Update model prices file by @CometActions in #6069
• [OPIK-5658] [FE] fix: align KPI metrics logsSource filter with traces table by @thiagohora in #6072
• [OPIK-5649] [BE] fix: only include trace input when adding to evaluation suite by @itamargolan in #6068
• [OPIK-5374] [GHA] fix: skip empty PRs in peter-evans/create-pull-request workflows by @JetoPistola in #5995
• [OPIK-5678] [BE] fix: guard filter binding by metric type in project metrics by @LifeXplorer in #6084
• [NA] [BE][FE] chore: sync provider model definitions by @CometActions in #6096
• [NA] [BE] Update model prices file by @CometActions in #6095
• [OPIK-5628] [FE] Clear stale job state on sandbox disconnect by @miguelgrc in #6091
• [NA] [E2E] fix: 3 e2e test failures by @AndreiCautisanu in #6088
• [OPIK-5437] [BE] fix: correct agent configuration version ordering by @BorisTkachenko in #6071
• [NA] [SDK] chore: remove unused LocalRunnerTask class by @petrotiurin in #6037

Full Changelog: 1.10.58...1.10.59

1.10.58

What's Changed

• [OPIK-4828] [BE] Fix thread view shows no data message but then eventually loads by @thiagohora in #5954
• [OPIK-5223][FE]: kpi cards; by @aadereiko in #6013
• [OPIK-5326] [SDK] feat: cast job input values to declared param types in runner by @petrotiurin in #5952
• [OPIK-5488] [FE] Update onboarding prompt to use /instrument and include workspace by @juanferrub in #6022
• [NA] fix: restore migration 000061 and split index change into 000062 by @ldaugusto in #6023
• [NA] [E2E] fix: increase online scoring test timeouts for GitHub-hosted runners by @AndreiCautisanu in #6024

Full Changelog: 1.10.57...1.10.58

1.10.57

What's Changed

• [NA] [CI] chore: downsize CI runners from ubuntu-latest-m to ubuntu-latest by @petrotiurin in #5990
• [OPIK-5027] [FE] fix: TraceLogsSidebar UX feedback iteration by @andriidudar in #5989
• [OPIK-5361] [INFRA] feat: enhance create-jira-ticket skill with story points, sprint, due date, and epic selection by @JetoPistola in #5982
• [OPIK-5370] [BE] fix: preserve source column in trace bulk update by @andriidudar in #5992
• [OPIK-5368] [INFRA] chore: add figma_screenshots/ to .gitignore by @JetoPistola in #5994
• [OPIK-5336] [BE] feat: add delete configuration parameters endpoint by @BorisTkachenko in #5986
• [OPIK-5378] [CI] chore: downsize Python SDK E2E test runners from ubuntu-latest-m to ubuntu-latest by @petrotiurin in #5991
• [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in #5997
• [OPIK-5247] [BE] fix: preserve assertion results and status after experiment item aggregation by @thiagohora in #5999
• [OPIK-5379] [FE] fix: disable spans link for non-SDK traces by @andriidudar in #5998
• [OPIK-5282] [SDK] feat: capture runner job stdout/stderr and stream to backend by @petrotiurin in #5976
• [OPIK-5360] [FE] fix: collapse ResizableSidePanel width when closed to prevent scroll overflow by @andriidudar in #6003
• [OPIK-5244] [FE] fix: remove v2 import from plugin GetStartedPage to enforce v1/v2 isolation by @andriidudar in #5996
• [OPIK-5240][FE]: redesign logs table by @aadereiko in #5959
• [OPIK-5429] [FE] fix: set source=experiment for playground-initiated experiment traces by @andriidudar in #6005
• [OPIK-5432] [FE] fix: resolve endless loop when returning from Annotate screen by @andriidudar in #6006
• [OPIK-5205] [SDK] fix: improve error messages for opik connect CLI command by @petrotiurin in #6004
• [NA] [SDK] CLI import/export improvements by @dsblank in #5616
• [NA] [BE][FE] chore: sync provider model definitions by @CometActions in #6015
• [OPIK-5270] [BE] [FE] fix: skip feedback score CTEs when excluded by @andrescrz in #6012

Full Changelog: 1.10.56...1.10.57

1.10.56

What's Changed

• [OPIK-5273] [BE] feat: add new project metrics for interactive chart by @BorisTkachenko in #5949
• [NA] [FE] fix: show only regular experiments on experiments page by @awkoy in #5957
• [OPIK-5321] [FE] Fix incorrect sizing in playground prompt header section by @miguelgrc in #5951
• [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in #5953
• [OPIK-5327] [BE] feat: support in-flight trace_id reporting for runner jobs by @BorisTkachenko in #5958
• [OPIK-5027] [FE] feat: TraceLogsSidebar — full traces table in Sheet overlay by @andriidudar in #5962
• [NA] [FE] chore: IA revamp cleanup — git blame ignore + stale skill removal by @andriidudar in #5969
• [OPIK-5206] [BE] feat: consume EM opikVersion for workspace version determination by @andrescrz in #5964
• [OPIK-5206] [FE] feat: enable workspace version endpoint integration by @andrescrz in #5970
• [OPIK-5307] [OPIK-5308] [FE] Add Agent Sandbox page by @JetoPistola in #5947
• [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @CometActions in #5972
• [OPIK-5312] [FE] feat: add loading state to assistant sidebar by @awkoy in #5961
• [OPIK-5334] [FE] Use active project scope and reset playground state on project switch by @miguelgrc in #5974
• [NA] [FE] feat: pass organizationId through assistant bridge context by @LifeXplorer in #5968
• [OPIK-5325] [SDK] feat: report running status before local runner job execution by @petrotiurin in #5950
• [OPIK-5305] [FE] fix: show dashboard resize handle on hover only by @andriidudar in #5971
• [OPIK-5309] [FE] feat: add trace trajectory and span inspection to Agent Sandbox by @JetoPistola in #5978
• [OPIK-5206] [BE] feat: add V1 entity check for alerts in workspace version by @andrescrz in #5975
• [NA] [BE][FE] chore: sync provider model definitions by @CometActions in #5981
• [OPIK-5191] [BE] feat: add user identity to ClickHouse log_comment by @Nimrod007 in #5778

Full Changelog: 1.10.55...1.10.56