Skip to content

feat(#515): add investing eval harness#553

Merged
adolago merged 1 commit intomainfrom
issue-515-eval-harness
Mar 15, 2026
Merged

feat(#515): add investing eval harness#553
adolago merged 1 commit intomainfrom
issue-515-eval-harness

Conversation

@adolago
Copy link
Copy Markdown
Owner

@adolago adolago commented Mar 15, 2026

Summary

  • add persisted investing eval datasets, golden snapshots, and replay runs for research artifacts, earnings packets, and portfolio briefings
  • expose the harness through zee:invest-evals plus zee investing eval dataset ... and zee investing eval run ...
  • document the eval state contract and add regression coverage plus telemetry for dataset and run activity

Validation

  • bash scripts/bun-audit-ci.sh
  • bash scripts/verify-skills.sh
  • bun run --cwd packages/zee typecheck
  • bun test --cwd packages/zee test/investing/evals.test.ts test/investing/thesis-queries.test.ts test/investing/portfolio-briefings.test.ts
  • CI=true bun test --cwd packages/zee --reporter=dots --coverage-reporter=lcov
  • cd packages/zee && bun run build
  • cd packages/zee && ./script/verify-binary.sh
  • exercised zee investing eval dataset create --json and zee investing eval run create --json against the built binary

Closes #515

@adolago adolago merged commit 0a470db into main Mar 15, 2026
5 of 6 checks passed
@adolago adolago deleted the issue-515-eval-harness branch March 15, 2026 16:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[child] evaluation dataset and golden-set harness

1 participant