Skip to content
This repository was archived by the owner on Jun 5, 2025. It is now read-only.

Use claude3.5 haiku instead of sonnet for Anthropic tests #928

Merged
rdimitrov merged 2 commits into from
Feb 5, 2025
Merged

Use claude3.5 haiku instead of sonnet for Anthropic tests #928

Changes from 1 commit
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
353422c
Use claude3.5 haiku instead of sonnet for Anthropic tests
rdimitrov Feb 5, 2025
52cd463
Merge branch 'main' into haiku
rdimitrov Feb 5, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions tests/integration/anthropic/testcases.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ testcases:
"role":"user"
}
],
"model":"claude-3-5-sonnet-20241022",
"model":"claude-3-5-haiku-20241022",
Copy link
Copy Markdown
Contributor

@jhrozek jhrozek Feb 5, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder if we could just strip the date prefix and use latest (see https://docs.anthropic.com/en/docs/about-claude/models) or if it would surprise us in the future.

Copy link
Copy Markdown
Member Author

@rdimitrov rdimitrov Feb 5, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I had the same concern too and decided to stick to this one until we can 👍

"stream":true,
"temperature":0
}
Expand All @@ -36,7 +36,7 @@ testcases:
"top_k": 50,
"temperature": 0,
"max_tokens": 4096,
"model": "claude-3-5-sonnet-20241022",
"model": "claude-3-5-haiku-20241022",
"stop_sequences": [
"</COMPLETION>",
"/src/",
Expand Down Expand Up @@ -78,7 +78,7 @@ testcases:
"role":"user"
}
],
"model":"claude-3-5-sonnet-20241022",
"model":"claude-3-5-haiku-20241022",
"stream":true
}
contains: |
Expand Down