Skip to content

Comments

Mark model input as dynamically sized#105

Merged
epwalsh merged 3 commits intomainfrom
epwalsh/compile-stuff
Nov 17, 2024
Merged

Mark model input as dynamically sized#105
epwalsh merged 3 commits intomainfrom
epwalsh/compile-stuff

Conversation

@epwalsh
Copy link
Member

@epwalsh epwalsh commented Nov 15, 2024

I tested this out with the 7B and it does not hurt throughput.

@epwalsh epwalsh mentioned this pull request Nov 15, 2024
@epwalsh epwalsh merged commit 57b38ad into main Nov 17, 2024
@epwalsh epwalsh deleted the epwalsh/compile-stuff branch November 17, 2024 21:09
dhgottesman pushed a commit to dhgottesman/OLMo-core that referenced this pull request Dec 30, 2025
I tested this out with the 7B and it does not hurt throughput.
dhgottesman pushed a commit to dhgottesman/OLMo-core that referenced this pull request Dec 30, 2025
I tested this out with the 7B and it does not hurt throughput.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant