Skip to content

Add batch generation to the MLXLM model#1759

Merged
RobinPicard merged 1 commit intomainfrom
add_batch_generate_mlx
Sep 26, 2025
Merged

Add batch generation to the MLXLM model#1759
RobinPicard merged 1 commit intomainfrom
add_batch_generate_mlx

Conversation

@RobinPicard
Copy link
Contributor

@RobinPicard RobinPicard commented Sep 23, 2025

Closes #1756

@RobinPicard RobinPicard self-assigned this Sep 23, 2025
@RobinPicard RobinPicard requested a review from rlouf September 23, 2025 13:01
@RobinPicard RobinPicard merged commit 2a19bdd into main Sep 26, 2025
5 checks passed
@RobinPicard RobinPicard deleted the add_batch_generate_mlx branch September 26, 2025 12:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add support for batch generation in MLXLM

2 participants