Skip to content

docker vllm: add server config for model Qwen/Qwen2.5-VL-7B-Instruct#1577

Merged
afierka-intel merged 3 commits intohabana_mainfrom
tthaddey/add-qwen-vision-habana_main
Jul 11, 2025
Merged

docker vllm: add server config for model Qwen/Qwen2.5-VL-7B-Instruct#1577
afierka-intel merged 3 commits intohabana_mainfrom
tthaddey/add-qwen-vision-habana_main

Conversation

@tthaddey
Copy link
Copy Markdown

docker vllm: add server config for model Qwen/Qwen2.5-VL-7B-Instruct

Signed-off-by: Tomasz Thaddey <tthaddey@habana.ai>
@afierka-intel
Copy link
Copy Markdown

/skip-gaudi-tests

Copy link
Copy Markdown

@afierka-intel afierka-intel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Gave few comments

Comment thread .cd/benchmark/benchmark_defaults.yaml
Comment thread .cd/benchmark/benchmark_defaults.yaml
Comment thread .cd/templates/template_vllm_benchmark.sh Outdated
Signed-off-by: Tomasz Thaddey <tthaddey@habana.ai>
@afierka-intel
Copy link
Copy Markdown

/skip-gaudi-tests

@afierka-intel afierka-intel merged commit d4d7792 into habana_main Jul 11, 2025
7 checks passed
@afierka-intel afierka-intel deleted the tthaddey/add-qwen-vision-habana_main branch July 11, 2025 10:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants