Skip to content

[Hardware][Gaudi]Add alibi support#69

Merged
kzawora-intel merged 1 commit intoHabanaAI:habana_mainfrom
wenbinc-Bin:add_alibi
Jul 1, 2024
Merged

[Hardware][Gaudi]Add alibi support#69
kzawora-intel merged 1 commit intoHabanaAI:habana_mainfrom
wenbinc-Bin:add_alibi

Conversation

@wenbinc-Bin
Copy link
Copy Markdown

Add Alibi support to hpu backend.

@wenbinc-Bin wenbinc-Bin force-pushed the add_alibi branch 2 times, most recently from a49d062 to 2b14304 Compare July 1, 2024 09:46
Signed-off-by: Wenbin Chen <wenbin.chen@intel.com>
Copy link
Copy Markdown

@kzawora-intel kzawora-intel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Thank you for the contribution!

@kzawora-intel kzawora-intel merged commit aae39b1 into HabanaAI:habana_main Jul 1, 2024
ranzhejiang pushed a commit to ranzhejiang/vllm-fork that referenced this pull request Apr 11, 2025
)

cherry-pick the latest fix from habana_main branch for llama, qwen and
baichun

Signed-off-by: Bob Zhu <bob.zhu@intel.com>
Co-authored-by: Bob Zhu <41610754+czhu15@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants