Skip to content

Comments

[3/3] fix dsv3 awq issue#4719

Merged
zhyncs merged 7 commits intosgl-project:mainfrom
laixinn:awq-linear
Mar 27, 2025
Merged

[3/3] fix dsv3 awq issue#4719
zhyncs merged 7 commits intosgl-project:mainfrom
laixinn:awq-linear

Conversation

@laixinn
Copy link
Contributor

@laixinn laixinn commented Mar 24, 2025

Motivation

related issue: #4462
The dsv3 awq issue requires a few PRs to fix, this is a part of it.
MoE wNa16 kernel #4625 requires this AWQ Linear.

Coauthor: @AniZpZ

Modifications

Migrate AWQ Linear from vLLM.

Checklist

@laixinn laixinn force-pushed the awq-linear branch 2 times, most recently from e544eae to 4f8d962 Compare March 24, 2025 10:23
laixinn and others added 2 commits March 24, 2025 18:25
Co-authored-by: AniZpZ <aniz1905@gmail.com>
Co-authored-by: AniZpZ <aniz1905@gmail.com>
@AniZpZ AniZpZ mentioned this pull request Mar 26, 2025
6 tasks
@zhyncs zhyncs merged commit ae25d36 into sgl-project:main Mar 27, 2025
9 of 21 checks passed
jimoosciuc pushed a commit to Furion-cn/sglang that referenced this pull request Apr 17, 2025
Co-authored-by: AniZpZ <aniz1905@gmail.com>
@zhyncs zhyncs mentioned this pull request Apr 23, 2025
6 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants