[Feature] 2:4 sparse marlin #13597
Description
Checklist
- If this is not a feature request but a general question, please start a discussion at https://github.com/sgl-project/sglang/discussions. Otherwise, it will be closed.
- Please use English. Otherwise, it will be closed.
Motivation
Hello, are there any plans to integrate 2:4 sparse marlin (w4a16) into sglang?
It seems to have been removed in #10750 , and I'm asking because I couldn't find it in the quantization roadmap #8180. Thank you.
Related resources
No response