Skip to content

Commit 4090968

Browse files
roikoren755Prozac614
authored andcommitted
Enable TP for Mamba-based models (sgl-project#14811)
Signed-off-by: Roi Koren <roik@nvidia.com>
1 parent 4007933 commit 4090968

File tree

1 file changed

+0
-1
lines changed
  • python/sglang/srt/layers/attention/mamba

1 file changed

+0
-1
lines changed

python/sglang/srt/layers/attention/mamba/mamba.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -339,7 +339,6 @@ def __init__(
339339
input_is_parallel=True,
340340
quant_config=quant_config,
341341
prefix=f"{prefix}.out_proj",
342-
reduce_results=False,
343342
)
344343

345344
self.norm = Mixer2RMSNormGated(

0 commit comments

Comments
 (0)