Skip to content

Revert "feat: update grouped_topk to support softmax and sigmoid"#4505

Merged
zhyncs merged 2 commits intomainfrom
revert-3680-feat/support-softmax-and-sigmoid-scoring-in-grouped-topk
Mar 17, 2025
Merged

Revert "feat: update grouped_topk to support softmax and sigmoid"#4505
zhyncs merged 2 commits intomainfrom
revert-3680-feat/support-softmax-and-sigmoid-scoring-in-grouped-topk

Conversation

@ispobock
Copy link
Collaborator

@ispobock ispobock commented Mar 17, 2025

Reverts #3680

Related to issue #4497.

Currently grouped_topk is only used for DeepSeek-V2/V2.5, biased_grouped_topk is used for DeepSeek-V3/R1. For DeepSeek-V2, the scoring function is always softmax, so don't need to add new option.

@zhyncs zhyncs merged commit 3ded4b2 into main Mar 17, 2025
36 of 40 checks passed
@zhyncs zhyncs deleted the revert-3680-feat/support-softmax-and-sigmoid-scoring-in-grouped-topk branch March 17, 2025 18:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants