Skip to content

Comments

Ensure attn_norm does not affect the residual stream#680

Merged
2015aroras merged 2 commits intomainfrom
shanea/fix-incorrect-attn-norm
Jul 30, 2024
Merged

Ensure attn_norm does not affect the residual stream#680
2015aroras merged 2 commits intomainfrom
shanea/fix-incorrect-attn-norm

Commits

Commits on Jul 30, 2024