Skip to content

sayankotor/FisherKronecker

Repository files navigation

If you use this code, please cite

@misc{chekalina2025generalizedfisherweightedsvdscalable, title={Generalized Fisher-Weighted SVD: Scalable Kronecker-Factored Fisher Approximation for Compressing Large Language Models}, author={Viktoriia Chekalina and Daniil Moskovskiy and Daria Cherniuk and Maxim Kurkin and Andrey Kuznetsov and Evgeny Frolov}, year={2025}, eprint={2505.17974}, archivePrefix={arXiv}, primaryClass={cs.LG}, url={https://arxiv.org/abs/2505.17974}, }

About

Approximation of MLP Layer's Fisher information with Kronecker factors

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors