StatsMerging: Statistics-Guided Model Merging via Task-Specific Teacher Distillation

Official implementation of our method for efficient model merging using task-specific teacher distillation and statistical feature guidance.