Skip to content

Set default to non normalization of the scores #59

@NohTow

Description

@NohTow

Following JaColBERTv2.5, I added the normalization of the scores for distillation.

Yet, this setup is not really standard/well-know and so the default should be no normalization, with a proper documentation on using normalization and its potential benefits. This would avoid confusion and possible sub-optimal results if the user does not normalize the teacher scores on its end aswell.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions