-
Notifications
You must be signed in to change notification settings - Fork 76
Cross-encoder distillation #2
Copy link
Copy link
Closed
Labels
enhancementNew feature or requestNew feature or request
Description
Working on cross-encoder distillation
We want to distill cross-encoder into ColBERT,
- Update the training so we can distill logits pre-computed on option.
- Create a function which computes logits using a pre-trained cross-encoder in order to create a dataset with logits that can be used to distill soft labels to colbert.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request