Pretraining loss being negative

[snat1505027]

Is it possible to get negative loss for each task during pretraining? Also can you share the pretraining log file (mostly the loss of each task, i.e., audio2text, audio_text_matching etc.)?

[rowanz]

hi Syeda - that shouldn't be possible! I think you probably have a bug somewhere in your setup. I do have logs somewhere on wandb, but I don't think they would be helpful in debugging this