NaNs in training

[nbgundavarapu]

Hi authors,

I'm getting NaNs in the training loss in the first epoch itself. I've tried 3 different seeds on relationship task, and it resulted in NaNs each time.

Is there any parameter that needs to be changed?

Thanks!