Describe the bug
This whole file seems to be largely un-tested by our unit testing suite.
https://github.com/OpenMined/PySyft/blob/master/syft/frameworks/torch/nn/rnn.py
Expected behavior
This file should have 100% test coverage.
Make sure to uncomment the codecov omit flag for this file #2896 (review)