Multi GPU

[Timopheym]

Sorry when is it planned to have multi-GPU? On my 1080 it takes apprx. 20min per epoch and it's almost impossible to train it for real use in current tasks =( I have two more GPU's that might help.. may be I can somehow help to enforce the implementation?

[bmccann]

Multi-GPU support broke when I added the task-specific validation metrics for each task. So we'll have to find a way to get around the problems that creep up or we'll have to turn off some metrics on multi-gpu runs.