Google Open-Sources GPipe Library for Training Large-Scale Neural Network Models | Synced

oogle this week introduced GPipe, an open-source library that dramatically improves training efficacy for large-scale neural network models.