Understanding Scalability and Fine-Grain Parallelism of Synchronous Data Parallel Training

Authors
Jiali Li, Bogdan Nicolae, Justin Wozniak, George Bosilca
Publication Date
Name of Publication Source
2019 IEEE/ACM Workshop on Machine Learning in High Performance Computing Environments (MLHPC)
Publisher
IEEE
Conference Location
Denver, CO
DOI
10.1109/MLHPC49564.2019.00006