Blazingly Fast Computer Vision Training with the Mosaic ResNet and Composer We (MosaicML) trained a ResNet-50 7x faster with no loss of accuracy. This is possible because of two observations: If you increase the accuracy, you can just train for fewer iterations—as long as you also adjust your learning rate schedule accordingly.
2022-6-12: 7x Faster ResNet-50, BIG-Bench, Neural corpus indexer, DeepSpeed & fp8 quantization
2022-6-12: 7x Faster ResNet-50, BIG-Bench…
2022-6-12: 7x Faster ResNet-50, BIG-Bench, Neural corpus indexer, DeepSpeed & fp8 quantization
Blazingly Fast Computer Vision Training with the Mosaic ResNet and Composer We (MosaicML) trained a ResNet-50 7x faster with no loss of accuracy. This is possible because of two observations: If you increase the accuracy, you can just train for fewer iterations—as long as you also adjust your learning rate schedule accordingly.