HorovodRunner examples

Important

Horovod and HorovodRunner are now deprecated and will not be pre-installed in Databricks Runtime 16.0 ML and above. For distributed deep learning, Databricks recommends using TorchDistributor for distributed training with PyTorch or the tf.distribute.Strategy API for distributed training with TensorFlow.

The examples in this section demonstrate how to use HorovodRunner to perform distributed training using a convolutional neural network model on the MNIST dataset, a large database of handwritten digits.

• Deep learning using TensorFlow with HorovodRunner for MNIST
• Adapt single node PyTorch to distributed deep learning