Can I use tf.distribute for multi-gaudi training instead of horovod & mpirun

As of June 2021, tf.distribute has been validated on ResNet50 Keras model. Details for tf.distribute are in the Scaling User Guide. For additional examples, see the ResNet Keras model from our GitHub Model Repository