How can someone monitor Gaudi device load balancing during a distributed training with Horovod on multiple Gaudi nodes

System Setup FAQ
1

User can use the hl-smi tool. For details, please see the System Management Tools Guide