Can Gaudi be used for Inference?

Theoretically, this is possible, but this is not a configuration that Habana has validated internally. Gaudi has been designed for training. For inference, we recommend using Goya. Please see more details on our Website

1 Like