Does Gaudi2 lib support Mixtral-8x7b?

jingkang99 · March 29, 2024, 11:18pm

Mixtral supported. how about Mixtral-8x7b?

Sayantan_S · March 29, 2024, 11:28pm

Yes Mixtral-8x7b is supported

Topic		Replies	Views
Dose habana support Mixtral-8x7b? Inference	1	181	March 29, 2024
Support for Mixtral - Optimum Habana General Questions models , pytorch	3	553	March 22, 2024
How do I confirm if Gaudi supports all the ops in my model? FAQ models	0	793	June 30, 2021
Has Gaudi enabled any Reinforcement Learning examples? FAQ	0	774	June 30, 2021
What is the best way to ensure that my model is taking advantage of BF16 and mixed mode training FAQ performance	0	713	June 30, 2021