Dose habana support Mixtral-8x7b?

jingkang99 · March 29, 2024, 11:18pm

has anyone tried to run Mixtral-8x7b model?

Thanks

Sayantan_S · March 29, 2024, 11:28pm

Yes Mixtral-8x7b is supported

Topic		Replies	Views
Does Gaudi2 lib support Mixtral-8x7b? Inference models	1	169	March 29, 2024
Support for Mixtral - Optimum Habana General Questions models , pytorch	3	553	March 22, 2024
PyTorch Apex is useful for mixed precision training. Does Habana have similar features FAQ pytorch	0	743	June 30, 2021
What Versions of TensorFlow are supported? 1.x, 2.x, Keras? Is eager mode supported in TF? FAQ	0	726	June 30, 2021
When can I see other PyTorch based models supported? FAQ pytorch	0	713	June 30, 2021