Dose habana support Mixtral-8x7b?

jingkang99 · March 29, 2024, 11:18pm

has anyone tried to run Mixtral-8x7b model?

Thanks

Sayantan_S · March 29, 2024, 11:28pm

Yes Mixtral-8x7b is supported

Topic		Replies	Views
Does Gaudi2 lib support Mixtral-8x7b? Inference models	1	166	March 29, 2024
Support for Mixtral - Optimum Habana General Questions models , pytorch	3	549	March 22, 2024
PyTorch Apex is useful for mixed precision training. Does Habana have similar features FAQ pytorch	0	740	June 30, 2021
What Versions of TensorFlow are supported? 1.x, 2.x, Keras? Is eager mode supported in TF? FAQ	0	723	June 30, 2021
Hugging Face Transformers using all 8 Habana Gaudi Devices PyTorch	4	1379	July 7, 2022