Dose habana support Mixtral-8x7b?

jingkang99 · March 29, 2024, 11:18pm

has anyone tried to run Mixtral-8x7b model?

Thanks

Sayantan_S · March 29, 2024, 11:28pm

Yes Mixtral-8x7b is supported

Topic		Replies	Views
Support for Mixtral - Optimum Habana General Questions models , pytorch	3	495	March 22, 2024
Does Gaudi2 lib support Mixtral-8x7b? Inference models	1	121	March 29, 2024
I'm running Habana's models and I don't see the same level of performance as what is published on the GitHub and Developer site FAQ performance	0	647	June 30, 2021
SynapseAI 1.9.0 Release Announcements	0	478	March 30, 2023
SynapseAI 1.8.0 Release Announcements	0	525	February 9, 2023