Does Gaudi2 lib support Mixtral-8x7b?

jingkang99 · March 29, 2024, 11:18pm

Mixtral supported. how about Mixtral-8x7b?

Sayantan_S · March 29, 2024, 11:28pm

Yes Mixtral-8x7b is supported

Topic		Replies	Views
Missing Results for LLaMA2 on Gaudi2 Inference	0	247	August 16, 2023
Current best inference server implementation for Gaudi2 Inference models , performance , pytorch	1	211	November 28, 2023
Questions about Gaudi 2 General Questions	1	405	March 14, 2023
Can I run my existing model on Gaudi? Do I need to re-compile it? FAQ performance	0	663	June 30, 2021
Has Gaudi enabled any Reinforcement Learning examples? FAQ	0	661	June 30, 2021