Mixtral-8x22B-v0.1-GGUF

by MaziyarPanahi

22B open-weight model from MaziyarPanahi for local AI inference.

Parameters 22B
RAM Required 24 GB
Context 4,096

♥ 78 people have liked this model on HuggingFace

⇩ 183,583 downloads on HuggingFace

How to Get This Model

Ollama ollama pull mixtral-8x22b-v0.1:22b
HuggingFace View model page →
LM Studio Search "Mixtral-8x22B-v0.1-GGUF" in LM Studio's Discover tab, or download the GGUF above.