Mistral-Small-24B-Instruct-2501-GGUF

by MaziyarPanahi

24B open-weight model from MaziyarPanahi for local AI inference.

Parameters 24B
RAM Required 24 GB
Context 4,096

♥ 12 people have liked this model on HuggingFace

⇩ 179,944 downloads on HuggingFace

How to Get This Model

Ollama ollama pull mistral-small-24b-instruct-2501:24b
HuggingFace View model page →
LM Studio Search "Mistral-Small-24B-Instruct-2501-GGUF" in LM Studio's Discover tab, or download the GGUF above.