Voxtral-Small-24B-2507-gguf

by handy-computer

24B open-weight model from handy-computer for local AI inference.

Parameters 24B
RAM Required 24 GB
Context 4,096

Benchmark scores not yet verified for this model.

⇩ 181,648 downloads on HuggingFace

How to Get This Model

Ollama ollama pull voxtral-small-24b-2507:24b
HuggingFace View model page →
LM Studio Search "Voxtral-Small-24B-2507-gguf" in LM Studio's Discover tab, or download the GGUF above.