Voxtral-Mini-4B-Realtime-2602-gguf

by handy-computer

4B open-weight model from handy-computer for local AI inference.

Parameters 4B
RAM Required 8 GB
Context 4,096

Benchmark scores not yet verified for this model.

⇩ 426,535 downloads on HuggingFace

How to Get This Model

Ollama ollama pull voxtral-mini-4b-realtime-2602:4b
HuggingFace View model page →
LM Studio Search "Voxtral-Mini-4B-Realtime-2602-gguf" in LM Studio's Discover tab, or download the GGUF above.