Qwen3.8-4B-Distill-GGUF

by empero-ai

Qwen3.8-4B-Distill-GGUF is a 4 billion parameter large language model provided by empero-ai designed for efficient deployment. It excels at reasoning tasks thanks to its distillation process and works well for local inference via llama.cpp. Running this quantized version locally requires minimal hardware resources, making it suitable for laptops or systems with limited GPU memory.

♥ 121 people have liked this model on HuggingFace

⇩ 752,514 downloads on HuggingFace