vntl-llama3-8b-v2-gguf

by lmg-anon

The vntl-llama3-8b-v2-gguf is an 8B parameter language model developed by lmg-anon that specializes in high-quality translation and conversational tasks. It excels at processing the VNTL-v5-1k dataset to deliver fluent responses, making it ideal for multilingual chat applications and localized content generation. Running this model locally requires a GPU with sufficient VRAM to handle its 8B parameter weight efficiently, ensuring responsive performance for real-time dialogue.

Parameters 8B
RAM Required 16 GB
Context 4,096

♥ 17 people have liked this model on HuggingFace

⇩ 639,689 downloads on HuggingFace

How to Get This Model

Ollama ollama pull vntl-llama3-8b-v2:8b
HuggingFace View model page →
LM Studio Search "vntl-llama3-8b-v2-gguf" in LM Studio's Discover tab, or download the GGUF above.