Browse Models

Meta-Llama-3.1-8B-Instruct-GGUF

Meta8B16 GB RAM

8B open-weight model from Meta for local AI inference.

LFM2.5-1.2B-Instruct-GGUF

LiquidAI1.2B4 GB RAM

1.2B open-weight model from LiquidAI for local AI inference.

GLM-5.2-GGUF

unslothUnknown8 GB RAM

Unknown open-weight model from unsloth for local AI inference.

canary-180m-flash-gguf

handy-computerUnknown8 GB RAM

Unknown open-weight model from handy-computer for local AI inference.

whisper-large-v3-gguf

handy-computerUnknown8 GB RAM

Unknown open-weight model from handy-computer for local AI inference.

Qwen3-8B-GGUF

Alibaba8B16 GB RAM

8B open-weight model from Alibaba for local AI inference.

Jan-v3.5-4B-gguf

janhq4B8 GB RAM

4B open-weight model from janhq for local AI inference.

Kimi-K2.7-Code-GGUF

unslothUnknown8 GB RAM

Unknown open-weight model from unsloth for local AI inference.

MiniCPM5-1B-Claude-Opus-Fable5-Thinking-GGUF

GnLOLot1B2 GB RAM

1B open-weight model from GnLOLot for local AI inference.

Llama-3.2-1B-Instruct-Q8_0-GGUF

hugging-quants1B2 GB RAM

1B open-weight model from hugging-quants for local AI inference.

Bielik-11B-v3.0-Instruct-awq

speakleash11B16 GB RAM

11B open-weight model from speakleash for local AI inference.

Wan2.2-I2V-A14B-GGUF

QuantStack14B24 GB RAM

14B open-weight model from QuantStack for local AI inference.

Gemma-4-31B-it-abliterated

paperscarecrow31B24 GB RAM

31B open-weight model from paperscarecrow for local AI inference.

Qwen3.6-27B-Uncensored-HauhauCS-Aggressive

HauhauCS27B24 GB RAM

27B open-weight model from HauhauCS for local AI inference.

ThinkingCap-Qwen3.6-27B-GGUF

bottlecapai27B24 GB RAM

27B open-weight model from bottlecapai for local AI inference.

Wan2.1

DeepBeepMeepUnknown8 GB RAM

Unknown open-weight model from DeepBeepMeep for local AI inference.

Voxtral-Mini-4B-Realtime-2602-gguf

handy-computer4B8 GB RAM

4B open-weight model from handy-computer for local AI inference.

Qwen_Qwen3.6-35B-A3B-GGUF

Alibaba35B48 GB RAM

35B open-weight model from Alibaba for local AI inference.

Qwythos-9B-v2-GGUF

empero-ai9B16 GB RAM

9B open-weight model from empero-ai for local AI inference.

gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF

yuxinlu112B16 GB RAM

12B open-weight model from yuxinlu1 for local AI inference.

Sulphur-2-base

SulphurAIUnknown8 GB RAM

Unknown open-weight model from SulphurAI for local AI inference.

whisper-medium-gguf

handy-computerUnknown8 GB RAM

Unknown open-weight model from handy-computer for local AI inference.

gemma-4-E2B-it-GGUF

Google2B4 GB RAM

2B open-weight model from Google for local AI inference.

Hello, Nice to meet you! 👋

Subscribe our newsletter to get the latest AI news.

Malcare WordPress Security