Models

Parable-Qwen3-8B-Claude-Fable-5-GGUF

AnkitAI8B16 GB RAM

8B open-weight model from AnkitAI for local AI inference.

grug-27b-gguf

ProCreations27B24 GB RAM

27B open-weight model from ProCreations for local AI inference.

GLM-4.7-Flash-GGUF

unslothUnknown8 GB RAM

Unknown open-weight model from unsloth for local AI inference.

gemma-4-31B-it-qat-q4_0-gguf

google31B24 GB RAM

31B open-weight model from google for local AI inference.

Qwen3.5-27B-GGUF

Alibaba27B24 GB RAM

27B open-weight model from Alibaba for local AI inference.

Kwaipilot_KAT-Coder-V2.5-Dev-GGUF

bartowskiUnknown8 GB RAM

Unknown open-weight model from bartowski for local AI inference.

Parable-Qwen3-4B-Claude-Fable-5-GGUF

AnkitAI4B8 GB RAM

4B open-weight model from AnkitAI for local AI inference.

gemma-4-E2B-it-qat-GGUF

Google2B4 GB RAM

2B open-weight model from Google for local AI inference.

ACE-Step-1.5-GGUF

ServeurpersoUnknown8 GB RAM

Unknown open-weight model from Serveurperso for local AI inference.

Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

huihui-aiUnknown8 GB RAM

Unknown open-weight model from huihui-ai for local AI inference.

POCKET-35B-GGUF

FINAL-Bench35B48 GB RAM

35B open-weight model from FINAL-Bench for local AI inference.

gemma-4-26B-A4B-it-qat-q4_0-gguf

google26B24 GB RAM

26B open-weight model from google for local AI inference.

gemma-4-E2B-it-qat-q4_0-gguf

google2B4 GB RAM

2B open-weight model from google for local AI inference.

gemma-4-E4B-it-qat-q4_0-gguf

google4B8 GB RAM

4B open-weight model from google for local AI inference.

automotive

flywheel-aiUnknown8 GB RAM

Unknown open-weight model from flywheel-ai for local AI inference.

DeepSeek-V4-Flash-0731-GGUF

DeepSeekUnknown8 GB RAM

Unknown open-weight model from DeepSeek for local AI inference.

LFM2.5-2.6B-GGUF

LiquidAI2.6B4 GB RAM

2.6B open-weight model from LiquidAI for local AI inference.

Qwen3.5-122B-A10B-GGUF

Alibaba122B80 GB RAM

122B open-weight model from Alibaba for local AI inference.

Qwen3.8-27B-Uncensored-GGUF

JonathanColetti27B24 GB RAM

27B open-weight model from JonathanColetti for local AI inference.

MiniMax-H3

DeepBeepMeepUnknown8 GB RAM

Unknown open-weight model from DeepBeepMeep for local AI inference.

MiniMax-H3_GGUFs

realrebelaiUnknown8 GB RAM

Unknown open-weight model from realrebelai for local AI inference.

audio.cpp-gguf

audio-cppUnknown8 GB RAM

Unknown open-weight model from audio-cpp for local AI inference.

Inkling-Small-GGUF

unslothUnknown8 GB RAM

Unknown open-weight model from unsloth for local AI inference.

Hello, Nice to meet you! 👋

Subscribe our newsletter to get the latest AI news.

Malcare WordPress Security