Browse Models

Qwen2.5-1.5B-Instruct-GGUF

Qwen1.5B4 GB RAM

1.5B open-weight model from Qwen for local AI inference.

Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V6-GGUF

LuffyTheFox35B48 GB RAM

35B open-weight model from LuffyTheFox for local AI inference.

paw-programs

programasweightsUnknown8 GB RAM

Unknown open-weight model from programasweights for local AI inference.

Qwen2.5-Coder-32B-Instruct-GGUF

Qwen32B24 GB RAM

32B open-weight model from Qwen for local AI inference.

gemma-4-31B-it-qat-GGUF

Google31B24 GB RAM

31B open-weight model from Google for local AI inference.

gemma-4-26B-A4B-it-ultra-uncensored-heretic-i1-GGUF

Google26B24 GB RAM

26B open-weight model from Google for local AI inference.

gemma-4-12B-coder-fable5-composer2.5-v1-GGUF

yuxinlu112B16 GB RAM

12B open-weight model from yuxinlu1 for local AI inference.

inkling-GGUF

unslothUnknown8 GB RAM

Unknown open-weight model from unsloth for local AI inference.

granite-4.1-3b-GGUF

ibm-granite3B4 GB RAM

3B open-weight model from ibm-granite for local AI inference.

Sugoi-32B-Ultra-GGUF

sugoitoolkit32B24 GB RAM

32B open-weight model from sugoitoolkit for local AI inference.

Qwen3-VL-4B-Instruct-GGUF

Alibaba4B8 GB RAM

4B open-weight model from Alibaba for local AI inference.

madlad400-3b-mt

google3B4 GB RAM

3B open-weight model from google for local AI inference.

MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF

GnLOLot1B2 GB RAM

1B open-weight model from GnLOLot for local AI inference.

svara-tts-v1

kenpathUnknown8 GB RAM

Unknown open-weight model from kenpath for local AI inference.

Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-NEO-CODE-Di-IMatrix-MAX-GGUF

DavidAU40B48 GB RAM

40B open-weight model from DavidAU for local AI inference.

Holo-3.1-35B-A3B-GGUF

Hcompany35B48 GB RAM

35B open-weight model from Hcompany for local AI inference.

gemma-4-12B-it-qat-q4_0-gguf

google12B16 GB RAM

12B open-weight model from google for local AI inference.

Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP-GGUF

DavidAU9B16 GB RAM

9B open-weight model from DavidAU for local AI inference.

LTX-2.3-GGUF

unslothUnknown8 GB RAM

Unknown open-weight model from unsloth for local AI inference.

gemma-4-E4B-it-qat-GGUF

Google4B8 GB RAM

4B open-weight model from Google for local AI inference.

whisper-large-v3-turbo-gguf

handy-computerUnknown8 GB RAM

Unknown open-weight model from handy-computer for local AI inference.

LTX-2

DeepBeepMeepUnknown8 GB RAM

Unknown open-weight model from DeepBeepMeep for local AI inference.

Qwen3-4B-GGUF

Qwen4B8 GB RAM

4B open-weight model from Qwen for local AI inference.

Hello, Nice to meet you! 👋

Subscribe our newsletter to get the latest AI news.

Malcare WordPress Security