Contents
- 0.1 granite-4.1-3b-GGUF
- 0.2 Sugoi-32B-Ultra-GGUF
- 0.3 Qwen3-VL-4B-Instruct-GGUF
- 0.4 madlad400-3b-mt
- 0.5 MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF
- 0.6 svara-tts-v1
- 0.7 Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-NEO-CODE-Di-IMatrix-MAX-GGUF
- 0.8 Holo-3.1-35B-A3B-GGUF
- 0.9 gemma-4-12B-it-qat-q4_0-gguf
- 0.10 Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP-GGUF
- 0.11 LTX-2.3-GGUF
- 0.12 gemma-4-E4B-it-qat-GGUF
- 0.13 whisper-large-v3-turbo-gguf
- 0.14 LTX-2
- 0.15 Qwen3-4B-GGUF
- 0.16 Qwen3.5-0.8B-GGUF
- 0.17 Meta-Llama-3.1-8B-Instruct-GGUF
- 0.18 LFM2.5-1.2B-Instruct-GGUF
- 0.19 GLM-5.2-GGUF
- 0.20 canary-180m-flash-gguf
- 0.21 whisper-large-v3-gguf
- 0.22 Qwen3-8B-GGUF
- 0.23 Jan-v3.5-4B-gguf
- 0.24 Kimi-K2.7-Code-GGUF
- 1 Hello, Nice to meet you!
granite-4.1-3b-GGUF
3B open-weight model from ibm-granite for local AI inference.
Sugoi-32B-Ultra-GGUF
32B open-weight model from sugoitoolkit for local AI inference.
MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF
1B open-weight model from GnLOLot for local AI inference.
Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-NEO-CODE-Di-IMatrix-MAX-GGUF
40B open-weight model from DavidAU for local AI inference.
Holo-3.1-35B-A3B-GGUF
35B open-weight model from Hcompany for local AI inference.
gemma-4-12B-it-qat-q4_0-gguf
The gemma-4-12B-it-qat-q4_0-gguf is a large language model developed by Google that features approximately 12 billion parameters. It excels at conversational interactions and handles any-to-any queries effectively, making it ideal for customer support bots or general dialogue systems. Running this model locally requires a system with sufficient RAM and
Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP-GGUF
9B open-weight model from DavidAU for local AI inference.
whisper-large-v3-turbo-gguf
Unknown open-weight model from handy-computer for local AI inference.
Meta-Llama-3.1-8B-Instruct-GGUF
8B open-weight model from Meta for local AI inference.
LFM2.5-1.2B-Instruct-GGUF
1.2B open-weight model from LiquidAI for local AI inference.
canary-180m-flash-gguf
Unknown open-weight model from handy-computer for local AI inference.
whisper-large-v3-gguf
Unknown open-weight model from handy-computer for local AI inference.
Kimi-K2.7-Code-GGUF
Unknown open-weight model from unsloth for local AI inference.
