bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
UN
unsloth
Wan2.2-TI2V-5B-GGUF
Create videoapache-2.0↓ 91.7K91,676 catalog downloads
LM
lmstudio-community
Meta-Llama-3.1-8B-Instruct-GGUF
Chat & write4.92 GBllama3.1↓ 86.8K86,810 catalog downloads
LM
lmstudio-community
Qwen3-Coder-30B-A3B-Instruct-GGUF
Chat & write18.63 GBNo license stated↓ 95.7K95,715 catalog downloads
Understand images21.17 GBapache-2.0↓ 3.1M3,089,950 catalog downloads
BA
bartowski
Llama-3.2-3B-Instruct-GGUF
Chat & write2.02 GBllama3.2↓ 110K109,952 catalog downloads
AL
Chat & write4.21 GBapache-2.0↓ 2.5K2,544 catalog downloads
IB
ibm-granite
granite-4.0-h-small-GGUF
Chat & write19.48 GBapache-2.0↓ 2.5K2,496 catalog downloads
NO
NousResearch
Hermes-2-Pro-Llama-3-8B-GGUF
Chat & write4.92 GBapache-2.0↓ 2.5K2,471 catalog downloads
IB
ibm-granite
granite-4.1-3B-GGUF
Chat & write2.1 GBapache-2.0↓ 2.4K2,421 catalog downloads
IN
inclusionAI
Ling-3.0-flash-GGUF
Chat & writemit↓ 2.3K2,320 catalog downloads
NO
NousResearch
Nous-Hermes-2-Mistral-7B-DPO-GGUF
Chat & write4.37 GBapache-2.0↓ 2.2K2,168 catalog downloads