Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Qwen_Qwen3.5-2B-GGUF
Understand imagesapache-2.0↓ 50.6K50,642 catalog downloads
BA
bartowski
Qwen2.5-3B-Instruct-GGUF
Chat & write1.93 GBNo license stated↓ 62K61,983 catalog downloads
BA
bartowski
DeepSeek-R1-Distill-Qwen-32B-GGUF
Chat & writeNo license stated↓ 53.8K53,848 catalog downloads
LM
lmstudio-community
NVIDIA-Nemotron-3-Nano-4B-GGUF
Chat & write2.84 GBNo license stated↓ 50.4K50,419 catalog downloads
UN
unsloth
LFM2.5-1.2B-Instruct-GGUF
Chat & write731 MBNo license stated↓ 49.6K49,616 catalog downloads
CM
CMSManhattan
JiRackUltra_1b
Chat & writemit↓ 1.9M1,883,610 catalog downloads
HA
handy-computer
nemotron-3.5-asr-streaming-0.6B-gguf
Transcribe speech496 MBopenmdw-1.1↓ 1.8M1,829,287 catalog downloads
HA
handy-computer
parakeet-unified-en-0.6B-gguf
Transcribe speech477 MBcc-by-4.0↓ 1.6M1,560,031 catalog downloads
IB
ibm-granite
granite-guardian-4.1-8B-GGUF
Chat & write5.12 GBapache-2.0↓ 1.4K1,431 catalog downloads
IB
ibm-granite
granite-4.0-350m-GGUF
Chat & write237 MBapache-2.0↓ 1.3K1,251 catalog downloads
IB
ibm-granite
granite-4.0-h-350m-GGUF
Chat & write223 MBapache-2.0↓ 1.2K1,227 catalog downloads