Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
deepseek-coder-1.3B-kexer-GGUF
Chat & write873 MBapache-2.0↓ 1.2K1,159 catalog downloads
BA
bartowski
Falcon3-3B-Instruct-GGUF
Chat & write2.01 GBNo license stated↓ 1.5K1,466 catalog downloads
BA
bartowski
functionary-small-v3.1-GGUF
Chat & write4.92 GBmit↓ 1.2K1,153 catalog downloads
Chat & write19.85 GBapache-2.0↓ 1.1K1,148 catalog downloads
BA
bartowski
Tesslate_Tessa-T1-32B-GGUF
Chat & write19.85 GBapache-2.0↓ 1.1K1,144 catalog downloads
BA
bartowski
QwQ-32B-Preview-IdeaWhiz-v1-GGUF
Chat & write19.85 GBapache-2.0↓ 1.1K1,143 catalog downloads
QU
QuantFactory
Dolphin3.0-Llama3.2-3B-GGUF
Chat & write2.24 GBllama3.2↓ 1.1K1,143 catalog downloads
UN
unsloth
GLM-Z1-9B-0414-GGUF
Chat & write6.17 GBmit↓ 1.1K1,142 catalog downloads
BA
bartowski
deepseek-coder-6.7B-kexer-GGUF
Chat & write4.08 GBapache-2.0↓ 1.1K1,141 catalog downloads
UN
unsloth
granite-4.0-h-350m-GGUF
Chat & write223 MBapache-2.0↓ 1.1K1,138 catalog downloads
BA
bartowski
Llama-Doctor-3.2-3B-Instruct-GGUF
Chat & write2.02 GBmit↓ 1.1K1,137 catalog downloads