bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
Chat & write1.12 GBapache-2.0↓ 3.9K3,916 catalog downloads
UN
unsloth
DeepSeek-R1-0528-GGUF
Chat & writemit↓ 3.9K3,902 catalog downloads
QU
QuantFactory
MN-Violet-Lotus-12B-GGUF
Chat & write7.48 GBcc-by-4.0↓ 3.9K3,881 catalog downloads
BA
Chat & write4.92 GBllama3.1↓ 3.9K3,859 catalog downloads
BA
Chat & write16.65 GBgemma↓ 3.8K3,771 catalog downloads
TH
TheBloke
Mixtral-8x7B-v0.1-GGUF
General26.44 GBapache-2.0↓ 3.7K3,744 catalog downloads
UN
unsloth
granite-4.0-h-micro-GGUF
Chat & write1.94 GBapache-2.0↓ 3.7K3,723 catalog downloads
UN
unsloth
Qwen-Image-Edit-GGUF
Transform images13.13 GBapache-2.0↓ 3.7K3,723 catalog downloads
UN
unsloth
GLM-4.5-GGUF
Chat & writemit↓ 3.7K3,720 catalog downloads
BA
bartowski
Qwen2.5-7B-Instruct-1M-GGUF
Chat & write4.68 GBapache-2.0↓ 3.7K3,683 catalog downloads
UN
Chat & write986 MBapache-2.0↓ 3.7K3,667 catalog downloads