Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
zai-org_GLM-4.7-Flash-GGUF
Chat & write18.47 GBmit↓ 10.3K10,252 catalog downloads
UN
unsloth
Z-Image-GGUF
Create images5.07 GBapache-2.0↓ 10K10,037 catalog downloads
BA
bartowski
huihui-ai_QwQ-32B-abliterated-GGUF
Chat & write19.85 GBapache-2.0↓ 9.9K9,904 catalog downloads
LM
lmstudio-community
Qwen2.5-7B-Instruct-GGUF
Chat & write4.68 GBapache-2.0↓ 9.7K9,686 catalog downloads
BA
bartowski
aya-expanse-8B-GGUF
Chat & write5.06 GBcc-by-nc-4.0↓ 9.7K9,672 catalog downloads
BA
Understand imagesapache-2.0↓ 9.6K9,633 catalog downloads
BA
bartowski
Qwen2.5.1-Coder-7B-Instruct-GGUF
Chat & write4.68 GBapache-2.0↓ 9.4K9,420 catalog downloads
TH
TheBloke
Llama-2-13B-chat-GGUF
Chat & write7.87 GBllama2↓ 9.3K9,333 catalog downloads
LM
lmstudio-community
Qwen2.5-Coder-32B-GGUF
Chat & write19.85 GBapache-2.0↓ 9.3K9,285 catalog downloads
LM
lmstudio-community
Qwen2.5-7B-Instruct-1M-GGUF
Chat & write4.68 GBapache-2.0↓ 9.1K9,090 catalog downloads
BA
bartowski
Llama-Song-Stream-3B-Instruct-GGUF
Chat & write2.02 GBapache-2.0↓ 8.8K8,835 catalog downloads