Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
Chat & write30.06 GBmit↓ 3.3K3,316 catalog downloads
BA
Chat & write806 MBgemma↓ 3.3K3,301 catalog downloads
BA
bartowski
granite-3.1-3B-a800m-instruct-GGUF
Chat & write2.02 GBapache-2.0↓ 3.3K3,295 catalog downloads
UN
unsloth
Kimi-Dev-72B-GGUF
Chat & writemit↓ 3.3K3,260 catalog downloads
UN
unsloth
Qwen-Image-Edit-2509-GGUF
Transform images13.13 GBapache-2.0↓ 3.2K3,235 catalog downloads
BA
bartowski
granite-3.1-8B-instruct-GGUF
Chat & write4.94 GBapache-2.0↓ 3.2K3,214 catalog downloads
BA
bartowski
magnum-12B-v2-GGUF
Chat & write7.48 GBapache-2.0↓ 3.2K3,174 catalog downloads
BA
bartowski
Ava-1.0-12B-GGUF
Chat & write7.48 GBapache-2.0↓ 3.1K3,146 catalog downloads
TH
TheBloke
openchat-3.5-1210-GGUF
Chat & write4.37 GBapache-2.0↓ 3.1K3,138 catalog downloads
LM
lmstudio-community
Phi-3.1-mini-4k-instruct-GGUF
Chat & write2.39 GBmit↓ 3.1K3,121 catalog downloads
QU
QuantFactory
Qwen2.5-7B-Instruct-abliterated-v2-GGUF
Chat & write4.68 GBapache-2.0↓ 3.1K3,105 catalog downloads