TheBloke
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
LM
lmstudio-community
Phi-3.1-mini-4k-instruct-GGUF
Chat & write2.39 GBmit↓ 3.1K3,121 catalog downloads
QU
QuantFactory
Qwen2.5-7B-Instruct-abliterated-v2-GGUF
Chat & write4.68 GBapache-2.0↓ 3.1K3,105 catalog downloads
LM
lmstudio-community
Olmo-3-32B-Think-GGUF
Chat & write19.48 GBapache-2.0↓ 3.1K3,103 catalog downloads
BA
bartowski
granite-3.1-2B-instruct-GGUF
Chat & write1.55 GBapache-2.0↓ 3.1K3,060 catalog downloads
BA
Chat & write14.33 GBapache-2.0↓ 3.1K3,058 catalog downloads
BA
bartowski
Hercules-5.0-Qwen2-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 3K3,039 catalog downloads
BA
Chat & write14.57 GBapache-2.0↓ 3K3,038 catalog downloads
UN
unsloth
FLUX.2-klein-base-4B-GGUF
Transform images2.6 GBapache-2.0↓ 3K3,033 catalog downloads
BA
bartowski
EVA-Qwen2.5-7B-v0.1-GGUF
Chat & write4.68 GBapache-2.0↓ 3K3,030 catalog downloads
UN
unsloth
GLM-5-GGUF
Chat & writemit↓ 3K3,027 catalog downloads
UN
unsloth
Hy-MT2-1.8B-GGUF
Translate text1.13 GBapache-2.0↓ 3K3,001 catalog downloads