bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
TH
TheBloke
Mistral-7B-v0.1-GGUF
Chat & write4.37 GBapache-2.0↓ 5.3K5,310 catalog downloads
BA
bartowski
ArliAI_QwQ-32B-ArliAI-RpR-v4-GGUF
Chat & write19.85 GBapache-2.0↓ 5.3K5,275 catalog downloads
LM
lmstudio-community
Qwen2.5-14B-Instruct-1M-GGUF
Chat & write8.99 GBapache-2.0↓ 5.3K5,271 catalog downloads
LM
lmstudio-community
SmolLM2-1.7B-Instruct-GGUF
Chat & write1.06 GBapache-2.0↓ 5.3K5,268 catalog downloads
BA
bartowski
THUDM_GLM-4-9B-0414-GGUF
Chat & write6.17 GBmit↓ 5.2K5,208 catalog downloads
BA
bartowski
Yi-1.5-9B-Chat-GGUF
Chat & write5.33 GBapache-2.0↓ 5.2K5,197 catalog downloads
BA
bartowski
Yi-Coder-9B-Chat-GGUF
Chat & write5.33 GBapache-2.0↓ 5.1K5,106 catalog downloads
BA
bartowski
granite-4.2-3B-GGUF
Chat & write2.32 GBapache-2.0↓ 5.1K5,104 catalog downloads
BA
bartowski
allenai_Olmo-3.1-32B-Think-GGUF
Chat & write19.48 GBapache-2.0↓ 5.1K5,095 catalog downloads
UN
unsloth
FLUX.1-schnell-GGUF
Create images6.91 GBapache-2.0↓ 5.1K5,053 catalog downloads
BA
Understand imagesapache-2.0↓ 5K4,977 catalog downloads