bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Qwen2.5-Coder-32B-GGUF
Chat & write19.85 GBapache-2.0↓ 5.4K5,388 catalog downloads
BA
bartowski
NousResearch_Hermes-4.3-36B-GGUF
Chat & write21.76 GBapache-2.0↓ 5.3K5,344 catalog downloads
TH
TheBloke
Mistral-7B-v0.1-GGUF
Chat & write4.37 GBapache-2.0↓ 5.3K5,310 catalog downloads
BA
bartowski
ArliAI_QwQ-32B-ArliAI-RpR-v4-GGUF
Chat & write19.85 GBapache-2.0↓ 5.3K5,275 catalog downloads
LM
lmstudio-community
Qwen2.5-14B-Instruct-1M-GGUF
Chat & write8.99 GBapache-2.0↓ 5.3K5,271 catalog downloads
LM
lmstudio-community
SmolLM2-1.7B-Instruct-GGUF
Chat & write1.06 GBapache-2.0↓ 5.3K5,268 catalog downloads
BA
bartowski
THUDM_GLM-4-9B-0414-GGUF
Chat & write6.17 GBmit↓ 5.2K5,208 catalog downloads
BA
bartowski
Yi-1.5-9B-Chat-GGUF
Chat & write5.33 GBapache-2.0↓ 5.2K5,197 catalog downloads
BA
bartowski
Yi-Coder-9B-Chat-GGUF
Chat & write5.33 GBapache-2.0↓ 5.1K5,106 catalog downloads
BA
bartowski
granite-4.2-3B-GGUF
Chat & write2.32 GBapache-2.0↓ 5.1K5,104 catalog downloads
BA
bartowski
allenai_Olmo-3.1-32B-Think-GGUF
Chat & write19.48 GBapache-2.0↓ 5.1K5,095 catalog downloads