QuantStack
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
Understand imagesapache-2.0↓ 186.4K186,420 catalog downloads
IN
InternScience
Agents-A1-4B-Q4_K_M-GGUF
Chat & writeapache-2.0↓ 186.4K186,394 catalog downloads
SU
sugoitoolkit
Sugoi-14B-Ultra-GGUF
Translate text8.99 GBapache-2.0↓ 181.9K181,923 catalog downloads
MA
MaziyarPanahi
Mistral-7B-Instruct-v0.3-GGUF
Chat & writeapache-2.0↓ 180.2K180,190 catalog downloads
PR
ProCreations
grug-27B-mtp-gguf
Chat & write16.81 GBapache-2.0↓ 176.4K176,361 catalog downloads
EM
empero-ai
Qwen3.8-4B-Distill-GGUF
Chat & write2.78 GBapache-2.0↓ 175.2K175,175 catalog downloads
EM
empero-ai
Qwen3.8-2B-Distill-GGUF
Chat & write1.31 GBapache-2.0↓ 171.2K171,158 catalog downloads
DE
dealignai
Ornith-1.5-9B-UNCENSORED-GGUF
Understand imagesmit↓ 165.3K165,307 catalog downloads
MA
MaziyarPanahi
Qwen3-4B-Instruct-2507-GGUF
Chat & write2.5 GBNo license stated↓ 199.3K199,305 catalog downloads
MA
MaziyarPanahi
Meta-Llama-3-8B-Instruct-GGUF
Chat & write4.92 GBNo license stated↓ 168.9K168,926 catalog downloads
MA
MaziyarPanahi
Phi-3.5-mini-instruct-GGUF
Chat & write2.39 GBNo license stated↓ 162.3K162,251 catalog downloads