ggml-org
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Chronos-Divergence-33B-GGUF
Chat & write19.62 GBcc-by-nc-4.0↓ 4.1K4,130 catalog downloads
UN
unsloth
Olmo-3-7B-Instruct-GGUF
Chat & write4.47 GBapache-2.0↓ 4.1K4,099 catalog downloads
LM
lmstudio-community
dolphin-2.8-mistral-7B-v02-GGUF
Chat & write4.37 GBapache-2.0↓ 4.1K4,095 catalog downloads
LM
lmstudio-community
granite-4.1-8B-GGUF
Chat & write5.35 GBapache-2.0↓ 4.1K4,090 catalog downloads
BA
bartowski
magnum-12B-v2.5-kto-GGUF
Chat & write7.48 GBapache-2.0↓ 4.1K4,080 catalog downloads
BA
bartowski
HuatuoGPT-o1-8B-GGUF
Chat & write4.92 GBapache-2.0↓ 4.1K4,069 catalog downloads
UN
Chat & write18.56 GBapache-2.0↓ 4K4,032 catalog downloads
GG
ggml-org
Qwen2.5-Coder-1.5B-Q8_0-GGUF
Chat & write1.65 GBapache-2.0↓ 4K3,970 catalog downloads
BA
bartowski
Reasoning-Llama-1B-v0.1-GGUF
Chat & write808 MBllama3.2↓ 4K3,967 catalog downloads
UN
unsloth
granite-4.0-micro-GGUF
Chat & write2.1 GBapache-2.0↓ 4K3,960 catalog downloads
BA
Chat & write19.85 GBmit↓ 3.9K3,925 catalog downloads