bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
Llama-3-8B-Instruct-Gradient-1048k-GGUF
Chat & write4.92 GBllama3↓ 1.2K1,210 catalog downloads
BA
bartowski
microsoft_Phi-4-reasoning-GGUF
Chat & write9.05 GBmit↓ 1.2K1,209 catalog downloads
BA
Chat & write14.33 GBapache-2.0↓ 1.2K1,208 catalog downloads
BA
bartowski
Crimson_Dawn-V0.1-GGUF
Chat & write7.48 GBapache-2.0↓ 1.2K1,206 catalog downloads
BA
bartowski
open-thoughts_OpenThinker2-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 1.2K1,205 catalog downloads
QU
QuantFactory
CausalLM-35B-beta-long-GGUF
Chat & write21.53 GBgpl-3.0↓ 1.2K1,205 catalog downloads
QU
QuantFactory
Llama-3.1-Storm-8B-GGUF
Chat & write4.92 GBllama3.1↓ 1.2K1,203 catalog downloads
UN
unsloth
Qwen3-32B-128K-GGUF
Chat & write19.76 GBapache-2.0↓ 1.2K1,202 catalog downloads
BA
bartowski
Dusk_Rainbow-GGUF
Chat & write4.92 GBapache-2.0↓ 1.2K1,196 catalog downloads
TH
TheBloke
zephyr-7B-alpha-GGUF
Chat & write4.37 GBmit↓ 1.2K1,183 catalog downloads
UN
unsloth
Qwen3-4B-128K-GGUF
Chat & write2.5 GBapache-2.0↓ 1.2K1,169 catalog downloads