bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
GG
ggml-org
Qwen2.5-Coder-0.5B-Q8_0-GGUF
Chat & write531 MBapache-2.0↓ 720720 catalog downloads
QU
QuantFactory
SecurityLLM-GGUF
Chat & write4.37 GBapache-2.0↓ 720720 catalog downloads
BA
bartowski
Tesslate_Tessa-Rust-T1-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 719719 catalog downloads
BA
bartowski
Pantheon-RP-1.6-12B-Nemo-KTO-GGUF
Chat & write7.48 GBapache-2.0↓ 712712 catalog downloads
GG
ggml-org
Qwen3-4B-Instruct-2507-Q8_0-GGUF
Chat & write4.28 GBapache-2.0↓ 712712 catalog downloads
QU
QuantFactory
HuatuoGPT-o1-8B-GGUF
Chat & write4.92 GBapache-2.0↓ 708708 catalog downloads
QU
QuantFactory
Llama-3.2-3B-Agent007-GGUF
Chat & write2.02 GBapache-2.0↓ 702702 catalog downloads
UN
unsloth
SmolLM2-1.7B-Instruct-GGUF
Chat & write1.06 GBapache-2.0↓ 700700 catalog downloads
BA
bartowski
Arcee-Agent-GGUF
Chat & write4.68 GBapache-2.0↓ 689689 catalog downloads
BA
bartowski
Qwen2-7B-Instruct-deccp-GGUF
Chat & write4.68 GBapache-2.0↓ 687687 catalog downloads
QU
QuantFactory
Qwen2.5-7B-Instruct-GGUF
Chat & write4.68 GBapache-2.0↓ 687687 catalog downloads