Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Buzz-8B-Large-v0.5-GGUF
Chat & write4.92 GBapache-2.0↓ 1.5K1,474 catalog downloads
Chat & write4.92 GBapache-2.0↓ 1.5K1,472 catalog downloads
BA
bartowski
EVA-Qwen2.5-32B-v0.0-GGUF
Chat & write19.85 GBapache-2.0↓ 1.5K1,467 catalog downloads
QU
QuantFactory
Buzz-8B-Large-v0.5-GGUF
Chat & write4.92 GBapache-2.0↓ 1.5K1,464 catalog downloads
BA
bartowski
Pantheon-RP-1.6-12B-Nemo-GGUF
Chat & write7.48 GBapache-2.0↓ 1.5K1,462 catalog downloads
GG
ggml-org
bge-small-en-v1.5-Q8_0-GGUF
Search documents37 MBmit↓ 1.5K1,460 catalog downloads
BA
bartowski
Kudzu-8B-GGUF
Chat & write4.92 GBapache-2.0↓ 1.5K1,459 catalog downloads
QU
QuantFactory
Qwen2.5-Sex-GGUF
Chat & write986 MBapache-2.0↓ 1.5K1,457 catalog downloads
BA
Chat & write7.48 GBapache-2.0↓ 1.5K1,454 catalog downloads
BA
bartowski
nomic-ai_nomic-embed-code-GGUF
Chat & write4.38 GBapache-2.0↓ 1.4K1,448 catalog downloads
BA
bartowski
Reasoning-0.5B-GGUF
Chat & write398 MBapache-2.0↓ 1.4K1,443 catalog downloads