QuantFactory
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
Unichat-llama3-Chinese-8B-GGUF
Chat & write4.92 GBapache-2.0↓ 546546 catalog downloads
UN
unsloth
rnj-1-instruct-GGUF
Chat & write5.11 GBapache-2.0↓ 546546 catalog downloads
UN
unsloth
ERNIE-4.5-0.3B-PT-GGUF
Chat & write241 MBapache-2.0↓ 543543 catalog downloads
BA
bartowski
Phi-3-mini-4k-instruct-v0.3-GGUF
Chat & write2.39 GBmit↓ 539539 catalog downloads
TH
TheBloke
Autolycus-Mistral_7B-GGUF
Chat & write4.37 GBapache-2.0↓ 537537 catalog downloads
QU
QuantFactory
KingNish-Llama3-8B-GGUF
Chat & write4.92 GBmit↓ 533533 catalog downloads
QU
QuantFactory
Qwen3-Reranker-0.6B-GGUF
Rank search results484 MBapache-2.0↓ 526526 catalog downloads
BA
bartowski
JetBrains-Qwen3.8-3.6-27B-blend-GGUF
Understand imagesapache-2.0↓ 525525 catalog downloads
BA
bartowski
Mistral-Evolved-11B-v0.1-GGUF
Chat & write6.72 GBapache-2.0↓ 523523 catalog downloads
BA
bartowski
DatacampLlama-3.1-8B-GGUF
Chat & write4.92 GBapache-2.0↓ 521521 catalog downloads
BA
bartowski
Phi-3-mini-4k-instruct-old-GGUF
Chat & write2.39 GBmit↓ 521521 catalog downloads