QuantFactory
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
magnum-v3-9B-customgemma2-GGUF
Chat & write5.76 GBgemma↓ 886886 catalog downloads
BA
bartowski
ozone-ai_Reverb-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 883883 catalog downloads
BA
Chat & write7.48 GBapache-2.0↓ 883883 catalog downloads
TH
TheBloke
MistralLite-7B-GGUF
Chat & write4.37 GBapache-2.0↓ 880880 catalog downloads
QU
QuantFactory
Fireball-3.1-8B-ORPO-GGUF
Chat & write4.92 GBllama3.1↓ 875875 catalog downloads
UN
unsloth
Seed-OSS-36B-Instruct-GGUF
Chat & write21.76 GBapache-2.0↓ 874874 catalog downloads
QU
QuantFactory
Baldur-8B-GGUF
Chat & write4.92 GBagpl-3.0↓ 872872 catalog downloads
BA
bartowski
NightyGurps-14B-v1.1-GGUF
Chat & write8.99 GBapache-2.0↓ 871871 catalog downloads
QU
QuantFactory
Llama-3-8B-Magpie-Pro-SFT-v0.1-GGUF
Chat & write4.92 GBllama3↓ 871871 catalog downloads
BA
Chat & write4.68 GBapache-2.0↓ 869869 catalog downloads
QU
QuantFactory
Llama-3-8B-Magpie-Air-MT-SFT-v0.1-GGUF
Chat & write4.92 GBllama3↓ 865865 catalog downloads