QuantFactory
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Aion-RP-Llama-3.1-8B-GGUF
Chat & write4.92 GBapache-2.0↓ 1.8K1,753 catalog downloads
QU
QuantFactory
Llama-3.2-1B-Instruct-GGUF
Chat & write808 MBllama3.2↓ 1.8K1,750 catalog downloads
BA
bartowski
kalomaze_Qwen3-16B-A3B-GGUF
Chat & write9.83 GBapache-2.0↓ 1.7K1,747 catalog downloads
GG
Chat & write1.65 GBapache-2.0↓ 1.7K1,741 catalog downloads
BA
Chat & write19.6 GBapache-2.0↓ 1.7K1,739 catalog downloads
BA
bartowski
granite-embedding-30m-english-GGUF
Chat & write30 MBapache-2.0↓ 1.7K1,729 catalog downloads
BA
bartowski
NousResearch_NousCoder-14B-GGUF
Chat & write9 GBapache-2.0↓ 1.7K1,718 catalog downloads
BA
bartowski
magnum-v2-4B-GGUF
Chat & write2.78 GBapache-2.0↓ 1.7K1,717 catalog downloads
Chat & write14.33 GBapache-2.0↓ 1.7K1,713 catalog downloads
QU
QuantFactory
Llama-3-8B-Lexi-Uncensored-GGUF
Chat & write4.92 GBllama3↓ 1.7K1,711 catalog downloads
LM
lmstudio-community
granite-4.2-3B-GGUF
Chat & write2.24 GBapache-2.0↓ 1.7K1,709 catalog downloads