QuantFactory
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
Chat & write4.68 GBapache-2.0↓ 869869 catalog downloads
QU
QuantFactory
Llama-3-8B-Magpie-Air-MT-SFT-v0.1-GGUF
Chat & write4.92 GBllama3↓ 865865 catalog downloads
QU
QuantFactory
Llama3.1-8B-PRM-Deepseek-Data-GGUF
Chat & write4.92 GBNo license stated↓ 1.1K1,143 catalog downloads
QU
QuantFactory
Llama3-8B-Chinese-Chat-GGUF
Chat & write4.92 GBNo license stated↓ 1.1K1,106 catalog downloads
QU
QuantFactory
Llama3-DocChat-1.0-8B-GGUF
Chat & write4.92 GBNo license stated↓ 1.1K1,101 catalog downloads
QU
QuantFactory
Reflection-Llama-3.1-8B-GGUF
Chat & write4.92 GBNo license stated↓ 1.1K1,085 catalog downloads
QU
QuantFactory
gemma-2-9B-it-DPO-GGUF
Chat & write5.76 GBNo license stated↓ 1.1K1,066 catalog downloads
QU
QuantFactory
Llama-3-13B-Instruct-v0.1-GGUF
Chat & write8.06 GBNo license stated↓ 1.1K1,066 catalog downloads
QU
QuantFactory
ChimeraLlama-3-8B-v3-GGUF
Chat & write4.92 GBNo license stated↓ 1K1,047 catalog downloads
GG
ggml-org
gemma-3-270m-GGUF
General292 MBNo license stated↓ 1K1,040 catalog downloads
QU
QuantFactory
Codestral-22B-v0.1-GGUF
Chat & write13.34 GBNo license stated↓ 1K1,037 catalog downloads