QuantFactory
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
Llama-3-Open-Ko-8B-GGUF
Chat & write4.92 GBNo license stated↓ 1K1,025 catalog downloads
QU
QuantFactory
Teuken-7B-instruct-research-v0.4-GGUF
Chat & write5.02 GBNo license stated↓ 1K1,013 catalog downloads
QU
QuantFactory
DeepSeek-Coder-V2-Lite-Instruct-GGUF
Chat & write10.36 GBNo license stated↓ 1K1,008 catalog downloads
QU
QuantFactory
Daredevil-8B-abliterated-GGUF
Chat & write4.92 GBNo license stated↓ 1K1,000 catalog downloads
QU
QuantFactory
falcon-mamba-7B-instruct-GGUF
Chat & write4.2 GBNo license stated↓ 1K1,000 catalog downloads
QU
QuantFactory
Skywork-Critic-Llama-3.1-8B-GGUF
Chat & write4.92 GBNo license stated↓ 991991 catalog downloads
QU
QuantFactory
L3.1-Storniitova-8B-GGUF
Chat & write4.92 GBNo license stated↓ 989989 catalog downloads
QU
QuantFactory
L3.1-Celestial-Stone-2x8B-GGUF
Chat & write8.33 GBNo license stated↓ 975975 catalog downloads
QU
QuantFactory
Hathor_Tahsin-L3-8B-v0.85-GGUF
Chat & write4.92 GBNo license stated↓ 974974 catalog downloads
QU
QuantFactory
Qwen-2.5-3B-Evol-CoT-GGUF
Chat & write1.93 GBNo license stated↓ 968968 catalog downloads
QU
QuantFactory
qwen2.5-reinstruct-alternate-lumen-14B-GGUF
Chat & write8.99 GBNo license stated↓ 966966 catalog downloads