QuantFactory
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
glm-4-9B-chat-GGUF
Chat & write6.25 GBNo license stated↓ 840840 catalog downloads
QU
QuantFactory
LongWriter-glm4-9B-GGUF
Chat & write6.25 GBNo license stated↓ 840840 catalog downloads
QU
QuantFactory
Mistral-7B-v0.2-hf-GGUF
Chat & write4.37 GBNo license stated↓ 831831 catalog downloads
QU
Chat & write4.92 GBNo license stated↓ 828828 catalog downloads
QU
QuantFactory
Meta-Llama-Guard-2-8B-GGUF
Chat & write4.92 GBNo license stated↓ 806806 catalog downloads
QU
QuantFactory
Book-Gut12B-GGUF
Chat & write7.48 GBNo license stated↓ 805805 catalog downloads
QU
QuantFactory
Gemma-2-2B-TitanFusion-GGUF
Chat & write1.71 GBNo license stated↓ 798798 catalog downloads
QU
QuantFactory
Llama-3-Instruct-8B-RDPO-GGUF
Chat & write4.92 GBNo license stated↓ 782782 catalog downloads
QU
QuantFactory
Einstein-v6.1-Llama3-8B-GGUF
Chat & write4.92 GBNo license stated↓ 763763 catalog downloads
QU
QuantFactory
OrpoLlama-3-8B-GGUF
Chat & write4.92 GBNo license stated↓ 761761 catalog downloads
QU
QuantFactory
Llama-3-Instruct-8B-DPO-GGUF
Chat & write4.92 GBNo license stated↓ 739739 catalog downloads