QuantFactory
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
MN-12B-RP-Ink-GGUF
Chat & write7.48 GBapache-2.0↓ 969969 catalog downloads
BA
Chat & write19.85 GBapache-2.0↓ 969969 catalog downloads
BA
bartowski
Replete-LLM-V2.5-Qwen-3B-GGUF
Chat & write2.1 GBapache-2.0↓ 968968 catalog downloads
BA
bartowski
Qwen2-0.5B-Instruct-GGUF
Chat & write398 MBapache-2.0↓ 966966 catalog downloads
BA
bartowski
Samantha-Qwen-2-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 964964 catalog downloads
QU
QuantFactory
Llama3.1-8B-Cobalt-GGUF
Chat & write4.92 GBllama3.1↓ 959959 catalog downloads
QU
QuantFactory
Infinity-Instruct-7M-Gen-Llama3_1-8B-GGUF
Chat & write4.92 GBllama3.1↓ 958958 catalog downloads
QU
QuantFactory
ArliAI-Llama-3-8B-Dolfin-v0.5-GGUF
Chat & write4.92 GBllama3↓ 957957 catalog downloads
QU
QuantFactory
Llama3.1-8B-Fireplace2-GGUF
Chat & write4.92 GBllama3.1↓ 957957 catalog downloads
BA
bartowski
YuLan-Mini-GGUF
Chat & write1.85 GBmit↓ 955955 catalog downloads
QU
QuantFactory
finance-Llama3-8B-GGUF
Chat & write4.92 GBllama3↓ 955955 catalog downloads