QuantFactory
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
Loki-v2.6-8B-1024k-GGUF
Chat & write4.92 GBNo license stated↓ 1.4K1,355 catalog downloads
QU
QuantFactory
MythoMax-L2-13B-GGUF
Chat & write4.92 GBNo license stated↓ 1.3K1,344 catalog downloads
QU
QuantFactory
CodeLlama-7B-Instruct-hf-GGUF
Chat & write4.08 GBNo license stated↓ 1.3K1,338 catalog downloads
QU
QuantFactory
deepseek-math-7B-instruct-GGUF
Chat & write4.22 GBNo license stated↓ 1.3K1,334 catalog downloads
QU
QuantFactory
Captain-Eris_Violet-V0.420-12B-GGUF
Chat & write7.48 GBNo license stated↓ 1.3K1,306 catalog downloads
QU
QuantFactory
Llama-3.1-Korean-8B-Instruct-GGUF
Chat & write4.92 GBNo license stated↓ 1.3K1,296 catalog downloads
QU
QuantFactory
SmallThinker-3B-Preview-abliterated-GGUF
Chat & write2.1 GBNo license stated↓ 1.3K1,288 catalog downloads
QU
QuantFactory
LLama-3.1-Hyper-Stock-GGUF
Chat & write4.92 GBNo license stated↓ 1.3K1,278 catalog downloads
BA
bartowski
internlm2_5-1_8b-chat-GGUF
Chat & write1.17 GBNo license stated↓ 1.3K1,270 catalog downloads
QU
QuantFactory
L3-bluuwhale-SAO-MIX-8B-V1_fp32-merge-calc-GGUF
Chat & write4.92 GBNo license stated↓ 1.3K1,260 catalog downloads
QU
QuantFactory
Bio-Medical-Llama-3-8B-GGUF
Chat & write4.92 GBNo license stated↓ 1.2K1,224 catalog downloads