QuantFactory
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
Qwen2.5-Coder-1.5B-GGUF
Chat & write986 MBapache-2.0↓ 604604 catalog downloads
UN
unsloth
Olmo-3-32B-Think-GGUF
Chat & write19.48 GBapache-2.0↓ 601601 catalog downloads
UN
unsloth
Jan-nano-128k-GGUF
Chat & write2.5 GBapache-2.0↓ 598598 catalog downloads
Chat & write4.68 GBapache-2.0↓ 597597 catalog downloads
BA
bartowski
Replete-LLM-Mist-Nemo-12B-GGUF
Chat & write7.48 GBapache-2.0↓ 592592 catalog downloads
QU
QuantFactory
Mistral-Nemo-Instruct-2407-GGUF
Chat & write7.48 GBapache-2.0↓ 592592 catalog downloads
QU
QuantFactory
dolphin-2.8-mistral-7B-v02-GGUF
Chat & write4.37 GBapache-2.0↓ 591591 catalog downloads
TH
Chat & write28.45 GBapache-2.0↓ 587587 catalog downloads
LM
lmstudio-community
nomic-embed-code-GGUF
Chat & write4.38 GBapache-2.0↓ 584584 catalog downloads
TH
TheBloke
Nous-Hermes-Llama-2-7B-GGUF
Chat & write4.08 GBmit↓ 584584 catalog downloads
LM
lmstudio-community
Qwen2-500M-Instruct-GGUF
Chat & write398 MBapache-2.0↓ 583583 catalog downloads