QuantFactory
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Pantheon-RP-1.0-8B-Llama-3-GGUF
Chat & write4.92 GBapache-2.0↓ 1.5K1,529 catalog downloads
BA
bartowski
SlimOrca-Llama-3-8B-GGUF
Chat & write4.92 GBapache-2.0↓ 1.5K1,520 catalog downloads
LM
lmstudio-community
Phi-3.1-mini-128k-instruct-GGUF
Chat & write2.39 GBmit↓ 1.5K1,515 catalog downloads
BA
bartowski
maverick-llama3-8B-GGUF
Chat & write4.92 GBapache-2.0↓ 1.5K1,509 catalog downloads
LM
lmstudio-community
codegemma-1.1-7B-it-GGUF
Chat & write5.33 GBgemma↓ 1.5K1,509 catalog downloads
UN
unsloth
granite-4.0-h-1B-GGUF
Chat & write901 MBapache-2.0↓ 1.5K1,508 catalog downloads
BA
bartowski
Yi-Coder-1.5B-GGUF
Chat & write964 MBapache-2.0↓ 1.5K1,502 catalog downloads
BA
bartowski
open-thoughts_OpenThinker2-32B-GGUF
Chat & write19.85 GBapache-2.0↓ 1.5K1,498 catalog downloads
BA
Chat & writeapache-2.0↓ 1.5K1,493 catalog downloads
BA
bartowski
Zenith_4B-GGUF
Chat & write2.78 GBapache-2.0↓ 1.5K1,493 catalog downloads
BA
bartowski
internlm_OREAL-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 1.5K1,480 catalog downloads