Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
Llama-3-Smaug-8B-GGUF
Chat & write4.92 GBllama2↓ 1.3K1,269 catalog downloads
BA
bartowski
LatitudeGames_Hearthfire-24B-GGUF
Chat & write14.33 GBapache-2.0↓ 1.3K1,265 catalog downloads
QU
QuantFactory
Qwen2.5-Coder-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 1.3K1,264 catalog downloads
QU
QuantFactory
Dolphin3.0-Llama3.2-1B-GGUF
Chat & write955 MBllama3.2↓ 1.3K1,261 catalog downloads
QU
QuantFactory
Gemma-2-2B-Chinese-it-GGUF
Chat & write1.71 GBgpl-3.0↓ 1.3K1,261 catalog downloads
QU
QuantFactory
SOLAR-10.7B-Instruct-v1.0-GGUF
Chat & write6.46 GBcc-by-nc-4.0↓ 1.3K1,251 catalog downloads
QU
QuantFactory
L3.1-Aglow-Vulca-v0.1-8B-GGUF
Chat & write4.92 GBcc-by-nc-4.0↓ 1.2K1,248 catalog downloads
BA
bartowski
simplescaling_s1.1-32B-GGUF
Chat & write19.85 GBapache-2.0↓ 1.2K1,246 catalog downloads
QU
QuantFactory
Llama-3-8B-Web-GGUF
Chat & write4.92 GBllama3↓ 1.2K1,242 catalog downloads
BA
bartowski
Menlo_Jan-nano-GGUF
Chat & write2.5 GBapache-2.0↓ 1.2K1,240 catalog downloads
BA
bartowski
OLMoE-1B-7B-0924-Instruct-GGUF
Chat & write4.21 GBapache-2.0↓ 1.2K1,239 catalog downloads