Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
TH
TheBloke
DiscoLM_German_7b_v1-GGUF
Chat & write4.37 GBapache-2.0↓ 994994 catalog downloads
QU
QuantFactory
SauerkrautLM-gemma-2-9B-it-GGUF
Chat & write5.76 GBgemma↓ 993993 catalog downloads
BA
bartowski
SamsungSAILMontreal_ByteCraft-GGUF
Chat & write5.22 GBmit↓ 992992 catalog downloads
BA
bartowski
Ichigo-llama3.1-s-instruct-v0.4-GGUF
Chat & write4.92 GBapache-2.0↓ 988988 catalog downloads
TH
TheBloke
Nous-Capybara-34B-GGUF
Chat & write20.66 GBmit↓ 988988 catalog downloads
UN
unsloth
SmolLM2-360M-Instruct-GGUF
Chat & write271 MBapache-2.0↓ 988988 catalog downloads
BA
bartowski
open-thoughts_OpenThinker-32B-GGUF
Chat & write19.85 GBapache-2.0↓ 985985 catalog downloads
QU
QuantFactory
Phi-3-mini-4k-instruct-Matter-0.1-Slim-A-GGUF
Chat & write2.32 GBapache-2.0↓ 985985 catalog downloads
BA
Chat & write19.85 GBapache-2.0↓ 981981 catalog downloads
BA
bartowski
StarDust-12B-v2-GGUF
Chat & write7.48 GBapache-2.0↓ 980980 catalog downloads
BA
bartowski
granite-3.0-8B-instruct-GGUF
Chat & write4.94 GBapache-2.0↓ 975975 catalog downloads