bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
miscii-14B-1028-GGUF
Chat & write8.99 GBapache-2.0↓ 1.3K1,348 catalog downloads
TH
TheBloke
em_german_mistral_v01-GGUF
Chat & write4.37 GBapache-2.0↓ 1.3K1,342 catalog downloads
LM
lmstudio-community
Llama-3-Groq-8B-Tool-Use-GGUF
Chat & write4.92 GBllama3↓ 1.3K1,339 catalog downloads
QU
QuantFactory
gemma-2-27B-it-abliterated-GGUF
Chat & write16.65 GBgemma↓ 1.3K1,339 catalog downloads
QU
QuantFactory
Dorna-Llama3-8B-Instruct-GGUF
Chat & write4.92 GBllama3↓ 1.3K1,336 catalog downloads
LM
lmstudio-community
aya-expanse-8B-GGUF
Chat & write5.06 GBcc-by-nc-4.0↓ 1.3K1,329 catalog downloads
QU
QuantFactory
Llama-3-Groq-8B-Tool-Use-GGUF
Chat & write4.92 GBllama3↓ 1.3K1,328 catalog downloads
QU
QuantFactory
gemma-2-9B-GGUF
Chat & write5.76 GBgemma↓ 1.3K1,325 catalog downloads
QU
QuantFactory
Qwen2.5-1.5B-Instruct-GGUF
Chat & write986 MBapache-2.0↓ 1.3K1,324 catalog downloads
QU
QuantFactory
Llama-3-Instruct-8B-SimPO-ExPO-GGUF
Chat & write4.92 GBllama3↓ 1.3K1,321 catalog downloads
UN
unsloth
Qwen3-16B-A3B-GGUF
Chat & write9.75 GBapache-2.0↓ 1.3K1,316 catalog downloads