bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
LM
lmstudio-community
Llama3-ChatQA-1.5-8B-GGUF
Chat & write4.92 GBllama3↓ 1.3K1,314 catalog downloads
QU
QuantFactory
llama-3-sqlcoder-8B-GGUF
Chat & write4.92 GBcc-by-sa-4.0↓ 1.3K1,311 catalog downloads
QU
QuantFactory
Llama3.2-3B-Enigma-GGUF
Chat & write2.02 GBllama3.2↓ 1.3K1,307 catalog downloads
BA
bartowski
Pantheon-RP-1.5-12B-Nemo-GGUF
Chat & write7.48 GBapache-2.0↓ 1.3K1,298 catalog downloads
QU
QuantFactory
Hermes-3-Llama-3.1-8B-GGUF
Chat & write4.92 GBllama3↓ 1.3K1,298 catalog downloads
BA
bartowski
Replete-LLM-V2.5-Qwen-1.5B-GGUF
Chat & write1.12 GBapache-2.0↓ 1.3K1,291 catalog downloads
GG
ggml-org
Qwen3-4B-GGUF
Chat & write2.5 GBapache-2.0↓ 1.3K1,290 catalog downloads
BA
Chat & write1.12 GBmit↓ 1.3K1,287 catalog downloads
BA
bartowski
knoveleng_Open-RS3-GGUF
Chat & write1.12 GBmit↓ 1.3K1,283 catalog downloads
BA
bartowski
miscii-14B-1225-GGUF
Chat & write8.99 GBapache-2.0↓ 1.3K1,281 catalog downloads
BA
Chat & write14.33 GBapache-2.0↓ 1.3K1,274 catalog downloads