unsloth
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Llama-3-8B-Instruct-Coder-v2-GGUF
Chat & write4.92 GBapache-2.0↓ 2.3K2,271 catalog downloads
BA
bartowski
PygmalionAI_Pygmalion-3-12B-GGUF
Chat & write7.48 GBapache-2.0↓ 2.3K2,267 catalog downloads
GG
ggml-org
gemma-3n-E4B-it-GGUF
Chat & write7.35 GBgemma↓ 2.3K2,259 catalog downloads
BA
bartowski
granite-3.1-1B-a400m-instruct-GGUF
Chat & write822 MBapache-2.0↓ 2.3K2,258 catalog downloads
QU
QuantFactory
EVA-D-Qwen2.5-1.5B-v0.0-GGUF
Chat & write986 MBapache-2.0↓ 2.2K2,246 catalog downloads
BA
bartowski
Phi-3.1-mini-4k-instruct-GGUF
Chat & write2.39 GBmit↓ 2.2K2,239 catalog downloads
QU
QuantFactory
L3-8B-Stheno-v3.2-GGUF
Chat & write4.92 GBcc-by-nc-4.0↓ 2.2K2,235 catalog downloads
UN
unsloth
granite-4.0-h-small-GGUF
Chat & writeapache-2.0↓ 2.2K2,235 catalog downloads
BA
Chat & write7.48 GBapache-2.0↓ 2.2K2,232 catalog downloads
UN
unsloth
orpheus-3B-0.1-ft-GGUF
Read text aloud2.09 GBapache-2.0↓ 2.2K2,204 catalog downloads
TH
TheBloke
Mistral-7B-Code-16K-qlora-GGUF
General4.37 GBapache-2.0↓ 2.2K2,191 catalog downloads