unsloth
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
dolphin-2.9.3-mistral-7B-32k-GGUF
Chat & write4.37 GBapache-2.0↓ 2.4K2,391 catalog downloads
BA
Chat & write7.48 GBapache-2.0↓ 2.4K2,350 catalog downloads
BA
bartowski
kai-os_Carnice-V2-27B-GGUF
Chat & write17.53 GBapache-2.0↓ 2.3K2,317 catalog downloads
UN
unsloth
Qwen3-8B-128K-GGUF
Chat & write5.03 GBapache-2.0↓ 2.3K2,311 catalog downloads
UN
unsloth
Qwen3-30B-A3B-128K-GGUF
Chat & write18.56 GBapache-2.0↓ 2.3K2,301 catalog downloads
BA
bartowski
Perciqa_Aurora-Code-1-GGUF
Chat & write21.39 GBapache-2.0↓ 2.3K2,272 catalog downloads
BA
bartowski
PygmalionAI_Pygmalion-3-12B-GGUF
Chat & write7.48 GBapache-2.0↓ 2.3K2,267 catalog downloads
GG
ggml-org
gemma-3n-E4B-it-GGUF
Chat & write7.35 GBgemma↓ 2.3K2,259 catalog downloads
BA
bartowski
granite-3.1-1B-a400m-instruct-GGUF
Chat & write822 MBapache-2.0↓ 2.3K2,258 catalog downloads
QU
QuantFactory
EVA-D-Qwen2.5-1.5B-v0.0-GGUF
Chat & write986 MBapache-2.0↓ 2.2K2,246 catalog downloads
BA
bartowski
Phi-3.1-mini-4k-instruct-GGUF
Chat & write2.39 GBmit↓ 2.2K2,239 catalog downloads