unsloth
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
UN
unsloth
Hy-MT2-1.8B-GGUF
Translate text1.13 GBapache-2.0↓ 3K3,001 catalog downloads
BA
bartowski
Gryphe_Codex-24B-Small-3.2-GGUF
Chat & write14.33 GBapache-2.0↓ 3K2,969 catalog downloads
LM
lmstudio-community
Qwen3-0.6B-GGUF
Chat & write484 MBapache-2.0↓ 3K2,961 catalog downloads
TH
TheBloke
dolphin-2.1-mistral-7B-GGUF
Chat & write4.37 GBapache-2.0↓ 3K2,960 catalog downloads
Chat & write14.33 GBapache-2.0↓ 2.9K2,948 catalog downloads
BA
bartowski
functionary-small-v3.2-GGUF
Chat & write4.92 GBmit↓ 2.9K2,925 catalog downloads
LM
lmstudio-community
Qwen2.5-1.5B-Instruct-GGUF
Chat & write986 MBapache-2.0↓ 2.9K2,925 catalog downloads
Chat & write19.85 GBapache-2.0↓ 2.9K2,910 catalog downloads
BA
Chat & write8.99 GBmit↓ 2.9K2,878 catalog downloads
BA
bartowski
soob3123_amoral-gemma3-4B-GGUF
Chat & write2.49 GBapache-2.0↓ 2.8K2,821 catalog downloads
BA
bartowski
v6-Finch-3B-HF-GGUF
Chat & write1.92 GBapache-2.0↓ 2.8K2,803 catalog downloads