unsloth
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
UN
unsloth
bge-small-en-v1.5-GGUF
Search documentsmit↓ 135.8K135,750 catalog downloads
UN
unsloth
Qwen3.5-35B-A3B-GGUF
Understand imagesapache-2.0↓ 135.5K135,518 catalog downloads
UN
unsloth
Qwen3.5-9B-MTP-GGUF
Understand imagesapache-2.0↓ 134.2K134,170 catalog downloads
UN
unsloth
Qwen3-4B-GGUF
Chat & write2.5 GBapache-2.0↓ 129.7K129,667 catalog downloads
UN
unsloth
DeepSeek-V4-Flash-GGUF
Generalmit↓ 125.2K125,222 catalog downloads
UN
unsloth
Qwen3-8B-GGUF
Chat & write5.03 GBapache-2.0↓ 124.2K124,199 catalog downloads
BA
bartowski
Ornith-1.5-35B-A3B-GGUF
Understand imagesmit↓ 120.9K120,856 catalog downloads
BA
bartowski
Llama-3.2-1B-Instruct-GGUF
Chat & write808 MBllama3.2↓ 120.6K120,573 catalog downloads
BA
bartowski
Qwen2.5-7B-Instruct-GGUF
Chat & write4.68 GBapache-2.0↓ 119.1K119,149 catalog downloads
UN
unsloth
Qwen-AgentWorld-35B-A3B-GGUF
Chat & writeapache-2.0↓ 116.7K116,693 catalog downloads
UN
unsloth
Qwen3.5-4B-MTP-GGUF
Understand imagesapache-2.0↓ 115.6K115,580 catalog downloads