ibm-granite
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
IB
ibm-granite
granite-4.0-h-350m-GGUF
Chat & write223 MBapache-2.0↓ 1.2K1,227 catalog downloads
IB
ibm-granite
granite-3.3-8B-instruct-GGUF
Chat & write4.94 GBapache-2.0↓ 1.2K1,163 catalog downloads
UN
Chat & write4.92 GBllama3.1↓ 45.9K45,922 catalog downloads
TH
TheBloke
Llama-2-7B-Chat-GGUF
Chat & write4.08 GBllama2↓ 45.2K45,248 catalog downloads
BA
bartowski
Qwen_Qwen3.5-9B-GGUF
Understand imagesapache-2.0↓ 45.1K45,105 catalog downloads
BA
bartowski
SmolLM2-1.7B-Instruct-GGUF
Chat & write1.06 GBapache-2.0↓ 44.1K44,099 catalog downloads
BA
bartowski
google_gemma-4-E4B-it-GGUF
Understand imagesapache-2.0↓ 42K42,019 catalog downloads
UN
unsloth
Llama-3.2-1B-Instruct-GGUF
Chat & write808 MBllama3.2↓ 40.1K40,108 catalog downloads
BA
bartowski
Qwen2.5-Coder-7B-Instruct-GGUF
Chat & write4.68 GBapache-2.0↓ 39.6K39,572 catalog downloads
UN
unsloth
gemma-3-1B-it-GGUF
Chat & write806 MBgemma↓ 38.4K38,430 catalog downloads
TH
TheBloke
TinyLlama-1.1B-Chat-v0.3-GGUF
Chat & write668 MBapache-2.0↓ 38.2K38,184 catalog downloads