ibm-granite
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
UN
Chat & write4.92 GBllama3.1↓ 45.9K45,922 catalog downloads
TH
TheBloke
Llama-2-7B-Chat-GGUF
Chat & write4.08 GBllama2↓ 45.2K45,248 catalog downloads
BA
bartowski
Qwen_Qwen3.5-9B-GGUF
Understand imagesapache-2.0↓ 45.1K45,105 catalog downloads
BA
bartowski
SmolLM2-1.7B-Instruct-GGUF
Chat & write1.06 GBapache-2.0↓ 44.1K44,099 catalog downloads
BA
bartowski
google_gemma-4-E4B-it-GGUF
Understand imagesapache-2.0↓ 42K42,019 catalog downloads
UN
unsloth
Llama-3.2-1B-Instruct-GGUF
Chat & write808 MBllama3.2↓ 40.1K40,108 catalog downloads
BA
bartowski
Qwen2.5-Coder-7B-Instruct-GGUF
Chat & write4.68 GBapache-2.0↓ 39.6K39,572 catalog downloads
TH
TheBloke
TinyLlama-1.1B-Chat-v0.3-GGUF
Chat & write668 MBapache-2.0↓ 38.2K38,184 catalog downloads
BA
bartowski
Qwen2.5-1.5B-Instruct-GGUF
Chat & write986 MBapache-2.0↓ 36.9K36,927 catalog downloads
TH
Chat & write4.08 GBNo license stated↓ 42.8K42,781 catalog downloads
BA
bartowski
microsoft_Phi-4-mini-instruct-GGUF
Chat & write2.49 GBNo license stated↓ 41.7K41,734 catalog downloads