Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
Chat & write18.75 GBapache-2.0↓ 6.1K6,075 catalog downloads
BA
bartowski
c4ai-command-r-v01-GGUF
Chat & write21.53 GBcc-by-nc-4.0↓ 5.9K5,939 catalog downloads
Chat & writeapache-2.0↓ 5.9K5,913 catalog downloads
BA
bartowski
Qwen2.5-14B_Uncencored-GGUF
Chat & write8.99 GBapache-2.0↓ 5.8K5,790 catalog downloads
Chat & write6.46 GBapache-2.0↓ 5.8K5,750 catalog downloads
TH
TheBloke
dolphin-2.6-mistral-7B-GGUF
Chat & write4.37 GBapache-2.0↓ 5.6K5,596 catalog downloads
BA
Chat & write20.04 GBmit↓ 5.6K5,574 catalog downloads
BA
bartowski
Mellum2-12B-A2.5B-Instruct-GGUF
Chat & write8.17 GBapache-2.0↓ 5.6K5,573 catalog downloads
UN
Chat & write1.93 GBapache-2.0↓ 5.6K5,566 catalog downloads
BA
bartowski
Yi-1.5-6B-Chat-GGUF
Chat & write3.67 GBapache-2.0↓ 5.5K5,511 catalog downloads
BA
bartowski
Trappu_Magnum-Picaro-0.7-v2-12B-GGUF
Chat & write7.48 GBapache-2.0↓ 5.4K5,422 catalog downloads