bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
Chat & write4.68 GBapache-2.0↓ 634634 catalog downloads
Chat & write4.37 GBapache-2.0↓ 632632 catalog downloads
BA
bartowski
Teleut-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 620620 catalog downloads
TH
Chat & write6.46 GBapache-2.0↓ 620620 catalog downloads
BA
bartowski
Rombos-Coder-V2.5-Qwen-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 619619 catalog downloads
TH
TheBloke
Panda-7B-v0.1-GGUF
Chat & write4.37 GBapache-2.0↓ 618618 catalog downloads
BA
bartowski
internlm3-8B-instruct-GGUF
Chat & write5.36 GBapache-2.0↓ 613613 catalog downloads
Chat & write4.37 GBapache-2.0↓ 610610 catalog downloads
BA
bartowski
AMD-OLMo-1B-SFT-DPO-GGUF
Chat & write734 MBapache-2.0↓ 608608 catalog downloads
BA
bartowski
Llama3-Crab-DPO-GGUF
Chat & write4.92 GBapache-2.0↓ 608608 catalog downloads
QU
QuantFactory
Ministral-3B-instruct-GGUF
Chat & write2 GBapache-2.0↓ 605605 catalog downloads