bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Crimson_Dawn-v0.2-GGUF
Chat & write7.48 GBapache-2.0↓ 578578 catalog downloads
BA
bartowski
Qwen2-Math-7B-Instruct-GGUF
Chat & write4.68 GBapache-2.0↓ 575575 catalog downloads
BA
bartowski
OpenChat-3.5-0106_32K-PoSE-GGUF
Chat & write4.37 GBapache-2.0↓ 574574 catalog downloads
BA
bartowski
HuatuoGPT-o1-7B-v0.1-GGUF
Chat & write4.68 GBapache-2.0↓ 573573 catalog downloads
BA
bartowski
TQ2.5-14B-Neon-v1-GGUF
Chat & write8.99 GBapache-2.0↓ 572572 catalog downloads
TH
Chat & write4.37 GBapache-2.0↓ 569569 catalog downloads
BA
bartowski
NuminaMath-7B-TIR-GGUF
Chat & write4.22 GBapache-2.0↓ 567567 catalog downloads
QU
QuantFactory
Vikhr-Llama3.1-8B-Instruct-R-21-09-24-GGUF
Chat & write4.92 GBapache-2.0↓ 565565 catalog downloads
QU
QuantFactory
Vikhr-Nemo-12B-Instruct-R-21-09-24-GGUF
Chat & write7.48 GBapache-2.0↓ 565565 catalog downloads
QU
QuantFactory
granite-3B-code-base-2k-GGUF
Chat & write2.13 GBapache-2.0↓ 558558 catalog downloads
BA
Chat & write808 MBapache-2.0↓ 555555 catalog downloads