bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Sailor2-8B-Chat-GGUF
Chat & write5.24 GBapache-2.0↓ 1.1K1,137 catalog downloads
BA
Chat & write8.4 GBmit↓ 1.1K1,134 catalog downloads
QU
QuantFactory
Llama3.2-3B-Esper2-GGUF
Chat & write2.02 GBllama3.2↓ 1.1K1,131 catalog downloads
BA
bartowski
Replete-LLM-V2.5-Qwen-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 1.1K1,130 catalog downloads
BA
bartowski
Pantheon-RP-1.6.1-12B-Nemo-GGUF
Chat & write7.48 GBapache-2.0↓ 1.1K1,126 catalog downloads
BA
bartowski
Impish_Mind_8B-GGUF
Chat & write4.92 GBapache-2.0↓ 1.1K1,121 catalog downloads
BA
Chat & write7.48 GBapache-2.0↓ 1.1K1,120 catalog downloads
TH
TheBloke
Llama-2-Coder-7B-GGUF
Chat & write4.08 GBapache-2.0↓ 1.1K1,119 catalog downloads
QU
QuantFactory
Llama-Guard-3-1B-GGUF
Chat & write955 MBllama3.2↓ 1.1K1,118 catalog downloads
BA
bartowski
FineLlama-3.1-8B-GGUF
Chat & write4.92 GBapache-2.0↓ 1.1K1,108 catalog downloads
QU
QuantFactory
Gemma-2-9B-ArliAI-RPMax-v1.1-GGUF
Chat & write5.76 GBgemma↓ 1.1K1,107 catalog downloads