bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Rombos-Coder-V2.5-Qwen-32B-GGUF
Chat & write19.85 GBapache-2.0↓ 1.2K1,238 catalog downloads
QU
QuantFactory
Mistral-Nemo-Instruct-2407-abliterated-GGUF
Chat & write7.48 GBapache-2.0↓ 1.2K1,238 catalog downloads
TH
TheBloke
dolphin-2.6-mistral-7B-dpo-GGUF
Chat & write4.37 GBapache-2.0↓ 1.2K1,235 catalog downloads
BA
bartowski
llm_calculator_v0.1-GGUF
Chat & write986 MBapache-2.0↓ 1.2K1,234 catalog downloads
QU
QuantFactory
Llama-3-WhiteRabbitNeo-8B-v2.0-GGUF
Chat & write4.92 GBllama3↓ 1.2K1,233 catalog downloads
UN
unsloth
DeepSeek-V3.1-Terminus-GGUF
Chat & writemit↓ 1.2K1,231 catalog downloads
UN
unsloth
ERNIE-4.5-21B-A3B-PT-GGUF
Chat & write13.33 GBapache-2.0↓ 1.2K1,224 catalog downloads
UN
unsloth
Seed-Coder-8B-Reasoning-GGUF
Chat & write5.07 GBmit↓ 1.2K1,224 catalog downloads
BA
Chat & write4.92 GBapache-2.0↓ 1.2K1,221 catalog downloads
QU
QuantFactory
dolphin-2.9.4-llama3.1-8B-GGUF
Chat & write4.92 GBllama3.1↓ 1.2K1,220 catalog downloads
BA
Chat & write7.48 GBapache-2.0↓ 1.2K1,217 catalog downloads