bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
Llama-3.1-8B-ArliAI-RPMax-v1.1-GGUF
Chat & write4.92 GBllama3.1↓ 2.4K2,421 catalog downloads
QU
QuantFactory
Meta-Llama-3.1-8B-Instruct-GGUF
Chat & write4.92 GBllama3.1↓ 2.4K2,417 catalog downloads
BA
bartowski
soob3123_amoral-gemma3-12B-GGUF
Chat & write7.3 GBapache-2.0↓ 2.4K2,414 catalog downloads
BA
Chat & write19.85 GBapache-2.0↓ 2.4K2,411 catalog downloads
BA
bartowski
allenai_Olmo-3.1-32B-Instruct-GGUF
Chat & write19.48 GBapache-2.0↓ 2.4K2,405 catalog downloads
QU
QuantFactory
Llama-3-Yggdrasil-8B-GGUF
Chat & write4.92 GBllama3↓ 2.4K2,394 catalog downloads
UN
unsloth
QwQ-32B-GGUF
Chat & write19.85 GBapache-2.0↓ 2.4K2,392 catalog downloads
BA
bartowski
dolphin-2.9.3-mistral-7B-32k-GGUF
Chat & write4.37 GBapache-2.0↓ 2.4K2,391 catalog downloads
BA
Chat & write7.48 GBapache-2.0↓ 2.4K2,350 catalog downloads
BA
bartowski
kai-os_Carnice-V2-27B-GGUF
Chat & write17.53 GBapache-2.0↓ 2.3K2,317 catalog downloads
UN
unsloth
Qwen3-8B-128K-GGUF
Chat & write5.03 GBapache-2.0↓ 2.3K2,311 catalog downloads