bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
Llama-3-KoEn-8B-GGUF
Chat & write4.92 GBcc-by-nc-sa-4.0↓ 839839 catalog downloads
BA
bartowski
SELM-Llama-3-8B-Instruct-iter-3-GGUF
Chat & write4.92 GBmit↓ 836836 catalog downloads
GG
ggml-org
gemma-4-E4B-GGUF
Work with multiple media8.03 GBapache-2.0↓ 831831 catalog downloads
BA
bartowski
open-thoughts_OpenThinker3-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 830830 catalog downloads
QU
QuantFactory
Llama-3-8B-Instruct-262k-GGUF
Chat & write4.92 GBllama3↓ 829829 catalog downloads
QU
QuantFactory
BgGPT-Gemma-2-9B-IT-v1.0-GGUF
Chat & write5.76 GBgemma↓ 824824 catalog downloads
QU
QuantFactory
Llama3.1-DarkStorm-Aspire-8B-GGUF
Chat & write4.92 GBapache-2.0↓ 821821 catalog downloads
BA
bartowski
Qwentile2.5-32B-Instruct-GGUF
Chat & write19.85 GBapache-2.0↓ 819819 catalog downloads
QU
QuantFactory
gemma-7B-aps-it-GGUF
Chat & write5.33 GBgemma↓ 819819 catalog downloads
BA
bartowski
GRMR-2B-Instruct-GGUF
Chat & write1.71 GBapache-2.0↓ 818818 catalog downloads
QU
QuantFactory
Reasoning-Llama-3B-v0.1-GGUF
Chat & write2.02 GBllama3.2↓ 818818 catalog downloads