ggml-org
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
gemma-2-9B-it-SimPO-rudpo-GGUF
Chat & write5.76 GBgemma↓ 1.1K1,094 catalog downloads
QU
QuantFactory
llama-3-Nephilim-v3-8B-GGUF
Chat & write4.92 GBcc-by-nc-4.0↓ 1.1K1,092 catalog downloads
UN
unsloth
OLMo-2-0425-1B-Instruct-GGUF
Chat & write936 MBapache-2.0↓ 1.1K1,085 catalog downloads
QU
QuantFactory
Turkish-Llama-8B-Instruct-v0.1-GGUF
Chat & write4.92 GBllama3↓ 1.1K1,083 catalog downloads
BA
Chat & write4.12 GBapache-2.0↓ 1.1K1,079 catalog downloads
QU
QuantFactory
Qwen2.5-7B-Gutenberg-KTO-GGUF
Chat & write4.68 GBgpl-3.0↓ 1.1K1,079 catalog downloads
QU
QuantFactory
Llama-3-8B-WizardLM-196K-GGUF
Chat & write4.92 GBllama3↓ 1.1K1,076 catalog downloads
BA
Chat & write7.48 GBapache-2.0↓ 1.1K1,073 catalog downloads
BA
Chat & write8.99 GBapache-2.0↓ 1.1K1,072 catalog downloads
BA
bartowski
Qwen2.5-32B-ArliAI-RPMax-v1.3-GGUF
Chat & write19.85 GBapache-2.0↓ 1.1K1,072 catalog downloads
TH
TheBloke
typhoon-7B-GGUF
Chat & write4.39 GBapache-2.0↓ 1.1K1,067 catalog downloads