Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Gemma2-Gutenberg-Doppel-9B-GGUF
Chat & write5.76 GBgemma↓ 4.8K4,765 catalog downloads
BA
bartowski
Dolphin3.0-Llama3.2-1B-GGUF
Chat & write808 MBllama3.2↓ 4.8K4,764 catalog downloads
UN
Chat & write8.99 GBapache-2.0↓ 4.8K4,757 catalog downloads
GG
ggml-org
functiongemma-270m-it-GGUF
Chat & write292 MBgemma↓ 4.7K4,711 catalog downloads
BA
bartowski
THUDM_GLM-4-32B-0414-GGUF
Chat & write19.68 GBmit↓ 4.7K4,670 catalog downloads
TH
TheBloke
Mistral-7B-OpenOrca-GGUF
Chat & write4.37 GBapache-2.0↓ 4.7K4,652 catalog downloads
BA
Chat & write14.33 GBapache-2.0↓ 4.6K4,631 catalog downloads
GG
Chat & write8.1 GBapache-2.0↓ 4.6K4,621 catalog downloads
GG
ggml-org
Qwen3-1.7B-GGUF
Chat & write1.28 GBapache-2.0↓ 4.6K4,605 catalog downloads
BA
bartowski
llama3.1-airoboros3.2-QDT-8B-GGUF
Chat & write4.92 GBllama3↓ 4.6K4,562 catalog downloads
BA
bartowski
Qwen_QwQ-32B-GGUF
Chat & writeapache-2.0↓ 4.5K4,537 catalog downloads