Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
CU
culturerevolt
gemma-4-12B-heretic-abliterated-GGUF
Chat & writeapache-2.0↓ 37.6K37,557 catalog downloads
0B
0bserverx
Qwen3.8-27B-Heretic-GSQ-RCO-GGUF
Chat & writeapache-2.0↓ 37.2K37,166 catalog downloads
Understand imagesapache-2.0↓ 36.8K36,772 catalog downloads
Generalapache-2.0↓ 36.7K36,735 catalog downloads
QU
QuantFactory
CodeLlama-7B-Instruct-hf-GGUF
Chat & write4.08 GBNo license stated↓ 1.3K1,338 catalog downloads
BA
bartowski
internlm_OREAL-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 1.5K1,480 catalog downloads
QU
QuantFactory
Qwen2.5-Sex-GGUF
Chat & write986 MBapache-2.0↓ 1.5K1,457 catalog downloads
BA
bartowski
PinkPixel_Crystal-Think-V2-GGUF
Chat & write2.5 GBapache-2.0↓ 1.4K1,420 catalog downloads
BA
bartowski
HuatuoGPT-o1-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 1.4K1,413 catalog downloads
BA
bartowski
Menlo_Jan-nano-GGUF
Chat & write2.5 GBapache-2.0↓ 1.2K1,240 catalog downloads
TH
TheBloke
dolphin-2.6-mistral-7B-dpo-GGUF
Chat & write4.37 GBapache-2.0↓ 1.2K1,235 catalog downloads