ggml-org
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Showing 12 of 180,842 models
Fit is a memory estimate, not a speed test.
BA
bartowski
openai_gpt-oss-20B-GGUF
Chat & write11.67 GBApache 2.0 (from base model)↓ 22K22,032 catalog downloads
BA
bartowski
qwen2.5-7B-ins-v3-GGUF
Chat & write4.68 GBApache 2.0 (from base model)↓ 13.3K13,271 catalog downloads
TH
TheDrummer
Tiger-Gemma-12B-v3-GGUF
General7.87 GBGemma Terms of Use (from base model)↓ 2.8K2,796 catalog downloads
QU
QuantFactory
Llama-3-Ko-Luxia-Instruct-GGUF
Chat & write5.02 GBLlama 3 Community (from base model)↓ 1.5K1,477 catalog downloads
QU
QuantFactory
CodeLlama-7B-Instruct-hf-GGUF
Chat & write4.08 GBLlama 2 Community (from base model)↓ 1.3K1,338 catalog downloads
QU
QuantFactory
Mistral-7B-v0.2-hf-GGUF
Chat & write4.37 GBApache 2.0 (from base model)↓ 831831 catalog downloads
TH
TheDrummer
Gemma-3-R1-12B-v1-GGUF
General7.3 GBGemma Terms of Use (from base model)↓ 153153 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-4B-OSS-oQ4
General3.18 GBMIT (from base model)↓ 99 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-4B-OSS-oQ6
General4.19 GBMIT (from base model)↓ 77 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-2B-OSS-oQ6
General2.24 GBMIT (from base model)↓ 77 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-2B-OSS-oQ4
General1.78 GBMIT (from base model)↓ 66 catalog downloads