ggml-org
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
GG
ggml-org
gpt-oss-20B-GGUF
Chat & write921 MBapache-2.0↓ 166.1K166,074 catalog downloads
UN
unsloth
GLM-5.2-GGUF
Chat & writemit↓ 164.2K164,180 catalog downloads
LM
lmstudio-community
gemma-4-E2B-it-GGUF
Generalapache-2.0↓ 156K156,011 catalog downloads
MI
mixedbread-ai
mxbai-embed-large-v1
Search documents670 MBapache-2.0↓ 5.8M5,778,239 catalog downloads
OR
ornith-ai
Ornith-1.0-9B-GGUF
Chat & write5.63 GBmit↓ 4.9M4,907,682 catalog downloads
NO
NousResearch
Hermes-2-Pro-Mistral-7B-GGUF
Chat & write4.37 GBapache-2.0↓ 5.6K5,571 catalog downloads
TH
TheBloke
Mistral-7B-Instruct-v0.2-GGUF
Chat & write4.37 GBapache-2.0↓ 155.9K155,931 catalog downloads
IB
ibm-granite
granite-8B-code-instruct-4k-GGUF
Chat & write4.88 GBapache-2.0↓ 4.8K4,760 catalog downloads
IB
ibm-granite
granite-4.0-h-tiny-GGUF
Chat & write4.23 GBapache-2.0↓ 4.6K4,603 catalog downloads
MI
mistralai
Devstral-Small-2507_gguf
Chat & writeapache-2.0↓ 4.4K4,421 catalog downloads
UN
unsloth
Qwen3.5-2B-GGUF
Understand imagesapache-2.0↓ 147.3K147,281 catalog downloads