ggml-org
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
LM
lmstudio-community
Qwen3.8-27B-GGUF
Generalapache-2.0↓ 171.5K171,518 catalog downloads
GG
ggml-org
gpt-oss-120B-GGUF
Chat & write849 MBapache-2.0↓ 167.1K167,067 catalog downloads
GG
ggml-org
gpt-oss-20B-GGUF
Chat & write921 MBapache-2.0↓ 166.1K166,074 catalog downloads
UN
unsloth
GLM-5.2-GGUF
Chat & writemit↓ 164.2K164,180 catalog downloads
LM
lmstudio-community
gemma-4-E2B-it-GGUF
Generalapache-2.0↓ 156K156,011 catalog downloads
TH
TheBloke
Mistral-7B-Instruct-v0.2-GGUF
Chat & write4.37 GBapache-2.0↓ 155.9K155,931 catalog downloads
MI
mixedbread-ai
mxbai-embed-large-v1
Search documents670 MBapache-2.0↓ 5.8M5,778,239 catalog downloads
OR
ornith-ai
Ornith-1.0-9B-GGUF
Chat & write5.63 GBmit↓ 4.9M4,907,682 catalog downloads
NO
NousResearch
Hermes-3-Llama-3.2-3B-GGUF
Chat & write2.02 GBllama3↓ 6.3K6,301 catalog downloads
IB
ibm-granite
granite-8B-code-instruct-4k-GGUF
Chat & write4.88 GBapache-2.0↓ 4.8K4,760 catalog downloads
IB
ibm-granite
granite-4.0-h-tiny-GGUF
Chat & write4.23 GBapache-2.0↓ 4.6K4,603 catalog downloads