ggml-org
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Llama-3.1-8B-Ultra-Instruct-GGUF
Chat & write4.92 GBllama3↓ 3.6K3,601 catalog downloads
BA
bartowski
Yi-Coder-1.5B-Chat-GGUF
Chat & write964 MBapache-2.0↓ 3.6K3,561 catalog downloads
LM
lmstudio-community
Seed-OSS-36B-Instruct-GGUF
Chat & write21.76 GBapache-2.0↓ 3.6K3,560 catalog downloads
BA
Chat & write4.92 GBllama3.1↓ 3.6K3,557 catalog downloads
LM
lmstudio-community
granite-4.2-8B-GGUF
Chat & write5.35 GBapache-2.0↓ 3.5K3,521 catalog downloads
BA
Chat & write2.39 GBapache-2.0↓ 3.5K3,514 catalog downloads
TH
TheBloke
dolphin-2.0-mistral-7B-GGUF
Chat & write4.37 GBapache-2.0↓ 3.5K3,464 catalog downloads
BA
bartowski
Trendyol-LLM-8B-chat-v2.0-GGUF
Chat & write4.92 GBllama3↓ 3.5K3,458 catalog downloads
UN
unsloth
GLM-4-9B-0414-GGUF
Chat & write6.17 GBmit↓ 3.5K3,450 catalog downloads
BA
Chat & write5.06 GBcc-by-nc-4.0↓ 3.4K3,408 catalog downloads
BA
bartowski
THUDM_GLM-Z1-32B-0414-GGUF
Chat & write19.68 GBmit↓ 3.4K3,375 catalog downloads