ggml-org
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
soob3123_amoral-gemma3-12B-v2-GGUF
Chat & write7.3 GBapache-2.0↓ 2.1K2,116 catalog downloads
BA
bartowski
Phi-3.5-MoE-instruct-GGUF
Chat & write25.35 GBmit↓ 2.1K2,109 catalog downloads
QU
QuantFactory
Meissa-Qwen2.5-7B-Instruct-GGUF
Chat & write4.68 GBgpl-3.0↓ 2.1K2,108 catalog downloads
BA
bartowski
arcee-ai_Homunculus-GGUF
Chat & write7.62 GBapache-2.0↓ 2.1K2,100 catalog downloads
QU
QuantFactory
Llama-3.1-8B-ArliAI-RPMax-v1.0-GGUF
Chat & write4.92 GBllama3.1↓ 2.1K2,099 catalog downloads
QU
QuantFactory
Llama-3-8B-Instruct-Finance-RAG-GGUF
Chat & write4.92 GBllama3↓ 2.1K2,097 catalog downloads
UN
Chat & write7.48 GBapache-2.0↓ 2.1K2,096 catalog downloads
BA
bartowski
Phi-3-medium-128k-instruct-GGUF
Chat & write8.57 GBmit↓ 2.1K2,090 catalog downloads
QU
QuantFactory
Llama-3.1-8B-EZO-1.1-it-GGUF
Chat & write4.92 GBllama3.1↓ 2.1K2,082 catalog downloads
QU
QuantFactory
Yi-1.5-9B-Chat-16K-GGUF
Chat & write5.33 GBapache-2.0↓ 2.1K2,080 catalog downloads
BA
bartowski
allura-org_remnant-glm4-32B-GGUF
Chat & write19.68 GBapache-2.0↓ 2.1K2,065 catalog downloads