ggml-org
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
NSFW-3B-GGUF
Chat & write1.71 GBNo license stated↓ 3.1K3,110 catalog downloads
LM
lmstudio-community
EXAONE-3.5-2.4B-Instruct-GGUF
Chat & write1.64 GBNo license stated↓ 3.1K3,058 catalog downloads
LM
lmstudio-community
OpenCoder-1.5B-Instruct-GGUF
Chat & write1.42 GBNo license stated↓ 3K2,997 catalog downloads
BA
bartowski
ibm-granite_granite-4.0-h-tiny-GGUF
Chat & write4.3 GBNo license stated↓ 2.9K2,906 catalog downloads
QU
QuantFactory
NeuralDaredevil-8B-abliterated-GGUF
Chat & write4.92 GBNo license stated↓ 2.9K2,892 catalog downloads
LM
lmstudio-community
LFM2.5-2.6B-GGUF
Chat & write1.67 GBNo license stated↓ 2.8K2,809 catalog downloads
QU
QuantFactory
dolphin-2.9-llama3-8B-GGUF
Chat & write4.92 GBNo license stated↓ 2.8K2,759 catalog downloads
AB
abenzerps
Spark-X2.5-4B-GGUF
Chat & write2.6 GBapache-2.0↓ 108.5K108,529 catalog downloads
AU
Chat & writemit↓ 107K106,977 catalog downloads
Work with multiple mediaapache-2.0↓ 105.6K105,624 catalog downloads
ZL
Chat & write1.14 GBapache-2.0↓ 105.5K105,526 catalog downloads