Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Phi-3-medium-128k-instruct-GGUF
Chat & write8.57 GBmit↓ 2.1K2,090 catalog downloads
QU
QuantFactory
Llama-3.1-8B-EZO-1.1-it-GGUF
Chat & write4.92 GBllama3.1↓ 2.1K2,082 catalog downloads
QU
QuantFactory
Yi-1.5-9B-Chat-16K-GGUF
Chat & write5.33 GBapache-2.0↓ 2.1K2,080 catalog downloads
BA
bartowski
allura-org_remnant-glm4-32B-GGUF
Chat & write19.68 GBapache-2.0↓ 2.1K2,065 catalog downloads
BA
bartowski
ConicCat_Qwen3.5-27B-Writer-GGUF
Chat & write17.53 GBapache-2.0↓ 2.1K2,063 catalog downloads
QU
QuantFactory
Llama-3.1-8B-Ultra-Instruct-GGUF
Chat & write4.92 GBllama3↓ 2.1K2,062 catalog downloads
LM
lmstudio-community
stable-code-instruct-3B-GGUF
Chat & write1.71 GBNo license stated↓ 2.5K2,540 catalog downloads
LM
lmstudio-community
internlm2-math-plus-7B-GGUF
Chat & write4.71 GBNo license stated↓ 2.3K2,332 catalog downloads
BA
bartowski
Falcon3-1B-Instruct-GGUF
Chat & write1.06 GBNo license stated↓ 2.3K2,326 catalog downloads
GG
ggml-org
Qwen2.5-Coder-3B-Q8_0-GGUF
Chat & write3.29 GBNo license stated↓ 2.2K2,175 catalog downloads
SE
SexGod1979
PinkCherry_NSFW_LTX23
Generalapache-2.0↓ 86.1K86,135 catalog downloads