bartowski
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
LM
lmstudio-community
Qwen2.5-Coder-7B-Instruct-GGUF
Chat & write4.68 GBapache-2.0↓ 24.2K24,199 catalog downloads
BA
bartowski
Qwen2.5-0.5B-Instruct-GGUF
Chat & write398 MBapache-2.0↓ 24.1K24,057 catalog downloads
QU
QuantFactory
Meta-Llama-3-8B-Instruct-GGUF
Chat & write4.92 GBllama3↓ 24K24,009 catalog downloads
UN
Chat & write4.68 GBapache-2.0↓ 23.6K23,623 catalog downloads
GG
ggml-org
Qwen2.5-Coder-14B-Q8_0-GGUF
Chat & write15.7 GBapache-2.0↓ 23.4K23,394 catalog downloads
LM
lmstudio-community
Qwen3.5-4B-GGUF
Generalapache-2.0↓ 22.8K22,764 catalog downloads
UN
Chat & write19.85 GBapache-2.0↓ 21.7K21,742 catalog downloads
BA
bartowski
Qwen_Qwen3-8B-GGUF
Chat & write5.03 GBapache-2.0↓ 21.1K21,058 catalog downloads
TH
TheBloke
Mixtral-8x7B-Instruct-v0.1-GGUF
Chat & write26.44 GBapache-2.0↓ 20.6K20,598 catalog downloads
UN
Understand imagesNo license stated↓ 27.3K27,313 catalog downloads
TH
TheBloke
MythoMax-L2-13B-GGUF
Chat & write7.87 GBNo license stated↓ 27.2K27,216 catalog downloads