unsloth
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
huihui-ai_QwQ-32B-abliterated-GGUF
Chat & write19.85 GBapache-2.0↓ 9.9K9,904 catalog downloads
UN
unsloth
functiongemma-270m-it-GGUF
Chat & write253 MBgemma↓ 9.7K9,687 catalog downloads
LM
lmstudio-community
Qwen2.5-7B-Instruct-GGUF
Chat & write4.68 GBapache-2.0↓ 9.7K9,686 catalog downloads
BA
bartowski
aya-expanse-8B-GGUF
Chat & write5.06 GBcc-by-nc-4.0↓ 9.7K9,672 catalog downloads
GG
ggml-org
bge-m3-Q8_0-GGUF
Compare sentences635 MBmit↓ 9.6K9,644 catalog downloads
BA
Understand imagesapache-2.0↓ 9.6K9,633 catalog downloads
BA
bartowski
Qwen2.5.1-Coder-7B-Instruct-GGUF
Chat & write4.68 GBapache-2.0↓ 9.4K9,420 catalog downloads
TH
TheBloke
Llama-2-13B-chat-GGUF
Chat & write7.87 GBllama2↓ 9.3K9,333 catalog downloads
LM
lmstudio-community
Qwen2.5-Coder-32B-GGUF
Chat & write19.85 GBapache-2.0↓ 9.3K9,285 catalog downloads
LM
lmstudio-community
Qwen2.5-7B-Instruct-1M-GGUF
Chat & write4.68 GBapache-2.0↓ 9.1K9,090 catalog downloads
BA
bartowski
MiniCPM5-2B-GGUF
Chat & write1.62 GBapache-2.0↓ 9.1K9,072 catalog downloads