NousResearch
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
AL
allenai
OLMo-2-0425-1B-Instruct-GGUF
Chat & write936 MBNo license stated↓ 805805 catalog downloads
BA
bartowski
L3-8B-Stheno-v3.2-GGUF
Chat & write4.92 GBcc-by-nc-4.0↓ 27.2K27,185 catalog downloads
LM
lmstudio-community
Qwen2.5-Coder-7B-Instruct-GGUF
Chat & write4.68 GBapache-2.0↓ 24.2K24,199 catalog downloads
QU
QuantFactory
Meta-Llama-3-8B-Instruct-GGUF
Chat & write4.92 GBllama3↓ 24K24,009 catalog downloads
UN
Chat & write4.68 GBapache-2.0↓ 23.6K23,623 catalog downloads
GG
ggml-org
Qwen2.5-Coder-14B-Q8_0-GGUF
Chat & write15.7 GBapache-2.0↓ 23.4K23,394 catalog downloads
LM
lmstudio-community
Qwen3.5-4B-GGUF
Generalapache-2.0↓ 22.8K22,764 catalog downloads
UN
Chat & write19.85 GBapache-2.0↓ 21.7K21,742 catalog downloads
TH
TheBloke
Mixtral-8x7B-Instruct-v0.1-GGUF
Chat & write26.44 GBapache-2.0↓ 20.6K20,598 catalog downloads
UN
Understand imagesNo license stated↓ 27.3K27,313 catalog downloads
TH
TheBloke
MythoMax-L2-13B-GGUF
Chat & write7.87 GBNo license stated↓ 27.2K27,216 catalog downloads