QuantFactory
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Qwen2-7B-Instruct-GGUF
Chat & write4.68 GBapache-2.0↓ 1.4K1,379 catalog downloads
BA
bartowski
Menlo_Jan-nano-128k-GGUF
Chat & write2.5 GBapache-2.0↓ 1.4K1,374 catalog downloads
GG
ggml-org
SmolLM2-135M-GGUF
Chat & write101 MBapache-2.0↓ 1.4K1,372 catalog downloads
BA
bartowski
Stheno-Hercules-3.1-8B-GGUF
Chat & write4.92 GBapache-2.0↓ 1.4K1,364 catalog downloads
QU
QuantFactory
Llama-3.2-3B-GGUF
Chat & write2.02 GBllama3.2↓ 1.4K1,359 catalog downloads
BA
Chat & write14.33 GBapache-2.0↓ 1.4K1,356 catalog downloads
LM
lmstudio-community
Devstral-Small-2505-GGUF
Chat & write14.33 GBapache-2.0↓ 1.4K1,356 catalog downloads
QU
QuantFactory
llama3-8B-DarkIdol-2.3-Uncensored-32K-GGUF
Chat & write4.92 GBllama3↓ 1.4K1,356 catalog downloads
Chat & write4.68 GBapache-2.0↓ 1.4K1,353 catalog downloads
QU
QuantFactory
L3-8B-Stheno-v3.3-32K-GGUF
Chat & write4.92 GBcc-by-nc-4.0↓ 1.4K1,353 catalog downloads
QU
QuantFactory
gemma-2-baku-2B-GGUF
Chat & write1.71 GBgemma↓ 1.4K1,351 catalog downloads