QuantFactory
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
TH
TheBloke
SOLAR-10.7B-Instruct-v1.0-GGUF
Chat & write6.46 GBapache-2.0↓ 1K1,031 catalog downloads
BA
Chat & write2.39 GBmit↓ 1K1,030 catalog downloads
QU
QuantFactory
Ko-Llama-3.1-8B-Lexi-Uncensored-V2-GGUF
Chat & write4.92 GBllama3.1↓ 1K1,026 catalog downloads
BA
bartowski
Peach-9B-8k-Roleplay-GGUF
Chat & write5.33 GBmit↓ 1K1,025 catalog downloads
QU
QuantFactory
gemma-2-9B-it-abliterated-GGUF
Chat & write5.76 GBgemma↓ 1K1,025 catalog downloads
QU
QuantFactory
Llama-3.2-Taiwan-Legal-3B-Instruct-GGUF
Chat & write2.02 GBllama3.2↓ 1K1,025 catalog downloads
QU
QuantFactory
Celeste-12B-V1.6-GGUF
Chat & write7.48 GBapache-2.0↓ 1K1,024 catalog downloads
QU
QuantFactory
SmolLM2-135M-Instruct-GGUF
Chat & write105 MBapache-2.0↓ 1K1,024 catalog downloads
BA
bartowski
granite-3.0-1B-a400m-instruct-GGUF
Chat & write822 MBapache-2.0↓ 1K1,022 catalog downloads
QU
QuantFactory
Llama-3.2-3B-Agent007-Coder-GGUF
Chat & write2.02 GBapache-2.0↓ 1K1,022 catalog downloads
QU
QuantFactory
ClinicalGPT-base-zh-GGUF
Chat & write5.27 GBafl-3.0↓ 1K1,021 catalog downloads