unsloth
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
L3-8B-Stheno-v3.1-GGUF
Chat & write4.92 GBcc-by-nc-4.0↓ 1.2K1,167 catalog downloads
BA
bartowski
internlm_OREAL-32B-GGUF
Chat & write19.85 GBapache-2.0↓ 1.2K1,163 catalog downloads
TH
TheBloke
Kimiko-Mistral-7B-GGUF
Chat & write4.37 GBapache-2.0↓ 1.2K1,163 catalog downloads
QU
QuantFactory
Llama-3-8B-Instruct-Gradient-1048k-GGUF-v2
Chat & write4.92 GBllama3↓ 1.2K1,161 catalog downloads
BA
bartowski
allenai_Olmo-3-32B-Think-GGUF
Chat & write19.48 GBapache-2.0↓ 1.2K1,160 catalog downloads
QU
QuantFactory
Llama-3-8B-ShareGPT-112K-GGUF
Chat & write4.92 GBllama3↓ 1.2K1,160 catalog downloads
QU
QuantFactory
internlm2-math-plus-7B-GGUF
Chat & write4.71 GBNo license stated↓ 1.5K1,478 catalog downloads
QU
QuantFactory
Llama-3-Ko-Luxia-Instruct-GGUF
Chat & write5.02 GBNo license stated↓ 1.5K1,477 catalog downloads
BA
bartowski
Falcon3-3B-Instruct-GGUF
Chat & write2.01 GBNo license stated↓ 1.5K1,466 catalog downloads
QU
QuantFactory
L3-Umbral-Mind-RP-v3.0-8B-GGUF
Chat & write4.92 GBNo license stated↓ 1.4K1,429 catalog downloads
QU
QuantFactory
Llama-3-Alpha-Ko-8B-Instruct-GGUF
Chat & write4.92 GBNo license stated↓ 1.4K1,419 catalog downloads