second-state
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
QU
QuantFactory
Llama-3-KoEn-8B-GGUF
Chat & write4.92 GBcc-by-nc-sa-4.0↓ 839839 catalog downloads
QU
QuantFactory
Qwen3-Reranker-4B-GGUF
Rank search results2.72 GBapache-2.0↓ 749749 catalog downloads
BA
Chat & write4.68 GBapache-2.0↓ 723723 catalog downloads
UN
unsloth
SmolLM2-1.7B-Instruct-GGUF
Chat & write1.06 GBapache-2.0↓ 700700 catalog downloads
BA
bartowski
Eurus-2-7B-PRIME-GGUF
Chat & write4.68 GBapache-2.0↓ 697697 catalog downloads
QU
QuantFactory
Qwen2.5-14B_Uncencored_Instruct-GGUF
Chat & write8.99 GBapache-2.0↓ 673673 catalog downloads
TO
TokenRhythm
NeoHorse-1-9B-GGUF
Chat & write5.63 GBapache-2.0↓ 23.7K23,672 catalog downloads
BA
bartowski
AMD-Llama-135m-GGUF
Chat & write86 MBapache-2.0↓ 647647 catalog downloads
LM
lmstudio-community
Qwen2.5-Math-7B-Instruct-GGUF
Chat & write4.68 GBapache-2.0↓ 645645 catalog downloads
LM
lmstudio-community
WizardLM-2-7B-GGUF
Chat & write4.37 GBapache-2.0↓ 642642 catalog downloads
TH
Chat & write4.37 GBapache-2.0↓ 640640 catalog downloads