TheBloke
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
smirki_UIGEN-T1.1-Qwen-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 782782 catalog downloads
TH
TheBloke
CodeNinja-1.0-OpenChat-7B-GGUF
Chat & write4.37 GBmit↓ 778778 catalog downloads
QU
QuantFactory
internistai-base-7B-v0.2-GGUF
Chat & write4.37 GBapache-2.0↓ 776776 catalog downloads
BA
bartowski
allenai_Olmo-3-7B-Instruct-GGUF
Chat & writeapache-2.0↓ 775775 catalog downloads
QU
QuantFactory
Llama-3-8B-WildChat-GGUF
Chat & write4.92 GBllama3↓ 772772 catalog downloads
BA
bartowski
Tess-v2.5-Phi-3-medium-128k-14B-GGUF
Chat & write8.57 GBmit↓ 765765 catalog downloads
TH
TheBloke
openchat-3.5-0106-GGUF
Chat & write4.37 GBapache-2.0↓ 765765 catalog downloads
BA
bartowski
kurage-en-GGUF
Chat & write4.68 GBapache-2.0↓ 764764 catalog downloads
BA
Chat & write1.55 GBapache-2.0↓ 763763 catalog downloads
UN
unsloth
dots.llm1.inst-GGUF
Chat & writemit↓ 763763 catalog downloads
UN
unsloth
gpt-oss-safeguard-20B-GGUF
Chat & write11.62 GBapache-2.0↓ 760760 catalog downloads