TheBloke
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
BA
bartowski
Celeste-12B-V1.6-GGUF
Chat & write7.48 GBapache-2.0↓ 940940 catalog downloads
BA
bartowski
dolphin-2.9.2-Phi-3-Medium-GGUF
Chat & write8.4 GBmit↓ 939939 catalog downloads
QU
QuantFactory
Reasoning-Llama-1B-v0.1-GGUF
Chat & write808 MBllama3.2↓ 939939 catalog downloads
QU
QuantFactory
llama-3-Korean-Bllossom-8B-GGUF
Chat & write4.92 GBllama3↓ 938938 catalog downloads
QU
QuantFactory
Llama3.1-8B-ShiningValiant2-GGUF
Chat & write4.92 GBllama3.1↓ 937937 catalog downloads
UN
unsloth
granite-4.0-1B-GGUF
Chat & write1.02 GBapache-2.0↓ 937937 catalog downloads
UN
unsloth
Olmo-3.1-32B-Instruct-GGUF
Chat & write19.48 GBapache-2.0↓ 936936 catalog downloads
BA
Chat & write4.94 GBapache-2.0↓ 934934 catalog downloads
TH
TheBloke
Guanaco-7B-Uncensored-GGUF
Chat & write4.08 GBapache-2.0↓ 934934 catalog downloads
BA
bartowski
LLAMA-3_8B_Unaligned_Alpha-GGUF
Chat & write4.92 GBapache-2.0↓ 931931 catalog downloads
TH
TheBloke
notus-7B-v1-GGUF
Chat & write4.37 GBmit↓ 931931 catalog downloads