TheBloke
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
TH
TheBloke
una-cybertron-7B-v2-GGUF
Chat & write4.37 GBapache-2.0↓ 664664 catalog downloads
BA
bartowski
Qwerus-7B-GGUF
Chat & write4.68 GBmit↓ 661661 catalog downloads
QU
QuantFactory
BioMistral-DARE-NS-GGUF
Chat & write4.37 GBapache-2.0↓ 659659 catalog downloads
QU
QuantFactory
TinyLlama-1.1B-Chat-v1.0-GGUF
Chat & write668 MBapache-2.0↓ 659659 catalog downloads
UN
unsloth
GLM-Z1-32B-0414-GGUF
Chat & write19.68 GBmit↓ 657657 catalog downloads
QU
QuantFactory
dolphin-2.9.2-qwen2-7B-GGUF
Chat & write4.68 GBapache-2.0↓ 656656 catalog downloads
LM
lmstudio-community
Yi-Coder-9B-Chat-GGUF
Chat & write5.33 GBapache-2.0↓ 653653 catalog downloads
BA
bartowski
EVA-Qwen2.5-7B-v0.0-GGUF
Chat & write4.68 GBapache-2.0↓ 651651 catalog downloads
BA
bartowski
SicariusSicariiStuff_Phi-lthy4-GGUF
Chat & write7.26 GBmit↓ 649649 catalog downloads
QU
QuantFactory
math-shepherd-mistral-7B-prm-GGUF
Chat & write4.37 GBNo license stated↓ 855855 catalog downloads
QU
QuantFactory
llama7b-wizardlm-unfiltered-GGUF
Chat & write4.08 GBNo license stated↓ 850850 catalog downloads