Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
LM
lmstudio-community
codegemma-7B-it-GGUF
Chat & write5.33 GBgemma↓ 1.5K1,548 catalog downloads
QU
QuantFactory
Llama-Guard-3-8B-GGUF
Chat & write4.92 GBllama3.1↓ 1.5K1,547 catalog downloads
UN
unsloth
MiniMax-M2-GGUF
Chat & writemit↓ 1.5K1,545 catalog downloads
LM
lmstudio-community
Qwen2.5-Coder-3B-GGUF
Chat & write1.93 GBNo license stated↓ 2K2,043 catalog downloads
QU
QuantFactory
Llama-3-8B-LexiFun-Uncensored-V1-GGUF
Chat & write4.92 GBNo license stated↓ 1.8K1,821 catalog downloads
QU
QuantFactory
Meta-Llama-3-8B-GGUF
Chat & write4.92 GBNo license stated↓ 1.8K1,750 catalog downloads
QU
QuantFactory
Gemma-2-Ataraxy-v2-9B-GGUF
Chat & write5.76 GBNo license stated↓ 1.7K1,698 catalog downloads
QU
QuantFactory
Llama-3.1-8B-OmniMatrix-v2-GGUF
Chat & write4.92 GBNo license stated↓ 1.7K1,689 catalog downloads
QU
QuantFactory
Hermes-3-Llama-3.1-8B-lorablated-GGUF
Chat & write4.92 GBNo license stated↓ 1.7K1,651 catalog downloads
QU
QuantFactory
saiga_llama3_8b-GGUF
Chat & write4.92 GBNo license stated↓ 1.6K1,647 catalog downloads
QU
QuantFactory
MagpieLM-4B-Chat-v0.1-GGUF
Chat & write2.78 GBNo license stated↓ 1.6K1,626 catalog downloads