Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
TH
TheBloke
Llama-2-7B-GGUF
Chat & write4.08 GBllama2↓ 17K16,970 catalog downloads
UN
unsloth
Qwen3-30B-A3B-GGUF
Chat & write18.56 GBapache-2.0↓ 16.8K16,766 catalog downloads
UN
unsloth
embeddinggemma-300m-GGUF
Compare sentences278 MBgemma↓ 16.3K16,273 catalog downloads
LM
lmstudio-community
gemma-2-9B-it-GGUF
Chat & write5.76 GBgemma↓ 16.1K16,069 catalog downloads
UN
Chat & write4.68 GBapache-2.0↓ 15.5K15,469 catalog downloads
BA
bartowski
dolphin-2.9-llama3-8B-GGUF
Chat & write4.92 GBNo license stated↓ 19.6K19,626 catalog downloads
TH
TheBloke
deepseek-coder-33B-instruct-GGUF
Chat & write19.94 GBNo license stated↓ 19.4K19,377 catalog downloads
TH
TheBloke
phi-2-GGUF
Chat & write1.79 GBNo license stated↓ 17.9K17,886 catalog downloads
Chat & write19.85 GBNo license stated↓ 17.7K17,671 catalog downloads
LM
lmstudio-community
Qwen3-4B-GGUF
Chat & write2.5 GBNo license stated↓ 17.2K17,210 catalog downloads
LM
lmstudio-community
DeepSeek-R1-Distill-Qwen-7B-GGUF
Chat & write4.68 GBNo license stated↓ 16.6K16,641 catalog downloads