unsloth
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Top 12 matches for GGUF
Fit is a memory estimate, not a speed test.
LM
lmstudio-community
SmolLM2-135M-Instruct-GGUF
Chat & write105 MBapache-2.0↓ 759759 catalog downloads
BA
bartowski
FastApply-7B-v1.0-GGUF
Chat & write4.68 GBapache-2.0↓ 750750 catalog downloads
TH
TheBloke
EstopianMaid-13B-GGUF
Chat & write7.87 GBapache-2.0↓ 750750 catalog downloads
BA
bartowski
dolphin-2.9.1-yi-1.5-9B-GGUF
Chat & write5.33 GBapache-2.0↓ 749749 catalog downloads
QU
QuantFactory
Qwen3-Reranker-4B-GGUF
Rank search results2.72 GBapache-2.0↓ 749749 catalog downloads
BA
bartowski
TinySwallow-1.5B-Instruct-GGUF
Chat & write986 MBapache-2.0↓ 748748 catalog downloads
TH
TheBloke
neural-chat-7B-v3-1-GGUF
Chat & write4.37 GBapache-2.0↓ 748748 catalog downloads
QU
QuantFactory
Bielik-7B-v0.1-GGUF
Chat & write4.37 GBapache-2.0↓ 741741 catalog downloads
BA
bartowski
SmolLM-1.7B-Instruct-v0.2-GGUF
Chat & write1.06 GBapache-2.0↓ 740740 catalog downloads
BA
bartowski
Replete-LLM-V2-Llama-3.1-8B-GGUF
Chat & write4.92 GBapache-2.0↓ 736736 catalog downloads
BA
bartowski
UwU-7B-Instruct-GGUF
Chat & write4.68 GBapache-2.0↓ 735735 catalog downloads