Small Local Model Files

Smaller, local-run-friendly model files and formats to prioritize for verified mirroring.

antirez/deepseek-v4-gguf mit 6434367 downloads external
openai/whisper-small apache-2.0 3246663 downloads external
BAAI/bge-small-zh-v1.5 mit 4686132 downloads external
unsloth/gemma-4-26B-A4B-it-GGUF apache-2.0 1465954 downloads external
unsloth/gemma-4-12b-it-GGUF apache-2.0 1390513 downloads external
Xenova/all-MiniLM-L6-v2 apache-2.0 2809852 downloads external
yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF apache-2.0 561577 downloads external
empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF apache-2.0 907682 downloads external
facebook/dinov2-small apache-2.0 2809592 downloads external
amazon/chronos-t5-small apache-2.0 1712389 downloads external
ibm-granite/granite-embedding-small-english-r2 apache-2.0 2099789 downloads external
mistralai/Mistral-Small-3.2-24B-Instruct-2506 apache-2.0 683208 downloads external
unsloth/gemma-4-E4B-it-GGUF apache-2.0 687378 downloads external
google/flan-t5-small apache-2.0 667748 downloads external
jinaai/jina-embeddings-v2-small-en apache-2.0 1168607 downloads external
unsloth/gemma-4-31B-it-GGUF apache-2.0 591899 downloads external
unsloth/gemma-4-26B-A4B-it-qat-GGUF apache-2.0 808837 downloads external
unsloth/gemma-4-E2B-it-GGUF apache-2.0 696110 downloads external
unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF apache-2.0 609270 downloads external
depth-anything/Depth-Anything-V2-Small-hf apache-2.0 1699057 downloads external
hustvl/vitmatte-small-composition-1k apache-2.0 1387470 downloads external
unsloth/gpt-oss-20b-GGUF apache-2.0 352246 downloads external
mistralai/Devstral-Small-2-24B-Instruct-2512 apache-2.0 343818 downloads external
onnx-community/Kokoro-82M-v1.0-ONNX apache-2.0 549803 downloads external
unsloth/gemma-4-12B-it-qat-GGUF apache-2.0 476353 downloads external
amazon/chronos-bolt-small apache-2.0 1703033 downloads external
google/gemma-4-12B-it-qat-q4_0-gguf apache-2.0 542572 downloads external
unsloth/Qwen3-Coder-Next-GGUF apache-2.0 279249 downloads external
Systran/faster-whisper-small mit 1211245 downloads external
intfloat/e5-small-v2 mit 656524 downloads external
mistralai/Mistral-Small-3.1-24B-Instruct-2503 apache-2.0 192600 downloads external
hustvl/yolos-small apache-2.0 719942 downloads external
yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF apache-2.0 241409 downloads external
Marqo/marqo-fashionSigLIP apache-2.0 758909 downloads external
ibm-granite/granite-4.0-h-small apache-2.0 395146 downloads external
unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF apache-2.0 243253 downloads external
NeoQuasar/Kronos-small mit 1312218 downloads external
autogluon/chronos-2-small apache-2.0 2852513 downloads external
AdamCodd/vit-base-nsfw-detector apache-2.0 676749 downloads external
minishlab/potion-base-8M mit 654619 downloads external
Xenova/bge-base-en-v1.5 mit 1778613 downloads external
lmstudio-community/gemma-4-E4B-it-GGUF apache-2.0 774995 downloads external
microsoft/deberta-v3-small mit 611094 downloads external
BAAI/bge-small-en mit 542813 downloads external
Qwen/Qwen3-Embedding-0.6B-GGUF apache-2.0 220727 downloads external
unsloth/Qwen-Image-Edit-2511-GGUF apache-2.0 221698 downloads external
unsloth/Qwen3-VL-2B-Instruct-GGUF apache-2.0 851190 downloads external
unsloth/diffusiongemma-26B-A4B-it-GGUF apache-2.0 265418 downloads external
thenlper/gte-small mit 321766 downloads external
google/mt5-small apache-2.0 306781 downloads external

Open interactive ranking page