Local LLM Starter Stack

Small, local-run-friendly model files, GGUF/ONNX/safetensors records, and local inference tools.

Audience: Local AI builders

Start with smaller files and common local formats
Check license and upstream gating
Request mirrors only for public permissive candidates
Use hosted downloads only when hashes are present

antirez/deepseek-v4-gguf mit 6434367 downloads external
openai/whisper-small apache-2.0 3246663 downloads external
BAAI/bge-small-zh-v1.5 mit 4686132 downloads external
unsloth/gemma-4-26B-A4B-it-GGUF apache-2.0 1465954 downloads external
unsloth/gemma-4-12b-it-GGUF apache-2.0 1390513 downloads external
Xenova/all-MiniLM-L6-v2 apache-2.0 2809852 downloads external
yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF apache-2.0 561577 downloads external
empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF apache-2.0 907682 downloads external
facebook/dinov2-small apache-2.0 2809592 downloads external
amazon/chronos-t5-small apache-2.0 1712389 downloads external
ibm-granite/granite-embedding-small-english-r2 apache-2.0 2099789 downloads external
mistralai/Mistral-Small-3.2-24B-Instruct-2506 apache-2.0 683208 downloads external
unsloth/gemma-4-E4B-it-GGUF apache-2.0 687378 downloads external
google/flan-t5-small apache-2.0 667748 downloads external
jinaai/jina-embeddings-v2-small-en apache-2.0 1168607 downloads external
unsloth/gemma-4-31B-it-GGUF apache-2.0 591899 downloads external
unsloth/gemma-4-26B-A4B-it-qat-GGUF apache-2.0 808837 downloads external
unsloth/gemma-4-E2B-it-GGUF apache-2.0 696110 downloads external
unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF apache-2.0 609270 downloads external
depth-anything/Depth-Anything-V2-Small-hf apache-2.0 1699057 downloads external
fixie-ai/ultravox-v0_5-llama-3_2-1b mit 1104950 downloads external
hustvl/vitmatte-small-composition-1k apache-2.0 1387470 downloads external
deepseek-ai/DeepSeek-R1-Distill-Llama-70B mit 367718 downloads external
unsloth/gpt-oss-20b-GGUF apache-2.0 352246 downloads external
deepseek-ai/DeepSeek-R1-Distill-Llama-8B mit 293196 downloads external

Open interactive stack pack