Local LLM Tools

GGUF, local-inference, agent, and tool records for builders running AI locally.

  • antirez/deepseek-v4-gguf mit 6434367 downloads external
  • unsloth/gemma-4-26B-A4B-it-GGUF apache-2.0 1465954 downloads external
  • unsloth/gemma-4-12b-it-GGUF apache-2.0 1390513 downloads external
  • unsloth/Qwen3.6-35B-A3B-GGUF apache-2.0 877585 downloads external
  • unsloth/Qwen3.5-9B-GGUF apache-2.0 1047718 downloads external
  • yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF apache-2.0 561577 downloads external
  • empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF apache-2.0 907682 downloads external
  • unsloth/Qwen3.6-27B-MTP-GGUF apache-2.0 868483 downloads external
  • unsloth/Qwen3.6-35B-A3B-MTP-GGUF apache-2.0 777715 downloads external
  • unsloth/Qwen3.5-4B-GGUF apache-2.0 998890 downloads external
  • unsloth/Qwen3.6-27B-GGUF apache-2.0 578691 downloads external
  • unsloth/gemma-4-E4B-it-GGUF apache-2.0 687378 downloads external
  • unsloth/gemma-4-31B-it-GGUF apache-2.0 591899 downloads external
  • unsloth/gemma-4-26B-A4B-it-qat-GGUF apache-2.0 808837 downloads external
  • DavidAU/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-NEO-CODE-Di-IMatrix-MAX-GGUF apache-2.0 544924 downloads external
  • unsloth/gemma-4-E2B-it-GGUF apache-2.0 696110 downloads external
  • unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF apache-2.0 609270 downloads external
  • unsloth/gpt-oss-20b-GGUF apache-2.0 352246 downloads external
  • unsloth/gemma-4-12B-it-qat-GGUF apache-2.0 476353 downloads external
  • unsloth/Qwen3-Coder-Next-GGUF apache-2.0 279249 downloads external
  • google/gemma-4-12B-it-qat-q4_0-gguf apache-2.0 542572 downloads external
  • yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF apache-2.0 241409 downloads external
  • unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF apache-2.0 243253 downloads external
  • DavidAU/Qwen3.6-27B-Heretic-Uncensored-FINETUNE-NEO-CODE-Di-IMatrix-MAX-GGUF apache-2.0 354747 downloads external
  • Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GGUF apache-2.0 230530 downloads external
  • lmstudio-community/gemma-4-E4B-it-GGUF apache-2.0 774995 downloads external
  • unsloth/Qwen2.5-VL-7B-Instruct-GGUF apache-2.0 384678 downloads external
  • Qwen/Qwen3-Embedding-0.6B-GGUF apache-2.0 220727 downloads external
  • unsloth/Qwen-Image-Edit-2511-GGUF apache-2.0 221698 downloads external
  • Jackrong/Qwopus3.6-27B-v2-MTP-GGUF apache-2.0 269084 downloads external
  • unsloth/Qwen3-VL-2B-Instruct-GGUF apache-2.0 851190 downloads external
  • unsloth/diffusiongemma-26B-A4B-it-GGUF apache-2.0 265418 downloads external
  • Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF apache-2.0 272609 downloads external
  • Jackrong/Qwen3.5-9B-DeepSeek-V4-Flash-GGUF apache-2.0 283586 downloads external
  • Qwen/Qwen3-4B-GGUF apache-2.0 397110 downloads external
  • unsloth/Qwen3.5-0.8B-GGUF apache-2.0 295186 downloads external
  • unsloth/gpt-oss-120b-GGUF apache-2.0 241119 downloads external
  • unsloth/Qwen3.5-35B-A3B-GGUF apache-2.0 135518 downloads external
  • Qwen/Qwen2.5-Coder-32B-Instruct-GGUF apache-2.0 257209 downloads external
  • PaddlePaddle/PaddleOCR-VL-1.6-GGUF apache-2.0 611348 downloads external
  • unsloth/GLM-5.2-GGUF mit 164180 downloads external
  • QuantStack/Wan2.2-I2V-A14B-GGUF apache-2.0 186516 downloads external
  • TheBloke/Mistral-7B-Instruct-v0.2-GGUF apache-2.0 155931 downloads external
  • Jackrong/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-GGUF apache-2.0 186420 downloads external
  • unsloth/Qwen3.5-27B-GGUF apache-2.0 146544 downloads external
  • unsloth/gemma-4-31B-it-qat-GGUF apache-2.0 293488 downloads external
  • Jackrong/Qwopus3.5-9B-Coder-MTP-GGUF apache-2.0 226549 downloads external
  • unsloth/FLUX.2-klein-4B-GGUF apache-2.0 243963 downloads external
  • TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF apache-2.0 200597 downloads external
  • google/gemma-4-26B-A4B-it-qat-q4_0-gguf apache-2.0 319537 downloads external

Open interactive ranking page