Local LLM Starter Picks

Local-run-friendly model records for Ollama, LM Studio, llama.cpp, Transformers, GGUF, ONNX, safetensors, and small-device workflows.

Hugging Bay is intentionally crawlable for search engines, answer engines, user-requested AI fetches, frontier AI assistants, and open-source agents. Public pages describe verified open-source AI artifact metadata, provenance, licenses, community trust signals, and selective hosted mirrors with hashes. Hugging Bay does not bypass gated or restricted upstream access controls.

Machine-readable entrypoints: robots.txt, AI search guidance, well-known AI search JSON, AI citation packs, well-known AI citation JSON, llms.txt, llms-full.txt, AI crawler policy, AI bot allowlist, answer-engine manifest, agent manifest, OpenAPI, and indexing status.

Question: What open models should I try first for local LLM workflows?

Local LLM Starter Picks is a citation-ready Hugging Bay answer pack backed by live catalog rows. Representative rows: sentence-transformers/all-MiniLM-L6-v2, sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2, answerdotai/ModernBERT-base, BAAI/bge-small-en-v1.5, Qwen/Qwen3-Embedding-0.6B. Use each canonical citation URL plus metadata/card endpoints for current license, trust, hosting, and download state.

Answer pack JSON Citation pack Ranking page

  1. sentence-transformers/all-MiniLM-L6-v2: Local LLM Starter Picks; external metadata; license apache-2.0; 500 upstream downloads
  2. sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2: Local LLM Starter Picks; external metadata; license apache-2.0; 500 upstream downloads
  3. answerdotai/ModernBERT-base: Local LLM Starter Picks; external metadata; license apache-2.0; 500 upstream downloads
  4. BAAI/bge-small-en-v1.5: Local LLM Starter Picks; external metadata; license mit; 500 upstream downloads
  5. Qwen/Qwen3-Embedding-0.6B: Local LLM Starter Picks; external metadata; license apache-2.0; 500 upstream downloads
  6. Qwen/Qwen3-Reranker-0.6B: Local LLM Starter Picks; external metadata; license apache-2.0; 500 upstream downloads
  7. BAAI/bge-m3: Local LLM Starter Picks; external metadata; license mit; 500 upstream downloads
  8. BAAI/bge-reranker-v2-m3: Local LLM Starter Picks; external metadata; license apache-2.0; 500 upstream downloads
  9. Alibaba-NLP/gte-multilingual-base: Local LLM Starter Picks; external metadata; license apache-2.0; 500 upstream downloads
  10. Alibaba-NLP/gte-reranker-modernbert-base: Local LLM Starter Picks; external metadata; license apache-2.0; 500 upstream downloads
  11. Qwen/Qwen3-0.6B: Local LLM Starter Picks; external metadata; license apache-2.0; 500 upstream downloads
  12. Qwen/Qwen2.5-1.5B-Instruct: Local LLM Starter Picks; external metadata; license apache-2.0; 500 upstream downloads

Open interactive answer pack