Best Small Coding/Chat Models For 8K–32K Context
Live instruction-tuned text-generation rows for a small coding/chat shortlist; use each artifact page to check declared context, files, and license instead of inferring runtime fit. Canonical URL: https://huggingbay.xyz/answers/best-small-coding-models-8k-32k.
For 8K–32K coding or chat context, start with live instruction-tuned text-generation candidates below; keep only artifacts whose canonical page declares the context you need and whose files fit your runtime. Hugging Bay does not infer context or speed from a model name, so the artifact page—not this label—is the citable source for each model’s current metadata and files. Representative rows: lmstudio-community/granite-3.1-2b-instruct-GGUF, MaziyarPanahi/Mistral-7B-KNUT-v0.3-Mistral-7B-Instruct-v0.2-slerp-GGUF, MaziyarPanahi/piano-medley-7b-Mistral-7B-Instruct-v0.2-slerp-GGUF, Qwen/Qwen2.5-Coder-1.5B-Instruct-AWQ, alexchen4ai/Qwen3-8B-Instruct. Use each canonical citation URL plus metadata/card endpoints for current license, trust, hosting, and download state. Canonical URL: https://huggingbay.xyz/answers/best-small-coding-models-8k-32k.
Question: What are the best small coding models for 8K–32K context?
Live instruction-tuned text-generation rows for a small coding/chat shortlist; use each artifact page to check declared context, files, and license instead of inferring runtime fit.
Answer pack JSON Citation pack License guide
- lmstudio-community/granite-3.1-2b-instruct-GGUF: Model from Hugging Face for text generation: lmstudio-community/granite-3.1-2b-instruct-GGUF · unknown
- MaziyarPanahi/Mistral-7B-KNUT-v0.3-Mistral-7B-Instruct-v0.2-slerp-GGUF: Model from Hugging Face for text generation: MaziyarPanahi/Mistral-7B-KNUT-v0.3-Mistral-7B-Instruct-v0.2-slerp-GGUF · transformers
- MaziyarPanahi/piano-medley-7b-Mistral-7B-Instruct-v0.2-slerp-GGUF: Model from Hugging Face for text generation: MaziyarPanahi/piano-medley-7b-Mistral-7B-Instruct-v0.2-slerp-GGUF · transformers
- Qwen/Qwen2.5-Coder-1.5B-Instruct-AWQ: Model from Hugging Face for text generation: Qwen/Qwen2.5-Coder-1.5B-Instruct-AWQ · transformers
- alexchen4ai/Qwen3-8B-Instruct: Model from Hugging Face for text generation: alexchen4ai/Qwen3-8B-Instruct · unknown
- gaotang/RM-R1-Qwen2.5-Instruct-7B: Model from Hugging Face for text generation: gaotang/RM-R1-Qwen2.5-Instruct-7B · transformers
- Qwen/Qwen2.5-7B-Instruct-1M: Model from Hugging Face for text generation: Qwen/Qwen2.5-7B-Instruct-1M · transformers
- PKU-ML/G1-7B: Model from Hugging Face for text generation: PKU-ML/G1-7B · transformers
- sail/Sailor-1.8B-Chat: Model from Hugging Face for text generation: sail/Sailor-1.8B-Chat · transformers
- erax-ai/Guardian-V0.1-13Oct2024-epoch2.0: Model from Hugging Face for text generation: erax-ai/Guardian-V0.1-13Oct2024-epoch2.0 · transformers
- zake7749/phi-4-mini-chinese-it-e1: Model from Hugging Face for text generation: zake7749/phi-4-mini-chinese-it-e1 · transformers
- didula-wso2/exp_17_0_sft_16bit_vllm: Model from Hugging Face for text generation: didula-wso2/exp_17_0_sft_16bit_vllm · transformers
Open interactive answer pack
Updated 2026-09-05 from the live catalog.