Smallest coding models for RTX 4090 24GB

Verified open coding models that fit in 24 GB on RTX 4090 24GB, smallest first — with license clarity and hosted-download status. Top pick: Snowflake/snowflake-arctic-instruct (~1.87 GB).

Hugging Bay is intentionally crawlable for search engines, answer engines, user-requested AI fetches, frontier AI assistants, and open-source agents. Public pages describe verified open-source AI artifact metadata, provenance, licenses, community trust signals, and selective hosted mirrors with hashes. Hugging Bay does not bypass gated or restricted upstream access controls.

Machine-readable entrypoints: robots.txt, AI search guidance, well-known AI search JSON, AI citation packs, well-known AI citation JSON, llms.txt, llms-full.txt, AI crawler policy, AI bot allowlist, answer-engine manifest, agent manifest, OpenAPI, and indexing status.

Verified open coding models that fit in 24 GB on RTX 4090 24GB, smallest first — with license clarity and hosted-download status. Top pick: Snowflake/snowflake-arctic-instruct (~1.87 GB).

#ModelEst. VRAMLicenseCommercialHostingFit page
1Snowflake/snowflake-arctic-instruct~1.87 GBapache-2.0yesexternalcheck
2skt/A.X-K1~1.87 GBapache-2.0yesexternalcheck
3Salesforce/codet5-small~1.87 GBapache-2.0yesexternalcheck
4devlocalhost/hi-tinylama-gguf-16bit~1.87 GBapache-2.0yesexternalcheck
5mradermacher/Phi-4-mini-instruct-abliterated-GGUF~1.87 GBmityesexternalcheck
6mmnga/RakutenAI-2.0-mini-instruct-gguf~1.87 GBapache-2.0yesexternalcheck
7DanielClough/Candle_phi-1~1.87 GBmityesexternalcheck
8mradermacher/Phi-4-mini-reasoning-heretic-GGUF~1.87 GBmityesexternalcheck
9dimsavva/devstal-experiment~1.87 GBapache-2.0yesexternalcheck
10mradermacher/zen4-coder-pro-GGUF~1.87 GBapache-2.0yesexternalcheck

Other GPUs: RTX 3090 24GB · RTX 3060 12GB · NVIDIA T4 16GB (free Colab) · A100 80GB · H100 80GB · mac-m3-max-64

Other tasks on RTX 4090 24GB: chat · reasoning · translation · summarization · vision · audio · rag · agents

Fit = weights + KV-cache estimate under 24 GB. Recomputed hourly from live catalog state.