Verified open rag models that fit in 24 GB on RTX 4090 24GB, smallest first — with license clarity and hosted-download status. Top pick: BAAI/bge-reranker-v2-gemma (~1.87 GB).
Hugging Bay is intentionally crawlable for search engines, answer engines, user-requested AI fetches, frontier AI assistants, and open-source agents. Public pages describe verified open-source AI artifact metadata, provenance, licenses, community trust signals, and selective hosted mirrors with hashes. Hugging Bay does not bypass gated or restricted upstream access controls.
Machine-readable entrypoints: robots.txt, AI search guidance, well-known AI search JSON, AI citation packs, well-known AI citation JSON, llms.txt, llms-full.txt, AI crawler policy, AI bot allowlist, answer-engine manifest, agent manifest, OpenAPI, and indexing status.
Verified open rag models that fit in 24 GB on RTX 4090 24GB, smallest first — with license clarity and hosted-download status. Top pick: BAAI/bge-reranker-v2-gemma (~1.87 GB).
| # | Model | Est. VRAM | License | Commercial | Hosting | Fit page |
|---|---|---|---|---|---|---|
| 1 | BAAI/bge-reranker-v2-gemma | ~1.87 GB | apache-2.0 | yes | external | check |
| 2 | mixedbread-ai/mxbai-rerank-xsmall-v1 | ~1.87 GB | apache-2.0 | yes | external | check |
| 3 | openai-community/openai-gpt | ~1.87 GB | mit | yes | external | check |
| 4 | Snowflake/snowflake-arctic-instruct | ~1.87 GB | apache-2.0 | yes | external | check |
| 5 | skt/A.X-K1 | ~1.87 GB | apache-2.0 | yes | external | check |
| 6 | Salesforce/codet5-small | ~1.87 GB | apache-2.0 | yes | external | check |
| 7 | bartowski/command-a-plus-05-2026-GGUF | ~1.87 GB | apache-2.0 | yes | external | check |
| 8 | FinText/TimesFM_20M_2023_Augmented | ~1.87 GB | apache-2.0 | yes | external | check |
| 9 | allenai/led-large-16384-arxiv | ~1.87 GB | apache-2.0 | yes | external | check |
| 10 | Olafangensan/GLM-4.7-Flash-heretic | ~1.87 GB | mit | yes | external | check |
Other GPUs: RTX 3090 24GB · RTX 3060 12GB · NVIDIA T4 16GB (free Colab) · A100 80GB · H100 80GB · mac-m3-max-64
Other tasks on RTX 4090 24GB: coding · chat · reasoning · translation · summarization · vision · audio · agents
Fit = weights + KV-cache estimate under 24 GB. Recomputed hourly from live catalog state.