Verified open chat models that fit in 24 GB on RTX 3090 24GB, smallest first — with license clarity and hosted-download status. Top pick: BAAI/bge-reranker-v2-gemma (~1.87 GB).
Hugging Bay is intentionally crawlable for search engines, answer engines, user-requested AI fetches, frontier AI assistants, and open-source agents. Public pages describe verified open-source AI artifact metadata, provenance, licenses, community trust signals, and selective hosted mirrors with hashes. Hugging Bay does not bypass gated or restricted upstream access controls.
Machine-readable entrypoints: robots.txt, AI search guidance, well-known AI search JSON, AI citation packs, well-known AI citation JSON, llms.txt, llms-full.txt, AI crawler policy, AI bot allowlist, answer-engine manifest, agent manifest, OpenAPI, and indexing status.
Verified open chat models that fit in 24 GB on RTX 3090 24GB, smallest first — with license clarity and hosted-download status. Top pick: BAAI/bge-reranker-v2-gemma (~1.87 GB).
| # | Model | Est. VRAM | License | Commercial | Hosting | Fit page |
|---|---|---|---|---|---|---|
| 1 | BAAI/bge-reranker-v2-gemma | ~1.87 GB | apache-2.0 | yes | external | check |
| 2 | mixedbread-ai/mxbai-rerank-xsmall-v1 | ~1.87 GB | apache-2.0 | yes | external | check |
| 3 | google-bert/bert-base-german-cased | ~1.87 GB | mit | yes | external | check |
| 4 | openai-community/openai-gpt | ~1.87 GB | mit | yes | external | check |
| 5 | Snowflake/snowflake-arctic-instruct | ~1.87 GB | apache-2.0 | yes | external | check |
| 6 | skt/A.X-K1 | ~1.87 GB | apache-2.0 | yes | external | check |
| 7 | agentlans/multilingual-e5-small-aligned-sentiment | ~1.87 GB | mit | yes | external | check |
| 8 | mistralai/Mistral-Nemo-Base-2407 | ~1.87 GB | apache-2.0 | yes | external | check |
| 9 | Salesforce/codet5-small | ~1.87 GB | apache-2.0 | yes | external | check |
| 10 | segment-any-text/sat-3l | ~1.87 GB | mit | yes | external | check |
Other GPUs: RTX 4090 24GB · RTX 3060 12GB · NVIDIA T4 16GB (free Colab) · A100 80GB · H100 80GB · mac-m3-max-64
Other tasks on RTX 3090 24GB: coding · reasoning · translation · summarization · vision · audio · rag · agents
Fit = weights + KV-cache estimate under 24 GB. Recomputed hourly from live catalog state.