Smallest chat models for H100 80GB

Verified open chat models that fit in 80 GB on H100 80GB, smallest first — with license clarity and hosted-download status. Top pick: BAAI/bge-reranker-v2-gemma (~1.87 GB).

Hugging Bay is intentionally crawlable for search engines, answer engines, user-requested AI fetches, frontier AI assistants, and open-source agents. Public pages describe verified open-source AI artifact metadata, provenance, licenses, community trust signals, and selective hosted mirrors with hashes. Hugging Bay does not bypass gated or restricted upstream access controls.

Machine-readable entrypoints: robots.txt, AI search guidance, well-known AI search JSON, AI citation packs, well-known AI citation JSON, llms.txt, llms-full.txt, AI crawler policy, AI bot allowlist, answer-engine manifest, agent manifest, OpenAPI, and indexing status.

Verified open chat models that fit in 80 GB on H100 80GB, smallest first — with license clarity and hosted-download status. Top pick: BAAI/bge-reranker-v2-gemma (~1.87 GB).

#ModelEst. VRAMLicenseCommercialHostingFit page
1BAAI/bge-reranker-v2-gemma~1.87 GBapache-2.0yesexternalcheck
2mixedbread-ai/mxbai-rerank-xsmall-v1~1.87 GBapache-2.0yesexternalcheck
3google-bert/bert-base-german-cased~1.87 GBmityesexternalcheck
4openai-community/openai-gpt~1.87 GBmityesexternalcheck
5Snowflake/snowflake-arctic-instruct~1.87 GBapache-2.0yesexternalcheck
6skt/A.X-K1~1.87 GBapache-2.0yesexternalcheck
7agentlans/multilingual-e5-small-aligned-sentiment~1.87 GBmityesexternalcheck
8mistralai/Mistral-Nemo-Base-2407~1.87 GBapache-2.0yesexternalcheck
9Salesforce/codet5-small~1.87 GBapache-2.0yesexternalcheck
10segment-any-text/sat-3l~1.87 GBmityesexternalcheck

Other GPUs: RTX 4090 24GB · RTX 3090 24GB · RTX 3060 12GB · NVIDIA T4 16GB (free Colab) · A100 80GB · mac-m3-max-64

Other tasks on H100 80GB: coding · reasoning · translation · summarization · vision · audio · rag · agents

Fit = weights + KV-cache estimate under 80 GB. Recomputed hourly from live catalog state.