Smallest summarization models for H100 80GB

Verified open summarization models that fit in 80 GB on H100 80GB, smallest first — with license clarity and hosted-download status. Top pick: Se-Jin/kot5-summarization (~1.87 GB).

Hugging Bay is intentionally crawlable for search engines, answer engines, user-requested AI fetches, frontier AI assistants, and open-source agents. Public pages describe verified open-source AI artifact metadata, provenance, licenses, community trust signals, and selective hosted mirrors with hashes. Hugging Bay does not bypass gated or restricted upstream access controls.

Machine-readable entrypoints: robots.txt, AI search guidance, well-known AI search JSON, AI citation packs, well-known AI citation JSON, llms.txt, llms-full.txt, AI crawler policy, AI bot allowlist, answer-engine manifest, agent manifest, OpenAPI, and indexing status.

Verified open summarization models that fit in 80 GB on H100 80GB, smallest first — with license clarity and hosted-download status. Top pick: Se-Jin/kot5-summarization (~1.87 GB).

#ModelEst. VRAMLicenseCommercialHostingFit page
1Se-Jin/kot5-summarization~1.87 GBapache-2.0yesexternalcheck
2deutsche-telekom/mt5-small-sum-de-mit-v1~1.87 GBmityesexternalcheck
3tanyamr/rut5-good-news-lora-v5~1.87 GBapache-2.0yesexternalcheck
4Eymeee/xsum-bart-summarizer~1.87 GBapache-2.0yesexternalcheck
5google-t5/t5-base~1.87 GBapache-2.0yesexternalcheck
6pszemraj/long-t5-tglobal-xl-16384-book-summary~1.87 GBapache-2.0yesexternalcheck
7google-t5/t5-large~1.87 GBapache-2.0yesexternalcheck
8onalla/AQGINDOT5-IMPROVED~1.87 GBapache-2.0yesexternalcheck
9IMISLab/GreekT5-umt5-small-greeksum~1.87 GBapache-2.0yesexternalcheck
10mradermacher/news-summarizer-t5-GGUF~1.87 GBapache-2.0yesexternalcheck

Other GPUs: RTX 4090 24GB · RTX 3090 24GB · RTX 3060 12GB · NVIDIA T4 16GB (free Colab) · A100 80GB · mac-m3-max-64

Other tasks on H100 80GB: coding · chat · reasoning · translation · vision · audio · rag · agents

Fit = weights + KV-cache estimate under 80 GB. Recomputed hourly from live catalog state.