Yes — bartowski/microsoft_Phi-4-mini-reasoning-GGUF fits on H100 80GB: estimated 1.87 GB (weights + KV cache) against 80 GB.
Hugging Bay is intentionally crawlable for search engines, answer engines, user-requested AI fetches, frontier AI assistants, and open-source agents. Public pages describe verified open-source AI artifact metadata, provenance, licenses, community trust signals, and selective hosted mirrors with hashes. Hugging Bay does not bypass gated or restricted upstream access controls.
Machine-readable entrypoints: robots.txt, AI search guidance, well-known AI search JSON, AI citation packs, well-known AI citation JSON, llms.txt, llms-full.txt, AI crawler policy, AI bot allowlist, answer-engine manifest, agent manifest, OpenAPI, and indexing status.
Yes — bartowski/microsoft_Phi-4-mini-reasoning-GGUF fits on H100 80GB: estimated 1.87 GB (weights + KV cache) against 80 GB.
| GPU | Verdict | VRAM |
|---|---|---|
| NVIDIA T4 16GB (free Colab) | Yes | 16 GB |
| NVIDIA L4 24GB | Yes | 24 GB |
| RTX 3060 12GB | Yes | 12 GB |
| RTX 4080 16GB | Yes | 16 GB |
| RTX 3090 24GB | Yes | 24 GB |
| RTX 4090 24GB | Yes | 24 GB |
| A100 40GB | Yes | 40 GB |
| A100 80GB | Yes | 80 GB |
| H100 80GB | Yes | 80 GB |
| Apple M-series 16GB (unified) | Yes | 16 GB |
| Apple M-series 32GB (unified) | Yes | 32 GB |
| Apple M-series 64GB (unified) | Yes | 64 GB |
| Apple M-series 128GB (unified) | Yes | 128 GB |
| CPU / 32GB system RAM | Yes | 32 GB |
| CPU / 64GB system RAM | Yes | 64 GB |
| Repo | Quant | Approx weights | Hosting |
|---|---|---|---|
| tdh111/bitnet-b1.58-2B-4T-GGUF | unknown | 4 GB | external |
| gabriellarson/NextCoder-7B-GGUF | unknown | 14 GB | external |
| mradermacher/Phi-4-mini-reasoning-heretic-GGUF | unknown | — | external |
| gaianet/Phi-3-medium-128k-instruct-GGUF | unknown | — | external |
| second-state/Phi-3-medium-4k-instruct-GGUF | unknown | — | external |
| pipenetwork/FrogBoss-32B-2510-MLX-8bit | unknown | 64 GB | external |
| Felladrin/gguf-Phi-3-mini-4k-instruct | unknown | — | external |
| amd/Phi-3-mini-4k-instruct-onnx-ryzenai-npu | unknown | — | external |
| Alcoft/Phi-3.5-mini-instruct-GGUF | unknown | — | external |
| mradermacher/MediQwen-Reasoning-4B-GGUF | unknown | 8 GB | external |
| mradermacher/NeuralExperiment-7b-MagicCoder-v7-i1-GGUF | unknown | 14 GB | external |
| bartowski/microsoft_Phi-4-mini-reasoning-GGUF | unknown | — | external |
Methodology: weights + KV-cache estimate from parameter count, quant precision, and declared context. Not a benchmark; runtimes differ. Data recomputed hourly.