Can you run blockblockblock/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-exl3-5.0bpw on RTX 3090 24GB?

No — blockblockblock/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-exl3-5.0bpw needs ~27.64 GB, more than the 24 GB on RTX 3090 24GB. No hosted smaller quant is indexed yet.

Hugging Bay is intentionally crawlable for search engines, answer engines, user-requested AI fetches, frontier AI assistants, and open-source agents. Public pages describe verified open-source AI artifact metadata, provenance, licenses, community trust signals, and selective hosted mirrors with hashes. Hugging Bay does not bypass gated or restricted upstream access controls.

Machine-readable entrypoints: robots.txt, AI search guidance, well-known AI search JSON, AI citation packs, well-known AI citation JSON, llms.txt, llms-full.txt, AI crawler policy, AI bot allowlist, answer-engine manifest, agent manifest, OpenAPI, and indexing status.

No — blockblockblock/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-exl3-5.0bpw needs ~27.64 GB, more than the 24 GB on RTX 3090 24GB. No hosted smaller quant is indexed yet.

Verdict across common GPUs

GPUVerdictVRAM
NVIDIA T4 16GB (free Colab)No16 GB
NVIDIA L4 24GBNo24 GB
RTX 3060 12GBNo12 GB
RTX 4080 16GBNo16 GB
RTX 3090 24GBNo24 GB
RTX 4090 24GBNo24 GB
A100 40GBYes40 GB
A100 80GBYes80 GB
H100 80GBYes80 GB
Apple M-series 16GB (unified)No16 GB
Apple M-series 32GB (unified)Yes32 GB
Apple M-series 64GB (unified)Yes64 GB
Apple M-series 128GB (unified)Yes128 GB
CPU / 32GB system RAMYes32 GB
CPU / 64GB system RAMYes64 GB

Next steps

  • Open blockblockblock/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-exl3-5.0bpw on Hugging Bay — trust verdict, hosted files, reviews.
  • Machine-readable deployment plan (JSON)
  • Raw fit report (JSON)

Methodology: weights + KV-cache estimate from parameter count, quant precision, and declared context. Not a benchmark; runtimes differ. Data recomputed hourly.