Can I run this model on my computer?

LEARN / LOCAL AI Sources checked

Compare the selected weight files with your available memory, check the runner supports the architecture and format, and test a short local load. Hugging Bay uses 60% of total memory as an initial file-size screen; runtime overhead and context still need room.

Start with the weight-file screen

These are decimal GB limits from Finder's current rule, not measured runtime requirements. Add all the required weight shards for the selected variant before comparing. Do not compare the size of an entire repository containing several alternative quantizations with one model's weight size.

Start with the weight-file screen
Your RAMFile-size ceiling
8 GB4.8 GB
16 GB9.6 GB
24 GB14.4 GB
32 GB19.2 GB
64 GB38.4 GB

Check four things before a large download

  1. Identify your system RAM and, on a discrete GPU, VRAM. Apple silicon uses shared memory.
  2. Check the exact architecture, file format and companion files your runner requires.
  3. Leave room for the operating system, runner and context cache. More context increases memory use.
  4. Load a small test and record the exact file, runner version, context and result. A fit estimate is not execution evidence.

Use hardware pages to inspect device profiles, Finder for current files, or the 16 GB Mac comparison for a concrete starting point.

When a file does not fit

Inspect a smaller model or a smaller supported quantization, reduce context, and close other memory-heavy apps. Check common local AI problems if loading fails. Avoid treating a smaller download as proof of better quality or adequate performance for your task.

Sources and checks

Checked 2026-10-26. Install requirements and availability can change; the linked source has current details.

Read as Markdown