Can I run QuantFactory/falcon-mamba-7b-instruct-GGUF on M2 Mac 36 GB?
File-size estimate: within budget. Estimate only. No fresh, matching Proof Lab measurement is available for this file and device.
FILE-SIZE ESTIMATE
File-size estimate: within budget.
Estimate only. No fresh, matching Proof Lab measurement is available for this file and device.
Next, open the model page to check its files and available run instructions.
View model and files- File on disk
- 3.92 GiB
- Memory allowance
- 4.89 GiB
- Memory pool
- unified memory
- Evidence
- Estimate only
The exact file
falcon-mamba-7b-instruct.Q4_K_M.gguf
File fingerprint
SHA-256
344b194b834336d156dcb507978631960ea99d335410cf17dbb5a1606612a6e1File size × 1.25 = 4.89 GiB. The assumed budget is 34.00 GiB unified memory, after reserving 2 GiB. Context, runtime and other apps can need more.
Run command
No tested command for this file and device yet. Open the model page for available setup instructions.
Alternatives with room
- QuantFactory/TIPO-500M-GGUF · 0.29 GiB · estimated fit
- unsloth/LFM2.5-1.2B-Instruct-GGUF · 0.68 GiB · estimated fit
- rippertnt/HyperCLOVAX-SEED-Text-Instruct-1.5B-Q4_K_M-GGUF · 1.06 GiB · estimated fit
These serve the same recorded task; quality and architecture support can differ.
Questions about this run
Can I run QuantFactory/falcon-mamba-7b-instruct-GGUF on M2 Mac 36 GB?
File-size estimate: within budget. Estimate only. No fresh, matching Proof Lab measurement is available for this file and device.
How is memory fit calculated?
File size × 1.25 = 4.89 GiB. The assumed budget is 34.00 GiB unified memory, after reserving 2 GiB. Context, runtime and other apps can need more.
Was this exact file tested on this device?
No matching fresh lab evidence is available. File-size estimates do not establish runtime support.