Qwen3.8 Flash Next on Mac Studio M5 Max 128 GB
180B (6B active) on 128 GB at 614 GB/s. Hardware details · Model details
Memory budget at 8K context
How the estimate is calculated
- Decode: reading 6.0B active parameters at 4.50 bits/weight takes 6.27 ms at 614 GB/s x 88% achieved efficiency.
- MoE routing penalty of 15% applied: expert gathers are less bandwidth-efficient than a dense sweep.
- Prefill: 120 TFLOPS (FP16) x 1.69 calibrated against measured prefill on this platform x 22% assumed model-FLOPs utilisation, divided by 2 x 32.9B parameters per token.
- Prefill uses 32.9B effective parameters, not the 6B active in decode: a batch of hundreds of tokens routes across most of the expert pool.
- MoE decode depends on how well the engine batches expert gathers; real results vary more than for dense models.
- Prefill throughput is highly engine-dependent. Flash attention, batch size and quantized KV all move this number substantially, and for sparse mixture-of-experts models it is the least reliable figure we produce.
- This is a calculated estimate, not a measurement. It assumes a single request, a short prompt, no speculative decoding and a warm model already resident in memory.
Estimator version estimator_v1. Stored with every estimated row so old estimates can be regenerated when the model improves.
| Quantization | Weights | Total needed | Utilisation | Fit | Max context |
|---|---|---|---|---|---|
MLX 4-bitrecommended | 98.1 GB | 102.8 GB | 94% | Borderline | 0 |
Q4_K_M | 104.7 GB | 109.6 GB | 101% | Does not fit | 0 |
Q8_0 | 181.7 GB | 188.9 GB | 174% | Does not fit | 0 |
BF16 | 335.3 GB | 347.1 GB | 319% | Does not fit | 0 |
The $100 comparison uses the Codex Pro 5x / Claude Max 5x plans. A fixed planning conversion is used for USD. This compares monthly spend only: subscriptions have usage limits, local hardware has different capabilities and constraints, and taxes or regional pricing may change the charged amount. Prices checked 7 September 2026.
Monthly breakdown
| Depreciation 3,026 over 5 years, straight-line to a 1,297 residual | $50.44 |
| Electricity 5.4 kWh/month at 0.140/kWh | $0.76 |
| Cost of capital 4.0%/yr on 2,810 average capital employed | $9.37 |
| Monthly cost before tax | $60.56 |
| Electricity tax shield Running costs are deductible business expenses | −$0.16 |
| First-year expensing §179 (100.0%) | −$15.13 |
| Monthly economic cost after tax | $45.27 |
Three different numbers, deliberately
Assumptions and sources (verified 2026-09-07)
- VAT rate: No US federal VAT · verified 2026-09-07
- Marginal tax rate: IRS Publication 542 — Corporations · verified 2026-09-07
- VAT recoverable fraction: site assumption · verified 2026-09-07
- Useful life: IRS Publication 946 — How To Depreciate Property · verified 2026-09-07
- Electricity price: Site assumption · verified 2026-09-07
| Hosted model | USD/1M output | Break-even | API at your volume | Verdict | Comparison type |
|---|---|---|---|---|---|
| Qwen3.8 Flash Alibaba Cloud | $0.42 | 29.4M/mo | $23 | API cheaper | Different model |
| DeepSeek-V4 Flash DeepSeek | $0.66 | 18.7M/mo | $37 | API cheaper | Different model |
| DeepSeek-V4 Pro DeepSeek | $1.98 | 6.2M/mo | $110 | Local cheaper | Different model |
| DeepSeek V4 Pro (Together) Together AI | $4.40 | 2.1M/mo | $321 | Local cheaper | Different model |
| GLM-5.3 Z.ai | $4.40 | 2.9M/mo | $236 | Local cheaper | Different model |
| Claude Haiku 4.5 Anthropic | $5.00 | 3.5M/mo | $197 | Local cheaper | Different model |
| Hardware | Decode | Price | Fit |
|---|---|---|---|
| Quad RTX 5090 workstation (4x 32 GB) | ~307–442 t/s | €13.999 | Borderline |
| Mac Studio M5 Ultra 256 GB | ~162–233 t/s | €9.599 | Comfortable |
| Mac Studio M5 Ultra 512 GB | ~101–145 t/s | €12.599 | Comfortable |
| Mac Studio M3 Ultra 256 GB | ~97.9–141 t/s | €6.299 | Comfortable |
| Mac Studio M3 Ultra 512 GB | ~58.9–84.7 t/s | €9.199 | Comfortable |
| CPU-only workstation (Ryzen 9950X, 192 GB DDR5) | ~8.5–12.3 t/s | €1.699 | Comfortable |
Compare Mac Studio M5 Max 128 GB against Mac Studio M5 Ultra 96 GB →
Page quality score (why this page is or is not indexed)
10/13 — indexed. Generated pages are gated so we do not ask a search engine to rank a page with nothing computed to say. The directive is emitted in the page head via the metadata API, not in the body, so it is authoritative.
- Has a memory-fit calculation (+3)
- Has a performance estimate (+2)
- Has a price (+2)
- Has an ownership economics calculation (+2)
- Well connected (18 internal links) (+1)