Mixtral 8x22B on Mac Studio M3 Ultra 512 GB
140.63B (39B active) on 512 GB at 819 GB/s. Hardware details · Model details
Yes. Mixtral 8x22B fits on Mac Studio M3 Ultra 512 GB at the recommended
Q8_0 configuration, requiring approximately 148.9 GB at 8K context. Practical context capacity is 64K.CompatibilityComfortable
Calculated fit
Yes
Calculated Uses under 80% of usable memory. Room for a long context and other work.
Recommended quantization
Q8_0
Calculated gguf
Memory required
148.9 GB
Calculated of 435.2 GB usable — 34%
Max practical context
64K
Calculated model supports 64K
Memory budget at 8K context
Model weights ⓘ
141.9 GB Calculated
KV cache ⓘ
1.8 GB Calculated
Runtime overhead ⓘ
5.3 GB Estimated
Total required
148.9 GB Calculated
Headroom ⓘ
286.3 GB Calculated
Highest-precision quantization that leaves headroom: uses 34% of usable memory at 8K context.
Unified memory: weights, KV cache and the OS share the same 512 GB pool. We assume 85% is addressable by the GPU, which matches a headless machine with the wired-memory limit raised.
Mixture of experts: all 140.63B parameters must be resident in memory even though only ~39B are active per token. Memory follows total parameters; speed follows active parameters.
Performance
Estimated performance · recommended Q8_0
Decode, prefill and TTFT below are estimates for Q8_0. We do not have a comparable Q8_0 measurement on this machine.
Estimated decode
—
Estimated Q8_0; calculated range
Estimated prefill
—
Estimated Q8_0; calculated range
Estimated TTFT at 8K
~41.9–86.8 s
Estimated Q8_0; calculated range
Hardware load reference
205 W
Measured machine-level load; not this model run
No throughput figures for this configuration. We do not estimate performance for a model that cannot load.
How the estimate is calculated
- Decode: reading 39.0B active parameters at 8.50 bits/weight takes 71.44 ms at 819 GB/s x 71% achieved efficiency.
- MoE routing penalty of 15% applied: expert gathers are less bandwidth-efficient than a dense sweep.
- Prefill: 57 TFLOPS (FP16) x 1.72 calibrated against measured prefill on this platform x 22% assumed model-FLOPs utilisation, divided by 2 x 74.1B parameters per token.
- Prefill uses 74.1B effective parameters, not the 39B active in decode: a batch of hundreds of tokens routes across most of the expert pool.
- MoE decode depends on how well the engine batches expert gathers; real results vary more than for dense models.
- Prefill throughput is highly engine-dependent. Flash attention, batch size and quantized KV all move this number substantially, and for sparse mixture-of-experts models it is the least reliable figure we produce.
- This is a calculated estimate, not a measurement. It assumes a single request, a short prompt, no speculative decoding and a warm model already resident in memory.
Estimator version estimator_v1. Stored with every estimated row so old estimates can be regenerated when the model improves.
Submit a benchmarkSubmissions stay pending until reviewed.
This model at other quantizations on this machine
| Quantization | Resident | Disk | Total needed | Utilisation | Fit | Max context |
|---|---|---|---|---|---|---|
MLX 4-bit | 76.6 GB | 76.6 GB | 81.7 GB | 19% | Comfortable | 64K |
Q4_K_M | 81.8 GB | 81.8 GB | 87.0 GB | 20% | Comfortable | 64K |
Q5_K_M | 95.9 GB | 95.9 GB | 101.6 GB | 23% | Comfortable | 64K |
Q8_0recommended | 141.9 GB | 141.9 GB | 148.9 GB | 34% | Comfortable | 64K |
BF16 | 261.9 GB | 261.9 GB | 272.6 GB | 63% | Comfortable | 64K |
Cost of running Mixtral 8x22B on this machineUnited States (federal) · C corporation · 8h/day
Monthly economic cost
$87
Calculated after tax
Codex/Claude Code
$100/mo
≈ $100/mo · local is $13 less
Net cash at purchase
$8,287
Calculated VAT not reclaimable
Total over 5 years
$5,198
Calculated after tax, after resale
Cost per USD/1M tokens
—
Calculated
The $100 comparison uses the Codex Pro 5x / Claude Max 5x plans. A fixed planning conversion is used for USD. This compares monthly spend only: subscriptions have usage limits, local hardware has different capabilities and constraints, and taxes or regional pricing may change the charged amount. Prices checked 7 September 2026.
Purchase-price input: $8,287 in United States (federal), tax/VAT excluded · estimated · Apple Refurbished / used market (converted catalogue estimate). This is the localized purchase input; the after-tax economic cost is calculated separately below.
Monthly breakdown
| Depreciation 5,801 over 5 years, straight-line to a 2,486 residual | $96.68 |
| Electricity 9.0 kWh/month at 0.140/kWh | $1.27 |
| Cost of capital 4.0%/yr on 5,386 average capital employed | $17.95 |
| Monthly cost before tax | $115.90 |
| Electricity tax shield Running costs are deductible business expenses | −$0.27 |
| First-year expensing §179 (100.0%) | −$29.00 |
| Monthly economic cost after tax | $86.63 |
Three different numbers, deliberately
Cash cost
$8,287
Money that leaves the bank account on day one, net of reclaimable VAT.
Accounting depreciation
$96.68/month
$5,801 written down over 5 years to a $2,486 residual.
After-tax economic cost
$86.63/month
Depreciation plus running costs plus cost of capital, less the tax those deductions save. This is the figure to compare between machines.
Assumptions and sources (verified 2026-09-07)
VAT rate
0% Official spec
VAT recoverable
0% Official spec
Federal C-corporation estimate at the flat 21% rate. Pass-through entities should use the sole-proprietor estimate as a rougher proxy.
Effective deduction rate
21.00% Calculated
Headline marginal rate 21.00%.
Depreciation
5 years, straight-line Assumption
Residual value
$2,486 (30%) Assumption
Extrapolated from the three-year curve.
Electricity
$0.140/kWh Assumption
Average power draw
51 W Calculated
Load 205 W for 20% of powered hours, idle 13 W for the rest — a machine that is on is not generating tokens the whole time.
Investment allowances
§179 100.0% Official spec
Worth $1,740 in total — first-year expensing that replaces later tax depreciation.
Cost of capital
$17.95/month Assumption
- VAT rate: No US federal VAT · verified 2026-09-07
- Marginal tax rate: IRS Publication 542 — Corporations · verified 2026-09-07
- VAT recoverable fraction: site assumption · verified 2026-09-07
- Useful life: IRS Publication 946 — How To Depreciate Property · verified 2026-09-07
- Electricity price: Site assumption · verified 2026-09-07
Federal planning estimate only, not tax advice. State and local income tax, sales/use tax and incentives are excluded. It assumes 100% business use, a Section 179 election, enough business income to use it, and that the full annual limit remains available.
Mixtral 8x22B on other hardware
| Hardware | Decode | Price | Fit |
|---|
Nearest alternatives to the Mac Studio M3 Ultra 512 GB
Mixtral 8x22B on Mac Studio M3 Ultra 256 GB256 GBMixtral 8x22B on Mac Studio M5 Ultra 512 GB512 GBMixtral 8x22B on Mac Studio M3 Ultra 96 GB96 GBMixtral 8x22B on Mac Studio M5 Ultra 256 GB256 GBMixtral 8x22B on Mac Studio M5 Ultra 96 GB96 GB
Compare Mac Studio M3 Ultra 512 GB against Mac Studio M3 Ultra 256 GB →
Compare Mac Studio M3 Ultra 512 GB against Mac Studio M3 Ultra 256 GB →