MiMo-V2.6 Pro 1.02T-A42B on RTX PRO 6000 Max-Q workstation (96 GB, 300 W)

1.0T (42B active) on 96 GB at 1,792 GB/s. Hardware details · Model details

No calculated fit. MiMo-V2.6 Pro 1.02T-A42B does not fit under standard overhead assumptions at Q4_K_M: the model calculates 615.3 GB required against 88.3 GB usable.
CompatibilityDoes not fit
Calculated fit
No
Calculated Requires more than 97% of usable memory. Needs a smaller quantization or more memory.
Smallest catalogued quantization
Q4_K_M
Calculated gguf
Memory required
615.3 GB
Calculated of 88.3 GB usable — 697%
Max practical context
0
Calculated model supports 1M

Memory budget at 8K context

Model weights
593.2 GB Calculated
KV cache
3.3 GB Calculated
Runtime overhead
18.8 GB Estimated
Total required
615.3 GB Calculated
Headroom
-526.9 GB Calculated
No quantization in our catalogue fits this machine.
Discrete GPU: 96 GB of VRAM, of which we assume 92% is usable after driver and context overhead.
Mixture of experts: all 1020B parameters must be resident in memory even though only ~42B are active per token. Memory follows total parameters; speed follows active parameters.
Performance

Estimated performance · recommended Q4_K_M

Decode, prefill and TTFT below are estimates for Q4_K_M. We do not have a comparable Q4_K_M measurement on this machine.

Estimated decode
Estimated Q4_K_M; calculated range
Estimated prefill
Estimated Q4_K_M; calculated range
Estimated TTFT at 8K
~30.7–63.6 s
Estimated Q4_K_M; calculated range
Hardware load reference
390 W
Measured machine-level load; not this model run
No throughput figures for this configuration. We do not estimate performance for a model that cannot load.
How the estimate is calculated
  1. Decode: reading 42.0B active parameters at 4.85 bits/weight takes 19.12 ms at 1792 GB/s x 74% achieved efficiency.
  2. MoE routing penalty of 15% applied: expert gathers are less bandwidth-efficient than a dense sweep.
  3. Prefill: 190 TFLOPS (FP16) x 2 for native FP8 tensor cores x 0.67 calibrated against measured prefill on this platform x 32% assumed model-FLOPs utilisation, divided by 2 x 207.0B parameters per token.
  4. Prefill uses 207.0B effective parameters, not the 42B active in decode: a batch of hundreds of tokens routes across most of the expert pool.

  • MoE decode depends on how well the engine batches expert gathers; real results vary more than for dense models.
  • Prefill throughput is highly engine-dependent. Flash attention, batch size and quantized KV all move this number substantially, and for sparse mixture-of-experts models it is the least reliable figure we produce.
  • This is a calculated estimate, not a measurement. It assumes a single request, a short prompt, no speculative decoding and a warm model already resident in memory.

Estimator version estimator_v1. Stored with every estimated row so old estimates can be regenerated when the model improves.

Submit a benchmarkSubmissions stay pending until reviewed.
This model at other quantizations on this machine
QuantizationResidentDiskTotal neededUtilisationFitMax context
Q4_K_Msmallest listed593.2 GB593.2 GB615.3 GB697%Does not fit0
Q5_K_M695.9 GB695.9 GB721.1 GB816%Does not fit0
Q8_01029.5 GB1029.5 GB1064.7 GB1205%Does not fit0
Cost of running MiMo-V2.6 Pro 1.02T-A42B on this machineUnited States (federal) · C corporation · 8h/day
Monthly economic cost
$138
Calculated after tax
Codex/Claude Code
$100/mo
≈ $100/mo · local is $38 more
Net cash at purchase
$10,809
Calculated VAT not reclaimable
Total over 5 years
$8,294
Calculated after tax, after resale
Cost per USD/1M tokens
Calculated

The $100 comparison uses the Codex Pro 5x / Claude Max 5x plans. A fixed planning conversion is used for USD. This compares monthly spend only: subscriptions have usage limits, local hardware has different capabilities and constraints, and taxes or regional pricing may change the charged amount. Prices checked 7 September 2026.

Purchase-price input: $10,809 in United States (federal), tax/VAT excluded · estimated · NL workstation integrator (converted catalogue estimate). This is the localized purchase input; the after-tax economic cost is calculated separately below.

Monthly breakdown

Depreciation
9,188 over 5 years, straight-line to a 1,621 residual
$153.13
Electricity
20.1 kWh/month at 0.140/kWh
$2.81
Cost of capital
4.0%/yr on 6,215 average capital employed
$20.72
Monthly cost before tax$176.65
Electricity tax shield
Running costs are deductible business expenses
−$0.59
First-year expensing
§179 (100.0%)
−$37.83
Monthly economic cost after tax$138.23

Three different numbers, deliberately

Cash cost
$10,809
Money that leaves the bank account on day one, net of reclaimable VAT.
Accounting depreciation
$153.13/month
$9,188 written down over 5 years to a $1,621 residual.
After-tax economic cost
$138.23/month
Depreciation plus running costs plus cost of capital, less the tax those deductions save. This is the figure to compare between machines.
Assumptions and sources (verified 2026-09-07)
VAT rate
0% Official spec
VAT recoverable
0% Official spec
Federal C-corporation estimate at the flat 21% rate. Pass-through entities should use the sole-proprietor estimate as a rougher proxy.
Effective deduction rate
21.00% Calculated
Headline marginal rate 21.00%.
Depreciation
5 years, straight-line Assumption
Residual value
$1,621 (15%) Assumption
Two GPU generations later, the card is worth a fraction of its list price.
Electricity
$0.140/kWh Assumption
Average power draw
114 W Calculated
Load 390 W for 20% of powered hours, idle 45 W for the rest — a machine that is on is not generating tokens the whole time.
Investment allowances
§179 100.0% Official spec
Worth $2,270 in total — first-year expensing that replaces later tax depreciation.
Cost of capital
$20.72/month Assumption
Federal planning estimate only, not tax advice. State and local income tax, sales/use tax and incentives are excluded. It assumes 100% business use, a Section 179 election, enough business income to use it, and that the full annual limit remains available.