modelrigs

Qwen3.6 27B on NVIDIA RTX 6000 Ada 48 GB

27.781B on 48 GB at 960 GB/s. Hardware details · Model details

Run locally →
Yes. Qwen3.6 27B fits on NVIDIA RTX 6000 Ada 48 GB at the recommended Q8_0 configuration, requiring approximately 30.4 GB at 8K context. Practical context capacity is 192K.
CompatibilityComfortable
Calculated fit
Yes
Calculated Uses under 80% of usable memory. Room for a long context and other work.
Recommended quantization
Q8_0
Calculated gguf
Memory required
30.4 GB
Calculated of 44.2 GB usable — 69%
Max practical context
192K
Calculated model supports 256K

Memory budget at 8K context

Model weights ⓘ
28.0 GB Calculated
KV cache ⓘ
0.5 GB Calculated
Runtime overhead ⓘ
1.8 GB Estimated
Total required
30.4 GB Calculated
Headroom ⓘ
13.8 GB Calculated
Highest-precision quantization that leaves headroom: uses 69% of usable memory at 8K context.
Discrete GPU: 48 GB of VRAM, of which we assume 92% is usable after driver and context overhead.
Hybrid attention: token-growing KV memory is charged to 16 full-attention blocks. The linear-attention blocks also hold fixed-size state, so the memory estimate is approximate.
Performance

Estimated performance · recommended Q8_0

Decode, prefill and TTFT below are estimates for Q8_0. We do not have a comparable Q8_0 measurement on this machine.

Estimated decode
—
Estimated Q8_0; calculated range
Estimated prefill
—
Estimated Q8_0; calculated range
Estimated TTFT at 8K
—
Estimated Q8_0; calculated range
Hardware load reference
300 W
Official spec hardware TDP; not this model run
No throughput figures for this configuration. We do not estimate performance for a model that cannot load.
How the estimate is calculated
  1. Decode: reading 27.8B active parameters at 8.50 bits/weight takes 43.92 ms at 960 GB/s x 70% achieved efficiency.
  • No FP16 compute figure for this hardware, so prefill cannot be estimated.
  • This is a calculated estimate, not a measurement. It assumes a single request, a short prompt, no speculative decoding and a warm model already resident in memory.

Estimator version estimator_v1. Stored with every estimated row so old estimates can be regenerated when the model improves.

Submit a benchmarkSubmissions stay pending until reviewed.
This model at other quantizations on this machine
QuantizationResidentDiskTotal neededUtilisationFitMax context
Q4_K_M16.2 GB16.2 GB18.1 GB41%Comfortable256K
Q5_K_M19.0 GB19.0 GB21.0 GB48%Comfortable256K
Q8_0recommended28.0 GB28.0 GB30.4 GB69%Comfortable192K
BF1651.7 GB51.7 GB54.8 GB124%Does not fit0
Cost of running Qwen3.6 27B on this machineUnited States (federal) · C corporation · 8h/day
Monthly economic cost
$2
Calculated after tax
Codex/Claude Code
$100/mo
≈ $100/mo · local is $98 less
Net cash at purchase
$0
Calculated VAT not reclaimable
Total over 5 years
$104
Calculated after tax, after resale
Cost per USD/1M tokens
—
Calculated

The $100 comparison uses the Codex Pro 5x / Claude Max 5x plans. A fixed planning conversion is used for USD. This compares monthly spend only: subscriptions have usage limits, local hardware has different capabilities and constraints, and taxes or regional pricing may change the charged amount. Prices checked 7 September 2026.

Monthly breakdown

Depreciation
0 over 5 years, straight-line to a 0 residual
$0.00
Electricity
15.6 kWh/month at 0.140/kWh
$2.19
Monthly cost before tax$2.19
Electricity tax shield
Running costs are deductible business expenses
−$0.46
Monthly economic cost after tax$1.73

Three different numbers, deliberately

Cash cost
$0
Money that leaves the bank account on day one, net of reclaimable VAT.
Accounting depreciation
$0.00/month
$0 written down over 5 years to a $0 residual.
After-tax economic cost
$1.73/month
Depreciation plus running costs plus cost of capital, less the tax those deductions save. This is the figure to compare between machines.
Assumptions and sources (verified 2026-09-07)
VAT rate
0% Official spec
VAT recoverable
0% Official spec
Federal C-corporation estimate at the flat 21% rate. Pass-through entities should use the sole-proprietor estimate as a rougher proxy.
Effective deduction rate
21.00% Calculated
Headline marginal rate 21.00%.
Depreciation
5 years, straight-line Assumption
Residual value
$0 (15%) Assumption
Two GPU generations later, the card is worth a fraction of its list price.
Electricity
$0.140/kWh Assumption
Average power draw
89 W Calculated
Load 300 W for 20% of powered hours, idle 36 W for the rest — a machine that is on is not generating tokens the whole time.
Investment allowances
§179 100.0% Official spec
Worth $0 in total — first-year expensing that replaces later tax depreciation.
Cost of capital
not applied Assumption
Federal planning estimate only, not tax advice. State and local income tax, sales/use tax and incentives are excluded. It assumes 100% business use, a Section 179 election, enough business income to use it, and that the full annual limit remains available.
Qwen3.6 27B on other hardware
HardwareDecodePriceFit
NVIDIA DGX H200 (8x H200, 1,128 GB)~331–476 t/s$359,430 *Comfortable
Quad RTX 5090 workstation (4x 32 GB)~75.5–109 t/s$12,611 *Comfortable
Lenovo ThinkStation PX (4x RTX PRO 6000, 384 GB)~66.1–95.1 t/s$58,553 *Comfortable
RTX 5090 workstation (1x 32 GB)~55.7–80.1 t/s$3,332 *Comfortable
Dual RTX 5090 workstation (2x 32 GB)~50.4–72.6 t/s$5,854 *Comfortable
Dell Precision 7960 Rack (2x RTX PRO 6000, 192 GB)~46.2–66.5 t/s$36,663 *Comfortable
Nearest alternatives to the NVIDIA RTX 6000 Ada 48 GB
Qwen3.6 27B on Dual used RTX 4090 workstation (48 GB)48 GBQwen3.6 27B on NVIDIA RTX A6000 48 GB48 GBQwen3.6 27B on NVIDIA A100 PCIe 40 GB40 GBQwen3.6 27B on Dual RTX 5090 workstation (2x 32 GB)64 GBQwen3.6 27B on NVIDIA RTX 5000 Ada 32 GB32 GB
Compare NVIDIA RTX 6000 Ada 48 GB against Dual used RTX 4090 workstation (48 GB) →