NVIDIA RTX A5000 24 GB

A 24 GB Ampere workstation GPU with ECC memory and optional two-card NVLink.

NVIDIAcomponentSuperseded0 models fit0 measured
Memory
24 GB
Official spec GDDR6 ECC
Memory bandwidth
768 GB/s
Official spec ~70% achieved in practice
Specifications
CPU
— Official spec
GPU
NVIDIA RTX A5000 Official spec
Memory
24 GB GDDR6 ECC Official spec
Memory bandwidth
768 GB/s Official spec source
Achieved bandwidth ⓘ
~70% (538 GB/s) Assumption
System RAM
128 GB Official spec
Interconnect
PCIe 4.0 x16; NVLink supported Official spec
Architecture
Discrete GPU with dedicated VRAM Official spec
Nominal power
230 W Official spec
Measured load power
— Assumption
Idle power
— Measured
Released
12 Apr 2021 Official spec
Model performance on NVIDIA RTX A5000 24 GB0 measured, 0 estimated
0 of 0 rows
Model↕QuantMemory↕Decode▼Prefill↕ContextFitConfidence↕
Nothing matches these filters.
Rows in grey are estimates from our bandwidth model, not measurements — they are shown as a range and never as a precise figure. Use the “measured only” filter to see just the 0 pairings on this machine that a real benchmark backs.
Ownership economicsUnited States (federal) · C corporation · 8h/day
Monthly economic cost
$1
Calculated after tax
Codex/Claude Code
$100/mo
≈ $100/mo · local is $99 less
Net cash at purchase
$0
Calculated VAT not reclaimable
Total over 5 years
$80
Calculated after tax, after resale
Cost per USD/1M tokens
—
Calculated

The $100 comparison uses the Codex Pro 5x / Claude Max 5x plans. A fixed planning conversion is used for USD. This compares monthly spend only: subscriptions have usage limits, local hardware has different capabilities and constraints, and taxes or regional pricing may change the charged amount. Prices checked 7 September 2026.

Monthly breakdown

Depreciation
0 over 5 years, straight-line to a 0 residual
$0.00
Electricity
12.0 kWh/month at 0.140/kWh
$1.68
Monthly cost before tax$1.68
Electricity tax shield
Running costs are deductible business expenses
−$0.35
Monthly economic cost after tax$1.33

Three different numbers, deliberately

Cash cost
$0
Money that leaves the bank account on day one, net of reclaimable VAT.
Accounting depreciation
$0.00/month
$0 written down over 5 years to a $0 residual.
After-tax economic cost
$1.33/month
Depreciation plus running costs plus cost of capital, less the tax those deductions save. This is the figure to compare between machines.
Assumptions and sources (verified 2026-09-07)
VAT rate
0% Official spec
VAT recoverable
0% Official spec
Federal C-corporation estimate at the flat 21% rate. Pass-through entities should use the sole-proprietor estimate as a rougher proxy.
Effective deduction rate
21.00% Calculated
Headline marginal rate 21.00%.
Depreciation
5 years, straight-line Assumption
Residual value
$0 (15%) Assumption
Two GPU generations later, the card is worth a fraction of its list price.
Electricity
$0.140/kWh Assumption
Average power draw
68 W Calculated
Load 230 W for 20% of powered hours, idle 28 W for the rest — a machine that is on is not generating tokens the whole time.
Investment allowances
§179 100.0% Official spec
Worth $0 in total — first-year expensing that replaces later tax depreciation.
Cost of capital
not applied Assumption
Federal planning estimate only, not tax advice. State and local income tax, sales/use tax and incentives are excluded. It assumes 100% business use, a Section 179 election, enough business income to use it, and that the full annual limit remains available.