InternLM 2.5 20B on Radeon RX 6800 16 GB
19.861B on 16 GB at 512 GB/s. Hardware details · Model details
No calculated fit. InternLM 2.5 20B does not fit under standard overhead assumptions at
Q4_K_M: the model calculates 14.4 GB required against 14.7 GB usable.CompatibilityDoes not fit
Calculated fit
No
Calculated Requires more than 97% of usable memory. Needs a smaller quantization or more memory.
Smallest catalogued quantization
Q4_K_M
Calculated gguf
Memory required
14.4 GB
Calculated of 14.7 GB usable — 98%
Max practical context
4K
Calculated model supports 32K
Memory budget at 8K context
Model weights ⓘ
11.6 GB Calculated
KV cache ⓘ
1.5 GB Calculated
Runtime overhead ⓘ
1.3 GB Estimated
Total required
14.4 GB Calculated
Headroom ⓘ
0.3 GB Calculated
No quantization in our catalogue fits this machine.
Discrete GPU: 16 GB of VRAM, of which we assume 92% is usable after driver and context overhead.
Performance
Estimated performance · recommended Q4_K_M
Decode, prefill and TTFT below are estimates for Q4_K_M. We do not have a comparable Q4_K_M measurement on this machine.
Estimated decode
—
Estimated Q4_K_M; calculated range
Estimated prefill
—
Estimated Q4_K_M; calculated range
Estimated TTFT at 8K
—
Estimated Q4_K_M; calculated range
Hardware load reference
250 W
Official spec hardware TDP; not this model run
No throughput figures for this configuration. We do not estimate performance for a model that cannot load.
How the estimate is calculated
- Decode: reading 19.9B active parameters at 4.85 bits/weight takes 33.60 ms at 512 GB/s x 70% achieved efficiency.
- No FP16 compute figure for this hardware, so prefill cannot be estimated.
- This is a calculated estimate, not a measurement. It assumes a single request, a short prompt, no speculative decoding and a warm model already resident in memory.
Estimator version estimator_v1. Stored with every estimated row so old estimates can be regenerated when the model improves.
Submit a benchmarkSubmissions stay pending until reviewed.
This model at other quantizations on this machine
| Quantization | Resident | Disk | Total needed | Utilisation | Fit | Max context |
|---|---|---|---|---|---|---|
Q4_K_Msmallest listed | 11.6 GB | 11.6 GB | 14.4 GB | 98% | Does not fit | 4K |
Q5_K_M | 13.6 GB | 13.6 GB | 16.5 GB | 112% | Does not fit | 0 |
Q8_0 | 20.0 GB | 20.0 GB | 23.1 GB | 157% | Does not fit | 0 |
BF16 | 37.0 GB | 37.0 GB | 40.6 GB | 276% | Does not fit | 0 |
Cost of running InternLM 2.5 20B on this machineUnited States (federal) · C corporation · 8h/day
Monthly economic cost
$1
Calculated after tax
Codex/Claude Code
$100/mo
≈ $100/mo · local is $99 less
Net cash at purchase
$0
Calculated VAT not reclaimable
Total over 5 years
$86
Calculated after tax, after resale
Cost per USD/1M tokens
—
Calculated
The $100 comparison uses the Codex Pro 5x / Claude Max 5x plans. A fixed planning conversion is used for USD. This compares monthly spend only: subscriptions have usage limits, local hardware has different capabilities and constraints, and taxes or regional pricing may change the charged amount. Prices checked 7 September 2026.
Monthly breakdown
| Depreciation 0 over 5 years, straight-line to a 0 residual | $0.00 |
| Electricity 13.0 kWh/month at 0.140/kWh | $1.82 |
| Monthly cost before tax | $1.82 |
| Electricity tax shield Running costs are deductible business expenses | −$0.38 |
| Monthly economic cost after tax | $1.44 |
Three different numbers, deliberately
Cash cost
$0
Money that leaves the bank account on day one, net of reclaimable VAT.
Accounting depreciation
$0.00/month
$0 written down over 5 years to a $0 residual.
After-tax economic cost
$1.44/month
Depreciation plus running costs plus cost of capital, less the tax those deductions save. This is the figure to compare between machines.
Assumptions and sources (verified 2026-09-07)
VAT rate
0% Official spec
VAT recoverable
0% Official spec
Federal C-corporation estimate at the flat 21% rate. Pass-through entities should use the sole-proprietor estimate as a rougher proxy.
Effective deduction rate
21.00% Calculated
Headline marginal rate 21.00%.
Depreciation
5 years, straight-line Assumption
Residual value
$0 (15%) Assumption
Two GPU generations later, the card is worth a fraction of its list price.
Electricity
$0.140/kWh Assumption
Average power draw
74 W Calculated
Load 250 W for 20% of powered hours, idle 30 W for the rest — a machine that is on is not generating tokens the whole time.
Investment allowances
§179 100.0% Official spec
Worth $0 in total — first-year expensing that replaces later tax depreciation.
Cost of capital
not applied Assumption
- VAT rate: No US federal VAT · verified 2026-09-07
- Marginal tax rate: IRS Publication 542 — Corporations · verified 2026-09-07
- VAT recoverable fraction: site assumption · verified 2026-09-07
- Useful life: IRS Publication 946 — How To Depreciate Property · verified 2026-09-07
- Electricity price: Site assumption · verified 2026-09-07
Federal planning estimate only, not tax advice. State and local income tax, sales/use tax and incentives are excluded. It assumes 100% business use, a Section 179 election, enough business income to use it, and that the full annual limit remains available.
InternLM 2.5 20B on other hardware
| Hardware | Decode | Price | Fit |
|---|
Nearest alternatives to the Radeon RX 6800 16 GB
InternLM 2.5 20B on Radeon RX 6800 XT 16 GB16 GBInternLM 2.5 20B on Radeon RX 6900 XT 16 GB16 GBInternLM 2.5 20B on Radeon RX 6950 XT 16 GB16 GBInternLM 2.5 20B on Radeon RX 7800 XT 16 GB16 GBInternLM 2.5 20B on Radeon RX 9060 XT 16 GB16 GB
Compare Radeon RX 6800 16 GB against Radeon RX 6800 XT 16 GB →
Compare Radeon RX 6800 16 GB against Radeon RX 6800 XT 16 GB →