Just a note, P40 came out at $5700 in 2016 dollars. In 2026 dollars that is $8000 (wow!). If you bought 100k today, assuming a 1% failure rate per year your $800M investment can be traded in for about $30M.
I think it is reasonable to assume a similar depreciation in GPUs.
Meaning you'd need to have made more than (800M - 30M) * (1 + income tax rate) + (power + maintenance).
Some say the margines on inference are already there for new GPUs but they are right margines.
I think it is reasonable to assume a similar depreciation in GPUs.
Meaning you'd need to have made more than (800M - 30M) * (1 + income tax rate) + (power + maintenance).
Some say the margines on inference are already there for new GPUs but they are right margines.