The hardware shortage is self-induced by the LLM providers, though - it doesn’t reflect actual demand. They’re shooting themselves in the foot by making their models bigger and throwing more and more data and compute (and energy and water) at it, for increasingly diminishing returns.

In my opinion, that’s not sustainable in the longterm and after the bubble pops, even the code generation ecosystem will change a lot. It’s gonna be interesting to see which way of working will survive.