It’s the code generation and automation uses that are growing. I don’t know about casual use or using AI for office tasks.
AI providers that offer API access don’t have enough hardware to support the demand. They keep increasing prices (the roundabout way by slowing down requests, reducing the amount of included tokens in tiers, and replacing models with new ones that use more tokens) and that’s still not enough to reduce demand.
Using AI to code and automate stuff is probably its most effective use. But most people don’t see it. Is all business/enterprise stuff happening behind the scenes.
The hardware shortage is self-induced by the LLM providers, though - it doesn’t reflect actual demand. They’re shooting themselves in the foot by making their models bigger and throwing more and more data and compute (and energy and water) at it, for increasingly diminishing returns.
In my opinion, that’s not sustainable in the longterm and after the bubble pops, even the code generation ecosystem will change a lot. It’s gonna be interesting to see which way of working will survive.
It’s the code generation and automation uses that are growing. I don’t know about casual use or using AI for office tasks.
AI providers that offer API access don’t have enough hardware to support the demand. They keep increasing prices (the roundabout way by slowing down requests, reducing the amount of included tokens in tiers, and replacing models with new ones that use more tokens) and that’s still not enough to reduce demand.
Using AI to code and automate stuff is probably its most effective use. But most people don’t see it. Is all business/enterprise stuff happening behind the scenes.
The hardware shortage is self-induced by the LLM providers, though - it doesn’t reflect actual demand. They’re shooting themselves in the foot by making their models bigger and throwing more and more data and compute (and energy and water) at it, for increasingly diminishing returns.
In my opinion, that’s not sustainable in the longterm and after the bubble pops, even the code generation ecosystem will change a lot. It’s gonna be interesting to see which way of working will survive.