Already the cost is quite high. A prolific year can easily burn 100usd a day in tokens and they have not even started to enshitify.

Some of the cost to run these models will come down a bit if Nvidia gets some actual competition which I’m sure will happen in the medium to long term because the hyper scalers definitely don’t like paying Nvidia’s AI ransom and the Chinese don’t want to be beholden to a company the US can influence.

We will see which happens first.