It remains unclear to me if anyone funding new models will actually benefit economically from having funded these models.
I think is possible that these models can *culturally*(/memetically) benefit the creator via e.g. being trained to propagandise for the values of the originator, but it is unclear to me if this hypothesis has even been properly tested.
However, even absent benefit from creating new models, there are still good reasons to support the economic changes that would allow such models to be created in Europe:
We need a more unified, EU-wide, approach to investment both private and public; we need to upgrade the power grids even just because they're old and a poor fit for existing supplies and demands let alone forecast new demands and new supplies; and we need local chip factories to protect against supply chain problems in the event of conflict involving existing suppliers.
I expect the AI-training investment bubble to burst before the EU gets any of those things, those things are good regardless.
Yes, it probably won't be clear until we have the benefit of some hindsight.
One thing I'm inclined to believe though is that the investment being made into compute and research today may not benefit the investors, but it will be net-positive on a longer time scale for the wider populace. A comparison to the internet and the dot-com bubble seems fitting.
And from that perspective I'd also be worried about the bubble bursting before Europe even gets started, as what remains after a bubble would still largely serve the US and China.
I think one problem with that comparison is that due to how energy intensive these datacentres are, they are very fast depreciating assets, unlike e.g. the telecom infrastructure that was (over-)built during the dot-com bubble, or the railway tracks from the era of Railway Mania.
The only reason a GPU-based compute-heavy datacentre built 5 years ago is still in operation today is the component shortage.
Without the current component shortages, those datacentres would just be so much less energy efficient per flop that it would literally be cheaper to just scrap the thing and rebuild it.
_________
This is not to say that we shouldn't build datacentres, but just that I wouldn't be so sure that the datacentres being built today won't be stranded assets long before they pay themselves off.
I agree, the datacenters and the GPUs inside them might be the least valuable thing to come out of the boom. The research in chips, architectures, and training, and the supporting infrastructure in fabs and energy grids still seems highly valuable. Europe will still see very little of that, but at least the Chinese labs still publish some of their research.
Comments
It remains unclear to me if anyone funding new models will actually benefit economically from having funded these models.
I think is possible that these models can *culturally*(/memetically) benefit the creator via e.g. being trained to propagandise for the values of the originator, but it is unclear to me if this hypothesis has even been properly tested.
However, even absent benefit from creating new models, there are still good reasons to support the economic changes that would allow such models to be created in Europe:
We need a more unified, EU-wide, approach to investment both private and public; we need to upgrade the power grids even just because they're old and a poor fit for existing supplies and demands let alone forecast new demands and new supplies; and we need local chip factories to protect against supply chain problems in the event of conflict involving existing suppliers.
I expect the AI-training investment bubble to burst before the EU gets any of those things, those things are good regardless.
Yes, it probably won't be clear until we have the benefit of some hindsight.
One thing I'm inclined to believe though is that the investment being made into compute and research today may not benefit the investors, but it will be net-positive on a longer time scale for the wider populace. A comparison to the internet and the dot-com bubble seems fitting.
And from that perspective I'd also be worried about the bubble bursting before Europe even gets started, as what remains after a bubble would still largely serve the US and China.
I think one problem with that comparison is that due to how energy intensive these datacentres are, they are very fast depreciating assets, unlike e.g. the telecom infrastructure that was (over-)built during the dot-com bubble, or the railway tracks from the era of Railway Mania.
The only reason a GPU-based compute-heavy datacentre built 5 years ago is still in operation today is the component shortage.
Without the current component shortages, those datacentres would just be so much less energy efficient per flop that it would literally be cheaper to just scrap the thing and rebuild it.
_________
This is not to say that we shouldn't build datacentres, but just that I wouldn't be so sure that the datacentres being built today won't be stranded assets long before they pay themselves off.
I agree, the datacenters and the GPUs inside them might be the least valuable thing to come out of the boom. The research in chips, architectures, and training, and the supporting infrastructure in fabs and energy grids still seems highly valuable. Europe will still see very little of that, but at least the Chinese labs still publish some of their research.