…with highly specialized datacenter grade hardware. They aren’t buying gaming GPUs or consumer grade SSD or RAM, they are just hogging all the manufacturing capacity for their own specific hardware needs.
Having racks of 72 enterprise AI GPUs with zero video out ports and 10TB of LPDDR5X memory flooding the market isn’t going to be very useful unless your plan is to start a datacenter yourself.
I mean, it would be really neat to own one, the 120kW power draw is just kind of a buzzkill for residential use.
The sheer volume of them and that they’re not “normal” means it wouldn’t be plug and play, but a chip is a chip to a large extent.
AI gpus can be cracked up and repurposed.
Ram can be done similarly.
An abundance of high performance chips with no plug and play use will still have a use found for them.
Like, if it was just a bunch of 9727’s or whatever high priced gamer gpus are called these days, people would just buy them for video games.
Nerds will buy this shit for pennies on the dollar, and if one figures out a novel use, the idea spreads quickly. And again, they don’t have to do it with the whole product, they can just rip out components.
That’s much more valuable to society than cheap gaming
Unless Nvidia gets in on remanufacturing, those GPUs are never going to repurposed for residential usefulness. B300 was designed from the onset for datacenter ai use exclusively, with no concessions for theoretical video out integrated to a board that overall demands over 15 kw. You couldn’t even power it with a 60A 220V circuit.
Some of the storage could get more consumer support, SAS is unusual but if there were a glut then various solutions could emerge. Similarly EDSFF cages aren’t really a hot consumer item, especially not e1.l, but I could imagine a glut driving home friendly adaptions.
DRAM modules are somewhere in between, though practically speaking they won’t be workable outside of their initial application.
There was a time when home and datacenter got closer together, but there’s been quite the divergence the last few years.
…with highly specialized datacenter grade hardware. They aren’t buying gaming GPUs or consumer grade SSD or RAM, they are just hogging all the manufacturing capacity for their own specific hardware needs.
Having racks of 72 enterprise AI GPUs with zero video out ports and 10TB of LPDDR5X memory flooding the market isn’t going to be very useful unless your plan is to start a datacenter yourself.
I mean, it would be really neat to own one, the 120kW power draw is just kind of a buzzkill for residential use.
I mean, you kind of just gave your own solution…
The sheer volume of them and that they’re not “normal” means it wouldn’t be plug and play, but a chip is a chip to a large extent.
AI gpus can be cracked up and repurposed.
Ram can be done similarly.
An abundance of high performance chips with no plug and play use will still have a use found for them.
Like, if it was just a bunch of 9727’s or whatever high priced gamer gpus are called these days, people would just buy them for video games.
Nerds will buy this shit for pennies on the dollar, and if one figures out a novel use, the idea spreads quickly. And again, they don’t have to do it with the whole product, they can just rip out components.
That’s much more valuable to society than cheap gaming
Unless Nvidia gets in on remanufacturing, those GPUs are never going to repurposed for residential usefulness. B300 was designed from the onset for datacenter ai use exclusively, with no concessions for theoretical video out integrated to a board that overall demands over 15 kw. You couldn’t even power it with a 60A 220V circuit.
Some of the storage could get more consumer support, SAS is unusual but if there were a glut then various solutions could emerge. Similarly EDSFF cages aren’t really a hot consumer item, especially not e1.l, but I could imagine a glut driving home friendly adaptions.
DRAM modules are somewhere in between, though practically speaking they won’t be workable outside of their initial application.
There was a time when home and datacenter got closer together, but there’s been quite the divergence the last few years.