“I’ve been saving for months to get the Corsair Dominator 64GB CL30 kit,” one beleagured PC builder wrote on Reddit. “It was about $280 when I looked,” said u/RaidriarT, “Fast forward today on PCPartPicker, they want $547 for the same kit? A nearly 100% increase in a couple months?”

  • SabinStargem@lemmy.today
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    1
    ·
    5 hours ago

    Far as RAM goes, it will become a good thing: it gives companies incentive to invest into the development of bigger RAM, more speed, and making the motherboard bandwidth big enough to handle it.

    The next big generation of hardware will be much better IMO, simply because the companies will have to compete by their merits. The downside is not having enough supply right now, but once the logistics and tech is in place, even non-AI people will benefit.

  • lightnsfw@reddthat.com
    link
    fedilink
    English
    arrow-up
    12
    arrow-down
    1
    ·
    edit-2
    8 hours ago

    Who’s bewildered? Of course this was going to happen. Everything enjoyable about life is being ruined. It’s not surprising at all.

  • Bongles@lemmy.zip
    link
    fedilink
    English
    arrow-up
    17
    ·
    12 hours ago

    This seems like an appropriate place for me to bitch:

    2 months ago I bought a new pre-built pc. It should’ve had 64gb of ram but had 32gb. They said the sticks they used were out of stock so they gave me a credit for $100 USD. I spent the 100 on 32gb more of what I thought was the exact same ram. I fucked up and bought a slightly higher speed so they wouldn’t work together after I tried for an afternoon. I also checked the correct listing i should’ve bought but it was more expensive, at about $125.

    I gave up and decided I’d just buy the faster ram again when it came back, rather than return it and get the correct one. It went out of stock in the time it took me to get my order so I figured I’d just wait.

    2 MONTHS later, it never came back in stock but an almost identical pair, with slightly different timing, is in stock right now at $216. If i had any idea this was coming in just 2 months, I could’ve just bought 64gb at once and started fresh, or corrected my mistake by returning what I bought.

    So i guess I’ll continue waiting, but hey at least notepad has copilot in it.

    • timhayes1991@lemmy.zip
      link
      fedilink
      English
      arrow-up
      5
      ·
      5 hours ago

      I always thought ram of different speeds worked together, they just were run at the speed of the slowest stick.

  • carrylex@lemmy.world
    link
    fedilink
    English
    arrow-up
    28
    ·
    15 hours ago

    Nice article but the numbers are a lot lower here in the EU.

    While there is some pricing increase it’s currently more around 50% and not 100%.

    The selected kit is also extremely expensive (350€ was ~300€) - similar kits are available for a lot less (270€ was ~180€) - so I doubt that anyone was buying it in the first place.

    I also think it’s not completely AI related but more likely that this is another RAM price fixing scandal happening right now. Pretty much the same that we see today happend in 2017-2018.

  • Tim_Bisley@piefed.social
    link
    fedilink
    English
    arrow-up
    174
    ·
    20 hours ago

    AI increases my power utility bill
    AI takes my water
    AI increases the price of GPUs
    AI increases the price of RAM
    AI makes my search results worse and slower
    AI is inserted into every website, app, program, and service making them all worse

    All so businesses and companies can increase productivity, reduce staff, and then turn around and increase prices to customers.

  • tabular@lemmy.world
    link
    fedilink
    English
    arrow-up
    67
    arrow-down
    1
    ·
    21 hours ago

    People buying RAM: oh no, what do we do?

    People buying GPUs: first time?

      • tabular@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        20 hours ago

        Well, I was aware RAM prices fluctuate.

        I’ve never been so unfortunate when buying larger RAM, or building a new system with a new DDR version.

        • givesomefucks@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          20 hours ago

          They don’t real fluctuate, it’s more oscillating.

          Sometimes it’s “normal” but due to a wide range of issues that can change quickly and stay that way for months because everyone waits till prices go down. So as they go down, people stop waiting,

  • brucethemoose@lemmy.world
    link
    fedilink
    English
    arrow-up
    23
    ·
    edit-2
    18 hours ago

    I just got a 2x64GB 6000 kit before its price skyrocketed by like $130. I saw other kits going up, but had no clue I timed it so well.

    …Also, why does “AI” need so much CPU RAM?

    In actual server deployments, pretty much all inference work is done in VRAM (read: HBM/GDDR); they could get by with almost no system RAM. And honestly most businesses are too dumb to train anything that extensively. ASICs that would use, say, LPDDR are super rare, and stuff like Hybrid/IGP inference is the realm of a few random folks with homelabs… Like me.

    I think ‘AI’ might be an overly broad term for general server buildout.

    • Kissaki@feddit.org
      link
      fedilink
      English
      arrow-up
      3
      ·
      edit-2
      4 hours ago

      I suspect RAM may become increasingly useful with the shift from pure chat LLM to connected agents, MCP, and catching results and data for scaling things like public Internet search and services.

      When I think of database system server software, a lot of performance gains are from keeping used data in RAM. With the expanding of LLM systems and it’s concerns, backing data, connective ness, and need for optimisation, a shift to caching and keeping in RAM seems to suggest itself. It’s already wasteful/big and operates on a lot of data, so it seems plausible that would not be a small cache.

    • tty5@lemmy.world
      link
      fedilink
      English
      arrow-up
      16
      ·
      edit-2
      16 hours ago

      Same memory production capacity can be allocated to ddr5 or to hbm and openai signed contracts with sk hynix and samsung, the two largest ram manufacturers in the world, and bought a significant percentage of next year’s production.

      DDR5 prices started spiking as that deals impact propagated through the supply chain. I bought a 2x32 6800 Cl30 kit for 195 euro 12 days ago. It was 330 euro 4 days later.

      • brucethemoose@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        16 hours ago

        …Is it that interchangeable?

        TBH I know little of memory fabs and HBM ICs, but I know (say) TSMC can’t just switch from a power-optimized process to a high frequency one at the drop of a hat.

        • tty5@lemmy.world
          link
          fedilink
          English
          arrow-up
          5
          ·
          16 hours ago

          Slightly different part, same process. The bigger bottleneck is packaging - HBM is 3d stacked.

          • brucethemoose@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            ·
            15 hours ago

            Ah. Yeah. And its on the fab to do that.

            I always though it’d be cool for CPUs to switch to packaged RAM, too. Samsung apparently tried to do it with Wide I/O for mobile ARM stuff, but it never caught on.

      • brucethemoose@lemmy.world
        link
        fedilink
        English
        arrow-up
        13
        ·
        edit-2
        16 hours ago

        They can ALL be run on RAM, theoretically. I bought 128GB so I can run GLM 4.5 with the experts offloaded to CPU, with a custom trellis/K quant mix; but this is a ‘personal use’ tinkerer setup basically no one but hobbyists will touch.

        Qwen Next is good at that because its very low active parameter.

        …But they aren’t actually deployed that way. They’re basically always deployed on cloud GPU boxes that serve dozens/hundreds of people at once, in parallel.

        AFAIK the only major model actually developed for CPU inference is one of the esoteric Gemma releases, aimed at mobile. And the bitnet experiments, which aren’t very big so far.

        (In case it’s not obvious, this is my special interest, and I’m happy to ramble on about how to set up ‘niche gaming rig hybrid models’ for anyone interested).

        • Passerby6497@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          16 hours ago

          I for one would enjoy triggering your unskippable cutscenes in setting up local CPU based AI if it can work on Linux with an older amd card.

          Don’t have funds for anything fancy, but would be interesting in playing around with it. Been wanting to get something like that setup for home assistant.

          • SabinStargem@lemmy.today
            link
            fedilink
            English
            arrow-up
            1
            ·
            5 hours ago

            If you just want an easy way to setup AI on Windows or Linux, KoboldCPP is my recommendation for your backend. It supports the GGUF format, which allows you to use both RAM and VRAM simultaneously. It won’t be the fastest thing, but it is easy enough to setup, with a bundled GUI for prep and actual usage. Through the IP address it gives, you can hook the backend into a frontend of choice.

            KoboldCPP

          • brucethemoose@lemmy.world
            link
            fedilink
            English
            arrow-up
            4
            ·
            edit-2
            16 hours ago

            Plenty of folks do AMD. A popular homelabsetup is 32GB AMD MI50 GPUs, which are quite cheap on eBay. Even Intel is fine these days!

            But what’s your setup, precisely? CPU, RAM, and GPU.

            • afk_strats@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              ·
              15 hours ago

              I have a MI50/7900xtx gaming/ai setup at homr which in i use for learning and to test out different models. Happy to answer questions

            • brucethemoose@lemmy.world
              link
              fedilink
              English
              arrow-up
              3
              ·
              edit-2
              14 hours ago

              The key is which model, and how.

              For the really sparse MoEs, you might be better off trying ik_llama.cpp, especially if you are targeting a ‘small’ quant. But the dense Gemma models (as good as they are) are probably not the best choice for 8G RAM these days.

  • tal@lemmy.today
    link
    fedilink
    English
    arrow-up
    34
    ·
    20 hours ago

    https://www.tomshardware.com/pc-components/storage/perfect-storm-of-demand-and-supply-driving-up-storage-costs

    OpenAI’s “Stargate” project has recently signed an agreement with Samsung and SK hynix for up to 900,000 wafers of DRAM per month. That figure alone would account for close to 40% of global DRAM output.

    High-density NAND products are effectively sold out months in advance. Samsung’s next-generation V9 NAND is already nearly booked before it’s even launched. Micron has presold almost all of its High Bandwidth Memory (HBM) output through 2026. Contracts that once covered a quarter now span years, with hyperscalers buying directly at the source.

    If China’s going to compete on AI, it’s going to be doing so with a limited supply of memory, I expect.

    • WhatAmLemmy@lemmy.world
      link
      fedilink
      English
      arrow-up
      23
      ·
      edit-2
      20 hours ago

      They’re going all in on domestic chip manufacturing, and they are catching up much faster than armchair generals, and even actual generals, predicted.

  • Phoenixz@lemmy.ca
    link
    fedilink
    English
    arrow-up
    9
    ·
    18 hours ago

    Old computer blew up, had to buy a new one. Nice 128gb ddr5. Just mobo, mem, cpu. Cpu is a rhyzen 9 9700

    The memory was well over 40% of the cost, wtf?