• 0 Posts
  • 334 Comments
Joined 3 years ago
cake
Cake day: September 9th, 2023

help-circle




  • In addition to what everyone else said, I’ll tell you why I don’t think that what we have currently can become some runaway superhuman intelligence:

    All “AI” people are talking about are basically “just” LLM wrappers: tools built to run a LLM in a loop while giving it access to the ability to write and run code. This gets pretty powerful, since you can do a lot programmatically (including monetary transactions), but has a fundamental limit:

    LLMs are trained ahead of time. And that’s a very cost intensive, long process. Beyond that, the LLM has only a context window of finite length. So there are no long-term planning capabilities. While running after being trained, the LLM can only condense knowledge into a summary and then re-read it, a lossy process that might introduce mistakes in “understanding” and will make any prolonged task degrade over time.

    And even if they figure out how to make the things actually self-modify and learn things, you can’t give every session that ability, since that’ll vastly increase the storage and performance requirements. Do sessions with that ability will be closely monitored and limited.

    So I don’t see any space where an evil AI could emerge, even when factoring in an essential possible future improvement to the technology.






  • Great article, I’m going to send this one around, thanks!

    But I’d like to make a distinction: LLMs are not just tools, it’s more basic; they’re just math.

    As the author themself said: Claude, Codex, and so on are tools built using LLMs.

    They drive you towards slop not least because they’re only available as subscription models that you pay for by token.

    Maybe commodification will lead to super terse models that run on personal or institutional servers, and exist as an advanced rubber duck to test your assumptions against. Totally thinkable with LLMs, yet very far from our current reality.



  • What makes them call LLMs “fascist”? I guess you could say that individuals who aren’t super rich can’t train them by themselves, so relying on them currently means you’re relying on these fuckers.

    That would be quite the stretch though …

    The response to the mail seems to think the same:

    Not sure if there’s any point in saying this, but the fact that the technology has notable companies pushing it forward that are often associated with fascism does not mean that the technology itself is somehow inextricably linked to fascism, just like how Microsoft making an operating system doesn’t associate operating systems in general with Microsoft or their goals. The GR was concerned with the technology as a whole AFAICT, not the companies developing some variants of it.