Or my favorite quote from the article

“I am going to have a complete and total mental breakdown. I am going to be institutionalized. They are going to put me in a padded room and I am going to write… code on the walls with my own feces,” it said.

  • btaf45@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    2 days ago

    Can you explain why AIs always have a “confidently incorrect” stance instead of admitting they don’t know the answer to something?

    • ganryuu@lemmy.ca
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      1 day ago

      I’d say that it’s simply because most people on the internet (the dataset the LLMs are trained on) say a lot of things with absolute confidence, no matter if they actually know what they are talking about or not. So AIs will talk confidently because most people do so. It could also be something about how they are configured.

      Again, they don’t know if they know the answer, they just say what’s the most statistically probable thing to say given your message and their prompt.

      • btaf45@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        1 day ago

        Again, they don’t know if they know the answer

        Then in that respect AIs aren’t even as powerful as an ordinary computer program.

        say a lot of things with absolute confidence, no matter if they actually know what they are talking about or not.

        That was my guess too.

        • Aggravationstation@feddit.uk
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          1
          ·
          1 day ago

          Then in that respect AIs aren’t even as powerful as an ordinary computer program.

          No computer programs “know” anything. They’re just sets of instructions with varying complexity.

          • btaf45@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            edit-2
            20 hours ago

            No computer programs “know” anything.

            Can you stop with the nonsense? LMFAO…

            if exists(thing) {
            write(thing);
            } else {
            write(“I do not know”);
            }

            • Aggravationstation@feddit.uk
              link
              fedilink
              English
              arrow-up
              1
              ·
              edit-2
              19 hours ago

              if exists(thing) {
              write(thing);
              } else {
              write(“I do not know”);
              }

              Yea I see what you mean, I guess in that sense they know if a state is true or false.

    • Matty_r@programming.dev
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 days ago

      Because its an auto complete trained on typical responses to things. It doesn’t know right from wrong, just the next word based on a statistical likelihood.

        • Matty_r@programming.dev
          link
          fedilink
          English
          arrow-up
          1
          ·
          edit-2
          1 day ago

          Exactly. I’m over simplifying it of course, but that’s generally how it works. Its also not “AI” as in Artificial Intelligence, in the traditional sense of the word, its Machine Learning. But of course its effectively had a semantic change over the last couple years because AI sounds cooler.

          Edit: just wanted to clarifying I’m talking about LLMs like ChatGPT etc