• terranoid@lemmy.cafe
    link
    fedilink
    English
    arrow-up
    113
    arrow-down
    1
    ·
    2 days ago

    YEP. I’m not in AI but I’m in cyber security.

    I used to tell people that there’s very little actual risk, because if we had something even half as concerning as AGI (which I’d argue we did with chatgpt 3.5), that we’d easily be able to lock it down and prevent it from doing anything funny.

    Super intelligence isn’t just going to magically spawn on 32 GB ram in a sandboxed environment. And AGI will not magically know how sandboxed it is or how to escape.

    …then I saw people letting Claude send emails and use their credit card on their behalf like immediately when it was able to do things that appeared intelligent.

    They literally saw the smallest hint of AGI and said, “here’s my credit card and identity, take the wheel”.

    There was no fucking talk of sandboxing. Everyone turned that off so they didn’t have to click the “allow” button.

    Not that I think we’re at any risk of ASI since it seems more like we hit a logarithmic wall, but we are absolutely at risk of letting random algorithms destroy critical parts of infrastructure because people are lazy and stupid and managed by even worse people.

    I would not be surprised if the right AI hallucinations could cause a nuclear bomb to go off right now. I’m not talking about super intelligence, just automated super idiocy.

    Proof: literally this post is about an idiot letting an AI control their fucking email and it emailed the FBI because it was fucking stupid

    • Supercrunchy@programming.dev
      link
      fedilink
      English
      arrow-up
      49
      arrow-down
      1
      ·
      2 days ago

      We live in a period of extreme stupidity, so I now fully expect AI to cause disasters in the same idiotic and tragically hilarious way.

      I expect AI to trigger a war because some idiot trusted it blindly without double checking (oh wait, it almost already happened!), and I’m sure there are plenty of people currently lobbying to have AI directly connected to weapons.

      Skynet is not going to have the objective to conquer the world, it’s going to have the objective of maximizing paperclip production.

      • HerbGrower@slrpnk.net
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        2
        ·
        1 day ago

        AI isn’t causing these disasters, people are. YOU are responsible for using it and what it does. I will never accept “chatgpt did it” as a fucking excuse.

        • NEZ27@lemmy.zip
          link
          fedilink
          English
          arrow-up
          14
          ·
          1 day ago

          They said the opposite. AI won’t cause disasters, idiots who give it access will. Some asshole will joke about nuking Iran, unawares that another asshole granted access to the proverbial ‘Button’, and we’ll have another international incident.

          Like just look at ‘Signal Gate’, and know that those idiots are still in charge. And those same idiots blamed bombing the all girls school in Iran on AI last March. And that’s just in the US, we have the biggest loudest idiots right now, but they are not the only idiots out there vibe coding up some war crimes.

    • HerbGrower@slrpnk.net
      link
      fedilink
      English
      arrow-up
      7
      ·
      1 day ago

      ChatGPT couldn’t destroy the world. What is that siren… Wtf do you mean you gave it access to a button that launches nuclear weapons and told it to protect the country?