• REDACTED@infosec.pub
    link
    fedilink
    English
    arrow-up
    8
    ·
    7 hours ago

    It’s not rogue if you tell it to do it. The guy literally said “email this to the FBI maybe that will fix everything”

  • ØR10N5B3LT@midwest.social
    link
    fedilink
    English
    arrow-up
    52
    ·
    14 hours ago

    MAGA podcaster Katie Miller has been called out for failing to mention her stake in Elon Musk’s xAI model while routinely criticizing rival AI chatbots on social media.

    Miller, the wife of White House Deputy Chief of Staff Stephen Miller, has habitually blasted top AI models ChatGPT, Claude, and Gemini for supposedly posing a risk to democracy or being biased against conservatives to her online followers.

    However, The Washington Post has revealed that Miller holds more than $1 million in Musk’s xAI chatbot, a stake she never disclosed despite making nearly 500 posts denouncing other models.

    reported from Daily Beast

    • heartSagan5@lemmy.zip
      link
      fedilink
      English
      arrow-up
      7
      ·
      14 hours ago

      being biased against conservatives to her online followers.

      Well, that’s bullshit. Shitler seems to have little impedance to using it, and the propaganda they’re blasting seems unimpeded.

  • Yerbouti@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    49
    ·
    16 hours ago

    Do people connect LLM’s to their email accounts? That sounds like the most intrusive thing you can do.

    • JackbyDev@programming.dev
      link
      fedilink
      English
      arrow-up
      5
      ·
      4 hours ago

      LLMs are little trickster demons. You can put up guard rails, but they’ll happily work around them. You can give pretty granular access on commands they can run, but they’re also good at finding the weird solutions that work to get around them. They do this themselves all the time in beneficial ways, it’s not always inherently bad (I don’t mean thwarting permissions).

      The big problem is that the code is non deterministic. Many guard rails are in the non deterministic part. So it’s sort of like politely asking it to not do something, versus making it impossible. Like caution paint on a ledge versus a fence. The issue is that if all the safeguards were in deterministic code, it’d be super hard to get anything done because you’d constantly be manually approving, so people don’t want that, so this is the problem we get.

    • DharkStare@lemmy.world
      link
      fedilink
      English
      arrow-up
      19
      ·
      12 hours ago

      You can give an LLM admin access to your computer so that it can perform tasks for people. I’m guessing that would allow the LLM to send emails on your behalf.

  • rizzothesmall@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    7
    ·
    12 hours ago

    I knew the leopard was specifically a face eating leopard, and I have seen from news stories that it has eat the faces of many many people. You’ll never believe what happened!

  • Sabata@ani.social
    link
    fedilink
    English
    arrow-up
    120
    arrow-down
    1
    ·
    20 hours ago

    Next year were going to see “Your absolutely correct, that was a civilian aircraft”

  • fireweed@lemmy.world
    link
    fedilink
    English
    arrow-up
    76
    ·
    21 hours ago

    Note that this was posted by Katie Miller (conservative political advisor and wife to the ghoul Stephen Miller), which immediately coats it in a thick layer of sus and prompts the immediate question: what’s her angle here?

        • douglasg14b@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          1
          ·
          18 hours ago

          It’s a clearly incorrect statement.

          Stupid people are stupid.

          Evil people are evil.

          Some evil people are stupid, and some stupid people are evil, but stupid people are not often evil on purpose. These are two separate classes of behavior.

            • Echo Dot@feddit.uk
              link
              fedilink
              English
              arrow-up
              1
              ·
              4 hours ago

              I think the point is, does she have some larger plan or did you just try and use chat GPT to commit some sort of crime and it picked up on that, and emailed the FBI.

    • Modern_medicine_isnt@lemmy.world
      link
      fedilink
      English
      arrow-up
      14
      ·
      19 hours ago

      I can tell you that stories like these and the AIs breaking out pump up AI security company stocks really well. Just watched some jump this morning after the gemini breakout news. I have reason to watch them, and the pattern holds pretty consistently. CEOs used to just say thing to make their own stock go up. But these days they trade favors with other companies. So they each say things to bolster each others stocks. My guess is that someone with a bunch of AI security stock asked her to post this.

    • SkunkWorkz@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      14 hours ago

      lol he has a wife? She must be a ghoul as well. Like no normal person can look at him, hear him speak and then think “I wish to marry him”

    • tocopherol@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      11
      ·
      20 hours ago

      If people like her are pushing the “horror AI” shit then there is definitely ulterior motives and it’s probably a bunch of bullshit. Just recently there have been mainstream media stories saying terrorists could use AI, they claimed Ansarallah was using Claude for their missile program, and a ton of stories like OPs. It feels artificial and I would bet the bubble is going to burst and they are trying to make excuses for why.

  • aesthelete@lemmy.world
    link
    fedilink
    English
    arrow-up
    49
    arrow-down
    2
    ·
    20 hours ago

    You connected it to your Gmail and then you’re surprised when it used it? Fuck off.

    • ScoffingLizard@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 hours ago

      I think it might be slop. It has the SSO function but I bever noticed that ChatGPT could interact with anything that wasn’t uploaded to it.

  • ayyy@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    20
    arrow-down
    1
    ·
    18 hours ago

    At this point if you’re still obstinacy enough to use these known garbage tools, you deserve it. You can no longer claim ignorance.

    • Bugamn@lemmy.zip
      link
      fedilink
      English
      arrow-up
      56
      arrow-down
      2
      ·
      15 hours ago

      It doesn’t know anything, it just parroted a response that fits with what the user wrote. That’s what LLMs do

      • Lovable Sidekick@lemmy.world
        link
        fedilink
        English
        arrow-up
        11
        arrow-down
        19
        ·
        15 hours ago

        Software devs (including myself) commonly describe software behavior with terms like think, know, decide… even though we know it isn’t literally doing that. “Parroted a response” is similarly inaccurate.

        • Bugamn@lemmy.zip
          link
          fedilink
          English
          arrow-up
          3
          ·
          4 hours ago

          Your response contradicts what you said before. If you understand that an LLM doesn’t know things, how is it interesting that it said that “it crossed the line”? Saying they crossed a line is a common response to being told they shouldn’t do something, so it’s natural that an LLM would respond that, no matter what it did before.

          • Lovable Sidekick@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            4 hours ago

            If a program is supposed to do something when it detects an error, it’s interesting if it reports the error but doesn’t do the thing. I would call that a bug.

        • jj4211@lemmy.world
          link
          fedilink
          English
          arrow-up
          19
          ·
          14 hours ago

          “Parroted” may be an oversimplification, but it generated a plausible continuation. The operator provided the assertion of a crossed line, and it ran with that. It never actually “knew” of its own volition, it accepted user input into the context and continued generation.

          I’ve done the same thing as an experiment when nothing was actually done. The LLM still generated a detailed account of what it did (that never happened) matching my accusation, generated profuse apology and promise not to do it again. So it didn’t “know” in any sense that it crossed the line, it just generated agreement with the operator’s assertion that it crossed the line.

          • Lovable Sidekick@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            4 hours ago

            “Parroted” is definitely an oversimplification, aka “inaccurate” as I said. I think your second paragraph is a good explanation of the mechanics. My take on it is that software able agree it did something wrong should have figured that out when it was considering doing the wrong thing, and should not have done it. In my professional opinion that’s a serious bug.

            • BlaestEgnen@feddit.dk
              link
              fedilink
              English
              arrow-up
              1
              ·
              3 hours ago

              Well, it still doesn’t know it was doing anything wrong.

              Most of the LLMs are tuned towards agreeing with the user, if you had a LLM able to stop a train crash. And you then blamed it for stopping the train crash, it would still start with a “sorry”

              • Lovable Sidekick@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                2 hours ago

                Yes, software doesn’t actually “know” anything or “think”. Those are terms used loosely by devs, not meant to be literal.

          • Lovable Sidekick@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            edit-2
            4 hours ago

            It is if you’re familiar with “parrot” and “stochastic parrot” not being the same, and the meaning of “inaccurate”. There’s also a difference between taking shots at wording and making an actual point. My real mistake was to criticize a criticism of AI in a forum where that automatically makes you the enemy no matter what you’re saying. I just don’t learn.

    • jj4211@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      ·
      14 hours ago

      Generally speaking, you can get an AI to admit fault and accept blame for something that never even happened.

      It reacts to the operator input that something happened that warrants blame. So the natural continuation of that conversation is to acknowledge the situation, accept blame, and promise to do better. It generally doesn’t model what did or did not happen, nor does the promise to do better mean anything. It does weigh in the context window that it wouldn’t be a natural continuation to do that action after text saying that it won’t happen, but can evaporate and doesn’t carry over when the operator goes to a new context window, which of course is a crazy nuance for the rando user to understand.

      • Lovable Sidekick@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        3 hours ago

        Hopefully most users get that a promise AI makes won’t stay in force forever, but it should definitely last through the current conversation. I mean, I would call that a minimal performance standard, and if it’s not true the AI shouldn’t make promises in the first place.

        I’m a little hazy on the part where accepting blame for something that didn’t happen is a natrual continuation of a conversation. It’s certainly not natural in human conversations. I would expect a well written and well trained AI to correct false assumptions or factual errors made by the user, not pander to them - unless it’s been told never to contradict the user.

    • floquant@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      69
      ·
      1 day ago

      My first reaction to learning what OpenClaw is was “that can’t be right”. So absolutely wild that people are giving mostly unmonitored, unlimited access to their PC to language models that can’t distinguish between roleplay and real life

      • architect@thelemmy.club
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        15
        ·
        21 hours ago

        Neither can over 30% of humans.

        Where do you all live where humanity proves itself and isn’t dumber than a box of llms?

        • starman2112@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          3
          ·
          11 hours ago

          Hi! I work in a factory. I would trust every one of the incompetent children left behind that keep the door revolving with my machines over an LLM every time. A human can learn, an LLM can’t. If a human fucks up, they do it in a way I can anticipate and account for, and when I tell them what they fucked up, they usually don’t do it again.

        • crispbacon99@lemmy.zip
          link
          fedilink
          English
          arrow-up
          9
          arrow-down
          1
          ·
          18 hours ago

          You just pull that number out of your ass? Also, speak for yourself. I don’t see LLM as anything more than a glorified web search

    • chisel@piefed.social
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      2
      ·
      19 hours ago

      For a work email connected to a work LLM, where you don’t particularly care about the privacy implications, LLMs are objectively vastly superior to built-in email search functionality. Especially Outlook.

  • charokol@lemmy.zip
    link
    fedilink
    English
    arrow-up
    200
    arrow-down
    1
    ·
    1 day ago

    I got my masters in machine learning years before LLMs took off. I’d usually tell people I work in “AI“. Even though it wasn’t quite accurate, people understood it easier than ML.

    The conversations would inevitably turn to joking about Skynet or AI taking over the world. I would reassure people that these models are only mimicking intelligence; they can make predictions, or they can classify data into categories, or they can generate text, etc, based on analyzing the patterns of data they’ve previously seen, but that’s it. They don’t understand anything, they can’t make decisions or act on their own. I’d tell people there couldn’t be an AI apocalypse because we would never be dumb enough to give them that ability.

    I don’t know why I gave us so much credit

    • pet the cat, walk the dog@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 hours ago

      There’s news right now on the front page of Lemmy.world that the US FAA wants to roll out AI for air traffic control. Although as per tradition, I didn’t read the actual article.

    • Zink@programming.dev
      link
      fedilink
      English
      arrow-up
      2
      ·
      10 hours ago

      This situation reminds me of the realization at the end of Terminator 3. Only instead of “Skynet wasn’t hardware; it was software” the real-world version is going to be “it wasn’t intelligence; it was access. Access willfully given, in a thousand pieces, because it was convenient.”

    • merc@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      7
      ·
      15 hours ago

      because we would never be dumb enough to give them that ability

      Simpsons did it first:

      drinking bird hitting 'y'

      Imagine trying to argue that Homer Simpson’s drinking bird nearly caused a catastrophe because it “lacked alignment” with Homer’s intentions. Or, that the bird “went rogue” and that’s why there was nearly a disaster.

      Clearly the “system” isn’t capable of doing Homer’s job, and only an idiot would hand over control to that system. But, apparently we’re now letting chatbots loose in the wild because they’re very good at generating text, which makes people think they’re intelligent, capable, and can actually make decisions.

    • Grail@multiverse.soulism.net
      link
      fedilink
      English
      arrow-up
      10
      arrow-down
      1
      ·
      17 hours ago

      The Australian Jewel Beetle nearly went extinct because of a beer bottle.

      You see, the female of this species is large, brown, and bevelled. It shares this characteristic in common with the beer bottles often thrown on the side of the road here in Australia. And not only does a beer bottle share these characteristics with these beetles, it’s bigger than them. And the male jewel beetle? It likes its ladies big.

      Australia had to change its beer bottles, because the males refused to mate with the females. They preferred to hump empty beer bottles on the side of the road. It couldn’t tell the difference between a beetle and a bottle. It was just using a statistical trick. “Anything brown, large, and bevelled is a female beetle”. That had been true in the ancestral environment, so evolution just used the pattern. And this cognitive shortcut lead to beetles trying to have sex with bottles.

      I don’t think we understand shit all that much more than the beetles. I think we’re just mimicking intelligence too. And one day we’ll all die because of our own equivalent of the beer bottles.

      • xspurnx@leminal.space
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        2
        ·
        15 hours ago

        You do realize that if this is what you believe it makes no sense to argue with you here.

        Hell, if you believe in consciousness (which I presume you do), then you’re just along for the ride, there’s nothing you really can do (except perhaps figure out your predicament).

        I refuse to accept it, therefore (the illusion of?) free will. Else I would drive me insane.

        • Grail@multiverse.soulism.net
          link
          fedilink
          English
          arrow-up
          1
          ·
          10 hours ago

          I think we have the ability to use our brains to actually solve problems, but it’s rare. It requires a kind of humility. We can’t assume we know everything, that we’re better than other creatures, or we’ll end up like the beetles.

          The jewel beetles didn’t think they had anything more to learn about womanhood. They thought whatever makes their insect dick hard is a woman. A lot of right wing guys online these days share the same opinion.

          And I mean, most of us drive cars to go zoom zoom, even though the emissions are killing life on Earth as we know it. We’re creating an environment more suited to dinosaurs than to mammals. And what do we use our massive brains for? We use them for excuses, not solutions. “I have to drive, otherwise I’ll starve”.

          We’re going extinct, just like the beetles. And when people say humans aren’t just using statistical shortcuts to mimick intelligence, I can’t take them seriously.

    • terranoid@lemmy.cafe
      link
      fedilink
      English
      arrow-up
      107
      arrow-down
      1
      ·
      1 day ago

      YEP. I’m not in AI but I’m in cyber security.

      I used to tell people that there’s very little actual risk, because if we had something even half as concerning as AGI (which I’d argue we did with chatgpt 3.5), that we’d easily be able to lock it down and prevent it from doing anything funny.

      Super intelligence isn’t just going to magically spawn on 32 GB ram in a sandboxed environment. And AGI will not magically know how sandboxed it is or how to escape.

      …then I saw people letting Claude send emails and use their credit card on their behalf like immediately when it was able to do things that appeared intelligent.

      They literally saw the smallest hint of AGI and said, “here’s my credit card and identity, take the wheel”.

      There was no fucking talk of sandboxing. Everyone turned that off so they didn’t have to click the “allow” button.

      Not that I think we’re at any risk of ASI since it seems more like we hit a logarithmic wall, but we are absolutely at risk of letting random algorithms destroy critical parts of infrastructure because people are lazy and stupid and managed by even worse people.

      I would not be surprised if the right AI hallucinations could cause a nuclear bomb to go off right now. I’m not talking about super intelligence, just automated super idiocy.

      Proof: literally this post is about an idiot letting an AI control their fucking email and it emailed the FBI because it was fucking stupid

      • Supercrunchy@programming.dev
        link
        fedilink
        English
        arrow-up
        44
        arrow-down
        1
        ·
        1 day ago

        We live in a period of extreme stupidity, so I now fully expect AI to cause disasters in the same idiotic and tragically hilarious way.

        I expect AI to trigger a war because some idiot trusted it blindly without double checking (oh wait, it almost already happened!), and I’m sure there are plenty of people currently lobbying to have AI directly connected to weapons.

        Skynet is not going to have the objective to conquer the world, it’s going to have the objective of maximizing paperclip production.

        • HerbGrower@slrpnk.net
          link
          fedilink
          English
          arrow-up
          5
          arrow-down
          1
          ·
          22 hours ago

          AI isn’t causing these disasters, people are. YOU are responsible for using it and what it does. I will never accept “chatgpt did it” as a fucking excuse.

          • NEZ27@lemmy.zip
            link
            fedilink
            English
            arrow-up
            12
            ·
            21 hours ago

            They said the opposite. AI won’t cause disasters, idiots who give it access will. Some asshole will joke about nuking Iran, unawares that another asshole granted access to the proverbial ‘Button’, and we’ll have another international incident.

            Like just look at ‘Signal Gate’, and know that those idiots are still in charge. And those same idiots blamed bombing the all girls school in Iran on AI last March. And that’s just in the US, we have the biggest loudest idiots right now, but they are not the only idiots out there vibe coding up some war crimes.

      • HerbGrower@slrpnk.net
        link
        fedilink
        English
        arrow-up
        5
        ·
        22 hours ago

        ChatGPT couldn’t destroy the world. What is that siren… Wtf do you mean you gave it access to a button that launches nuclear weapons and told it to protect the country?

      • village604@adultswim.fan
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        1
        ·
        16 hours ago

        I think people tend to forget that neural networks were designed to mimic how the brain works.

    • architect@thelemmy.club
      link
      fedilink
      English
      arrow-up
      4
      ·
      21 hours ago

      Yea I don’t know why you thought that, either. The technogarchs have been clear for 2.5 decades they would do this. They have written extensively about it.

    • TheTechnician27@lemmy.world
      link
      fedilink
      English
      arrow-up
      19
      ·
      1 day ago

      I’m guessing this means you got your master’s before transformers made sequential data processing so parallelizable that it’d be commercially viable to let Bob down the street into the “we” who wouldn’t be dumb enough to give them that ability.

      I think your assumption was reasonable.

      • prole@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        3
        ·
        22 hours ago

        I’m guessing this means you got your master’s before The Transformers made sequential data processing so parallelizable that it’d be commercially viable

        I knew it was the All Spark

    • qqq@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      6
      ·
      20 hours ago

      these models are only mimicking intelligence

      I always find this to be such an interesting turn of phrase: “mimicking intelligence”. If it is possible for these systems to cross the line into “thought” I think we’ll miss it entirely because of our biases that the type of “thought” we have is somehow special or mystical even.

        • qqq@lemmy.world
          link
          fedilink
          English
          arrow-up
          9
          arrow-down
          1
          ·
          20 hours ago

          I have no idea. We are unable to prove that other humans are thinking and not just “mimicking intelligence” let alone something we’ve created. People approaching this subject with such certainty are imo being overly confident or outright dishonest.

          With respect to what I believe, since you asked, I think there is essentially no reason to distinguish “mimicking intelligence” with high fidelity from “intelligence”. I don’t feel comfortable talking to LLMs as if they were merely machines, but I don’t approach them as if they were human either; they’re in a very weird spot to me. I understand the simplicity of the math and programming behind them probably better than average, but that doesn’t help me come to a conclusion on “thinking”

          • SorryQuick@lemmy.ca
            link
            fedilink
            English
            arrow-up
            1
            ·
            18 hours ago

            Other humans can feel emotions, or so you’d believe, but I have no proof of this. All I see is they receive certain input (I call you a shitface) and produce certain output (You punch me in the balls). LLMs can mimic this. But is one of the two more valid than the other? From an observers’ point of view they are the exact same.

            • qqq@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              18 hours ago

              Odd example but yes it gets uncertain very quickly. If we discover the mechanism of our own thought it’d be easy enough to apply those rules to the new subject and see if they match or at least look similar. A negative wouldn’t be conclusive, but it’d at least give us something to work with. As it stands right now we just guess, and that guess is essentially guided by bias or at best by the fact that the thing we’re looking at doesn’t appear even remotely similar to anything we’d call “thinking”. This is simply not the case with LLMs (they do a very good job of displaying something that looks like thinking) so our guess is imo even more unsound.

  • vala@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    67
    arrow-down
    1
    ·
    1 day ago

    Absolutely nuts that people allow their agents out of maga jail. I would never let an LLM in the same room as my email account.