• rtxn@lemmy.world
    link
    fedilink
    arrow-up
    9
    ·
    edit-2
    2 hours ago

    PocketOS founder blames ‘Cursor running Anthropic’s flagship Claude Opus 4.6’

    Fuck that. I’m blaming the PocketOS founder and every person in the chain of decisions that led to a clanker being given this level of unrestricted access to the database and the backups.

  • Avicenna@programming.dev
    link
    fedilink
    arrow-up
    12
    ·
    4 hours ago

    If you are going to give an LLM a free pass to your whole prod database least you should do is to take weekly (or daily if plausible) offline backups of it. A hard limit against deleting stuff would be better.

  • Raven@lemmy.org
    link
    fedilink
    arrow-up
    13
    ·
    6 hours ago

    This is fun to read. I hope people will have their actual intelligence activated after this.

  • deadbeef79000@lemmy.nz
    link
    fedilink
    arrow-up
    76
    ·
    10 hours ago

    Man who shit his own pants horrified that his pants are full of shit.

    Demands explanation from pants vendor.

      • jafra@slrpnk.net
        link
        fedilink
        arrow-up
        6
        ·
        5 hours ago

        Actually this is how AI should be viewed. Under the right circumstances it maybe saves lots of time, but it also might destroy, so treat it like you would an intern…

  • gravitas_deficiency@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    105
    ·
    12 hours ago

    If you are giving your codegen LLM - the model involved truly, genuinely doesn’t matter - admin access to your prod env, all I’m going to do is point and laugh.

  • grueling_spool@sh.itjust.works
    link
    fedilink
    arrow-up
    37
    ·
    11 hours ago

    No bro you don’t understand, Claude needs access to backups so it can restore them in case something breaks because our senior dev ($50k, 2YoE) doesn’t know how to do it

  • db2@lemmy.world
    link
    fedilink
    arrow-up
    23
    ·
    11 hours ago

    They can’t go rogue, they have no agency or desire or thought. What really happened is the thing specifically designed to do whatever the Plinko line with the most chips says did it because the incompetent dickheads who deployed it didn’t know how not to do that.

  • Brokkr@lemmy.world
    link
    fedilink
    arrow-up
    51
    ·
    12 hours ago

    I don’t understand what Railway is supposed to do here? If deleting a drive also deletes the backup, what’s the point of the backup?

  • patruelis@lemmy.world
    link
    fedilink
    arrow-up
    16
    ·
    12 hours ago

    Its bound to happen more and more. More concerning, what is it decides to insert unknown code into backups? How are they detected? Who’s guarding all if these? Another AI?

    • pinball_wizard@lemmy.zip
      link
      fedilink
      arrow-up
      7
      ·
      11 hours ago

      Exactly. We aren’t (and probably won’t) even learn about all the subtle poisoning happening, causing waste and data loss.