PocketOS founder blames ‘Cursor running Anthropic's flagship Claude Opus 4.6’ plus Railway’s infrastructure for data disaster.
  • WalnutLum@lemmy.ml
    33·
    14 hours ago

    I hate when it says these things “go rogue”

    They’re stochastic word generators, if your harness doesn’t have anything to prevent bad stuff there’s always gonna be a chance it’ll delete your database.

  • pedz@lemmy.ca
    6·
    11 hours ago

    Someone wasn’t following the 3-2-1 rule. That wouldn’t have happened if they used LTO tape backups.

    I used to work for a hosting company that had the IBM i servers of insurance companies and big retailers. Servers were replicated in real time but they also had offline backups on LTO tapes.

    If you give AI access to your backups, you deserve what happens.

  • kevinsky@feddit.nl
    15·
    14 hours ago

    The AI agent’s misdemeanors were then hugely amplified by a cloud infrastructure provider’s API wiping all backups after the main database was zapped.

    In what scenario should wiping backups over an API even be a thing?

    • Enoril@jlai.lu
      4·
      11 hours ago

      For example if you delete an aws database, the associated snapshots are also deleted automatically. It’s written in the document and you have to tune some parameters to avoid that.

      So I assume the AI deleted the database and they tried to restore it… discovering the database associated snapshots weren’t there anymore. oops…

      • kevinsky@feddit.nl
        3·
        10 hours ago

        Snapshots are not a real backup untill you commit them to some sort of immutable storage.

  • FriendOfDeSoto@startrek.websiteEnglish
    21·
    16 hours ago

    This is how so-called AI can also create jobs…

    This sort of story isn’t the norm. But it is a risk. Why would anybody in their right mind chose to implement these half-cooked tools in a production environment? You don’t run a beta test during open heart surgery either.

      • Bo7a@piefed.caEnglish
        4·
        12 hours ago

        And I’m out here raising chickens in the woods for a couple of years until that rate is more like 500k and then I’ll start answering calls from clients who have been on sprees firing their best engineers and replacing them with juniors who now have no mentors to teach them how to see these problems before they happen.

        I’m betting 2028 is going to be a good year for my bank account. Until then I’ll scrimp and save and grow what food I can to avoid the insanity that is currently holding every sprint planner hostage.