• RustyNova@lemmy.world
    link
    fedilink
    arrow-up
    8
    ·
    17 hours ago

    I oversimplified it but the actual process was to zip files to send to an FTP server

    The cron zipped the files to send in the same directory as the zipped files, then sent the zip, then deleted the zip

    Looks fine, right? But what if the FTP server is slow and uploading take more time than the hourly cron dispatch? You now have a second script that zip all the folder, with the previous zip file, which will slow down the upload, etc…

    I believe may have been started by an FTP upload erroring out and forcing an early return without having a cleanup, and progressively got worse

    … I suppose this happened. The logs were actually broken and didn’t actually add the message part of the error object, and only logging the memory address to it