New Fastly Threat Research Reveals AI crawlers make up almost 80% of AI bot traffic, Meta Leads AI Crawling As ChatGPT Dominates Real-Time Web Traffic | Fastly
www.fastly.com
SAN FRANCISCO – August 19, 2025 – Fastly, Inc. (NYSE: FSLY), a leader in global edge cloud platforms, today released its Q2 2025 Threat Insights Report, exposing a striking shift in the nature and scale of automated web traffic. Analysis of traffic from mid-April to mid-July shows that AI crawlers made up almost 80% of all AI bot traffic observed, with Meta generating more than half and eclipsing both Google and OpenAI combined.
  • PattyMcB@lemmy.worldEnglish
    22·
    3 days ago

    I couldn’t click the cookie policy garbage because the AI chat bot obscured the buttons on that page.

    Talk about AI slop

  • dan@upvote.auEnglish
    76·
    3 days ago

    Are they sure that the Meta traffic is AI bots? A lot of people share links in posts on Meta products, which scrape the links to generate a preview.

      • dan@upvote.auEnglish
        6·
        3 days ago

        They are for anything that’s E2E encrypted such as Messenger and WhatsApp, so that the link isn’t revealed to Meta servers.

        As far as I know, for things like posts on Facebook, the server does the scraping. This is especially the case in the web version, since client-side scraping of arbitrary sites would require those sites to have an open CORS policy, which comes with security risks.

        There’s a Sharing Debugger tool on the Facebook developer site that lets you force rescrape a site.

    • bert_macklin_fbi@lemmy.worldEnglish
      2·
      3 days ago

      It would not surprise me to see that the traffic traced back to “scrapers”. A user’s perceived relevance often ties to the recency of the dataset.