Davriellelouna@lemmy.world to Technology@lemmy.worldEnglish · edit-225 days agoThe AI company Perplexity is complaining their bots can't bypass Cloudflare's firewallwww.searchenginejournal.comexternal-linkmessage-square249linkfedilinkarrow-up1868arrow-down18
arrow-up1860arrow-down1external-linkThe AI company Perplexity is complaining their bots can't bypass Cloudflare's firewallwww.searchenginejournal.comDavriellelouna@lemmy.world to Technology@lemmy.worldEnglish · edit-225 days agomessage-square249linkfedilink
minus-squarepressanykeynow@lemmy.worldlinkfedilinkEnglisharrow-up1·edit-224 days ago Cloudflare doesn’t distinguish these things It does. You just make useragent like “AI bot request initiated by user” and the website owners will decide for themselves to allow your traffic or not. If your bot pretends to not be a bot, it should be blocked. Edit. Btw Openai does this.
It does.
You just make useragent like “AI bot request initiated by user” and the website owners will decide for themselves to allow your traffic or not.
If your bot pretends to not be a bot, it should be blocked.
Edit. Btw Openai does this.