alyaza [they/she]@beehaw.orgM to Technology@beehaw.orgEnglish · 2 days ago99% of My Website Traffic Is Bots: A year of fighting scrapers on my 1.5 million-page website. What I tried, how I failed, and what's working now.patronview.comexternal-linkmessage-square11linkfedilinkarrow-up196arrow-down16cross-posted to: technology@lemmy.zip
arrow-up190arrow-down1external-link99% of My Website Traffic Is Bots: A year of fighting scrapers on my 1.5 million-page website. What I tried, how I failed, and what's working now.patronview.comalyaza [they/she]@beehaw.orgM to Technology@beehaw.orgEnglish · 2 days agomessage-square11linkfedilinkcross-posted to: technology@lemmy.zip
minus-squaremasterofn001@lemmy.calinkfedilinkarrow-up6·1 day agoOne thing I’ve noticed that doesn’t need to know page structure - scroll all the way down and look for the last section with the title Conclusion. Just noticed this a few daus ago. So many sites I’ve never heard of about niche topics have the exact same layouts and all ended with a Conclusion. Why is there a conclusion on a page for swapping out a circuit breaker or building a fence gate or how to properly shoot heroin? Ai slop.
One thing I’ve noticed that doesn’t need to know page structure - scroll all the way down and look for the last section with the title Conclusion.
Just noticed this a few daus ago. So many sites I’ve never heard of about niche topics have the exact same layouts and all ended with a Conclusion.
Why is there a conclusion on a page for swapping out a circuit breaker or building a fence gate or how to properly shoot heroin? Ai slop.