MarcellusDrum@lemmy.ml to Technology@lemmy.worldEnglish · 6 months agoThis website is for humanslocalghost.devexternal-linkmessage-square56linkfedilinkarrow-up1108arrow-down12
arrow-up1106arrow-down1external-linkThis website is for humanslocalghost.devMarcellusDrum@lemmy.ml to Technology@lemmy.worldEnglish · 6 months agomessage-square56linkfedilink
minus-square𝚝𝚛𝚔@aussie.zonelinkfedilinkEnglisharrow-up6·6 months agoIs there a more ignored file on the internet than robots.txt?
Is there a more ignored file on the internet than robots.txt?
Do dnt headers count?