minus-squareShitpostCentral@lemmy.worldtoTechnology@lemmy.world•AI companies are violating a basic social contract of the web and and ignoring robots.txtlinkfedilinkEnglisharrow-up16·8 months agoYou’re second point is a good one, but you absolutely can log the IP which requested robots.txt. That’s just a standard part of any http server ever, no JavaScript needed. linkfedilink
minus-squareShitpostCentral@lemmy.worldOPtoPiracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.com•How does Usenet content not immediately get DMCA'd into oblivion?linkfedilinkEnglisharrow-up1·9 months agoThis makes perfect sense. Thank you! linkfedilink
ShitpostCentral@lemmy.world to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.comEnglish · 9 months agoHow does Usenet content not immediately get DMCA'd into oblivion?plus-squaremessage-squaremessage-square15fedilinkarrow-up12arrow-down10
arrow-up12arrow-down1message-squareHow does Usenet content not immediately get DMCA'd into oblivion?plus-squareShitpostCentral@lemmy.world to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.comEnglish · 9 months agomessage-square15fedilink
You’re second point is a good one, but you absolutely can log the IP which requested robots.txt. That’s just a standard part of any http server ever, no JavaScript needed.