Davriellelouna@lemmy.world to Technology@lemmy.worldEnglish · edit-21 month agoThe AI company Perplexity is complaining their bots can't bypass Cloudflare's firewallwww.searchenginejournal.comexternal-linkmessage-square249fedilinkarrow-up1870arrow-down16
arrow-up1864arrow-down1external-linkThe AI company Perplexity is complaining their bots can't bypass Cloudflare's firewallwww.searchenginejournal.comDavriellelouna@lemmy.world to Technology@lemmy.worldEnglish · edit-21 month agomessage-square249fedilink
minus-squarepressanykeynow@lemmy.worldlinkfedilinkEnglisharrow-up1·edit-229 days ago Cloudflare doesn’t distinguish these things It does. You just make useragent like “AI bot request initiated by user” and the website owners will decide for themselves to allow your traffic or not. If your bot pretends to not be a bot, it should be blocked. Edit. Btw Openai does this.
It does.
You just make useragent like “AI bot request initiated by user” and the website owners will decide for themselves to allow your traffic or not.
If your bot pretends to not be a bot, it should be blocked.
Edit. Btw Openai does this.