Ayhem@lemmy.world to Artificial Intelligence@lemmy.worldEnglish · 2 years agoWebsites blocking OpenAIlemmy.worldimagemessage-square14fedilinkarrow-up171arrow-down14file-text
arrow-up167arrow-down1imageWebsites blocking OpenAIlemmy.worldAyhem@lemmy.world to Artificial Intelligence@lemmy.worldEnglish · 2 years agomessage-square14fedilinkfile-text
minus-squareAggressivelyPassive@feddit.delinkfedilinkEnglisharrow-up7·2 years agoRobots.txt never was any hurdle, it’s just a flag which you are free to ignore.
Robots.txt never was any hurdle, it’s just a flag which you are free to ignore.