menu
techminis

A naukri.com initiative

google-web-stories
Home

>

Open Source News

>

Open sourc...
source image

TechCrunch

4d

read

3.5k

img
dot

Image Credit: TechCrunch

Open source devs are fighting AI crawlers with cleverness and vengeance

  • Open source developers are facing challenges with AI web-crawling bots, as they are disproportionately affected due to sharing more infrastructure publicly and having fewer resources.
  • An AI bot named AmazonBot caused DDoS outages by disobeying robot.txt rules on a Git server website hosting FOSS projects.
  • FOSS developer Xe Iaso created Anubis, a reverse proxy check inspired by Egyptian mythology, to block bots and allow human-operated browsers.
  • Anubis gained quick popularity in the FOSS community by preventing bot requests with a proof-of-work check and presenting a cute anime picture for successful human requests.

Read Full Article

like

24 Likes

For uninterrupted reading, download the app