Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This seems like a useful index, but I just wanted to say that I love the name. A good name is so much fun.


I just stumbled on it while searching for AI crawler user agents.

I'm not sure how often it's updated. It seems fairly complete from other sources I've been looking at (mainly robots.txt files for well-known publishers).


It's updated daily. Thanks for posting by the way.


Thanks for making it, a great resource!


Ha thanks, it was a shower thought




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: