Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

As someone who works at a non-profit which is increasingly and regularly crawled, sometimes very aggressively,

PLEASE PLEASE PLEASE establish and use a consistent useragent string.

This lets us load balance and steer traffic appropriately.

Thank you.



Mind sharing which one? I'm curious




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: