Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Their servers are probably configured fine. They likely have a pool of servers with no reverse DNS to try and catch servers issuing different content to Googlebot


I'm pretty confident that the server 1.2.3.4 which returns crawl-5-6-7-8-googlebot.com it's a badly configured one.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: