Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
nly
on Feb 21, 2014
|
parent
|
context
|
favorite
| on:
Inside DuckDuckGo, Google's Tiniest, Fiercest Comp...
Their servers are probably configured fine. They likely have a pool of servers with no reverse DNS to try and catch servers issuing different content to Googlebot
Aldo_MX
on March 5, 2014
[–]
I'm pretty confident that the server 1.2.3.4 which returns crawl-5-6-7-8-googlebot.com it's a badly configured one.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: