HackerTrans
トップ新着トレンドコメント過去質問紹介求人

Portoaj

no profile record

コメント

Portoaj
·9 か月前·議論
Hi wibbily, your point on the first conflicts is fair enough, we'll update that.

I somewhat disagree with you on the last conflict: you have one document stating pretty clearly that returning a 503 for the robots.txt "blocks all crawling". The other document states there's a 12 hour block after which Google may decide to crawl the other pages (not just the robots.txt like you said).

Thanks for the feedback though, definitely some work to be done on validating the conflicts we surface.
Portoaj
·9 か月前·議論
Totally agree - we've found a handful of conflicts on every large company whose public docs we've looked at but a lot of the value is definitely in internal docs where there's no technical writer double checking everything that comes out.