How to block Google from crawling https links Solution for how to block Google from crawling https links. The Google crawler looks for a robots.txt file when accessing your site. naveen 18/06/2012
