.Google.com's Gary Illyes discloses Googlebot collects hyperlinks as opposed to "adhering to" them, negating main documents.Googlebot collects hyperlinks as opposed to following all of them in real-time.Gary Illyes shared this information in Google's 'Search Off The Report' podcast.Google.com's information negates the real crawler habits.