How To Control Googlebot's Interaction With Your Website
Google's Search Relations team provides insights into controlling Googlebot's interactions with webpages on the latest 'Search Off The Record' podcast.
Gary Illyes Google John Mueller Search Relations Search Off The Record John Mueller Googlebot From Accessing
Source: searchenginejournal.com