Google Search Console Introduces Comprehensive Robots.txt Report: Unlocking Insights
Robots.txt Report: A robots.txt file lets you tell search engines which pages to crawl and which ones to skip. Bots.txt files are found in the source files of many websites.
Source: eyesonnews.com