Separate names with a comma.
Discussion in 'SEO and Marketing' started by evargro, May 15, 2019.
What is robots.txt?
when you use robot.TXT file in you site ..then it means that you are giving a command to google crawler that which page you want to crawl or which is not...by using allow and disallow action
Robots.txt is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website.