View Single Post
Old 15th October 2019, 02:34 AM   #2
VIP Contributor
jeffscott's Avatar

Join Date: Oct 2014
Location: Singapore
Posts: 927

Robot.txt is a tag that tells the search engine bots not to crawl the specific page.

Worldwide trusted website for Free Bet365 Football Tips!
jeffscott is offline   Reply With Quote