Welcome to the Small Business Ideas Forum! We are a community of over 100,000 small business folks with over 163,000 posts for you to browse. We pride ourselves on being the friendliest forum you will find and we'd love to have you as a member of our community. Please take a moment and register for a free account. If you need any help, please contact Chris Logan.

Small Business Ideas Forum

Small Business Ideas Forum

A friendly place to share small business ideas and knowledge, ask questions, find help and encourage others that are involved in the small business industry. Topics include small business marketing, generating revenue and small business computing.

Go Back   Small Business Ideas Forum > Small Business Marketing - Online > Search Engine Optimization
Register Search Today's Posts Mark Forums Read

Thread Tools
Old 12th April 2018, 12:23 PM   #1
MBA Trainer
VIP Contributor

Join Date: Nov 2013
Posts: 224
Default Role Of Robot Txt

What is role of robot txt file in SEO ? If this file is not fetched by the Google then what are its consequences ?

august birthstone | aries birthstone
MBA Trainer is offline   Reply With Quote
Register or log in to remove this ad.
Old 15th April 2018, 10:30 PM   #2
VIP Contributor
jeffscott's Avatar

Join Date: Oct 2014
Location: Singapore
Posts: 927

When you use Robot.txt file you have content that you want to blocked from the search engines for better indexing process.

Worldwide trusted website for Free Bet365 Football Tips!
jeffscott is offline   Reply With Quote
Old 15th April 2018, 11:36 PM   #3

Join Date: May 2015
Posts: 56

Search engine always looks at your robots.txt file before it crawls your website. This is because to see the instructions on where they are allowed to crawl and index on the search engine results. We use Robots.txt files if we want search engines to ignore any duplicate pages on the website.

jamesbush is offline   Reply With Quote
Old 5th June 2018, 11:45 PM   #4

Join Date: Dec 2017
Posts: 24

Robots.txt file of your website tells the search engines bot which content, pages to access and index on your website on which pages not to.Keeping the search engines from accessing certain pages on your site is essential for both the privacy of your site and for your SEO. As a example if your website do not have robot file then may be search engines can crawl your root files, pages like admin, and more backend pages. In every site there is some pages which you do not want that they become visible for every one. So Use of RObots.txt file is very important and useful.

pxmediainc is offline   Reply With Quote


Similar Threads
Thread Thread Starter Forum Replies Last Post
Role Of Business Development Consultant In Business Start Up LaneKreps Small Business Finance 8 21st August 2018 03:23 AM
What Is The Role Of PA (page Authority) In SEO? Tradegateway Search Engine Optimization 10 3rd June 2016 01:29 AM
Role Of Business Development Consultant In Business Start Up LaneKreps Small Business Finance 3 16th March 2016 06:39 AM
Report: The Role Of Digital In A Period Of Economic Slowdown theopapada Free Links 0 26th February 2008 10:20 AM
Does Google's robot have a virus ? hwajcman Search Engine Optimization 2 4th November 2004 06:20 PM

Thread Tools

Get Updates
RSS Feeds:
RSS Feed for Search Engine Optimization RSS for this Category Only: Search Engine Optimization

RSS Feed for Small Business Ideas Forum RSS for Entire Forum
Forum Rules

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Small Business Ideas Forum

At Your Business - Small Business Directory
Free Business Forms - Prewritten Documents
Search Engine Guide
Small business guide to search marketing

Small Business Brief
Fetching the Best Small Business Info

Free Links - Free Advertising
Free Guide - Online Directory

Advertise your business here
Contact us for more details!

Semantic Juice
Register now to access free Quick SEO service!

Rocket Lawyer
Sign up for free 7 day trial. Boost your biz!

Buy UPC Codes
Get your products listed online!

All times are GMT -5. The time now is 11:06 AM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
Copyright 2004 - 2018 - Privacy