Welcome to the Small Business Ideas Forum! We are a community of over 100,000 small business folks with over 163,000 posts for you to browse. We pride ourselves on being the friendliest forum you will find and we'd love to have you as a member of our community. Please take a moment and register for a free account. If you need any help, please contact Chris Logan.

Small Business Ideas Forum

Small Business Ideas Forum

A friendly place to share small business ideas and knowledge, ask questions, find help and encourage others that are involved in the small business industry. Topics include small business marketing, generating revenue and small business computing.

Go Back   Small Business Ideas Forum > Small Business Marketing - Online > Search Engine Optimization
Register Search Today's Posts Mark Forums Read

Reply
 
Thread Tools
Old 12th April 2018, 01:23 PM   #1
MBA Trainer
VIP Contributor
 

Join Date: Nov 2013
Posts: 206
Default Role Of Robot Txt

What is role of robot txt file in SEO ? If this file is not fetched by the Google then what are its consequences ?

__________________
aries birthstone | libra birthstone
MBA Trainer is offline   Reply With Quote
Register or log in to remove this ad.
Old 15th April 2018, 11:30 PM   #2
jeffscott
VIP Contributor
 
jeffscott's Avatar
 

Join Date: Oct 2014
Location: Singapore
Posts: 928
Default

When you use Robot.txt file you have content that you want to blocked from the search engines for better indexing process.

__________________
Worldwide trusted website for Free Bet365 Football Tips!
jeffscott is offline   Reply With Quote
Old 16th April 2018, 12:36 AM   #3
jamesbush
Member
 

Join Date: May 2015
Posts: 56
Default

Search engine always looks at your robots.txt file before it crawls your website. This is because to see the instructions on where they are allowed to crawl and index on the search engine results. We use Robots.txt files if we want search engines to ignore any duplicate pages on the website.

jamesbush is offline   Reply With Quote
Old 6th June 2018, 12:45 AM   #4
pxmediainc
Member
 

Join Date: Dec 2017
Posts: 24
Default

Robots.txt file of your website tells the search engines bot which content, pages to access and index on your website on which pages not to.Keeping the search engines from accessing certain pages on your site is essential for both the privacy of your site and for your SEO. As a example if your website do not have robot file then may be search engines can crawl your root files, pages like admin, and more backend pages. In every site there is some pages which you do not want that they become visible for every one. So Use of RObots.txt file is very important and useful.

pxmediainc is offline   Reply With Quote
Reply   

Bookmarks


Similar Threads
Thread Thread Starter Forum Replies Last Post
Role Of Business Development Consultant In Business Start Up LaneKreps Small Business Finance 8 21st August 2018 04:23 AM
What Is The Role Of PA (page Authority) In SEO? Tradegateway Search Engine Optimization 10 3rd June 2016 02:29 AM
Role Of Business Development Consultant In Business Start Up LaneKreps Small Business Finance 3 16th March 2016 07:39 AM
Report: The Role Of Digital In A Period Of Economic Slowdown theopapada Free Links 0 26th February 2008 11:20 AM
Does Google's robot have a virus ? hwajcman Search Engine Optimization 2 4th November 2004 07:20 PM



Thread Tools

Get Updates
RSS Feeds:
RSS Feed for Search Engine Optimization RSS for this Category Only: Search Engine Optimization

RSS Feed for Small Business Ideas Forum RSS for Entire Forum
Forum Rules


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


Small Business Ideas Forum


 
At Your Business - Small Business Directory
Free Business Forms - Prewritten Documents
 
Search Engine Guide
Small business guide to search marketing

 
Small Business Brief
Fetching the Best Small Business Info


Free Links - Free Advertising
Free Guide - Online Directory



Advertise your business here
Contact us for more details!


Semantic Juice
Register now to access free Quick SEO service!


Rocket Lawyer
Sign up for free 7 day trial. Boost your biz!


Buy UPC Codes
Get your products listed online!




All times are GMT -5. The time now is 01:19 PM.


Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
Copyright 2004 - 2018 - Privacy