Welcome to the Small Business Ideas Forum! We are a community of over 100,000 small business folks with over 163,000 posts for you to browse. We pride ourselves on being the friendliest forum you will find and we'd love to have you as a member of our community. Please take a moment and register for a free account. If you need any help, please contact Chris Logan.

Small Business Ideas Forum

Small Business Ideas Forum

A friendly place to share small business ideas and knowledge, ask questions, find help and encourage others that are involved in the small business industry. Topics include small business marketing, generating revenue and small business computing.

Go Back   Small Business Ideas Forum > Small Business Marketing - Online > Search Engine Optimization
Register Search Today's Posts Mark Forums Read

Reply
 
Thread Tools
Old 5th February 2016, 09:47 AM   #1
MBA Trainer
VIP Contributor
 

Join Date: Nov 2013
Posts: 225
Default Robot.txt And SEO

What robot.txt and what is its importance in SEO ?

__________________
august birthstone | aries birthstone
MBA Trainer is offline   Reply With Quote
Register or log in to remove this ad.
Old 8th February 2016, 12:11 AM   #2
Piers Rollins
Member
 

Join Date: Apr 2015
Posts: 51
Default

Robots.txt is a text document file, which tells search engine robots, spiders/bots a instruction on which pages of your website should be indexed and which web pages should be ignored.

__________________
Newton Roofing
Piers Rollins is offline   Reply With Quote
Old 8th February 2016, 01:57 AM   #3
jackluter
VIP Contributor
 

Join Date: Jul 2014
Posts: 162
Default

Roborts help the search engine in finding the pages of a web site to be crawled.
It also helps allowing/disallowing the users.

jackluter is offline   Reply With Quote
Old 8th February 2016, 02:52 AM   #4
siriinnovations
Member
 

Join Date: Dec 2015
Posts: 40
Default

Robot.txt is one of the file used in SEO to crawl the website and helps in finding any issues present in the website through crawling.

siriinnovations is offline   Reply With Quote
Old 9th February 2016, 01:30 AM   #5
BenDorio
Member
 

Join Date: Feb 2016
Location: California
Posts: 39
Default

Quote:
Originally Posted by Piers Rollins View Post
Robots.txt is a text document file, which tells search engine robots, spiders/bots a instruction on which pages of your website should be indexed and which web pages should be ignored.
Robots.txt file doesn't have the strict relation to SEO, but it will help you to prevent getting unwanted pages in the index of SE. Also, you should know that the instructions described in robots.txt have just the recommendatory character and Google not always executes instructions prescribed there.

BenDorio is offline   Reply With Quote
Old 9th February 2016, 06:07 AM   #6
wrigmark
Member
 

Join Date: Oct 2015
Location: London, UK
Posts: 21
Send a message via Skype™ to wrigmark

Default

Very Simple; Robot .txt is all about allowing or disallowing web pages appearing search engine result pages.

wrigmark is offline   Reply With Quote
Old 10th February 2016, 12:13 AM   #7
jeffscott
VIP Contributor
 
jeffscott's Avatar
 

Join Date: Oct 2014
Location: Singapore
Posts: 927
Default

Robot.txt file helps the website for better indexing in the search engine.

__________________
Worldwide trusted website for Free Bet365 Football Tips!
jeffscott is offline   Reply With Quote
Old 5th April 2016, 04:56 AM   #8
paulaugust
Member
 

Join Date: Dec 2015
Posts: 39
Default

When a search engine crawler comes to your site, it will look for a special file on your site. That file is called robots.txt
If your Web site doesn't have a robots.txt file yet, read on to learn how to create one. If you already have a robots.txt file, read our tips to make sure that it doesn't contain errors.

paulaugust is offline   Reply With Quote
Old 8th April 2016, 08:08 AM   #9
alexfernandes
Senior Member
 

Join Date: Apr 2014
Posts: 108
Default

Robots.txt file is uploaded to the root of the folder. With this file we can able to give instruction to Google like which webpage we want to allow or disallow to index or crawl the webpage.

alexfernandes is offline   Reply With Quote
Old 8th April 2016, 12:45 PM   #10
geeksonrepair
Senior Member
 

Join Date: Mar 2016
Posts: 130
Default

Robot file is very important part of seo .its helps to index our webpages with search engine.

geeksonrepair is offline   Reply With Quote
Reply   

Bookmarks


Similar Threads
Thread Thread Starter Forum Replies Last Post
The Evils of SEO Copywriting copywriter Copywriting 13 14th January 2017 01:09 PM
SEO Benefits D_Kotian Search Engine Optimization 27 21st March 2016 12:17 AM
The Geek-Free SEO Guide (Videos) - 9 Most Important Factors SoftDev Search Engine Optimization 0 21st December 2015 05:05 AM
Common SEO Mistakes ecapsnet Search Engine Optimization 24 22nd January 2015 01:31 AM
5 Key SEO Findings - New Benchmark Study acwebguru Search Engine Optimization 23 21st October 2013 07:53 AM



Thread Tools

Get Updates
RSS Feeds:
RSS Feed for Search Engine Optimization RSS for this Category Only: Search Engine Optimization

RSS Feed for Small Business Ideas Forum RSS for Entire Forum
Forum Rules


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


Small Business Ideas Forum


 
At Your Business - Small Business Directory
Free Business Forms - Prewritten Documents
 
Search Engine Guide
Small business guide to search marketing

 
Small Business Brief
Fetching the Best Small Business Info


Used Values - Free Links
Blue Book





All times are GMT -5. The time now is 12:55 PM.


Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
Copyright 2004 - 2018 - Privacy