Welcome to the Small Business Ideas Forum! We are a community of over 100,000 small business folks with over 163,000 posts for you to browse. We pride ourselves on being the friendliest forum you will find and we'd love to have you as a member of our community. Please take a moment and register for a free account. If you need any help, please contact Chris Logan.

Small Business Ideas Forum

Small Business Ideas Forum

A friendly place to share small business ideas and knowledge, ask questions, find help and encourage others that are involved in the small business industry. Topics include small business marketing, generating revenue and small business computing.

Go Back   Small Business Ideas Forum > Small Business Marketing - Online > Search Engine Optimization
Register Search Today's Posts Mark Forums Read

Reply
 
Thread Tools
Old 4th May 2013, 10:14 PM   #1
badloy1135
Member
 

Join Date: May 2013
Location: Ozamis City
Posts: 2
Default What Is Page Crawling?

I am looking for a nice explanation on what is crawling? how it affects a domain?

badloy1135 is offline   Reply With Quote
Register or log in to remove this ad.
Old 6th May 2013, 03:26 AM   #2
revenue4u
Member
 

Join Date: Sep 2011
Location: Vilonia AR. USA
Posts: 35
Send a message via Skype™ to revenue4u

Default

When you create a new site or page it is not listed on any search engines (SE's) yet. You should then create and submit a sitemap to notify the SE's about your new site or page. The SE's have robots that will then be scheduled to visit and inventory your new stuff. The inventory process is often referred to as "crawling" as in: The Googlebot crawled my site today.

revenue4u is offline   Reply With Quote
Old 6th May 2013, 04:51 AM   #3
noahwilson
Banned
 

Join Date: Mar 2013
Location: Australia
Posts: 72
Default

Crawling a process to indexing the website urls by search engine bot.

noahwilson is offline   Reply With Quote
Old 6th May 2013, 09:45 AM   #4
Jen 100
Senior Member
 

Join Date: Feb 2013
Location: St. Louis, MO
Posts: 115
Default

Google explains crawling like this:
Quote:
Crawling is the process by which Googlebot discovers new and updated pages to be added to the Google index.
We use a huge set of computers to fetch (or "crawl") billions of pages on the web. The program that does the fetching is called Googlebot (also known as a robot, bot, or spider). Googlebot uses an algorithmic process: computer programs determine which sites to crawl, how often, and how many pages to fetch from each site.
You can read more about crawling and indexing here: http://support.google.com/webmasters...n&answer=70897

__________________
Unidev complete tech solutions including software development, mobile/ecommerce development and innovative online marketing and web design
Jen 100 is offline   Reply With Quote
Old 6th May 2013, 10:15 AM   #5
Logan
Administrator
 

Join Date: Jun 2004
Location: Colorado
Posts: 8,047
Default

Here is another presentation by google that provides a good understanding of crawling and how search engines work ... http://www.google.com/insidesearch/h...-indexing.html

__________________
Search Engine Guide - Small Business Guide to Search Marketing
Small Business Brief - Small Business Ideas Forum, Articles & News
Logan is offline   Reply With Quote
Old 9th May 2013, 06:56 AM   #6
badloy1135
Member
 

Join Date: May 2013
Location: Ozamis City
Posts: 2
Default Re: what is Page Crawling?

thanks a lot @Logan for the link... It will really help me a lot..

badloy1135 is offline   Reply With Quote
Old 10th May 2013, 12:08 AM   #7
panthervision23
VIP Contributor
 

Join Date: Mar 2013
Posts: 516
Default

Search engines use crawlers to record and index your webpages to their respective SERP categories.

panthervision23 is offline   Reply With Quote
Old 10th May 2013, 01:09 AM   #8
robinmark
Member
 

Join Date: Apr 2013
Posts: 86
Default

Quote:
Originally Posted by revenue4u View Post
When you create a new site or page it is not listed on any search engines (SE's) yet. You should then create and submit a sitemap to notify the SE's about your new site or page. The SE's have robots that will then be scheduled to visit and inventory your new stuff. The inventory process is often referred to as "crawling" as in: The Googlebot crawled my site today.
Agree with this the googlebot crawled your site or page in scheduled visit.

robinmark is offline   Reply With Quote
Old 27th May 2013, 06:24 AM   #9
guptaabhijit318
Member
 

Join Date: Dec 2012
Posts: 57
Default

Crawling is the process of an engine requesting and effectively downloading a unique URL.

guptaabhijit318 is offline   Reply With Quote
Old 27th May 2013, 07:01 AM   #10
binarynpixel
Banned
 

Join Date: Apr 2013
Location: Sydney
Posts: 36
Default

Page crawling a process to indexing website url be search engine bot, and store it on search engine's database.

binarynpixel is offline   Reply With Quote
Reply   

Bookmarks


Similar Threads
Thread Thread Starter Forum Replies Last Post
Foolproof & Sure-Fire Way To Rank First Page In Google Jaime M. Search Engine Optimization 9 26th January 2016 04:43 PM
The Success Of Your E-commerce Web Design Depends On The Product Page acwebguru Website Development 2 13th May 2013 09:30 AM
Facebook Profile Or Page For Business? KirkEisele Social Media 30 15th November 2012 09:58 AM
How To Increase Page Rank Of Website! seowebtech Search Engine Optimization 40 25th February 2010 11:47 PM
Tips on Getting Inbound Links niceguy Link Development 32 23rd May 2007 11:08 AM



Thread Tools

Get Updates
RSS Feeds:
RSS Feed for Search Engine Optimization RSS for this Category Only: Search Engine Optimization

RSS Feed for Small Business Ideas Forum RSS for Entire Forum
Forum Rules


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


Small Business Ideas Forum


 
At Your Business - Small Business Directory
Free Business Forms - Prewritten Documents
 
Search Engine Guide
Small business guide to search marketing

 
Small Business Brief
Fetching the Best Small Business Info


Free Links - Free Advertising
Free Guide - Online Directory



Advertise your business here
Contact us for more details!


Semantic Juice
Register now to access free Quick SEO service!


Rocket Lawyer
Sign up for free 7 day trial. Boost your biz!


Buy UPC Codes
Get your products listed online!




All times are GMT -5. The time now is 06:13 AM.


Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
Copyright 2004 - 2018 - Privacy