PDA

View Full Version : Crawling process



alvinbert
07-21-2011, 09:30 AM
By using software a website is crawled called a spider in the case of Google. During this the crawler will looks for links to different pages from that website and look at the text on a website. The spider can crawl webpages more then one before they gets indexed and the spider will start from URLs found on previous indexed pages. A web crawler does not visit every page daily as this would be not needed when some pages have been never change and the crawler visit pages with frequent changes.

kathrinefernand
07-21-2011, 05:54 PM
You have a very perfect knowledge dear...
will you tell me simply that how i make my site crawling fast??

mesasa
07-23-2011, 10:26 AM
In Simple Wording It is the process through which google index your site and hence show when somebody search for your site or related keyword.