PDA

View Full Version : Crawling and indexing



JackITo
04-19-2012, 01:57 AM
What is the crawling and what is indexing?What is the difference between crawling and indexing?

CS Cart Customization (http://www.hitechito.com/technology/open-source-technologies/cs-cart-development.php) | Zen Cart Customization (http://www.hitechito.com/technology/open-source-technologies/zencart-development.php) | Magento Customization (http://www.hitechito.com/technology/open-source-technologies/magento-development.php)

riya189
04-19-2012, 02:39 AM
Crawling- Google sends its spiders to your website..

Indexing- Google visited your website and has added you to its database..

rohitash2
04-19-2012, 02:46 AM
When any website is published or hosted and when Google spider update their database for the listing of that website then it is indexing and after that these spider continuously update their database at regular time interval then it is called Crawling.

watson123
04-19-2012, 06:43 AM
Crawling means sucking content without processing the results. Crawlers are rather dumb processes that fetch content supplied by Web servers answering (HTTP) requests of requested URIs, delivering those contents to other processes, e.g. crawling caches or directly to indexers. Crawlers get their URIs from a crawling engine that’s feeded from different sources, including links extracted from previously crawled Web documents, URI submissions, foreign Web indexes, and whatnot.

Indexing means making sense out of the retrieved contents, storing the processing results in a (more or less complex) document index. Link analysis is a way to measure URI importance, popularity, trustworthiness and so on. Link analysis is often just a helper within the indexing process, sometimes the end in itself, but traditionally a task of the indexer, not the crawler (high sophisticated crawling engines do use link data to steer the

Labexpress
04-19-2012, 06:49 AM
Crawling means sucking content without processing the results. Crawlers are rather dumb processes that fetch content supplied by Web servers answering (HTTP) requests of requested URIs, delivering those contents to other processes, e.g. crawling caches or directly to indexers. Crawlers get their URIs from a crawling engine that’s feeded from different sources, including links extracted from previously crawled Web documents, URI submissions, foreign Web indexes, and whatnot.

Indexing means making sense out of the retrieved contents, storing the processing results in a (more or less complex) document index. Link analysis is a way to measure URI importance, popularity, trustworthiness and so on. Link analysis is often just a helper within the indexing process, sometimes the end in itself, but traditionally a task of the indexer, not the crawler (high sophisticated crawling engines do use link data to steer the

Very useful information and clearly defines about terms.Thanks

AllenSantiago
04-19-2012, 08:48 AM
Crawling is defined as discover new or updated web page and this searching information of your website is called crawling whereas indexing means saving of new web pages in the search engine database that is called indexing.

virtueinfo11
04-20-2012, 09:27 AM
before crawling your website, if there is no any robots.txt or sitemap.xml file on your website, does search engine crawl your website or it need both file?

titleseo
04-21-2012, 12:44 AM
The crawling the the term innovated by search engines. It is a process which is undertaken by the automated system of search engine to find out the best website for search result. and the indexing defines the website registration on the search engine. You have to submit your website on search engine for getting listed on the search result. Both are connected with each other. Without crawling your website never get index on search engine like google and yahoo.

alexisrois
04-21-2012, 01:55 AM
The search engines crawls your site and then indexes what it recognizes as a cached version of the web page. The web page may modify in design before they crawl and then re-index the new web page hence the term cache is used as almost a warning to say that the site may have modified since they crawled it.

johnwilson639
04-21-2012, 02:20 AM
When we make a new websites then google index this site in their database is called a indexing.and after that crawler regularly update this pages called crawling.

ebriks
04-21-2012, 02:22 AM
Indexing and Crawling both are different terms. Crwaling means when search engine crawler comes or visit your website and indexing performs when search engine bot or crawler comes to the webpage and saved it in the search database.

ChrisDevlin
04-21-2012, 02:45 AM
Search engine bots will visits your website and crawl your website datas and store in their database. Then your website will be indexed in all search engines.

alexisrois
04-27-2012, 06:32 AM
In simple words, when search engine crawlers visit your link that is known as crawling and when search engine crawlers save that links in search engine database is known as indexing.