Results 1 to 13 of 13
  1. #1
    Registered User JackITo's Avatar
    Join Date
    Apr 2012
    Posts
    77

    Crawling and indexing

    What is the crawling and what is indexing?What is the difference between crawling and indexing?

    CS Cart Customization | Zen Cart Customization | Magento Customization

  2. #2
    Senior Member
    Join Date
    Dec 2010
    Location
    India
    Posts
    82
    Crawling- Google sends its spiders to your website..

    Indexing- Google visited your website and has added you to its database..

  3. #3
    Registered User
    Join Date
    Mar 2012
    Posts
    34
    When any website is published or hosted and when Google spider update their database for the listing of that website then it is indexing and after that these spider continuously update their database at regular time interval then it is called Crawling.

  4. #4
    Registered User
    Join Date
    Apr 2012
    Posts
    453
    Crawling means sucking content without processing the results. Crawlers are rather dumb processes that fetch content supplied by Web servers answering (HTTP) requests of requested URIs, delivering those contents to other processes, e.g. crawling caches or directly to indexers. Crawlers get their URIs from a crawling engine that’s feeded from different sources, including links extracted from previously crawled Web documents, URI submissions, foreign Web indexes, and whatnot.

    Indexing means making sense out of the retrieved contents, storing the processing results in a (more or less complex) document index. Link analysis is a way to measure URI importance, popularity, trustworthiness and so on. Link analysis is often just a helper within the indexing process, sometimes the end in itself, but traditionally a task of the indexer, not the crawler (high sophisticated crawling engines do use link data to steer the

  5. #5
    Registered User
    Join Date
    Mar 2012
    Posts
    80
    Quote Originally Posted by watson123 View Post
    Crawling means sucking content without processing the results. Crawlers are rather dumb processes that fetch content supplied by Web servers answering (HTTP) requests of requested URIs, delivering those contents to other processes, e.g. crawling caches or directly to indexers. Crawlers get their URIs from a crawling engine that’s feeded from different sources, including links extracted from previously crawled Web documents, URI submissions, foreign Web indexes, and whatnot.

    Indexing means making sense out of the retrieved contents, storing the processing results in a (more or less complex) document index. Link analysis is a way to measure URI importance, popularity, trustworthiness and so on. Link analysis is often just a helper within the indexing process, sometimes the end in itself, but traditionally a task of the indexer, not the crawler (high sophisticated crawling engines do use link data to steer the
    Very useful information and clearly defines about terms.Thanks
    CHEMICALS "Two type" Are Most Important Part of Our Daily life , So be Careful While their Supplying .

  6. #6
    Senior Member
    Join Date
    Nov 2011
    Location
    USA
    Posts
    172
    Crawling is defined as discover new or updated web page and this searching information of your website is called crawling whereas indexing means saving of new web pages in the search engine database that is called indexing.
    Last edited by AllenSantiago; 09-12-2012 at 07:30 AM.

  7. #7
    Senior Member virtueinfo11's Avatar
    Join Date
    Sep 2011
    Location
    India
    Posts
    200
    before crawling your website, if there is no any robots.txt or sitemap.xml file on your website, does search engine crawl your website or it need both file?

  8. #8
    Junior Member
    Join Date
    Apr 2012
    Location
    USA
    Posts
    17
    The crawling the the term innovated by search engines. It is a process which is undertaken by the automated system of search engine to find out the best website for search result. and the indexing defines the website registration on the search engine. You have to submit your website on search engine for getting listed on the search result. Both are connected with each other. Without crawling your website never get index on search engine like google and yahoo.

  9. #9
    Registered User alexisrois's Avatar
    Join Date
    Jan 2012
    Posts
    24
    The search engines crawls your site and then indexes what it recognizes as a cached version of the web page. The web page may modify in design before they crawl and then re-index the new web page hence the term cache is used as almost a warning to say that the site may have modified since they crawled it.

  10. #10
    Member
    Join Date
    Apr 2012
    Posts
    54
    When we make a new websites then google index this site in their database is called a indexing.and after that crawler regularly update this pages called crawling.

  11. #11
    Junior Member
    Join Date
    Apr 2012
    Posts
    27
    Indexing and Crawling both are different terms. Crwaling means when search engine crawler comes or visit your website and indexing performs when search engine bot or crawler comes to the webpage and saved it in the search database.

  12. #12
    Registered User
    Join Date
    Feb 2012
    Location
    USA
    Posts
    129
    Search engine bots will visits your website and crawl your website datas and store in their database. Then your website will be indexed in all search engines.

  13. #13
    Registered User alexisrois's Avatar
    Join Date
    Jan 2012
    Posts
    24

    Re:

    In simple words, when search engine crawlers visit your link that is known as crawling and when search engine crawlers save that links in search engine database is known as indexing.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

  Find Web Hosting      
  Shared Web Hosting UNIX & Linux Web Hosting Windows Web Hosting Adult Web Hosting
  ASP ASP.NET Web Hosting Reseller Web Hosting VPS Web Hosting Managed Web Hosting
  Cloud Web Hosting Dedicated Server E-commerce Web Hosting Cheap Web Hosting


Premium Partners:


Visit forums.thewebhostbiz.com: to discuss the web hosting business, buy and sell websites and domain names, and discuss current web hosting tools and software.