View Full Version : What are Spiders, Robots and Crawlers and what are their functions?
oorjaclinic
03-20-2017, 03:49 AM
What are Spiders, Robots and Crawlers and what are their functions?
Spiders, Robots and Crawlers all are same these are automated software programme search engine use to stay up to date with web activities and finding new.
RH-Calvin
03-20-2017, 12:19 PM
They are all the same and are different names of a search engine automated program that is responsible to read through webpage source and provide information to search engines. They are helpful to crawl and index webpages in search engines.
zorbee
03-20-2017, 03:33 PM
Spiders, Robots and Crawlers all are same these are software programme search engine use to crawl index every web page on the internet.
sharmaroshni
03-21-2017, 03:26 AM
Spiders, Robots, and Crawlers all are same these are automated software program search engine use to stay up to date with web activities and finding new links and information to index in their database. Search engines need to keep their database updated so they created some automated programs which go from site to site and find the new data for search engine also collects the information about the webpage what is the page all about.
All the three programs Spiders, Robots, and crawlers are same and do similar work we call them with different names these are only service tools for the search engine which helps to find and index new web links in search engine correctly.
Search engine robots or crawlers works is to find new links for search engine and index them in search engine database. When you submit a new website or link in webmaster or search console it is kept in queue till the time robots visit the web page and verify its content.
Powered by vBulletin® Version 4.2.4 Copyright © 2025 vBulletin Solutions, Inc. All rights reserved.