nilam-shah
10-27-2014, 01:27 AM
What are the different method to control the robot?
RH-Calvin
10-27-2014, 05:47 AM
Robot can be controlled using a Sitemap or a Robots.txt file for your website. A sitemap will helps robots to crawl your webpages frequently, while Robots.txt file will restrict and allow webpages listed from crawling.
Powered by vBulletin® Version 4.2.4 Copyright © 2024 vBulletin Solutions, Inc. All rights reserved.