Results 1 to 3 of 3

Thread: Robot.txt error

  1. #1
    Senior Member
    Join Date
    May 2014
    Posts
    217

    Robot.txt error

    If Google bot does not access robot.txt file, what is problem and how can it be solved ?

  2. #2
    Registered User 24x7servermanag's Avatar
    Join Date
    Jul 2017
    Location
    India
    Posts
    1,020
    Please make sure you have uploaded it under the correct location in your web hosting panle. Robot.txt is used to crawl the pages website. It tells that which part of the area should not be accessed. We can define the pages which should not be accessed by putting the disallow tag in robot.txt. Those disallow pages are restricted to visit. It also help to index the web content.

    You can ask your web hosting provider to upload it under your control panel (root directory of the website) and webmaster will pick it automatically.

    If you have access then you can upload it from your end.

    If you are still facing any issue then please let me n=know what exact error are you getting.
    Server Management Company
    India's Leading Managed Service Provider | Skype: techs24x7
    Cpanel Technical Discussions - Lets talk !

  3. #3
    Registered User
    Join Date
    Nov 2017
    Location
    Delhi
    Posts
    23
    Robots.txt fetch error is actually a common type of error seen in Google Webmaster Tools section and most websites encounter this issue due to low quality web hosting.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

  Find Web Hosting      
  Shared Web Hosting UNIX & Linux Web Hosting Windows Web Hosting Adult Web Hosting
  ASP ASP.NET Web Hosting Reseller Web Hosting VPS Web Hosting Managed Web Hosting
  Cloud Web Hosting Dedicated Server E-commerce Web Hosting Cheap Web Hosting


Premium Partners:


Visit forums.thewebhostbiz.com: to discuss the web hosting business, buy and sell websites and domain names, and discuss current web hosting tools and software.