Results 1 to 7 of 7
  1. #1
    Senior Member
    Join Date
    Aug 2015
    Location
    Dubai
    Posts
    512

    Robots.txt not working?

    Its found 404 Error. Please help to solved out this problem.

  2. #2
    Member
    Join Date
    Apr 2016
    Posts
    65
    First put a text file and put these lines
    User-agent : *
    Disallow: /
    then save it by name "robots.txt"
    Now type www.yourdomain.com/robots.txt
    and see the result

  3. #3
    Senior Member
    Join Date
    Jun 2013
    Location
    Forum
    Posts
    5,019
    Robots.txt is a text file inserted into a website to contain instructions for search engine robots. The file lists webpages that are allowed and disallowed from search engine crawling.
    Cheap VPS | $1 VPS Hosting
    Windows VPS Hosting | Windows with Remote Desktop
    Cheap Dedicated Server | Free IPMI Setup

  4. #4
    Quote Originally Posted by RH-Calvin View Post
    Robots.txt is a text file inserted into a website to contain instructions for search engine robots. The file lists webpages that are allowed and disallowed from search engine crawling.
    My opinion is the same you.

  5. #5

  6. #6
    Member
    Join Date
    Apr 2016
    Location
    Thailand
    Posts
    36
    There are many reasons to get 404 error! So u must tell more detail.
    Make money on instagram by Instaeasy Review
    My FB page: Mark Review

  7. #7

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

  Find Web Hosting      
  Shared Web Hosting UNIX & Linux Web Hosting Windows Web Hosting Adult Web Hosting
  ASP ASP.NET Web Hosting Reseller Web Hosting VPS Web Hosting Managed Web Hosting
  Cloud Web Hosting Dedicated Server E-commerce Web Hosting Cheap Web Hosting


Premium Partners:


Visit forums.thewebhostbiz.com: to discuss the web hosting business, buy and sell websites and domain names, and discuss current web hosting tools and software.