Results 1 to 7 of 7
  1. #1
    Senior Member
    Join Date
    Sep 2017
    Location
    New york
    Posts
    117

    Which is better Robots.txt or Meta Robots Tag?

    Hlo Friends,
    Which is better Robots.txt or Meta Robots Tag?

  2. #2
    Senior Member
    Join Date
    Mar 2017
    Posts
    422
    It depends on what you want to do. There are many meta robots tags that can help you for a different purpose. But if you make restitution to the SE spiders to do not crawl your webiste so robots.txt file is better.

  3. #3
    Registered User
    Join Date
    Aug 2016
    Posts
    182
    Robot.txt is good to block a specific category/folder
    Robot Meta is good to block a individual page

  4. #4
    Registered User
    Join Date
    Nov 2013
    Posts
    905
    I think Robots.txt is better.

  5. #5
    Registered User
    Join Date
    Aug 2017
    Posts
    31
    Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.

  6. #6
    Senior Member
    Join Date
    Jun 2013
    Location
    Forum
    Posts
    5,019
    Robots.txt is better compared to meta robots tag. Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
    Cheap VPS | $1 VPS Hosting
    Windows VPS Hosting | Windows with Remote Desktop
    Cheap Dedicated Server | Free IPMI Setup

  7. #7
    Registered User 24x7servermanag's Avatar
    Join Date
    Jul 2017
    Location
    India
    Posts
    1,020
    Robot.txt is always best. Can you please refer this post for the same answer - http://forums.hostsearch.com/showthr...or-meta-robots ?

    Hope this will help you.
    Server Management Company
    India's Leading Managed Service Provider | Skype: techs24x7
    Cpanel Technical Discussions - Lets talk !

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

  Find Web Hosting      
  Shared Web Hosting UNIX & Linux Web Hosting Windows Web Hosting Adult Web Hosting
  ASP ASP.NET Web Hosting Reseller Web Hosting VPS Web Hosting Managed Web Hosting
  Cloud Web Hosting Dedicated Server E-commerce Web Hosting Cheap Web Hosting


Premium Partners:


Visit forums.thewebhostbiz.com: to discuss the web hosting business, buy and sell websites and domain names, and discuss current web hosting tools and software.