Hlo Friends,
Which is better Robots.txt or Meta Robots Tag?
Hlo Friends,
Which is better Robots.txt or Meta Robots Tag?
It depends on what you want to do. There are many meta robots tags that can help you for a different purpose. But if you make restitution to the SE spiders to do not crawl your webiste so robots.txt file is better.
Robot.txt is good to block a specific category/folder
Robot Meta is good to block a individual page
I think Robots.txt is better.
Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
Robots.txt is better compared to meta robots tag. Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
█ Cheap VPS | $1 VPS Hosting
█ Windows VPS Hosting | Windows with Remote Desktop
█ Cheap Dedicated Server | Free IPMI Setup
Robot.txt is always best. Can you please refer this post for the same answer - http://forums.hostsearch.com/showthr...or-meta-robots ?
Hope this will help you.
Server Management Company
India's Leading Managed Service Provider | Skype: techs24x7
Cpanel Technical Discussions - Lets talk !
|
Bookmarks