PDA

View Full Version : Which is better Robots.text or Meta Robots Tag?



crackersguru
08-21-2017, 01:10 AM
Which is better Robots.text or Meta Robots Tag?

daikaads
08-21-2017, 02:34 AM
I prefer Meta Robots Tag as it is easier to implement on the website and to block the search engines.

checkifsccode
08-21-2017, 02:45 AM
Robots meta tag gives option that crawl or not crawl specific page.It also informs about do-follow and no-follow links on the web page.whereas robots.txt is a list of a directories which mainly used for restriction about crawling of a specific web pages.so both used for different purposes and not better than each other.

RH-Calvin
08-21-2017, 07:20 AM
Robots.txt file is better compared to meta robots tag. Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.

Ranjith tenny
08-21-2017, 08:50 AM
Meta tag can be used to disallow a single page. ... There is the very huge difference between meta robot and robots.txt. In robots.txt, we ask crawlers which page you have to crawl and which one you have to exclude but we don't ask crawler to not to index those excluded pages from crawling.

deepakrajput
08-21-2017, 10:52 PM
Robots.txt is much better than others.

Nas
08-22-2017, 12:20 AM
Robots.txt is an actual text file, whereas meta robot tags are meta directives. Robots.txt dictates site or directory-wide crawl behavior, whereas meta robots can dictate indexation behavior at the individual page (or page element) level.

seojesica
08-22-2017, 01:19 AM
Robots.txt file is very important, but you can use both, because both have own importance.

Fadia Sheetal
08-22-2017, 01:26 AM
Robots.txt is batter than meta robots tag. Search engine following the robots.txt

oneyestech
08-22-2017, 04:24 AM
Robots.txt file is very important, but you can use both, because both have own importance.

Yes, Why can't we use the both methods because they both do the same work ..

jonny deep
08-22-2017, 04:56 AM
Often the robots.txt file located at the root of the domain name is the ideal tool for communicating with search engines (Robots with Google, Yahoo and Microsofts) in indexing websites. However, in some cases, the /robots.txt file becomes limited and its use is very cumbersome. Heavy META "robots" at the moment are useful even when using it. Quite different from robots.txt file

ecartproduct
08-22-2017, 05:28 AM
Robots' meta tag is important

Robots.txt file is a text file for restricting bots (robots, search engine crawlers ) from a website or certain pages on the website. Using a robots.txt file and with a disallow direction, we can restrict bots or search engine crawling program from websites and or from certain folders and files.

A robots meta tag is used to give direction for robots or the spiders regarding crawling and indexing of particular page. By using a robots meta tag which requests bots to avoid crawling and indexing, that page can be avoided from crawling by search engine bots or robots and avoid indexing in search results. A request name “follow” or “nofollow” is used in robots meta tags provided in the head section of a webpage to consider or not consider the counting of links provided on the page. Not adding a robots meta tag will be considered as the default direction such as index, follow.

Nirala
08-22-2017, 06:42 AM
Use robots.txt file, use meta robots when the robots.txt file does not work properly because meta robots hurt sites sometimes.
If you use the robots.txt file then you can block different directories or pages with one file, if you use meta robots you have to add it on every page where you want to be and indirectly it makes your code lengthy.

SKN
08-24-2017, 08:03 AM
robots.txt file is better and easy to use.

anirban09P
10-11-2017, 11:55 PM
There is a very huge difference between

Robots.txt: we ask crawlers which page you have to crawl

Meta Tag: which one you have to exclude but we don't ask crawler to not to index those excluded pages from crawling.

leena13
10-12-2017, 01:25 AM
Thanks for giving this useful information on here. thanks for sharing.

Prateektechnoso
10-26-2017, 09:24 AM
Robots.txt is the best way to maintain the Website to Crawl and Index Pages in Search Engine Result Page. We can control everything in this single page. So best is Robots.txt file format in SEO.


For your information :

Prateektechnosoft is a Netsuite Partner and expertise in NetSuite ERP, CRM, Cloud CRM, TribeHR, PSA and other Netsuite Solutions. And also providing Netsuite services of implementation, integration, support & development services.