View Full Version : Which is better — Meta Robot tags or robots.txt?
tony_S
02-13-2019, 05:48 AM
Which is better — Meta Robot tags or robots.txt?
bradvictor1
02-13-2019, 07:08 AM
I think you should need to go with Robots.txt file, because it can compatibly with every server, there few chances like in other servers Meta robots code don't work.
thaichacha
02-13-2019, 11:23 PM
robots.txt file is a publicly available file. Anyone can see what sections of your server you don't want robots to use. Meta tags are used to dis allow a single page from crawling. Meta Robots tag is much better as it helps in forcing the search engine crawlers not to index and display the hidden pages in your server.
Powered by vBulletin® Version 4.2.4 Copyright © 2024 vBulletin Solutions, Inc. All rights reserved.