PDA

View Full Version : What is robots.txt?



ajay49560
10-12-2015, 05:29 AM
What is robots.txt?

Natalie Dormer
10-12-2015, 09:25 AM
Check this thread, this topic is already discussed
http://forums.hostsearch.com/showthread.php?83975-Robots-txt&highlight=ROBOT.TXT

salman gee
10-12-2015, 02:30 PM
Seo is keyword; as the keyword lead searchers to websites for which they search. It is also
Preferred To make many external links in your website refer to keyword, and it is considered
one of the Most important strategies for preparing website for search engine which is keyword.
What is Seo
Seo is meta tag; as the meta tag gives information about the content of your website's pages
To Search engine. Moreover,it is one of things that make your website appears in a better
Place In Search engine which is meta tag.
What is Seo
Seo is description; as the description should be a complete sentence, not separated
words.the description should describe the content of your website so that it can be really
useful, and every page should have its own description.
What is Seo
Seo is title; as the title is the main text that describes a page on internet. title is considered one
Of The most important elements of seo, after the general content of the page, and the title
Appears At the top of the browsers.
What is Seo
Seo is traffic; as the traffic is the amount of sent and received data from and to the website.In
Order To get high traffic for your website, you should get good content. You should also
Choose the Keyword well to get high traffic.
What is Seo
Seo is content; as the good content is a result of friendship with all search engines. the
content Should Also be of high quality, significance and target. In order to get quick archive
for your website, you Have to develop the content constantly.

RH-Calvin
10-13-2015, 02:40 AM
Robots.txt is a text file that helps to list webpages to instruct search engine crawlers. It lists pages that are allowed to crawl and disallow for search engine spiders.

Andrew Smith
10-13-2015, 02:57 AM
Robots .txt use for allow and disallow on website.

WellingtonSilva
10-13-2015, 08:28 AM
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots.

irfan
10-14-2015, 01:52 AM
The robots.txt is a text file Webmasters create to give instruction to web spider that how to crawl and index pages on their website.

seairexim
10-14-2015, 05:46 AM
Mate, you are going wrong way... the question is all about the robots.txt not about the "what is SEO?"

dennis123
10-21-2015, 03:00 AM
Robot.txt is a text file, it can edit and put in your website while nofollow is a meta tag. With Robots.txt, the search engine cannot crawl the page but with Nofollow meta tag, the page is still crawlable, but in search engine’s index, this page is not shown, and there will be no outgoing links from that page.