What is the limit to robots.txt for SEO?

[sadianisar]

What is the limit to robots.txt for SEO?

[amanshastry43]

Didn't get your question please explain it thoroughly

[alpa]

The robots exclusion protocol (REP), or robots.txt is a text file webmasters create to instruct robots (typically search engine robots) on how to crawl & index.

[Rammadhur]

Robots.txt Files Must Be Smaller Than 500KB
Google's John Mueller reminds webmasters on his Google+ page that Google has a limit of only being able to process up to 500KB of your robots.txt file.
This is an important point, if you have a super heavy robots.txt file, and it is beyond 500KB, then GoogleBot can get confused. If GoogleBot gets confused with your robots.txt it can cause serious issues with your site's health in the Google results.

Robots.txt Specifications: http://bit.ly/2itop3g

[chiragpatel108]

Currently Search engine enforce a size of robot.txt file is 500 kb

[RH-Calvin]

Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.

[cracker]

The robots.txt file is one of the primary ways of telling a search engine where it can and can’t go on your website. All major search engines support the basic functionality it offers. There are some extra rules that are used by a few search engines which can be useful too. This guide covers all the uses of robots.txt for your website. While it looks deceivingly simple, making a mistake in your robots.txt can seriously harm you site, so make sure to read and understand this.

[david hong]

Robots.txt file is used to guide the search engine automatically to the page you want it to search for and then index the page. Most sites also have the directories and files do not need to search engine robots to visit. Thus creating a robots.txt file can help you in SEO.