What is the limit of a robot.txt file?

[ruhikhan]

Hello friends,

I Want to Know that What is the limit of a robot.txt file?

[mihirthakur]

there's no limit for robots.txt

[MVMInfotech]

Googlebot will only read the first 500kb. If your robots.txt is longer, it can result in a line being truncated in an unwanted way. The simple solution is to limit your robots.txt files to a reasonable size.

[yuva12]

Your robots.txt file must be smaller than 500KB

[RH-Calvin]

A maximum file size may be enforced per crawler. Content which is after the maximum file size may be ignored. Google currently enforces a size limit of 500kb.

[saralee123]

Google has apply the siz limit to robot.txt file with filesize 500kb .Content after the 500kb may be ignored.

[milinmaru]

Google has a limit of only being able to process up to 500KB of your robots.txt file.

[amarnathsmm]

You cannot make search engine ignore separate directories which have private files.