PDA

View Full Version : What? If Robot.txt blocked?



seo.gops
02-22-2022, 08:58 PM
Anyone explains to me What? If Robot.txt tester blocked a website or webpage?

SKPTitleLLC
02-23-2022, 01:40 AM
If your web page is blocked with a robots. txt file, its URL can still appear in search results, but the search result will not have a description. Image files, video files, PDFs, and other non-HTML files will be excluded.

catholic
02-23-2022, 02:07 AM
In this blocked robots.txt case URL can still appear in search engine results, but the search result will not have a description. Image files, video files, PDFs, and other non-HTML files will be excluded. If you see this search result for your page and want to fix it, remove the robots.

laragiles
02-23-2022, 02:18 AM
'Indexed, though blocked by robots. txt' indicates that Google has found your page, but has also found an instruction to ignore it in your robots file