PDA

View Full Version : Robots.txt not working?



raheel
03-04-2016, 07:29 AM
Its found 404 Error. Please help to solved out this problem.

rahul3214
04-08-2016, 02:19 AM
First put a text file and put these lines
User-agent : *
Disallow: /
then save it by name "robots.txt"
Now type www.yourdomain.com/robots.txt
and see the result

RH-Calvin
04-12-2016, 02:31 AM
Robots.txt is a text file inserted into a website to contain instructions for search engine robots. The file lists webpages that are allowed and disallowed from search engine crawling.

smitharetha
04-15-2016, 12:29 AM
Robots.txt is a text file inserted into a website to contain instructions for search engine robots. The file lists webpages that are allowed and disallowed from search engine crawling.

My opinion is the same you.

seomarqetrix
04-16-2016, 10:13 AM
Yes, I agree with you.rahul3214

Alpha Men
04-16-2016, 12:24 PM
There are many reasons to get 404 error! So u must tell more detail.

ragulaussie
04-18-2016, 03:17 AM
Nice information