PDA

View Full Version : Robots.txt not working?



raheel
03-04-2016, 06:29 AM
Its found 404 Error. Please help to solved out this problem.

rahul3214
04-08-2016, 01:19 AM
First put a text file and put these lines
User-agent : *
Disallow: /
then save it by name "robots.txt"
Now type www.yourdomain.com/robots.txt
and see the result

RH-Calvin
04-12-2016, 01:31 AM
Robots.txt is a text file inserted into a website to contain instructions for search engine robots. The file lists webpages that are allowed and disallowed from search engine crawling.

smitharetha
04-14-2016, 11:29 PM
Robots.txt is a text file inserted into a website to contain instructions for search engine robots. The file lists webpages that are allowed and disallowed from search engine crawling.

My opinion is the same you.

seomarqetrix
04-16-2016, 09:13 AM
Yes, I agree with you.rahul3214

Alpha Men
04-16-2016, 11:24 AM
There are many reasons to get 404 error! So u must tell more detail.

ragulaussie
04-18-2016, 02:17 AM
Nice information