Hi I was wondering do the robot.txt files cause problems or are they search engine friendly?

x-2o

You actually use the robots.txt file to tell the search enigens what to do on your site.

http://www.searchengineworld.com/rob...s_tutorial.htm

Christoph

robots.txt actually allows hackers to know the directories your hiding from them.

so its a security issue too. just keep that in mind.

In my opinion avoid robots.txt unless your hiding something and then its worth using .htaccess to protect it.

I've decided to not use one now thanks for the info.

x-2o

I thought robots.txt was used to tell search engines what not to index. It is not meant to hide anything from the web, but hide the directories and files from search engine. Therefore it not a security issue. Just as html tells the browser what to display, so does the robots.txt tell the search engine what to display. Using robots.txt to hide directories and files you don't want anyone to have access to would be like putting HTML comments into your pages to hide some information you don't want other to see, but with both all people have to do is put forth a little effort and lookup the robots.txt file or the HTML source.

Gewthen
http://www.whedimer.com