PDA

View Full Version : robots.txt



delpino
01-22-2004, 04:04 PM
Hello there,

I have urls like this:

www.freizeitagentur.de/show_user.php?nickname=user1
www.freizeitagentur.de/show_user.php?nickname=user2


I tried to block it with robots.txt:

Disallow: /show_user.php

This doesn't really work. (because every url is unique?) Any other solutions?

Chris
01-22-2004, 06:21 PM
put show_user.php in a directory and then block the directory.

Or, have show_user.php echo out a robots meta tag.

delpino
01-23-2004, 02:13 AM
Thanks for your help, Chris.

The first solution requires quite a lot of changes to the script.

The second will still cause a lot of traffic.

I think robots.txt is flexible enough at the moment.