As so many search egines use "spiders" to find your page they sometime list thing you don't want them to!
For example; do you have any...
Personal infomation
Images
Testing pages
If any of your directories contain the things above you can stop search engines listing it by
using the a technique called "robots.txt".
1) Make a new file
2) Type...
User-agent: *
Disallow: /images/
Disallow: /testsite/
Disallow: /admin/topsecret.html
The example above disallows the directories "images", "testsite" and "topsecret" in the "admin"
directory from being listed by search engines.
3) Save as robots.txt
4) Upload to yourname.com N.B You have to have your own domain for this trick
So what if you don't have anything to disallow ?
Well then, just put the following.
User-agent: *
Disallow:
What if you don't want anything listed ?
User-agent: *
Disallow: /
This entire site is copyright Martin Kemp 1999 |