16 Jul
2008
16 Jul
'08
11:21 p.m.
Sean Conner wrote:
And on the page you want people to hit first, add
the following to
the <HEAD> section:
<meta name="robots" content="index,nofollow">
That means (to the search engines that respect it, like Google) to
index
the contents of the page, but not to follow any links (like, to the
individual files).
Doesn't that mean that the Internete Archive (aka wayback) won't make
copies of stuff?
This has turned out to be pretty useful in recovering "vanished" stuff
before now!
Antonio