5 Feb
2002
5 Feb
'02
7:03 a.m.
Lawrence LeMay wrote:
Somewhat out of question, but does anyone know of any software that
would download a web site, or a portion, to a local disk? IE, I
would want to be able to archive part of a web site onto a CDrom,
without having to manually save every image and web page, and
manually edit the html links, etc.
I would ask you to make sure that bulk downloading of someone else's
site is allowed before attempting this. Some people's websites are on
restricted bandwidth (David Gesswein's pdp8.net springs to mind), or
there may be other reasons why the owner requests that people do not do
this. The prohibition may not be in plain text -- there may be a file
called robots.txt which records the names of agents and areas of the
website that are out of bounds to robots. wget respects these
restrictions (unless hacked), but there are agents that do not.
Secondly, this is for your own use, right? I ask as someone who has had
their site downloaded and distributed to a third party to put on their
site!
- Paul