9 Apr
2011
9 Apr
'11
6:10 a.m.
Last weekend I promised to enable rsync access to the archives
(and mirrors) here.
I've set up the following rsync (no password required) archive sets here:
ftp : Public rsync access to ftp://ftp.trailing-edge.com/ area
pdp-10-tape-images : public rsync access to the PDP-10 tape images,
i.e. http://pdp-10.trailing-edge.com/
bitsavers-mirror : public rsync access to my local bitsavers mirror,
i.e. http://bitsavers.trailing-edge.com/
Suggested rsync commands would be, for example:
mkdir ./pdp-10-tape-images
rsync -rlptu -v www.trailing-edge.com::pdp-10-tape-images ./pdp-10-tape-images
mkdir ./ftp.trailing-edge.com
rsync -rlptu -v www.trailing-edge.com::ftp ./ftp.trailing-edge.com
mkdir ./bitsavers-mirror
rsync -rlptu -v www.trailing-edge.com::bitsavers-mirror ./bitsavers-mirror
Realistically the pdp-10-tape-images and ftp sites don't change often,
butm my bitsavers mirror is kept up to date.
I like to think my outgoing bandwidth (20 Mbit) is pretty much infinite,
this looks like a good way to find out :-)
ftp racks up to 3.5 Gbytes. PDP-10 tapes racks up to 2.2 Gbytes. And
bitsavers-mirror racks up to 126 Gbytes.
Tim.
14 Sep
14 Sep
1:27 a.m.
Tim,
are your mirrors still open?
I am going to try to retrieve bitsavers again. I had my mirror here at
home go away, and am going to try to recover it again from your site if
that is possible.
I think I tried a few weeks ago and got an error, and didn't think
anything of it, but I want to try again now that I have fixed some issues.
thanks
Jim
On 4/9/2011 6:10 AM, Tim Shoppa wrote:
Last weekend I promised to enable rsync access to the
archives
(and mirrors) here.
I've set up the following rsync (no password required) archive sets here:
ftp : Public rsync access to ftp://ftp.trailing-edge.com/ area
pdp-10-tape-images : public rsync access to the PDP-10 tape images,
i.e. http://pdp-10.trailing-edge.com/
bitsavers-mirror : public rsync access to my local bitsavers mirror,
i.e. http://bitsavers.trailing-edge.com/
Suggested rsync commands would be, for example:
mkdir ./pdp-10-tape-images
rsync -rlptu -v www.trailing-edge.com::pdp-10-tape-images ./pdp-10-tape-images
mkdir ./ftp.trailing-edge.com
rsync -rlptu -v www.trailing-edge.com::ftp ./ftp.trailing-edge.com
mkdir ./bitsavers-mirror
rsync -rlptu -v www.trailing-edge.com::bitsavers-mirror ./bitsavers-mirror
Realistically the pdp-10-tape-images and ftp sites don't change often,
butm my bitsavers mirror is kept up to date.
I like to think my outgoing bandwidth (20 Mbit) is pretty much infinite,
this looks like a good way to find out :-)
ftp racks up to 3.5 Gbytes. PDP-10 tapes racks up to 2.2 Gbytes. And
bitsavers-mirror racks up to 126 Gbytes.
Tim.
15 Sep
15 Sep
6:46 p.m.
I took a couple of shots at doing the rsync operation on bitsavers and
didn't come up with an incantation that works.
Here is what I finally figured out
rsync -rlptu -v rsync://bitsavers.org/bitsavers ./bitsavers
however this wants a password.
You were correct about Tim's connection it seemed to go into a verizon
connection which might be a home, not sure. It went quickly for a while
then taped off.
Let me know if it is okay to copy or how to use the classiccmp
connection rather than tim's
Thanks
Jim
On 9/14/2011 11:32 AM, Al Kossow wrote:
On 9/14/11 1:27 AM, jim s wrote:
Tim,
are your mirrors still open?
I am going to try to retrieve bitsavers again.
I suspect the bandwidth from bitsavers is better than from tim.
19 Sep
19 Sep
8:23 p.m.
On 09/14/2011 02:32 PM, Al Kossow wrote:
Is it kosher to rsync (big) sections of the archive from you? I.e.,
it won't piss you off? ;) How big is the whole shebang these days?
-Dave
--
Dave McGuire
Port Charlotte, FL
I am going to
try to retrieve bitsavers again.
I suspect the bandwidth from bitsavers is better than from tim. 
20 Sep
20 Sep
2:04 a.m.
Dave McGuire <mcguire at neurotica.com> writes:
Is it kosher to rsync (big) sections of the archive
from you? I.e.,
it won't piss you off? ;)
If that's a problem, you're welcome to rsync as much as you like from
our bitsavers mirror:
rsync://rsync.mirrorservice.org/sites/www.bitsavers.org/
... then do a final sync off the master to catch up.
(It probably won't be very fast; mirrorservice.org has loads of
bandwidth, but it's also very busy, and probably not located near
you...)
How big is the whole shebang these days?
Our mirror's 127 gig at the moment.
--
Adam Sampson <ats at offog.org> <http://offog.org/>
8:21 a.m.
On 9/19/11 8:23 PM, Dave McGuire wrote:
Is it kosher to rsync (big) sections of the archive
from you? I.e., it won't piss you off? ;) How big is the whole shebang these days?
The issue is I don't control who has access to rsync on bitsavers.
It's probably easier to set up an rsync with a mirror site.
There is nothing of significance hidden from http, and there is no dynamic content, so
doing a wget
from http://bitsavers.org gets you essentially the same
thing as an rsync.
It is currently around 130gb.
9:35 a.m.
On 9/20/11 8:55 AM, Chuck Guzis wrote:
On 20 Sep 2011 at 8:21, Al Kossow wrote:
Limiting factor is postprocessing and OCR time.
I just checked, and there are over 10000 documents scanned for
bitsavers but not processed.
And bitsavers is one of two archives I'm currently working on.
There are 14000 documents in the other one, which was started
about two years ago for internal CHM use.
here is the rate of growth of bitsavers since 2006
gb #pdfs
20060523 52 9328
20060728 9406
20061224 10287
20070214 10690
20070421 11082
20070911 12183
20071122 74 12386
20080321 88 14496
20091108 104 14987
20100122 105
20110401 19450
20110920 127 20615
It is currently around 130gb.
So you'd need to expand, what, 20-30 times to fill an inexpensive
consumer-level hard drive? :)
10:11 a.m.
On 20 Sep 2011 at 9:35, Al Kossow wrote:
here is the rate of growth of bitsavers since 2006...
Joking aside, Al, what you and the other folks at CHM is incredibly
valuable from a historic sense.
I've long thought that the paper is far more important in that
respect than the iron. The paper gives you a glimpse of what was in
the designer's mind, which would be otherwise very difficult to
discern from boards full of components.
And stuff is still vanishing. Yesterday, one of the posters from
Erik's VC forum was looking for a driver from Orchid, which was
acquired by Micronics and hosted on its ftp, which has vanished. The
Wayback machine was no help.
--Chuck
10:38 a.m.
You can poke websites at archive.org to crawl. It won't help if the
site has robots set to deflect archiving, but sometime it misses all of
a site because the front porch is marked closed. I have entered all of
my sites for crawling. I don't know how good it does archiving content
though. It seems to get images, but not sure about binaries of various
types. I've seen a very few binaries, so they do save some.
It may be a function of how hard you poke at it.
Jim
On 9/20/2011 10:11 AM, Chuck Guzis wrote:
Orchid, which was
acquired by Micronics and hosted on its ftp, which has vanished. The
Wayback machine was no help.
11:03 a.m.
On 20 Sep 2011 at 10:38, jim s wrote:
You can poke websites at archive.org to crawl. It
won't help if the
site has robots set to deflect archiving, but sometime it misses all
of a site because the front porch is marked closed. I have entered
all of my sites for crawling. I don't know how good it does archiving
content though. It seems to get images, but not sure about binaries
of various types. I've seen a very few binaries, so they do save
some.
Nope, Micronics has ROBOTS.TXT.
I've never found archive.org to be of much use when looking for
defunct ftp material.
Am I missing something?
--Chuck
11:41 a.m.
----- Original Message -----
From: "Chuck Guzis" <cclist at sydex.com>
To: "General Discussion: On-Topic and Off-Topic Posts"
<cctalk at classiccmp.org>
Sent: Tuesday, September 20, 2011 2:03 PM
Subject: Re: New rsync mirroring at trailing-edge.com
Nope, Micronics has ROBOTS.TXT.
I've never found archive.org to be of much use when looking for
defunct ftp material.
Am I missing something?
--Chuck
You can figure out the filenames sometimes using archive.org and then do an
FTP search to find that file. Sometimes the files are on some university FTP
in Asia that doesn't bother deleting old stuff.
12:58 p.m.
On 20 Sep 2011 at 14:41, TeoZ wrote:
You can figure out the filenames sometimes using
archive.org and then
do an FTP search to find that file. Sometimes the files are on some
university FTP in Asia that doesn't bother deleting old stuff.
Did that--the filename (IIRC) is REUTL21.EXE. Tried about 5 ftp
searching sites. Nothing; even for REUTL*
--Chuck
2:14 p.m.
----- Original Message -----
From: "Chuck Guzis" <cclist at sydex.com>
To: "General Discussion: On-Topic and Off-Topic Posts"
<cctalk at classiccmp.org>
Sent: Tuesday, September 20, 2011 3:58 PM
Subject: Re: New rsync mirroring at trailing-edge.com
On 20 Sep 2011 at 14:41, TeoZ wrote:
Orchid Ramquest drivers?
You can figure out the filenames sometimes using
archive.org and then
do an FTP search to find that file. Sometimes the files are on some
university FTP in Asia that doesn't bother deleting old stuff.
Did that--the filename (IIRC) is REUTL21.EXE. Tried about 5 ftp
searching sites. Nothing; even for REUTL*
--Chuck
3:02 p.m.
----- Original Message -----
From: "Chuck Guzis" <cclist at sydex.com>
To: "General Discussion: On-Topic and Off-Topic Posts"
<cctalk at classiccmp.org>
Sent: Tuesday, September 20, 2011 5:33 PM
Subject: Re: New rsync mirroring at trailing-edge.com
On 20 Sep 2011 at 17:14, TeoZ wrote:
The ISA version needs to configure the card (which is what the ADF file does
on the MCA bus) after that you need the correct memory manager I assume.
Guess I should go and look for what I am using on my Model 60 (not sure
which cards are installed).
Orchid Ramquest drivers?
Specifically, the MCA version of the Ramquest, which appears to be
very different from the ISA version.
--Chuck
4842
days inactive
5006
days old
18 comments
7 participants
participants (7)
-
aek＠bitsavers.org -
ats＠offog.org -
cclist＠sydex.com -
jws＠jwsss.com -
mcguire＠neurotica.com -
shoppa＠trailing-edge.com -
teoz＠neo.rr.com