16 May
2008
16 May
'08
11:58 a.m.
My preference for distributing large trees of files
is
rsync, since it's designed for that, and it lets you efficiently
update an existing local copy with as little data transferred as
possible -- which is great for things like Bitsavers that are
constantly being added to.
Which is working quite well..
so it certainly sounds like a worthwhile project to
me. "Voltsavers"
The issue isn't who hosts it, but the bandwidth issues. There are hundreds
of data books, and they are running about 100mb each when scanned. It is
impractical for me to burst them into smaller chunks due to the time it
would take to do it. I've had little luck getting people to work on
postprocessing the scans in the past. Currently, about 1/3 of everything I
have scanned is on bitsavers.
It takes about a week to process what I can scan in a day.
On an average scanning day I can scan 5-10 thousand pages.
I've been scanning now for over 9 years (obviously, not every day)..
Because of the thinness of the paper used, a box of data books is over
10k pages.
This should give you an idea of the magnitude of work involved in scanning
a large databook collection..