Re: We must preserve the Cypherpunks Mailing List archives! IMPORTANT!

[Greg Newby <gbnewby AT pglaf.org>]

I will try to find a way to add these older items to the archives at https://lists.cpunks.org so it's findable there.  (I'm the guy who currently runs Mailman and the server there.) 

The .tar.bz2 file has 92,195 individual files.  I appended them all to a single file, which email clients can open as an mbox file.  But mailx reported 84519 messages, and mutt reported 84531.

I have temporarily put this combined file here, until I can add them to lists.cpunks.org somewhere under /var/lib/mailman:

All files concatenated as-is:
http://www.petascale.org/cypherpunks-1999-2015.mbox
md5sum:  2a4ed20b98411cfd18c69765b21c30d2  cypherpunks-1999-2015.mbox


Presumably the other ~7664 files have something that gives the email clients I tried indigestion.  So I appended a blank line to each file, and then ran "formail -ds" on each file.  Now mailx reports and mutt(neomutt) reports 96969 messages.

All files concatenated after being "fixed" as described:
http://www.petascale.org/cypherpunks-1999-2015-fixed.mbox
a08b619f3bcc92253dbd9140956c79ef  cypherpunks-1999-2015-fixed.mbox


There are four messages from pre-1999.  Then, lots from 1999 starting with:

  Date: Tue, 16 Mar 1999 02:32:36 -0800
  From: Matthew X <profrv AT nex.net.au>
  To: cypherpunks AT einstein.ssz.com
  Cc: declan AT well.com
  Subject: War on terra

There are messages going through 2016, and lots of messages with broken headers from formail.  It would take more work to "fix" whatever might be broken for all the files in the .bz2 work.  The 'nmh' email client might be helpful for this, since it uses individual files, rather than mbox files.

If anyone has ideas about how to create an improved mbox file (or simply provides one) I can add that to the lists.cpunks.org archive instead.  I will also add the .bz2 which provides individual files.  I'm glad that Riad had this older set!

Enjoy!
  - Greg

On Fri, Jul 06, 2018 at 11:09:47AM +0200, Tom Busby wrote:
> I managed the extract that file successfully.
> 
> I uploaded the extract to GitHub if you wanna just git clone it instead:
> 
> https://github.com/cryptoanarchywiki/2000-to-2016-raw-cypherpunks-archive
> 
> On Fri, 6 Jul 2018, 5:40 am Steve Kinney, <admin AT pilobilus.net> wrote:
> 
> >
> >
> > On 07/05/2018 07:20 PM, juan wrote:
> > >
> > >
> > > quote:
> > > From: "Riad S. Wahby" <rsw AT jfet.org>
> > > Subject: Re: moving on
> > > Date: Sat, 20 Aug 2016 20:44:31 -0700
> > >
> > > Done! This tarball goes back as far as 1999, though I'm not certain
> > > it's a complete archive. Note that prior to the LNE node, the list
> > > was 100% unfiltered, so what's below includes a decent amount of spam.
> > > All told, it's about 95k messages in Maildir format.
> > >
> > > https://cpunks.org/cpunk/cypherpunks.tar.bz2
> >
> > wget sez:  HTTP request sent, awaiting response... 404 Not Found
> >
> > > https://cpunks.org/cpunk/cypherpunks.tar.bz2.asc
> >
> > wget sez:  HTTP request sent, awaiting response... 404 Not Found
> >
> > >
> > > -----------------
> > >
> > >
> > >       I uploaded a copy of those archives here
> > >
> > >       https://www6.zippyshare.com/v/H0msMEKw/file.html
> >
> > Seems legit except 'extract' has been chewing on the file for 45 minutes
> > now without spitting out any useful bits that I can see, while 'top'
> > indicates 99% of CPU cycles dedicated to the task.  It's kind of
> > reassuring that 'extract' reports files in "GNU tar format" were found.
> > But @126 MB I would expect /most/ archive files of this size to unpack
> > in way less than a minute here.
> >
> > amidoinitrite?
> >
> > Has anybody got a verifiably useful copy?
> >
> > :o)
> >
> >
> >