Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-23 Thread Doug Barton
On 12/21/2016 06:15 PM, Royce Williams wrote: On Wed, Dec 21, 2016 at 3:49 PM, Ken Chase wrote: On Wed, Dec 21, 2016 at 04:41:29PM -0800, Doug Barton said: [..] >>Everyone has a line at which "I don't care what's in the pipes, I just >>work here" changes into something

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-22 Thread Large Hadron Collider
i mind not one iota to store some on my computer but it won't be accessible because i don't want to publish it until i can get a dedicated server On 2016-12-22 09:17 PM, Randy Bush wrote: "If it's a politically-generated thing I'll have to deal with at an operational level, it's on topic."

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-22 Thread Randy Bush
>> "If it's a politically-generated thing I'll have to deal with at an >> operational level, it's on topic." > Hmm.. works for me. and do not omit the amplification attack of endless rinse repeat of self-righteous pontification of what people should and should not post randy

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-21 Thread Valdis . Kletnieks
On Wed, 21 Dec 2016 21:54:42 -0500, Andrew Kirch said: > I can't for the life of me see why we'd have to deal with it in the course > of our jobs beyond calling someone and having them install more A/C. This > is, flat-out, off topic. You don't have any fiber that runs into regen shacks in

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-21 Thread Valdis . Kletnieks
On Wed, 21 Dec 2016 19:49:41 -0500, Ken Chase said: > "If it's a politically-generated thing I'll have to deal with at an > operational level, it's on topic." Hmm.. works for me. pgp0FlidUAEkD.pgp Description: PGP signature

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-21 Thread Royce Williams
On Wed, Dec 21, 2016 at 8:03 PM, Jason Hellenthal wrote: > Simply put… if the data that is hosted on the sites aforementioned then cough > up the damn space and host it. Data space is cheap as hell these days, parse > it and get the hell on with it already. > >

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-21 Thread Jason Hellenthal
Simply put… if the data that is hosted on the sites aforementioned then cough up the damn space and host it. Data space is cheap as hell these days, parse it and get the hell on with it already. *Disclaimer* not meant to single out any one party in this conversation but the whole subject all

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-21 Thread Royce Williams
On Tue, Dec 20, 2016 at 7:08 AM, Royce Williams wrote: [snip] > IMO, *operational, politics-free* discussion of items like these would > also be on topic for NANOG: > > - Some *operational* workarounds for country-wide blocking of > Facebook, Whatsapp, and Twitter [1],

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-21 Thread Andrew Kirch
I can't for the life of me see why we'd have to deal with it in the course of our jobs beyond calling someone and having them install more A/C. This is, flat-out, off topic. Andrew On Wed, Dec 21, 2016 at 9:15 PM, Royce Williams wrote: > On Wed, Dec 21, 2016 at 3:49

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-21 Thread Royce Williams
On Wed, Dec 21, 2016 at 3:49 PM, Ken Chase wrote: > On Wed, Dec 21, 2016 at 04:41:29PM -0800, Doug Barton said: > [..] > >>Everyone has a line at which "I don't care what's in the pipes, I just > >>work here" changes into something more actionable. > > > >Stretched far

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-21 Thread Ken Chase
On Wed, Dec 21, 2016 at 04:41:29PM -0800, Doug Barton said: [..] >>Everyone has a line at which "I don't care what's in the pipes, I just >>work here" changes into something more actionable. > >Stretched far beyond any credibility. Your argument boils down to, "If it's >a political

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-21 Thread Doug Barton
On 12/20/2016 8:08 AM, Royce Williams wrote: n Sat, Dec 17, 2016 at 6:15 PM, Doug Barton wrote: On 12/16/2016 1:48 PM, Hugo Slabbert wrote: This started as a technical appeal, but: https://www.nanog.org/list 1. Discussion will focus on Internet operational and

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-20 Thread Royce Williams
n Sat, Dec 17, 2016 at 6:15 PM, Doug Barton wrote: > On 12/16/2016 1:48 PM, Hugo Slabbert wrote: >> >> This started as a technical appeal, but: >> >> https://www.nanog.org/list >> >> 1. Discussion will focus on Internet operational and technical issues as >> described in the

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-17 Thread Doug Barton
On 12/16/2016 1:48 PM, Hugo Slabbert wrote: This started as a technical appeal, but: https://www.nanog.org/list 1. Discussion will focus on Internet operational and technical issues as described in the charter of NANOG. Hard to see how the OP has anything to do with either of the above.

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread Larry Sheldon
I guess at long last it is time for Larry to stop thinking there was a common interest here. NANOG has gone completely into the weeds (my email client treats it as political spam). Sad--once upon a time it was a home for science in an insane academic world. -- "Everybody is a genius. But

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread Jean-Francois Mezei
On 2016-12-16 10:58, Rich Kulawiec wrote: > This is a short-term (about one month) project being thrown together > in a hurry...and it could use some help. How much data are we talking about here? A few floppy disks ? a couple of megabytes ? gigabytes ? terabytes ? petabytes ? Have you

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread Mark Blackman
> On 16 Dec 2016, at 21:35, Rob McEwen wrote: > But global warming and CO2 being a cause of it. http://climate.nasa.gov/evidence/ What sort of effects do you reckon a 35% increase in atmospheric CO2 over historical levels over the

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread Aaron C. de Bruyn via NANOG
On Fri, Dec 16, 2016 at 1:35 PM, Rob McEwen wrote: > On 12/16/2016 3:30 PM, Ken Chase wrote: > A 39-inch rise in the ocean levels over the next century is based on > fear-mongering and junk science designed to scare politicians into > increasing grant $$ from the federal

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread Rob McEwen
On 12/16/2016 4:48 PM, Hugo Slabbert wrote: This started as a technical appeal, but: https://www.nanog.org/list 1. Discussion will focus on Internet operational and technical issues as described in the charter of NANOG. 6. Postings of political, philosophical, and legal nature are prohibited.

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread Hugo Slabbert
This started as a technical appeal, but: https://www.nanog.org/list 1. Discussion will focus on Internet operational and technical issues as described in the charter of NANOG. ... 6. Postings of political, philosophical, and legal nature are prohibited. ... -- Hugo Slabbert | email,

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread Rob McEwen
On 12/16/2016 3:30 PM, Ken Chase wrote: http://abcnews.go.com/US/north-carolina-bans-latest-science-rising-sea-level/story?id=16913782 North Carolina is not banning science. It is banning absolutely preposterous and manipulated junk science. A 39-inch rise in the ocean levels over the next

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread Ken Chase
I seriously doubt that there's going to be a witchhunt even close to as well funded as anti-torrent DMCA-wielding piracy hunters, and it's not even nearly the same as keeping a copy of wikileaks.aes, or sattelite photos of Streisand's campus, or photos of Elian Gonzales, a copy of deCSS, the

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread Steven Miano
It would seem like the more copies the better, seemingly chunking this data up and using .torrent files may be a way to both (a) ensure the integrity of the data, and (b) enable an additional method to ensure that there are enough copies being replicated (initial seeders would hopefully retain the

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread Ken Chase
University Toronto's Robarts Library is hosting an all-day party tomorrow of people to surf and help identify datasets, survey and get size and details, authenticate copies, etc. fb event: https://www.facebook.com/events/1828129627464671/ /kc On Fri, Dec 16, 2016 at 06:42:46PM +0200, DaKnOb

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread DaKnOb
We are currently working on a scheme to successfully authenticate and verify the integrity of the data. Datasets in https://climate.daknob.net/ are compressed to a .tar.bz2 and then hashed using SHA-256. The final file with all checksums is then signed using a set of PGP keys. We are still

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread Ken Chase
Surfing through the links - any hints on how big these datasets are? Everyone's got a few TB to throw at things, but fewer of us have spare PB to throw around. There's some random #s on the goog doc sheet for sizes (100's of TB for the landsat archive seems credible), and there's one number that

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread Royce Williams
See also: https://twitter.com/textfiles/status/808715999042117632 https://twitter.com/textfiles/status/808922272551550976 Jason Scott‏@textfiles When your boss gives you the goahead to mirror 200tb of NOAA data, you run with it Don't let the fact that The Internet Archive is all over

Re: Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread DaKnOb
If you’re interested, there’s also a Slack team: climatemirror.slack.com You can find more info about that here: - https://climate.daknob.net/ - http://climatemirror.org/ - http://www.ppehlab.org/datarefuge Thank you for your help! > On 16 Dec 2016, at 17:58, Rich Kulawiec

Wanted: volunteers with bandwidth/storage to help save climate data

2016-12-16 Thread Rich Kulawiec
This is a short-term (about one month) project being thrown together in a hurry...and it could use some help. I know that some of you have lots of resources to throw at this, so if you have an interest in preserving a lot of scientific research data, I've set up a mailing list to coordinate IT