Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-31 Thread Anastassis Perrakis
Dear all, The discussion about keeping primary data, and what level of data can be considered 'primary', has - rather unsurprisingly - come up also in areas other than structural biology. An example is next generation sequencing. A full-dataset is a few tera bytes, but post-processing

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-31 Thread Gerard Bricogne
Dear Tassos, It is unclear whether this thread will be able to resolve your deep existential concerns about what to be, but you do introduce a couple of interesting points: (1) raw data archiving in areas (of biology) other than structural biology, and (2) archiving the samples rather than

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-31 Thread Martin Kollmar
Still, after hundreds (?) of emails to this topic, I haven't seen any convincing argument in favor of archiving data. The only convincing arguments are against, and are from Gerard K and Tassos. Why? The question is not what to archive, but still why should we archive all the data. Because

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-31 Thread Robert Esnouf
...@nki.nl) Subject: Re: [ccp4bb] To archive or not to archive, that's the question! To: CCP4BB@JISCMAIL.AC.UK Dear all, The discussion about keeping primary data, and what level of data can be considered 'primary', has - rather unsurprisingly - come up also in areas other than structural

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-31 Thread Oganesyan, Vaheh
board CCP4BB@JISCMAIL.AC.UK (on behalf of Anastassis Perrakis a.perra...@nki.nl) Subject: Re: [ccp4bb] To archive or not to archive, that's the question! To: CCP4BB@JISCMAIL.AC.UK Dear all, The discussion about keeping primary data, and what level of data can be considered 'primary', has

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-31 Thread David Waterman
or not to archive, that's the question! To: CCP4BB@JISCMAIL.AC.UK Dear all, The discussion about keeping primary data, and what level of data can be considered 'primary', has - rather unsurprisingly - come up also in areas other than structural biology. An example

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-31 Thread Clemens Vonrhein
Dear Vaheh, On Mon, Oct 31, 2011 at 03:18:07PM +, Oganesyan, Vaheh wrote: But to store those difficult datasets to help the future software development sounds really farfetched. As far as I see the general plan, that would be a second stage (deposit all datasets) - the first one would be

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-31 Thread Martin Kollmar
@JISCMAIL.AC.UK (on behalf of Anastassis Perrakis a.perra...@nki.nl) Subject: Re: [ccp4bb] To archive or not to archive, that's the question! To: CCP4BB@JISCMAIL.AC.UK Dear all, The discussion about keeping primary data, and what level of data can be considered 'primary', has - rather

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-31 Thread Gerard Bricogne
Dear Martin, Thank you for this very clear message about your views on this topic. There is nothing like well articulated dissenting views to force a real assessment of the initial arguments, and you have certainly provided that. As your presentation is modular, I will interleave my

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-31 Thread Kelly Daughtry
@JISCMAIL.AC.UK CCP4BB@JISCMAIL.AC.UK(on behalf of Anastassis Perrakis a.perra...@nki.nl a.perra...@nki.nl) Subject: Re: [ccp4bb] To archive or not to archive, that's the question! To: CCP4BB@JISCMAIL.AC.UK Dear all, The discussion about keeping primary data, and what level of data can

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-31 Thread Gerard Bricogne
: (+44) - 1865 - 287547 Original message Date: Mon, 31 Oct 2011 11:37:47 +0100 From: CCP4 bulletin board CCP4BB@JISCMAIL.AC.UK (on behalf of Anastassis Perrakis a.perra...@nki.nl) Subject: Re: [ccp4bb] To archive or not to archive, that's the question! To: CCP4BB@JISCMAIL.AC.UK

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-29 Thread Jrh
Dear Gerard K, Many thanks indeed for this. Like Gerard Bricogne you also indicate that the location option being the decentralised one is 'quite simple and very cheap in terms of centralised cost'. The SR Facilities worldwide I hope can surely follow the lead taken by Diamond Light Source and

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-29 Thread Herbert J. Bernstein
One important issue to address is how deal with the perceived reliability issues of the federated model and how to start to approach the higher reliability of the centralized model described bu Gerard K, but without incurring what seems to be at present unacceptable costs. One answer comes from

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-29 Thread Jrh
Dear Herbert, I imagine it likely that eg The Univ Manchester eScholar system will have in place duplicate storage for the reasons you outline below. However for it to be geographically distant is, to my reckoning, less likely, but still possible. I will add that further query to my first query

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-29 Thread Herbert J. Bernstein
Dear John, Most sound institutional data repositories use some form of off-site backup. However, not all of them do, and the standards of reliabilty vary. The advantages of an explicit partnering system are both practical and psychological. The practical part is the major improvement in

[ccp4bb] To archive or not to archive, that's the question!

2011-10-28 Thread Gerard DVD Kleywegt
Hi all, It appears that during my time here at Cold Spring Harbor, I have missed a small debate on CCP4BB (in which my name has been used in vain to boot). I have not yet had time to read all the contributions, but would like to make a few points that hopefully contribute to the discussion

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-28 Thread Colin Nave
Gerard I said in INCREASING order of influence/power i.e. you are in first place. The joke comes from I used to think if there was reincarnation, I wanted to come back as the President or the Pope or a .400 baseball hitter. But now I want to come back as the bond market. You can intimidate

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-28 Thread Gerard DVD Kleywegt
Gerard I said in INCREASING order of influence/power i.e. you are in first place. Ooo! *Now* it makes sense! :-) --Gerard The joke comes from I used to think if there was reincarnation, I wanted to come back as the President or the Pope or a .400 baseball hitter. But now I want to

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-28 Thread Ethan Merritt
On Friday, October 28, 2011 02:02:46 pm Gerard DVD Kleywegt wrote: I'm a tad disappointed to be only in fourth place, Colin! What has the Pope ever done for crystallography? http://covers.openlibrary.org/b/id/5923051-L.jpg -- Ethan A Merritt Biomolecular Structure Center, K-428 Health

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-28 Thread Gerard DVD Kleywegt
On Friday, October 28, 2011 02:02:46 pm Gerard DVD Kleywegt wrote: I'm a tad disappointed to be only in fourth place, Colin! What has the Pope ever done for crystallography? http://covers.openlibrary.org/b/id/5923051-L.jpg Fock'n'Pope! Great find, Ethan! So maybe he deserves fourth place

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-28 Thread Gerard Bricogne
Dear Gerard, I think that a major achievement of this online debate will have been to actually get you to carry out a constructive analysis (an impressive one, I will be the first to say) of this question, instead of dismissing it right away. It is almost as great an achievement as getting

Re: [ccp4bb] To archive or not to archive, that's the question!

2011-10-28 Thread Herbert J. Bernstein
As the poster who mentioned the $1000 - $3000 per terabyte per year figure, I should point out that the figure originated not from La La land but from an NSF RDLM workshop in Princeton last summer. Certainly the actual costs may be higher or lower depending on economies/diseconomies of scale