Re: [galaxy-dev] Selective storage of galaxy files

2011-08-26 Thread Edward Kirton
An easy and immediate solution may be to: (a) create a "Link data" tool. The user specifies the data ID and your tool queries a db to find the location and creates a symlink to the data, which is stored on different groups'/projects' disks. While subsequent datafiles will still be stored in the

Re: [galaxy-dev] Selective storage of galaxy files

2011-08-22 Thread Nate Coraor
Ravi Madduri wrote: > Nate > I brought this issue up at the users conference and I wanted to bring it up > again. How does somebody like us keep track of new development like this and > how can we contribute? Hi Ravi, The best way is probably to ask on the dev list whether we are, or have inte

Re: [galaxy-dev] Selective storage of galaxy files

2011-08-22 Thread Ravi Madduri
Nate I brought this issue up at the users conference and I wanted to bring it up again. How does somebody like us keep track of new development like this and how can we contribute? Regards On Aug 22, 2011, at 11:57 AM, Nate Coraor wrote: > Dave Walton wrote: >> Dear Galaxy developers, >> >> O

Re: [galaxy-dev] Selective storage of galaxy files

2011-08-22 Thread Nate Coraor
Dave Walton wrote: > Dear Galaxy developers, > > Our institution is trying solve our storage problem (we need lots, > especially for NGS data, and someone needs to fund it). What we would like > to be able to do, is based on some criteria control in what location a file > gets written to disk. >

Re: [galaxy-dev] Selective storage of galaxy files

2011-08-11 Thread Ravi Madduri
Dave At University of Chicago, we are working on designing and implementing a storage solution that addresses the criteria you describe below. It is still in very early stage but we will be happy to work with you and get your requirements. On Aug 11, 2011, at 9:44 AM, Dave Walton wrote: > Dear

Re: [galaxy-dev] Selective storage of galaxy files

2011-08-11 Thread Hans-Rudolf Hotz
Hi Dave We do something similar already: We store the NGS data outside of the Galaxy directory tree in our NGS repository. And our (selfwritten) NGS tools in Galaxy know were to find the data in the repository and were to put it. (see 'key insight 3' and '4' in my presentation at this years G

[galaxy-dev] Selective storage of galaxy files

2011-08-11 Thread Dave Walton
Dear Galaxy developers, Our institution is trying solve our storage problem (we need lots, especially for NGS data, and someone needs to fund it). What we would like to be able to do, is based on some criteria control in what location a file gets written to disk. This criteria could be an indivi