Re: [galaxy-dev] Fwd: How to Clean up Old Data

2013-06-26 Thread jean-François Taly

Hello,

Regards your comment about keeping history but deleting data, I suggest 
you convert your history into a Workflow.
You could then delete the history and therefore all files attached to it 
but  keep a copy of the protocol for future use.


Hope it helps

Best

Jean-François


Also is there a way a user can keep her history around as a record of
what was done and be able to rerun it later, but still delete the
actual data?

I don't think that is possible at the moment.
Cheers,
Bjoern




--
#
Jean-François Taly
Bioinformatician

Bioinformatics Core Facility
http://biocore.crg.cat
CRG - Centre de Regulació Genòmica (Room 439)
Parc de Recerca Biomèdica de Barcelona (PRBB)
Doctor Aiguader, 88
08003 Barcelona
Spain

email: jean-francois.t...@crg.eu
phone: +34 93 316 0202
fax: +34 93 316 0099
#



___
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
 http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
 http://galaxyproject.org/search/mailinglists/


Re: [galaxy-dev] Fwd: How to Clean up Old Data

2013-06-25 Thread Björn Grüning
Hi Greg,

sorry, for my late response. I'm currently not in my lab with access to
the server. I will mail you an example when I'm back, after GCC.

Which cron service are you using?
Cheers,
Bjoern

> (I'm resending this, it didn't seem to go through)
> 
> 
> -- Forwarded message --
> From: greg 
> Date: Thu, Jun 13, 2013 at 9:29 AM
> Subject: Re: [galaxy-dev] How to Clean up Old Data
> To: Björn Grüning 
> Cc: "galaxy-dev@lists.bx.psu.edu" 
> 
> 
> Hi Bjorn,
> 
> Could I have a look at your cron job for this? I'm not completely sure
> what to schedule.
> 
> Thanks,
> 
> Greg
> 
> On Mon, Mar 11, 2013 at 1:17 PM, greg  wrote:
> > Thanks.  Could I have a look at what your cron job looks like?
> >
> > -Greg
> >
> > On Mon, Mar 11, 2013 at 11:58 AM, Björn Grüning
> >  wrote:
> >> Hi Greg,
> >>
> >>> I'm trying to figure out how to reduce the data stored on the galaxy 
> >>> server.
> >>>
> >>> I came across this page and it looks like data will get deleted if the
> >>> history element gets deleted but I can't tell if this happens
> >>> automatically or if I need to cron these scripts:
> >>> http://wiki.galaxyproject.org/Admin/Config/Performance/Purge%20Histories%20and%20Datasets
> >>>
> >>> Is there anything else I can do to clean up unused data?
> >>
> >> No that should be sufficient. You need to run
> >>
> >> python cleanup_datasets.py universe_wsgi.ini -d 60
> >>
> >> with the different parameters ... -1 -2 -3 
> >> It will not happen automatically, i recommend you to set up a cron job
> >> that runs every week. You also may want to change the -d 60 to something
> >> less than 60.
> >>
> >>> Also is there a way a user can keep her history around as a record of
> >>> what was done and be able to rerun it later, but still delete the
> >>> actual data?
> >>
> >> I don't think that is possible at the moment.
> >> Cheers,
> >> Bjoern
> >>
> >>> Thanks,
> >>>
> >>> Greg
> >>> ___
> >>> Please keep all replies on the list by using "reply all"
> >>> in your mail client.  To manage your subscriptions to this
> >>> and other Galaxy lists, please use the interface at:
> >>>
> >>>   http://lists.bx.psu.edu/
> >>
> >>
> 
> ___
> Please keep all replies on the list by using "reply all"
> in your mail client.  To manage your subscriptions to this
> and other Galaxy lists, please use the interface at:
>   http://lists.bx.psu.edu/
> 
> To search Galaxy mailing lists use the unified search at:
>   http://galaxyproject.org/search/mailinglists/



___
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/

[galaxy-dev] Fwd: How to Clean up Old Data

2013-06-25 Thread greg
(I'm resending this, it didn't seem to go through)


-- Forwarded message --
From: greg 
Date: Thu, Jun 13, 2013 at 9:29 AM
Subject: Re: [galaxy-dev] How to Clean up Old Data
To: Björn Grüning 
Cc: "galaxy-dev@lists.bx.psu.edu" 


Hi Bjorn,

Could I have a look at your cron job for this? I'm not completely sure
what to schedule.

Thanks,

Greg

On Mon, Mar 11, 2013 at 1:17 PM, greg  wrote:
> Thanks.  Could I have a look at what your cron job looks like?
>
> -Greg
>
> On Mon, Mar 11, 2013 at 11:58 AM, Björn Grüning
>  wrote:
>> Hi Greg,
>>
>>> I'm trying to figure out how to reduce the data stored on the galaxy server.
>>>
>>> I came across this page and it looks like data will get deleted if the
>>> history element gets deleted but I can't tell if this happens
>>> automatically or if I need to cron these scripts:
>>> http://wiki.galaxyproject.org/Admin/Config/Performance/Purge%20Histories%20and%20Datasets
>>>
>>> Is there anything else I can do to clean up unused data?
>>
>> No that should be sufficient. You need to run
>>
>> python cleanup_datasets.py universe_wsgi.ini -d 60
>>
>> with the different parameters ... -1 -2 -3 
>> It will not happen automatically, i recommend you to set up a cron job
>> that runs every week. You also may want to change the -d 60 to something
>> less than 60.
>>
>>> Also is there a way a user can keep her history around as a record of
>>> what was done and be able to rerun it later, but still delete the
>>> actual data?
>>
>> I don't think that is possible at the moment.
>> Cheers,
>> Bjoern
>>
>>> Thanks,
>>>
>>> Greg
>>> ___
>>> Please keep all replies on the list by using "reply all"
>>> in your mail client.  To manage your subscriptions to this
>>> and other Galaxy lists, please use the interface at:
>>>
>>>   http://lists.bx.psu.edu/
>>
>>

___
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/