Re: [galaxy-dev] Looking for recommendations: How to run galaxy workflows in batch

2012-07-18 Thread Geert Vandeweyer
Hi, In case you'd be interested: we use a script that creates interlaced data of paired end data. We run this outside galaxy on groups of samples ordered in directories at once. We then import the interlaced data into galaxy, enabling batch workflow. The first step of the workflow is a deint

Re: [galaxy-dev] Looking for recommendations: How to run galaxy workflows in batch

2012-07-18 Thread Sascha Kastens
Hi Dev-Team,   are you planning or maybe working on an update which enables the possiblilty to run workflows in batch mode with paired end data?   Cheers, Sascha ___ Please keep all replies on the list by using "reply all" in your mail

Re: [galaxy-dev] Looking for recommendations: How to run galaxy workflows in batch

2012-07-05 Thread Thon Deboer
But this only works if you have a single dataset (such as a BAM file) for each workflow to run on. If you have pairs of files (such as paired end FASTQ files, not an uncommon workflow nowadays :) ) you need to resort to using the API, since there is no support for paired end sequencing in GALAXY

Re: [galaxy-dev] Looking for recommendations: How to run galaxy workflows in batch

2012-07-04 Thread Dannon Baker
In your workflows, are you using "Input Dataset" steps? Galaxy uses these steps to know how to map datasets to do special things like this. If you're not currently using them, just open the workflow editor and add input dataset steps (it's at the very bottom of the tool list) connected to the

Re: [galaxy-dev] Looking for recommendations: How to run galaxy workflows in batch

2012-07-04 Thread Bernd Jagla
Dannon Baker writes: > > Hi Dave, > > Yes, galaxy's standard run-workflow dialog has a feature where you can select multiple datasets as input > for a single "Input Dataset" step. To do this, click the icon referenced by the tooltip in the screenshot > below to select multiple files. All pa

Re: [galaxy-dev] Looking for recommendations: How to run galaxy workflows in batch

2012-02-07 Thread Dannon Baker
Thanks for the suggestion, I like that! I'll make the change shortly. -Dannon On Feb 7, 2012, at 8:03 AM, Louise-Amélie Schmitt wrote: > Hello Dannon > > Could it be possible to have the input dataset's display name appended to the > new history's name instead of plain numbers when the "Send

Re: [galaxy-dev] Looking for recommendations: How to run galaxy workflows in batch

2012-02-07 Thread Louise-Amélie Schmitt
Hello Dannon Could it be possible to have the input dataset's display name appended to the new history's name instead of plain numbers when the "Send results in a new history" option is checked? This new feature is indeed very useful (thanks a million for it) but the numbered suffixes ma

Re: [galaxy-dev] Looking for recommendations: How to run galaxy workflows in batch

2012-02-06 Thread Dannon Baker
This method only works for single inputs at the moment, though eventually it'd be nice to allow pairing. Another option for you would be to use the workflows API, with which you can definitely specify multiple inputs. See workflow_execute.py in the scripts/api folder of your galaxy installatio

Re: [galaxy-dev] Looking for recommendations: How to run galaxy workflows in batch

2012-02-06 Thread Dave Lin
Thank you Dannon. That is helpful. What if I need to specify multiple inputs per run (i.e. .csfasta + .qual file)? -Dave On Mon, Feb 6, 2012 at 1:27 PM, Dannon Baker wrote: > Hi Dave, > > Yes, galaxy's standard run-workflow dialog has a feature where you can > select multiple datasets as input

Re: [galaxy-dev] Looking for recommendations: How to run galaxy workflows in batch

2012-02-06 Thread Dannon Baker
Hi Dave,Yes, galaxy's standard run-workflow dialog has a feature where you can select multiple datasets as input for a single "Input Dataset" step.  To do this, click the icon referenced by the tooltip in the screenshot below to select multiple files.  All parameters remain static between execution

[galaxy-dev] Looking for recommendations: How to run galaxy workflows in batch

2012-02-06 Thread Dave Lin
Hi All, I'm looking to batch process 40 large data sets with the same galaxy workflow. This obviously can be done in a brute-force manual manner. However, is there a better way to schedule/invoke these jobs in batch 1) from the UI with a plugin 2) command-line 3) web-service Thanks in advance