Re: [galaxy-user] Monitoring usage

2014-01-08 Thread Enis Afgan
Ni Neil, There is Galaxy Reports app all that runs as a separate web app and is generally available at galaxy instance/reports URL. It's config file needs to be configured to point to your Galaxy instance database (see reports_wsgi.ini in Galaxy's home dir) and the app launched via run_reports.sh.

[galaxy-user] January 2014 Galaxy CloudMan Release

2014-01-07 Thread Enis Afgan
/cloudman/commits/all?search=a6bf542%3Acc55ca9 from 4 contributors*. Enjoy and please let us know what you think, Enis Afgan https://wiki.galaxyproject.org/EnisAfgan and Dannon Bakerhttps://wiki.galaxyproject.org/DannonBaker Galaxy Team

Re: [galaxy-user] Botryllus genome

2013-11-08 Thread Enis Afgan
Hi Katie, For genomes that are not available on Galaxy Main (or general questions you might have about Galaxy), it's best to send an email to the galaxy-user mailing list (CC'd now). You can subscribe to the mailing list here http://lists.bx.psu.edu/listinfo/galaxy-user As far as the particular

Re: [galaxy-user] How to become admin on Galaxy Cloudman

2013-09-29 Thread Enis Afgan
Hi Yan, On CloudMan's Admin page (i.e., instance ip/cloud/admin) you can add the email address you registered with in Galaxy on your cloud instance in the 'add galaxy admin' box and click add. After Galaxy restarts, you will have become an admin on that instance. Best, Enis On Sep 29, 2013 10:04

Re: [galaxy-user] CloudMan console not responding

2013-08-29 Thread Enis Afgan
Hi Deniz, Resizing the data volume via the main CloudMan page is fixed now and will work for any newly created cluster. On Thu, Aug 29, 2013 at 8:40 AM, Enis Afgan afg...@gmail.com wrote: Sorry to hear you're having trouble Deniz. I've just tried to replicate the issues and wanted to check

Re: [galaxy-user] Uploading files to Cloudman by FTP

2013-08-28 Thread Enis Afgan
Hi Anto, This has now been fixed for any new cluster. Sorry for the trouble and let us know if you have any more questions. Cheers On Aug 9, 2013 5:06 PM, Anto Praveen Rajkumar Rajamani a...@hum-gen.au.dk wrote: Hello, I have started a new cloudman instance. Now, I am trying to upload my

Re: [galaxy-user] [galaxy-dev] Connecting to new Galaxy Cloudman by FTP

2013-08-27 Thread Enis Afgan
FTP issues are fixed now so things will be functional out of the box without any of these workarounds. On Tue, Jul 16, 2013 at 4:04 PM, Daniel Blankenberg d...@bx.psu.edu wrote: Hey Mo, You can use ssh to connect to the Galaxy machine. If you used cloudlaunch to create your instance, it

[galaxy-user] Fwd: HCC Analysis Pipeline

2013-08-05 Thread Enis Afgan
Hi Moritz, I'm forwarding your message to galaxy-user mailing list and Jennifer from Galaxy. Between the two, you should be able to get some help because unfortunately this is not my area of expertise so I'm afraid I won't be of much help. Good luck, Enis -- Forwarded message --

Re: [galaxy-user] Local galaxy install vs cloudman

2013-03-05 Thread Enis Afgan
H Jim, The components for the cloud version are built in an automated fashion using CloudBioLinux scripts (https://github.com/chapmanb/cloudbiolinux) so maybe using those can get you closer to what you're after? Cheers, Enis On Wed, Mar 6, 2013 at 5:17 AM, James Vincent j...@uvm.edu wrote:

Re: [galaxy-user] Why SGE needed for galaxy ?

2013-02-07 Thread Enis Afgan
Hi Zeeshan, In order to gain from the scalability of the cloud, SGE does need to run. However, CloudMan sets all that up and manages it going forward. Enis On Fri, Feb 8, 2013 at 8:59 AM, Zeeshan Ali Shah zas...@pdc.kth.se wrote: Hi, It seems that cloud man need SGE for scaling . Does SGE

Re: [galaxy-user] converting solid files

2013-01-13 Thread Enis Afgan
Hi Nuphar, I believe yu should be using a tool that is color-space aware and not converting the data - Galaxy Main has 'Bowtie for SOLID' available, which should understand your data as is. BTW, for these types of questions, you should send the email to galaxy-user mailing list

[galaxy-user] New Galaxy CloudMan Release

2012-11-25 Thread Enis Afgan
*We just released an update to CloudMan.* CloudMan offers an easy way to get a personal and completely functional instance of Galaxy in the cloud in just a few minutes, without any manual configuration. *This update brings a large number of updates and new features, the most prominent ones

Re: [galaxy-user] Can't seem to stop or restart the Galaxy in server

2012-10-17 Thread Enis Afgan
With a certain version of Python there's been an issue stopping Galaxy using ctrl+C. You can use 'sh run.sh --daemon' to have the process run in the background and then 'sh run.sh --stop-damemon' to stop it. Hope this helps, Enis On Thu, Oct 18, 2012 at 4:12 PM, Sachit Adhikari

Re: [galaxy-user] Galaxy in cloud (not Amazon)

2012-10-04 Thread Enis Afgan
)) and the Galaxy set for cluster(http://wiki.g2.bx.psu.edu/Admin/Config/Performance/Cluster). We need Galaxy for large biological data quickly (faster than a stand alone machine). Maybe we do not understand something? Best regards, Anatoly 2012/10/3 Enis Afgan eaf...@emory.edu Yes

Re: [galaxy-user] Galaxy CloudMan - Nodes can't make their own qsub calls?

2012-09-15 Thread Enis Afgan
Added: worker nodes are now submit hosts as well: https://bitbucket.org/galaxy/cloudman/changeset/b4c66783b42fb559b35b689363b34826d00ced34 This will be generally available with the next release of CloudMan is made (however, there is no immediate plans for doing so as quite a bit of other details

Re: [galaxy-user] Galaxy in AWS AMI

2012-06-13 Thread Enis Afgan
Hi Lilach, It seems you ran into a bug that was introduced in the most recent CloudMan update. It's been fixed now. If you still have your instance up, the way to get around the issue is to simply strip off '/cloud' part of the URL and you'll get to Galaxy. Any new instances will work fine.

[galaxy-user] Updates to CloudMan

2012-06-08 Thread Enis Afgan
*We just released an update to CloudMan.* CloudMan offers an easy way to get a personal and completely functional instance of Galaxy in the cloud in just a few minutes, without any manual configuration. *This update brings a large number of updates and new features, the most prominent ones

Re: [galaxy-user] mount issue

2012-05-11 Thread Enis Afgan
Hi Zeeshan, The file system error message you saw when you first start a new cluster is, oddly enough, the expected behavior. And, like you noticed, after the cluster has been initialized for the first time, subsequent startups do not show the error. Enis On Thu, May 10, 2012 at 4:11 AM, Zeeshan

Re: [galaxy-user] Problems starting Galaxy Cloudman

2012-03-12 Thread Enis Afgan
Also Greg Starting a new cloudman instance with a different cluster name than previously used will always give you a clean environment and setup so you can continue to always use the us-east region. Cheers, Enis On 10/03/2012 2:08 PM, Ross ross.laza...@gmail.com wrote: Since Dannon is likely

Re: [galaxy-user] Advice on disabling SGE queue on galaxy-cloudman

2012-03-06 Thread Enis Afgan
Hi John, Theoretically, this is a straightforward task but in reality CloudMan gets in the way of making it stick. Namely, if you are to manually remove the master instance from being an execution host, CloudMan will add it back in the next time a node is added or removed from the cluster, thus

Re: [galaxy-user] Is the result of galaxy tool (e.g. FastQ Groomer) automatically saved somewhere on a local linux server?

2012-02-12 Thread Enis Afgan
Hi Arthur, Any tools run on main.g2.bx... are only stored on that server and not on your local machine. By clicking on the Save icon (floppy disk) in your history item, you are able to transfer the data from the remote server to your local machine. As far as your local installation goes - the

Re: [galaxy-user] Cloudman - Cluster could not complete job errors

2012-01-25 Thread Enis Afgan
Hi Dave, Sorry to hear you're having trouble and no, the behavior you describe is not the expected behavior. From the description, unfortunately it does not sound like adding more nodes will help the case. Could you take a look at the log files for Galaxy and see if anything there is indicating

Re: [galaxy-user] CloudMan - SGE / Cluster Questions

2012-01-24 Thread Enis Afgan
Hi again Greg, On Tue, Jan 24, 2012 at 2:51 PM, mailing list margeem...@gmail.com wrote: Hi guys, So I'm trying to take a bioinformatics pipeline we currently run on our own SGE cluster (which seems to have a lot of customizations ! I'm finding out) and I want to run it on Amazon using

Re: [galaxy-user] BioCloudCentral - First Launch Not Working

2012-01-24 Thread Enis Afgan
. Would it be possible for the user to enter their zone on the form? Or could CloudMan detect a problem, shutdown and try a different zone? (probably infeasible). Thanks again, Greg On Tue, Jan 24, 2012 at 9:08 AM, Enis Afgan afg...@gmail.com wrote: Hi Greg, This sounds like the availability

Re: [galaxy-user] BioCloudCentral - First Launch Not Working

2012-01-24 Thread Enis Afgan
Hi Greg, This sounds like the availability zone issue. I am assuming you are restarting the same cluster (i.e., using the same name) and the instance that gets created may be created in a zone different from the one that the volume from the previous instantiation of the cluster was in.

Re: [galaxy-user] CloudMan - Galaxy - Sharing Confusion

2012-01-12 Thread Enis Afgan
Hi Greg, Galaxy makes the tools more accessible by allowing web access to those tools, it automatically handles job submission and management, as well as allows simpler integration with other tools to form complex analyses. Enis On Thu, Jan 12, 2012 at 8:59 PM, mailing list margeem...@gmail.com

Re: [galaxy-user] CloudMan - Galaxy - Sharing Confusion

2012-01-12 Thread Enis Afgan
Hi Greg, Please see below. Two follow up questions: 1. Can I terminate my main instance, then start a new Cloudman instance later and enter this share string to get back to where I was? That would save some money vs stopping my main instance. You should always terminate a cluster. Stopping

Re: [galaxy-user] Bug ? in Galaxy Cloudman display

2011-12-27 Thread Enis Afgan
Hi Greg, The color legend for the node status has been removed from the distribution and replaced with the autoscaling option because it was too static to take up that much screen space. The icons should be easy to interpret standalone: - blue: pending instance from AWS - yellow: instance setup

Re: [galaxy-user] CloudMan - The connection has timed out

2011-12-22 Thread Enis Afgan
group. It probably makes sense to consolidate in one place so I'm continuing the updates over there: http://biostar.stackexchange.com/questions/15554/galaxy-cloudman-cant-get-an-instance-started-the-connection-has-timed-out -Greg On Sat, Dec 17, 2011 at 3:36 AM, Enis Afgan eaf

Re: [galaxy-user] CloudMan - The connection has timed out

2011-12-17 Thread Enis Afgan
Hi Greg, Sorry to hear you're having trouble. Can you please confirm that you followed the step for creating a security group on the wiki and opened all the specified ports? Enis On Fri, Dec 16, 2011 at 7:58 PM, mailing list margeem...@gmail.com wrote: Hi Everyone, I'm trying to set up Cloud

[galaxy-user] An update to Galaxy CloudMan

2011-11-28 Thread Enis Afgan
A new version of CloudMan for running Galaxy on Amazon cloud has been released today. Any new cluster will automatically use this version. Existing clusters will have a link displayed at the top of the CloudMan console offering to perform an automated update. The new version brings the following

Re: [galaxy-user] Using Galaxy Cloudman for a workshop

2011-11-16 Thread Enis Afgan
Hi Clare, Jeremy (from the team) ran a similar workshop several months ago and used some resource intensive tools (e.g., Tophat). We were concerned about the same scalability issues so we just started 4 separate clusters and divided the users across those. The approach worked well and it turned

Re: [galaxy-user] Problem launching cloud instance

2011-10-30 Thread Enis Afgan
Hi Clare, Sorry about the trouble. I just disabled that if statement in the template so the option should no longer be disabled for any new cluster. My goal was to simplify usage but I'll obviously have to revisit the implementation... Sorry for the trouble and good luck with the demo tomorrow.

Re: [galaxy-user] Cost

2011-10-10 Thread Enis Afgan
Hi Lizex, The AWS pricing page has the prices for consuming their cloud resources: http://aws.amazon.com/ec2/#pricing As the model suggests, the total price will depend on your usage - at the minimum, you'll need 1 instance for the duration of your computation and an EBS volume to hold your data.

[galaxy-user] CloudMan automates cluster customization

2011-07-24 Thread Enis Afgan
Hello all, A new version of CloudMan has just been released. The two most prominent changes in this release include: 1. Support for automated persistance of modifications to the underlying file systems 2. Support for CloudBioLinux clusters on Ubuntu 11.04 - 1. CloudMan has

Re: [galaxy-user] Enis: [galaxy-bugs] Security Groups int the cloud

2011-07-19 Thread Enis Afgan
Hi Luciano, Did you first create the galaxyWeb security group? Instructions are available on usegalaxy.org/cloud under Step 1. Enis On 7/18/11 2:37 PM, Luciano Cosme wrote: Hi, I am trying to run Galaxy in the cloud and I am following your screencast. I am having a problem when I need

Re: [galaxy-user] adding tools to cloud version

2011-06-30 Thread Enis Afgan
By default, on cluster termination and restart everything is reverted to the state the cluster was initially in. However, if you'd like to customize your instance by adding tools and such, it is possible. The document describing the procedure is available here:

Re: [galaxy-user] cloud instance drops settings on reboot

2011-06-28 Thread Enis Afgan
Hi Joe, This is by design. In order to change the settings in universe_wsgi.ini, you should edit file universe_wsgi.ini.cloud in the cluster's bucket on S3. This file get pulled in by Cloudman each time an instance starts. As far as restarting Cloudman, there is a (new) Admin panel (link at top

Re: [galaxy-user] cloud instance drops settings on reboot

2011-06-28 Thread Enis Afgan
-- *From:* Enis Afgan [eaf...@emory.edu] *Sent:* Tuesday, June 28, 2011 11:46 AM *To:* Joseph Hargitai *Cc:* galaxy-user@lists.bx.psu.edu *Subject:* Re: [galaxy-user] cloud instance drops settings on reboot Hi Joe, This is by design. In order to change the settings in universe_wsgi.ini

Re: [galaxy-user] cloud instance drops settings on reboot

2011-06-28 Thread Enis Afgan
however the Cloudman Admin tab you are referring to. Is this a version issue? we use: galaxy-cloudman-2011-03-22 (ami-da58aab3) I do have the Admin tab in galaxy itself, but I do not think that is what you are referring to. joe -- *From:* Enis Afgan [eaf

Re: [galaxy-user] cloud instance drops settings on reboot

2011-06-28 Thread Enis Afgan
-da58aab3) I do have the Admin tab in galaxy itself, but I do not think that is what you are referring to. joe From: Enis Afgan [eaf...@emory.edu] Sent: Tuesday, June 28, 2011 3:30 PM To: Joseph Hargitai Cc: galaxy-user@lists.bx.psu.edu Subject: Re: [galaxy-user] cloud instance

Re: [galaxy-user] cloud instance drops settings on reboot

2011-06-28 Thread Enis Afgan
On Tue, Jun 28, 2011 at 6:38 PM, Joseph Hargitai joseph.hargi...@einstein.yu.edu wrote: throws this: {updated: false} -- *From:* Enis Afgan [eaf...@emory.edu] *Sent:* Tuesday, June 28, 2011 6:02 PM *To:* Oliver Hofmann; Joseph Hargitai *Cc:* galaxy-user

Re: [galaxy-user] aspera install on cloud install

2011-06-21 Thread Enis Afgan
Hi Joe, We have not tried aspera (if I recall correctly, they're not open source?). At the University of Chicago, though, there has been some work on enabling Galaxy on the cloud to work with GridFTP and GlobusOnline, which is somewhat related. There is a talk and PPT about that available at

Re: [galaxy-user] database on the cloud

2011-04-18 Thread Enis Afgan
Hi Thomas, It turns out you discovered a bug in the cloud setup. We're missing a 2bit file and a respective reference to the file for the extract genomic DNA tool. We'll update the deployment but in the mean time you can configure the instance yourself with just a few commands: # connect to the

Re: [galaxy-user] Help!!!!!! with Galaxy Cloud!!!!!

2011-04-15 Thread Enis Afgan
...@yahoo.com wrote: Hello again, So I am able to see all of the .dat files in /mnt/galaxyData. What commands can I use to download a file to my HD? Also, what program should I use to open the .dat file? Thanks again, Mike --- On *Wed, 4/13/11, Enis Afgan eaf...@emory.edu* wrote: From: Enis

Re: [galaxy-user] Help!!!!!! with Galaxy Cloud!!!!!

2011-04-15 Thread Enis Afgan
step closer. Thanks again, Mike --- On *Fri, 4/15/11, Enis Afgan eaf...@emory.edu* wrote: From: Enis Afgan eaf...@emory.edu Subject: Re: [galaxy-user] Help!! with Galaxy Cloud! To: Mike Dufault dufau...@yahoo.com Cc: galaxy-u...@bx.psu.edu Date: Friday, April 15, 2011, 8:21 AM

Re: [galaxy-user] View Running Job from Multiple Computers?

2011-04-14 Thread Enis Afgan
Yes it is - where you access the cloud console or Galaxy from has no affect on running of the jobs. Enis On Thu, Apr 14, 2011 at 12:01 PM, Mike Dufault dufau...@yahoo.com wrote: Hi, I have an instance of Galaxy running on AWS. I would like to view it's progress throughout the day, but I am

Re: [galaxy-user] Help!!!!!! with Galaxy Cloud!!!!!

2011-04-12 Thread Enis Afgan
Hi Mike, Try accessing your Galaxy instance now. It should be ok. The link in your email contained the IP for your instance so I took the liberty of restarting Galaxy and that brought it back up. There seems to have been an issue with Galaxy accessing its database and that resulted in Galaxy

Re: [galaxy-user] Help!!!!!! with Galaxy Cloud!!!!!

2011-04-12 Thread Enis Afgan
if the analysis would be compromised. Thanks again to you and the whole Galaxy team. Best, Mike --- On *Tue, 4/12/11, Enis Afgan eaf...@emory.edu* wrote: From: Enis Afgan eaf...@emory.edu Subject: Re: [galaxy-user] Help!! with Galaxy Cloud! To: Mike Dufault dufau...@yahoo.com Cc

Re: [galaxy-user] server error trying to DL data from galaxy on cloud

2011-03-28 Thread Enis Afgan
Hi Karl, Hmm, not having Galaxy accessible is definitely not a step in the right direction. Being signed into command line is not an issue; something else must have gone wrong. To start, please take a look at the (bottom of) galaxy log file (and email the relevant part if you don't see how to fix

Re: [galaxy-user] server error trying to DL data from galaxy on cloud

2011-03-28 Thread Enis Afgan
You're almost there, the command should be executed from your local machine (home directory is fine) and it should look as follows: scp -i path to keyfile ubuntu@publicDNS:/mnt/galaxyData/files/000/dataset_11.dat . (note the 'ubuntu@' before the public DNS and a trailing dot (.) - the dot means

Re: [galaxy-user] dataflow using Galaxy on Amazon EC2

2011-03-27 Thread Enis Afgan
, 2011, at 2:27 PM, Enis Afgan wrote: Hi Luqman, Take a look a my comments below. On Fri, Mar 25, 2011 at 5:06 PM, Luqman Hodgkinson luq...@berkeley.eduwrote: Hi Enis, Thank you for your detailed reply. After playing with Galaxy, there are some questions I have. 1. All my Java

Re: [galaxy-user] dataflow using Galaxy on Amazon EC2

2011-03-25 Thread Enis Afgan
. That should give you a good indication of whether available functionality can be applied in your scenario as well. Enis Sincerely, with best wishes, Luqman On Mar 25, 2011, at 10:21 AM, Enis Afgan wrote: Hi Luqman, Were you planning on using Galaxy CloudMan (usegalaxy.org/cloud

Re: [galaxy-user] Galaxy on Cloud not recognizing .txt files as fastq

2011-03-15 Thread Enis Afgan
Thanks Dan. The revision of Galaxy is the problem - the instance of Galaxy on the cloud is a month old now; it is at revision 5064 so. I'll release an update in the coming days along with an updated CloudMan. Enis On Mon, Mar 14, 2011 at 11:24 PM, Daniel Blankenberg d...@bx.psu.edu wrote: Hi

Re: [galaxy-user] Galaxy on Cloud not recognizing .txt files as fastq

2011-03-14 Thread Enis Afgan
Hi Karl, As a quick check, are the permissions for the S3 file set so anyone can read the file? That's required before Galaxy's upload tool will be able to access the file. Alternatively, if you don't want to set such loose permissions, you should be able to get a a signed URL for the given file

[galaxy-user] An update to Galaxy CloudMan

2011-01-24 Thread Enis Afgan
We'd like to announce an update to Galaxy CloudMan - a completely standalone version Galaxy on Amazon's cloud. The new version has been released that brings a number of improvements to the core functionality of CloudMan and expands the number of tools available within Galaxy CloudMan to match that