Re: airavata-server docker open issues

2015-07-22 Thread Shameera Rathnayaka
Hi Pankaj, If you pass environment variable then you don't want to edit property file. Airavata give priority to system property then properties from airavata-server.properties file. Hence you don't need to edit properties file. ~Shameera. On Wed, Jul 22, 2015 at 9:40 PM Pankaj Saha wrote: > H

Re: airavata-server docker open issues

2015-07-22 Thread Pankaj Saha
Hey Shameera Can you please explain with an example, I am not able to get what you are trying to say about system properties. What I have suggested here needs env variables to be passed as parameters while running the containers. Start up script will set these properties before running the airavata

Re: airavata-server docker open issues

2015-07-22 Thread Shameera Rathnayaka
Hi Pankaj, did you try parsing those values as system properties when you start docker images? It should work. Then you can add those system properties from startup script instead of manipulating property file. On Wed, Jul 22, 2015 at 6:15 PM Pankaj Saha wrote: > I am planning to add a shell sc

Re: airavata-server docker open issues

2015-07-22 Thread Pankaj Saha
I am planning to add a shell script(startup.sh) along with Dockerfile in the source, so that it make required changes and then start the airavata server. This will resolve the issues 2,3,4. like: CMD bash -C './startup.sh';'bash' ​ startup.sh

RE: docker use case

2015-07-22 Thread Schwartz, Terri
Pankaj and Marlon, thanks for the responses. Marlon, you answered exactly what I was about to ask after reading Pankaj's response, i.e., what problem are you trying to solve with the use of docker, or what is the goal. Terri From: Pierce, Marlon [marpi...@iu.e

Re: docker use case

2015-07-22 Thread Pierce, Marlon
Thanks for the response, Pankaj. I'll add the following. This is a GSOC project so we are very interested in seeing how best to use Docker and other tools with Airavata. Pankaj is making good progress but I would not yet say we are all-in on Docker. Our overriding goal is to provide a "harne

Re: review - docker pga

2015-07-22 Thread Shameera Rathnayaka
Hi Pankaj, I am suggesting the sort of a same thing in a different way, no issue +1 for above approach it make sense. Thanks, Shameera. On Wed, Jul 22, 2015 at 12:47 PM Pankaj Saha wrote: > Hi Shameera, > > Here is a bit of confusion. > The approach should be: when used down load the airavata

Re: The connection between Airavata and micro-service

2015-07-22 Thread Pierce, Marlon
Hi― We have moved away from Web services over the last couple of years to use Apache Thrift. Our overall goal is to use Thrift both externally (the API server) and internally around internal components (the Registry, GFAC, Orchestrator, which are works in progress). So we are very invested in an

The connection between Airavata and micro-service

2015-07-22 Thread 宇菲
I became interested in Airavata one year ago because of micro-service. But I can't find that Airavata come up with micro-service any more. I wonder why? What is the relationship between Airavata and micro-service? Or did you give up the concept of micro-service in Airavata?

Re: Enforcing cross cutting aspects on Thrift API calls with Guice AOP framework

2015-07-22 Thread Amila Jayasekara
Just curious; How do Guice intercept Thrift calls ? -AJ On Mon, Jul 20, 2015 at 11:20 AM, Hasini Gunasinghe wrote: > Hi Marlon, > > On Mon, Jul 20, 2015 at 8:58 AM, Pierce, Marlon wrote: > >> Thanks, Hasini. This is an interesting point. Compared to Web services >> implementations in the past

Re: review - docker pga

2015-07-22 Thread Pankaj Saha
Hi Shameera, Here is a bit of confusion. The approach should be: when used down load the airavata source code, he will get a Dockerfile(not image) with it. He can build his own docker image out of it. He can make changes to source code of airavata php gateway and make docker image out of it. So we

Re: docker use case

2015-07-22 Thread Pankaj Saha
Hi Terri, - Why you decided to use docker? docker is a light weight container which makes the software deployment easy and quick. In a distributed environment when multiple components needs to be installed across many host systems its cumbersome job to install them manually across all the nodes.

Re: review - docker pga

2015-07-22 Thread Shameera Rathnayaka
Hi Pankaj, There are two types of docker images, 1. Released airavata docker images - Here we will directly download binary from one of apache mirror extract it and use. e.g.: after 0.15 release we will have a docker images apache/airavata-:0.15 . Released Dockerfiles are final, we won't change an

docker use case

2015-07-22 Thread Schwartz, Terri
Hi, I've been noticing the emails back and forth about dockerfiles for airavata and am curious about your decision to use docker. We're contemplating using docker and would benefit from understanding your decision. I'd appreciate it if someone would explain: - Why you decided to use docker?

Re: airavata-server docker open issues

2015-07-22 Thread Pankaj Saha
adding one more item in the list 4. Dockerfile should copy the content of airavata server after maven build is completed. It will only copy the class files and executable files no source code is required in the docker image. Now for each branch, maven is creating zip folder with the branch id like

airavata-server docker open issues

2015-07-22 Thread Pankaj Saha
Hello Devs, Here are few open items that we need to fix before we allow Dockerfile to be part of airavata source tree. 1. airavata-server.sh still has dependency on JAVA_HOME env variable. Which we have to change manually after creating docker container. 2. airavata-server.properties file needs

Re: review - docker pga

2015-07-22 Thread Pankaj Saha
we should not copy this from github. Reason is user can have his local version of code and after making changes he may wish to create a docker for his source code. Dockerfile should stay in the root of the airavata-php-gateway source code. If we download it from git for different version then user

Re: review - docker pga

2015-07-22 Thread Shameera Rathnayaka
When ever it is possible, we should reduce number of docker command lines as it create a new layer. in that case not only RUNS we can reduce WORKDIR too by using cd in following line. Is there any special reason you didn't get this from github? if you do that then docker file it self explain whic

Re: Question for dynamic substitution for scientific workflows

2015-07-22 Thread Suresh Marru
Hi Faye, You are on the right mailing list to contact the GSoC students. Doug, John, Can you please share your meta-scheduling goals with Faye and brainstorm on how the workflow scenario Faye is describing can layer over your solutions? It might take few back and forth emails until the goals are

Re: review - docker pga

2015-07-22 Thread Pankaj Saha
Hi Shameera, I think it always good create minimum layers with docker images do you mean concatenating multiple RUN statements together? "COPY ./ /var/www/airavata-php-gateway" is copying the content of the php gateway(/var/www/airavata-php-gateway) from local host system to the docker image. M

Re: Re: Question for dynamic substitution for scientific workflows

2015-07-22 Thread 宇菲
Hi, OK. Thank Suresh and Marlon. I have already done all the tutorials before. Since you are all busy this month, I will try my best by myself recently. However, Suresh said that "there are couple of Google Summer of Code students working on a related project. It will be good if you could co

Re: review - docker pga

2015-07-22 Thread Shameera Rathnayaka
Hi Pankaj, I think it always good create minimum layers with docker images, because it is required to download large number of layers when you push this to registry. base on that I would suggest to create one layer for all prerequisites and one layer for all php extensions. e.g.: RUN apt-get insta

Re: Question for dynamic substitution for scientific workflows

2015-07-22 Thread Suresh Marru
Hi Faye, This will be a good contribution to Airavata. For real-world workflow examples, you can read at - https://sites.google.com/site/earthcubeworkflow/workflow-vignettes We can help you construct some of them, but unfortunately we are all tied up with a Airavata tutorial until end of the month