Jenkins build is back to normal : oodt-trunk #1536

[Apache Jenkins Server]

See 

Re: PushPull directory

[MengYing Wang]

Dear Prof. Mattmann,

Done. I have updated the confluence pages:

https://cwiki.apache.org/confluence/display/OODT/OODT+Push-Pull+User+Guide
https://cwiki.apache.org/confluence/display/OODT/OODT+Push+Pull+Plugins

And send the solution email back to you and dev@oodt.apache.org through the
page https://www.mail-archive.com/dev@oodt.apache.org/msg04276.html. It may
take some days to update the mail archive?

Thanks,
Mengying Wang

On Thu, Oct 16, 2014 at 4:47 PM, Mattmann, Chris A (3980) <
chris.a.mattm...@jpl.nasa.gov> wrote:

>  Please send out how you solved it Angela thanks
>
> Sent from my iPhone
>
> On Oct 16, 2014, at 4:38 PM, "MengYing Wang" 
> wrote:
>
>   Dear Tyler,
>
>   The pushpull problem has been solved. Now I could use pushpull to crawl
> some remote ftp directories. Thank you.
>
>  Best,
> Mengying Wang
>
>
>
>
>
> On Thu, Oct 16, 2014 at 2:47 PM, Tyler Palsulich 
> wrote:
>
>> Hi Mengying,
>>
>>  Did you ever make any progress on this? What exactly were you trying to
>> do, again? What error are you seeing?
>>
>>  Thanks,
>> Tyler
>>
>> On Sun, Oct 5, 2014 at 10:26 AM, MengYing Wang 
>> wrote:
>>
>>> Dear Prof. Mattmann and Tyler,
>>>
>>>  This is the pushpull zip file. ​
>>>   cas-pushpull-0.6.zip
>>> 
>>> ​
>>> Thank you for your help!
>>>
>>>  Best,
>>> Mengying (Angela) Wang
>>>
>>> On Sun, Oct 5, 2014 at 9:56 AM, Tyler Palsulich 
>>> wrote:
>>>
  > MY COMMENT: Please send me your  zipped up. I will
 >take a look - Tyler can you also look?

 Yup! We'll get it sorted out.

>>>
>>>
>>>
>>>  --
>>>  Best,
>>> Mengying (Angela) Wang
>>>
>>
>>
>
>
>  --
>  Best,
> Mengying (Angela) Wang
>
>


-- 
Best,
Mengying (Angela) Wang

Re: No data files are downloaded using Apache OODT Pushpull

[Chris Mattmann]

Thank you Angela!

Chris Mattmann
chris.mattm...@gmail.com




-Original Message-
From: Mengying Wang 
Reply-To: 
Date: Friday, October 17, 2014 at 11:06 AM
To: , Chris Mattmann 
Subject: Re: No data files are downloaded using Apache OODT Pushpull

>Dear Mattmann,
>
>Problem solved. I have made the following 2 changes:
>
>1: Change the active status of the daemon from ¹no¹ to Œyes¹. That is,
>
>[CAS_PP_HOME]/etc/examples/RemoteSpecsFiles/RemoteSpecs.xml
>
>
>  period="3m">epsilon="20s" runOnReboot="yes"/>
> ..
>
>
>
>2: It is mainly caused by the protocol issues of the PushPull ftp plugins.
>So I used the other PushPull ftp plugins. For the details please refer to
>OODT Push Pull Plugins.
>
>Then everything is ok. Thank you for your help!
>
>Best,
>Angela Wang

Re: No data files are downloaded using Apache OODT Pushpull

[AngelaWang]

Dear Mattmann,

Problem solved. I have made the following 2 changes:

1: Change the active status of the daemon from ’no’ to ‘yes’. That is, 

[CAS_PP_HOME]/etc/examples/RemoteSpecsFiles/RemoteSpecs.xml


epsilon="20s" runOnReboot="yes"/>
..



2: It is mainly caused by the protocol issues of the PushPull ftp plugins. So I 
used the other PushPull ftp plugins. For the details please refer to OODT Push 
Pull Plugins.

Then everything is ok. Thank you for your help!

Best,
Angela Wang

Re: No data files are downloaded using Apache OODT Pushpull

[Mengying Wang]

Dear Mattmann,

Problem solved. I have made the following 2 changes:

1: Change the active status of the daemon from ’no’ to ‘yes’. That is,

[CAS_PP_HOME]/etc/examples/RemoteSpecsFiles/RemoteSpecs.xml


  epsilon="20s" runOnReboot="yes"/>
 ..



2: It is mainly caused by the protocol issues of the PushPull ftp plugins.
So I used the other PushPull ftp plugins. For the details please refer to
OODT Push Pull Plugins.

Then everything is ok. Thank you for your help!

Best,
Angela Wang

Re: Evaluate Suitable Scientific Workflow Language for Airavata.

[Shameera Rathnayaka]

Hi Supun,

I meant to say JS is a well-known client side scripting language i have
messed scripting part. Even we use Python, ultimately we should convert
this to java model in server side, somehow we need to serialized python
representation to the language which java can parse and generate that
model. In this case we need to parse python script in java isn't it? I am
not exactly clear how you suggesting to use python here. More details on
how end system works if we use Python would be great help to clearly
understand your points.

Thanks,
Shameera.

On Fri, Oct 17, 2014 at 1:00 AM, Chris Mattmann 
wrote:

> Have you guys considered using JCC [1] as a means
> to expose the workflow API currently in Java as a
> Python API?
>
> We are exploring its use in OODT, and we have already
> created a Tika [2] JCC-based python API.
>
> Cheers,
> Chris
>
> [1] http://lucene.apache.org/pylucene/jcc/
> [2] http://github.com/chrismattmann/tika-python/
>
> 
> Chris Mattmann
> chris.mattm...@gmail.com
>
>
>
>
> -Original Message-
> From: Supun Kamburugamuva 
> Reply-To: 
> Date: Thursday, October 16, 2014 at 3:43 PM
> To: dev 
> Cc: "Alek Jones (Indiana)" , Suresh Marru
> , "architect...@airavata.apache.org"
> , "dev@oodt.apache.org"
> 
> Subject: Re: Evaluate Suitable Scientific Workflow Language for Airavata.
>
> >Once we had an offline discussion about the Airavata Workflow language
> >(with Milinda, Saliya and Shameera). In that discussion one thing came out
> >was why we need to invent a different language when a simple library like
> >Python will full fill of Airavata requirements.
> >
> >There are many benefits in using a Python library as the API for
> >controlling Airavata workflows.
> >
> >1. It is a library, gives the ultimate control over the execution and it
> >can be simpler than any domain specific language that we can come with
> >like
> >XML, JSON etc
> >2. Most people use python and can learn it easily than any Domain specific
> >language
> >3. You can easily create a Python library for Airavata because all the
> >APIs
> >are thrift based.
> >4. If you design the constructs correctly you can plug an XBaya.
> >
> >Any thoughts?
> >
> >Thanks,
> >Supun..
> >
> >
> >On Thu, Oct 16, 2014 at 6:30 PM, Supun Kamburugamuva 
> >wrote:
> >
> >> Hi Shameera,
> >>
> >> Why you prefer JavaScript over a language like Python?
> >>
> >> Thanks,
> >> Supun..
> >>
> >> On Thu, Oct 16, 2014 at 6:25 PM, Shameera Rathnayaka <
> >> shameerai...@gmail.com> wrote:
> >>
> >>> ​Hi,
> >>>
> >>> First of all thanks everyone for giving valuable inputs. After doing
> >>>some
> >>> background search and talking to different people in the University
> >>>who has
> >>> used different workflow languages, I myself convinced that introducing
> >>>an
> >>> another workflow language is not what actually they need. By changing
> >>> exiting workflow language to another will not solve problems. What they
> >>> asking is a easy way to construct the workflows. Indirectly what they
> >>> asking for a sort of API which they can use to generate the workflows
> >>>and
> >>> run it. Correct me if i am wrong here.
> >>>
> >>> As most of above replies depict,  if we can get a simple API, as an
> >>> example, for a web based application, JavaScript API would be a good
> >>> solution, and probably JSON would be a good candidate for language,
> >>>instead
> >>> of XML.
> >>>
> >>> Airavata community already have started to implement web base GUI.
> >>>Hence
> >>> introducing a JSON base JavaScript API would be great help. WDYT?
> >>>
> >>> Thanks,
> >>> Shameera.
> >>>
> >>>
> >>> On Fri, Sep 19, 2014 at 5:01 PM, Aleksander Slominski (NY) <
> >>> alek...@gmail.com> wrote:
> >>>
>  Hi,
> 
>  it is not dataflow instead focused on orchestrating REST services but
>  you may find it useful datapoint - we created worfklow service that
> uses
>  natively JavaScript and JSON to describe what happens during workflow
>  execution:
> 
> https://www.ng.bluemix.net/docs/#services/workflow/index.html#coewf002
> 
>  HTH,
> 
>  Alek
> 
>  On Thu, Sep 18, 2014 at 1:54 PM, Suresh Marru 
> wrote:
> 
> > Hi Chris,
> >
> > Great to hear OODT community will be interested in adopting a JSON
> > based workflow language and potentially a web based composer as well.
> > Airavata previously had BPEL support initially through a home grown
> > implementation [1] by Alek Slominski and later through Apache ODE
> >[2]. Also
> > a white paper [3] by Alek on this topic is an interesting read.
> >
> > I am of the same opinion that we should adopt something more modern
> >as
> > the challenges from scientific workflows seems to be converging with
> >the
> > data flow patterns in business workflows.
> >
> > It will be great if we can all compile a list of potential candidates
> > and hack them through.
> >
> > Suresh
>