RE: [VOTE] Apache OODT 0.10 RC #2

2015-09-04 Thread Mallder, Valerie
Hi Chris,

I just started working with release candidate #1, to see if it solves the 
serialization exceptions I've been getting when try to use the resource 
manager. Haven't gotten far enough to make an assessment yet. Unfortunately, I 
won't be back to work within 72 hours to try to start checking out #2. If you 
want to release it before I have a chance to play with it, I won't be offended. 
Just wanted to give you a heads up that I probably wont be able to vote within 
the 72 hrs.

Val



Sent from my iPhone.

From: Chris Mattmann 
Sent: Friday, September 4, 2015 5:59:46 PM
To: dev@oodt.apache.org
Subject: [VOTE] Apache OODT 0.10 RC #2

Hi Folks,

I have posted a 2nd release candidate for the Apache OODT 0.10
release.  The source code is at:

https://dist.apache.org/repos/dist/dev/oodt/

For more detailed information, see the included CHANGES.txt file
for details on release contents and latest changes. The release was
made using the OODT release process, documented on the Wiki here:

https://cwiki.apache.org/confluence/display/OODT/Release+Process

The release was made from the OODT 0.10 tag (r1701325) at:

http://svn.apache.org/repos/asf/oodt/tags/0.10-rc2/

A staged Maven repository is available at:

https://repository.apache.org/content/repositories/orgapacheoodt-1007/


Please vote on releasing these packages as Apache OODT 0.10. The
vote is open for at least the next 72 hours.

Only votes from OODT PMC are binding, but folks are welcome to check
the release candidate and voice their approval or disapproval. The
vote passes if at least three binding +1 votes are cast.

[ ] +1 Release the packages as Apache OODT 0.10

[ ] -1 Do not release the packages because...

Thanks!

Cheers,
Chris

P.S. Here is my +1.





Re: [VOTE] Apache OODT 0.10 RC #2

2015-09-04 Thread kelly
MD5: matches
SHA1: matches
Signature: Good signature from "Chris Mattmann (CODE SIGNING KEY) 
"
Python tests: Ran 34 tests in 0.014s, OK
Java tests: maven-3.2.1, jdk 1.7.0_25, OK

> [✓] +1 Release the packages as Apache OODT 0.10

Make it so.

--k

[VOTE] Apache OODT 0.10 RC #2

2015-09-04 Thread Chris Mattmann
Hi Folks,

I have posted a 2nd release candidate for the Apache OODT 0.10
release.  The source code is at:

https://dist.apache.org/repos/dist/dev/oodt/

For more detailed information, see the included CHANGES.txt file
for details on release contents and latest changes. The release was
made using the OODT release process, documented on the Wiki here:

https://cwiki.apache.org/confluence/display/OODT/Release+Process

The release was made from the OODT 0.10 tag (r1701325) at:

http://svn.apache.org/repos/asf/oodt/tags/0.10-rc2/

A staged Maven repository is available at:

https://repository.apache.org/content/repositories/orgapacheoodt-1007/


Please vote on releasing these packages as Apache OODT 0.10. The
vote is open for at least the next 72 hours.

Only votes from OODT PMC are binding, but folks are welcome to check
the release candidate and voice their approval or disapproval. The
vote passes if at least three binding +1 votes are cast.

[ ] +1 Release the packages as Apache OODT 0.10

[ ] -1 Do not release the packages because...

Thanks!

Cheers,
Chris

P.S. Here is my +1.





Re: Review Request 38021: OODT-872 Upgrade Jena dependencies to org.apache.jena 3.0.0

2015-09-04 Thread Chris Mattmann

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38021/#review97779
---


Lewis I applied this patch and tried it on the 0.10 RC #2 branch that I'm about 
to ship. Weirdly enough tests don't pass in commons:

{{{
[dhcp-137-79-206-90:~/tmp/oodt0.11] mattmann% more 
commons/target/surefire-reports/org.apache.oodt.commons.util.XMLTest.txt 
---
Test set: org.apache.oodt.commons.util.XMLTest
---
Tests run: 9, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 0.253 sec <<< 
FAILURE!
testDOM(org.apache.oodt.commons.util.XMLTest)  Time elapsed: 0.092 sec  <<< 
FAILURE!
junit.framework.AssertionFailedError: Stringified DOM document CRC mismatch, 
got value = 1102069581
at junit.framework.Assert.fail(Assert.java:47)
at junit.framework.Assert.assertTrue(Assert.java:20)
at org.apache.oodt.commons.util.XMLTest.testDOM(XMLTest.java:62)

testDump(org.apache.oodt.commons.util.XMLTest)  Time elapsed: 0.006 sec  <<< 
FAILURE!
junit.framework.AssertionFailedError: Dumped DOM tree CRC mismatch; got 
3208931170
at junit.framework.Assert.fail(Assert.java:47)
at junit.framework.Assert.assertTrue(Assert.java:20)
at org.apache.oodt.commons.util.XMLTest.testDump(XMLTest.java:88)

[dhcp-137-79-206-90:~/tmp/oodt0.11] mattmann% 
}}}

{{{
---
 T E S T S
---
Running org.apache.oodt.commons.util.LDAPTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.03 sec
Running org.apache.oodt.commons.activity.ActivityStoppedTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.13 sec
Running org.apache.oodt.commons.io.FixedBufferOutputStreamTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.024 sec
Running org.apache.oodt.commons.ConfiguredTestCaseTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.716 sec
Running org.apache.oodt.commons.NaughtyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.027 sec
Running org.apache.oodt.commons.net.NetTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.041 sec
Running org.apache.oodt.commons.util.Base64Test
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.031 sec
Running org.apache.oodt.commons.util.EnterpriseEntityResolverTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.151 sec
Running org.apache.oodt.commons.ConfigurationTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.21 sec
Running org.apache.oodt.commons.activity.DatagramLoggingActivityFactoryTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.096 sec
Running org.apache.oodt.commons.activity.ActivityTrackerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.052 sec
Running org.apache.oodt.commons.util.XMLTest
Tests run: 9, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 0.253 sec <<< 
FAILURE!
Running org.apache.oodt.commons.activity.ActivityTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.043 sec
Running org.apache.oodt.commons.io.DirectorySelectorTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.027 sec
Running org.apache.oodt.commons.filter.TestTimeEventWeightedHash
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.053 sec
Running org.apache.oodt.commons.activity.CompositeActivityTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.071 sec
Running org.apache.oodt.commons.object.jndi.ObjectContextTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.043 sec
Running org.apache.oodt.commons.util.CacheMapTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec
Running org.apache.oodt.commons.util.UtilityTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.03 sec
Running org.apache.oodt.commons.MultiServerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.19 sec
Running org.apache.oodt.commons.io.TestLoggerOutputStream
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.03 sec
Running org.apache.oodt.commons.io.NullInputStreamTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec
Running org.apache.oodt.commons.exec.TestEnvUtilities
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.026 sec
Running org.apache.oodt.commons.AppTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec
Running org.apache.oodt.commons.object.jndi.TestContextTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.02 sec
Running org.apache.oodt.commons.io.NullOutputStreamTest
Tes

Re: OODT File Manager - Airavata Integration Document

2015-09-04 Thread Suresh Marru
OODT Dev's

Does the CAS or other OODT components have irods (http://irods.org/)
integration? I am trying to work on a use case to integrate irdos
functionality to Airavata. If OODT components already layer over irods,
thats probably the better way to go.

Cheers,
Suresh

On Tue, Sep 1, 2015 at 1:36 AM Chris Mattmann 
wrote:

> Great to hear. I’ll check it out.
>
> —
> Chris Mattmann
> chris.mattm...@gmail.com
>
>
>
>
>
>
> -Original Message-
> From: DImuthu Upeksha 
> Reply-To: 
> Date: Monday, August 31, 2015 at 9:03 PM
> To: , "d...@airavata.apache.org"
> 
> Subject: Re: OODT File Manager - Airavata Integration Document
>
> >Hi Chris,
> >
> >Thank you for your feedback. This is a POC level implementation done by me
> >and there is a lot of room for improvement. It would be great if both
> >Airavata and OODT teams can go through the design and decide whether
> >Airavata can be integrated with OODT File manager. But my idea is, yes it
> >is possible.
> >
> >Thanks,
> >Dimuthu
> >
> >On Tue, Sep 1, 2015 at 5:07 AM, Mattmann, Chris A (3980) <
> >chris.a.mattm...@jpl.nasa.gov> wrote:
> >
> >> Great work Dimuthu!
> >>
> >> So this means now Airavata and OODT’s File Manager are integrated?
> >> :=)
> >>
> >> CC/dev@oodt.a.o
> >>
> >> Cheers,
> >> Chris
> >>
> >> ++
> >> Chris Mattmann, Ph.D.
> >> Chief Architect
> >> Instrument Software and Science Data Systems Section (398)
> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >> Office: 168-519, Mailstop: 168-527
> >> Email: chris.a.mattm...@nasa.gov
> >> WWW:  http://sunset.usc.edu/~mattmann/
> >> ++
> >> Adjunct Associate Professor, Computer Science Department
> >> University of Southern California, Los Angeles, CA 90089 USA
> >> ++
> >>
> >>
> >>
> >>
> >>
> >> -Original Message-
> >> From: DImuthu Upeksha 
> >> Reply-To: "d...@airavata.apache.org" 
> >> Date: Saturday, August 29, 2015 at 1:27 AM
> >> To: "d...@airavata.apache.org" 
> >> Subject: OODT File Manager - Airavata Integration Document
> >>
> >> >Hi all,
> >> >
> >> >
> >> >Please find the document [1] that describes the steps followed in the
> >> >attempt of integrating OODT File Manager and AIravata. This setup is
> >> >currently working on gw77.
> >> >
> >> >
> >> >[1]
> >> >
> >>
> >>
> https://docs.google.com/document/d/1mr3k_OmgEweeVhJtuMTvofL__v9uPwyWbWrP-
> >>M
> >> >OFUDw/edit?usp=sharing
> >> >
> >> >
> >> >Thanks
> >> >Dimuthu
> >> >
> >> >
> >> >--
> >> >Regards
> >> >W.Dimuthu Upeksha
> >> >Undergraduate
> >> >Department of Computer Science And Engineering
> >> >University of Moratuwa, Sri Lanka
> >> >
> >> >
> >> >
> >>
> >>
> >
> >
> >--
> >Regards
> >
> >W.Dimuthu Upeksha
> >Undergraduate
> >Department of Computer Science And Engineering
> >
> >University of Moratuwa, Sri Lanka
>
>
>


Re: Review Request 37705: Full implementation of Avro RPC cas-workflow module.

2015-09-04 Thread Radu Manole

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37705/
---

(Updated Sept. 4, 2015, 2:29 p.m.)


Review request for oodt, Lewis McGibbney and Chris Mattmann.


Changes
---

Change the structure of workflow client/server, now it can be configurated in 
properties file what implementation should be used.


Repository: oodt


Description
---

Extracted interfaces from workflow server and client, and created Avro RPC base 
communication. Created Avro types for transmision, and a factory that manages 
trasformation from avro type to oodt type. Scrips now use Avro rpc.


Diffs (updated)
-

  
trunk/crawler/src/main/java/org/apache/oodt/cas/crawl/action/WorkflowMgrStatusUpdate.java
 1693501 
  
trunk/mvn/archetypes/radix/src/main/resources/archetype-resources/workflow/src/main/resources/bin/wmgr
 1693501 
  
trunk/mvn/archetypes/radix/src/main/resources/archetype-resources/workflow/src/main/resources/bin/wmgr-client
 1693501 
  
trunk/pcs/core/src/main/java/org/apache/oodt/pcs/util/WorkflowManagerUtils.java 
1693501 
  trunk/pge/src/main/java/org/apache/oodt/cas/pge/PGETaskInstance.java 1693501 
  trunk/pge/src/test/java/org/apache/oodt/cas/pge/TestPGETaskInstance.java 
1693501 
  
trunk/webapp/components/src/main/java/org/apache/oodt/cas/webcomponents/workflow/WorkflowMgrConn.java
 1693501 
  trunk/workflow/pom.xml 1693501 
  trunk/workflow/src/main/avro/types/AvroWorkflow.avsc PRE-CREATION 
  trunk/workflow/src/main/avro/types/AvroWorkflowCondition.avsc PRE-CREATION 
  trunk/workflow/src/main/avro/types/AvroWorkflowInstance.avsc PRE-CREATION 
  trunk/workflow/src/main/avro/types/AvroWorkflowInstancePage.avsc PRE-CREATION 
  trunk/workflow/src/main/avro/types/AvroWorkflowTask.avsc PRE-CREATION 
  trunk/workflow/src/main/avro/types/protocol.avdl PRE-CREATION 
  trunk/workflow/src/main/bin/wmgr 1693501 
  trunk/workflow/src/main/bin/wmgr-client 1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/cli/action/GetFirstPageCliAction.java
 1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/cli/action/GetLastPageCliAction.java
 1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/cli/action/GetNextPageCliAction.java
 1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/cli/action/GetPrevPageCliAction.java
 1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/cli/action/GetWorkflowInstCliAction.java
 1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/cli/action/GetWorkflowInstsCliAction.java
 1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/cli/action/WorkflowCliAction.java
 1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/examples/BranchRedirector.java
 1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/examples/RandomStatusUpdateTask.java
 1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/structs/TaskJob.java 
1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/structs/WorkflowInstancePage.java
 1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/AvroRpcWorkflowManager.java
 PRE-CREATION 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/AvroRpcWorkflowManagerClient.java
 PRE-CREATION 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/WorkflowManager.java
 PRE-CREATION 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/WorkflowManagerClient.java
 PRE-CREATION 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/WorkflowManagerClientStarter.java
 PRE-CREATION 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/WorkflowManagerStarter.java
 PRE-CREATION 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/XmlRpcWorkflowManager.java
 1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/XmlRpcWorkflowManagerClient.java
 1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/rpc/AvroRpcWorkflowManagerFactory.java
 PRE-CREATION 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/rpc/RpcCommunicationFactory.java
 PRE-CREATION 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/rpc/WorkflowManagerFactory.java
 PRE-CREATION 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/rpc/XmlRpcWorkflowManagerFactory.java
 PRE-CREATION 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/tools/InstanceRepoCleaner.java
 1693501 
  
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/util/AvroTypeFactory.java
 PRE-CREATION 
  trunk/workflow/src/main/resources/workflow.properties 1693501 
  
trunk/workflow/src/test/java/org/apache/oodt/cas/workflow/cli/TestWorkflowCli.java
 1693501 
  
trunk/workflow/src/test/java/org/apache/oodt/cas/work