RE: intermittent tests

[Ross Laidlaw]

p.s. Apologies for the formatting in my previous message (sent it from my
phone)



Begin forwarded message:

*From:* Ross Laidlaw 
*Date:* 22 June 2013 18:42:06 BST
*To:* "dev@oodt.apache.org" 
*Subject:* *Re: intermittent tests*

Hi Lewis,

I made a commit this morning to the trunk (r1495698) which triggered
Jenkins build #984.  When I saw the build failure I thought "uh oh... have
I just broken something?" but the changes from the previous build were tiny
(CHANGES.txt and a couple of Javadoc edits in the DataDeliveryServlet
class, no code changes).  I had a quick look through the console output for
the build and saw the following (you've probably already seen this before
posting your email):

Java HotSpot(TM) Server VM warning: Insufficient space for shared memory
file:
   /tmp/hsperfdata_jenkins/29391
Try using the -Djava.io.tmpdir= option to select an alternate temp location.

I'm not sure if this was a one-off glitch or whether it also caused some of
the other build failures.

Ross




On 22 Jun 2013, at 17:11, Lewis John Mcgibbney 
wrote:

Good Morning,
The intermittent test can be attributed to memory allocation on whichever
slave we build oodt trunk on.
I am not really comfortable with the fact that the buulds fails like
this...
I will try my best to look in to this... regards less if it means assigning
more mem to the builfd?
Any thoughts? All works good for me every day and I do svn up every day
Have a great weekend troops
Lewis

-- 
*Lewis*

Re: OODT build issues (Fwd: APPS Third-party (TPS) software component list)

[Mattmann, Chris A (398J)]

Hi Greg,

Thanks for your questions (copying the dev@ list per our discussion).
My replies inline below:

-Original Message-

From: Greg Earle 
Date: Wednesday, June 19, 2013 10:55 PM
To: jpluser 
Cc: Greg Earle , "Lee, Hyun H (398J)"

Subject: OODT build issues (Fwd: APPS Third-party (TPS) software component
list)

>Hi Chris (and Hyun),
>
>I was asked by Costin Radulescu to install Apache OODT on one of our
>Dev systems.  It's a Linux box running 64-bit Red Hat RHEL 6.3.
>
>He had sent me a TPS request (formalized form we use in MIPL) asking
>for the "Latest" version, but later on sent an Excel spreadsheet that
>specifically mentioned version 0.3.  (But I think that was only because
>he made up the spreadsheet some months back.)

Yep latest version is 0.6-SNAPSHOT (trunk). Should be released in the
next week or so, but it's fairly stable right now. I'm going to RM it.

>
>I first tried using Maven 3.0.1 but it splatted all over the place.

0.3 will do that to you since we didn't support Maven3 until OODT-369 [1]
which will ship in 0.6 (and is available now in trunk/0.6-SNAPSHOT).


>I fell back to Maven 2.2.1 which seemed to make OODT a lot happier.

Heh, yep.

>
>Anyway, I was able to build 0.3 OK; but then I thought I should try to
>build the latest & greatest 0.5.  The following message chronicles the
>2 major problems I ran into (in copious detail - sorry) with both 0.5
>and 0.4 (which I tried after 0.5 failed).  Executive summary:
>
>(1) Catalog and Archive Service Generic Multi-valued Metadata Container
>
>A couple of the tests seem to have a race condition where they try to
>clean up their mess and remove a temporary metadata .tests directory
>before all the files are completely removed (NFS issue; possibly due
>to caching/sync), provoking 2 ENOTEMPTY errors.

Yep this is an NFS issue -- you can always change this with a
java.io.tmpDir
property (passed to Maven with mvn
-Djava.io.tmpDir=/some/where/not/on/nfs).
Issue described in detail here:

https://issues.apache.org/jira/browse/OODT-110


>
>(2) CAS Protocol SFTP Implementation
>
>The "TestJschSftpProtocol" test is failing because it can't contact
>whatever server it is trying to contact ("Connection refused").

Odd, it should be trying to connect locally.

>
>If you could give a quick glance-over to this (overly verbose, sorry)
>transcript and suggest anything (like resources to consult) that would
>help me potentially get past these 2 issues, I'd appreciate it.

No worries -- if you get failing tests like the above and they are blocking
progress you can always type mvn -Dmaven.skip.tests=true install and then
that should get you past.

>
>In the meantime I'm going to ask Costin if he can get along with using
>version 0.3 in the interim.

Try 0.6-SNAPSHOT -- should work better :)

Also happy to answer any further questions here on list. Cheers!

Chris

[1] https://issues.apache.org/jira/browse/OODT-369

++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattm...@nasa.gov
WWW:  http://sunset.usc.edu/~mattmann/
++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++



>
>Begin forwarded message:
>
>> From: Greg Earle 
>> Date: June 19, 2013 10:28:57 PM PDT
>> To: Costin Radulescu , "Levoe, Steven R (398D)"
>>
>> Cc: Alex Leung , Greg Earle
>>
>> Subject: Re: APPS Third-party (TPS) software component list
>> content-type: text/plain; charset=us-ascii
>> 
>> On Jun 19, 2013, at 5:17 PM, Greg Earle wrote:
>> 
>>> I installed the "apache-oodt-0.3-src.tar.gz" file into "external"
>>> because I think you said it had been donated(?) to The Apache
>>>Foundation
>>> and thus was no longer JPL/NASA Proprietary ... right?
>>> 
>>> I compared the Apache version to the old JPL one and the JPL one
>>> just has a "oodt.jar" file (with some docs) - but the Apache one
>>> looks like it's a zillion ".java" files that need to be built with
>>> Maven, which isn't installed yet.
>> 
>> [Removed Janet from the long boring technical discussion.  Sorry Janet.]
>> 
>> Update:
>> 
>> OK - so I found a Maven RPM
>>(apache-maven-3.0.3-1.el6.sroycode.noarch.rpm)
>> and installed it.
>> 
>> The README.txt file in the OODT 0.3 "src" directory says to just run
>> "mvn install" to build it.  I tried that but it croaked.
>> 
>> Then I looked in the README.txt file again and it says it uses Maven2.
>> 
>> So I installed Maven 2.2.1 instead (into externals, alongside
>>apache-oodt -
>> no RPM for it that I could find which didn't have a ton of dependencies)
>> and this time it built all the way through; albeit with a bunch of
>> "WARNING" messages.
>> 
>> It looks like it built a bunch of .j

Re: intermittent tests

[Ross Laidlaw]

Hi Lewis,

I made a commit this morning to the trunk (r1495698) which triggered Jenkins 
build #984.  When I saw the build failure I thought "uh oh... have I just 
broken something?" but the changes from the previous build were tiny 
(CHANGES.txt and a couple of Javadoc edits in the DataDeliveryServlet class, no 
code changes).  I had a quick look through the console output for the build and 
saw the following (you've probably already seen this before posting your email):

Java HotSpot(TM) Server VM warning: Insufficient space for shared memory file:
   /tmp/hsperfdata_jenkins/29391
Try using the -Djava.io.tmpdir= option to select an alternate temp location.

I'm not sure if this was a one-off glitch or whether it also caused some of the 
other build failures.

Ross




On 22 Jun 2013, at 17:11, Lewis John Mcgibbney  
wrote:

> Good Morning,
> The intermittent test can be attributed to memory allocation on whichever
> slave we build oodt trunk on.
> I am not really comfortable with the fact that the buulds fails like
> this...
> I will try my best to look in to this... regards less if it means assigning
> more mem to the builfd?
> Any thoughts? All works good for me every day and I do svn up every day
> Have a great weekend troops
> Lewis
> 
> -- 
> *Lewis*

Jenkins build is back to normal : oodt-trunk #985

[Apache Jenkins Server]

See 

intermittent tests

[Lewis John Mcgibbney]

Good Morning,
The intermittent test can be attributed to memory allocation on whichever
slave we build oodt trunk on.
I am not really comfortable with the fact that the buulds fails like
this...
I will try my best to look in to this... regards less if it means assigning
more mem to the builfd?
Any thoughts? All works good for me every day and I do svn up every day
Have a great weekend troops
Lewis

-- 
*Lewis*

Build failed in Jenkins: oodt-trunk #984

[Apache Jenkins Server]

See 

Changes:

[rlaidlaw] OODT-636: Fixed Javadoc warnings for CAS-Product

--
[...truncated 3572 lines...]
A commons
A commons/src
A commons/src/test
A commons/src/test/org
A commons/src/test/org/apache
A commons/src/test/org/apache/oodt
A commons/src/test/org/apache/oodt/commons
A commons/src/test/org/apache/oodt/commons/AbstractTestCase.java
A commons/src/test/org/apache/oodt/commons/NaughtyTest.java
A commons/src/test/org/apache/oodt/commons/AppTest.java
A commons/src/test/org/apache/oodt/commons/ConfiguredTestCaseTest.java
A commons/src/test/org/apache/oodt/commons/MultiServerTest.java
A commons/src/test/org/apache/oodt/commons/exec
AUcommons/src/test/org/apache/oodt/commons/exec/TestEnvUtilities.java
A commons/src/test/org/apache/oodt/commons/filter
AU
commons/src/test/org/apache/oodt/commons/filter/TestTimeEventWeightedHash.java
A commons/src/test/org/apache/oodt/commons/net
A commons/src/test/org/apache/oodt/commons/net/NetTest.java
A commons/src/test/org/apache/oodt/commons/object
A commons/src/test/org/apache/oodt/commons/object/jndi
A commons/src/test/org/apache/oodt/commons/object/jndi/TestContext.java
A 
commons/src/test/org/apache/oodt/commons/object/jndi/TestContextTest.java
A 
commons/src/test/org/apache/oodt/commons/object/jndi/ObjectContextTest.java
A commons/src/test/org/apache/oodt/commons/ConfigurationTest.java
A commons/src/test/org/apache/oodt/commons/io
A 
commons/src/test/org/apache/oodt/commons/io/FixedBufferOutputStreamTest.java
A commons/src/test/org/apache/oodt/commons/io/NullInputStreamTest.java
A commons/src/test/org/apache/oodt/commons/io/NullOutputStreamTest.java
AU
commons/src/test/org/apache/oodt/commons/io/TestLoggerOutputStream.java
A commons/src/test/org/apache/oodt/commons/activity
AU
commons/src/test/org/apache/oodt/commons/activity/CompositeActivityTest.java
AUcommons/src/test/org/apache/oodt/commons/activity/HistoryTest.java
AU
commons/src/test/org/apache/oodt/commons/activity/ActivityTrackerTest.java
AU
commons/src/test/org/apache/oodt/commons/activity/ActivityStoppedTest.java
AUcommons/src/test/org/apache/oodt/commons/activity/ActivityTest.java
AU
commons/src/test/org/apache/oodt/commons/activity/DatagramLoggingActivityFactoryTest.java
AUcommons/src/test/org/apache/oodt/commons/activity/IncidentTest.java
A commons/src/test/org/apache/oodt/commons/util
A 
commons/src/test/org/apache/oodt/commons/util/EnterpriseEntityResolverTest.java
A commons/src/test/org/apache/oodt/commons/util/LDAPTest.java
A commons/src/test/org/apache/oodt/commons/util/XMLTest.java
A commons/src/test/org/apache/oodt/commons/util/CacheMapTest.java
A commons/src/test/org/apache/oodt/commons/util/UtilityTest.java
A commons/src/test/org/apache/oodt/commons/util/Base64Test.java
A commons/src/main
A commons/src/main/java
A commons/src/main/java/org
A commons/src/main/java/org/apache
A commons/src/main/java/org/apache/oodt
A commons/src/main/java/org/apache/oodt/commons
A commons/src/main/java/org/apache/oodt/commons/Service.java
A commons/src/main/java/org/apache/oodt/commons/ExecServerConfig.java
A commons/src/main/java/org/apache/oodt/commons/exec
A commons/src/main/java/org/apache/oodt/commons/exec/EnvUtilities.java
AUcommons/src/main/java/org/apache/oodt/commons/exec/ExecHelper.java
AUcommons/src/main/java/org/apache/oodt/commons/exec/ExecUtils.java
AUcommons/src/main/java/org/apache/oodt/commons/exec/StreamGobbler.java
A commons/src/main/java/org/apache/oodt/commons/filter
A commons/src/main/java/org/apache/oodt/commons/filter/TimeEvent.java
AU
commons/src/main/java/org/apache/oodt/commons/filter/TimeEventWeightedHash.java
A 
commons/src/main/java/org/apache/oodt/commons/filter/ObjectTimeEvent.java
A commons/src/main/java/org/apache/oodt/commons/net
A commons/src/main/java/org/apache/oodt/commons/net/Net.java
A commons/src/main/java/org/apache/oodt/commons/Configuration.java
A commons/src/main/java/org/apache/oodt/commons/EDAException.java
A commons/src/main/java/org/apache/oodt/commons/pagination
A 
commons/src/main/java/org/apache/oodt/commons/pagination/PaginationUtils.java
A commons/src/main/java/org/apache/oodt/commons/ExecServer.java
A commons/src/main/java/org/apache/oodt/commons/activity
A 
commons/src/main/java/org/apache/oodt/commons/activity/NullStorage.java
A 
commons/src/main/java/org/apache/oodt/commons/activity/WriterStorage.ja