[jira] [Commented] (HDFS-3243) TestParallelRead timing out on jenkins

2012-04-11 Thread Hudson (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13251540#comment-13251540
 ] 

Hudson commented on HDFS-3243:
--

Integrated in Hadoop-Hdfs-trunk #1011 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1011/])
HDFS-3243. TestParallelRead timing out on jenkins. Contributed by Henry 
Robinson. (Revision 1312029)

 Result = FAILURE
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1312029
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestParallelReadUtil.java


 TestParallelRead timing out on jenkins
 --

 Key: HDFS-3243
 URL: https://issues.apache.org/jira/browse/HDFS-3243
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: hdfs client, test
Reporter: Todd Lipcon
Assignee: Henry Robinson
 Fix For: 3.0.0

 Attachments: HDFS-3243.0.patch


 Trunk builds have been failing recently due to a TestParallelRead timeout. It 
 doesn't report in the Jenkins failure list because surefire handles timeouts 
 really poorly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HDFS-3243) TestParallelRead timing out on jenkins

2012-04-11 Thread Hudson (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13251591#comment-13251591
 ] 

Hudson commented on HDFS-3243:
--

Integrated in Hadoop-Mapreduce-trunk #1046 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1046/])
HDFS-3243. TestParallelRead timing out on jenkins. Contributed by Henry 
Robinson. (Revision 1312029)

 Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1312029
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestParallelReadUtil.java


 TestParallelRead timing out on jenkins
 --

 Key: HDFS-3243
 URL: https://issues.apache.org/jira/browse/HDFS-3243
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: hdfs client, test
Reporter: Todd Lipcon
Assignee: Henry Robinson
 Fix For: 3.0.0

 Attachments: HDFS-3243.0.patch


 Trunk builds have been failing recently due to a TestParallelRead timeout. It 
 doesn't report in the Jenkins failure list because surefire handles timeouts 
 really poorly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HDFS-3243) TestParallelRead timing out on jenkins

2012-04-10 Thread Todd Lipcon (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250803#comment-13250803
 ] 

Todd Lipcon commented on HDFS-3243:
---

Seems like this test was lengthened by HDFS-2834. I'm not sure yet whether it 
represents a performance regression, or if the test itself was just changed in 
such a way that it runs much longer.

On branch-2:
{code}
  testcase time=9.15 classname=org.apache.hadoop.hdfs.TestParallelRead 
name=testParallelRead/
{code}

On trunk:
{code}
  testcase time=23.397 classname=org.apache.hadoop.hdfs.TestParallelRead 
name=testParallelReadCopying/
  testcase time=133.218 classname=org.apache.hadoop.hdfs.TestParallelRead 
name=testParallelReadByteBuffer/
  testcase time=61.364 classname=org.apache.hadoop.hdfs.TestParallelRead 
name=testParallelReadMixed/
{code}

I also see a lot of blocked threads in the jstack on trunk. I asked Henry to 
take a look at this.

 TestParallelRead timing out on jenkins
 --

 Key: HDFS-3243
 URL: https://issues.apache.org/jira/browse/HDFS-3243
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: hdfs client, test
Reporter: Todd Lipcon
Assignee: Henry Robinson

 Trunk builds have been failing recently due to a TestParallelRead timeout. It 
 doesn't report in the Jenkins failure list because surefire handles timeouts 
 really poorly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HDFS-3243) TestParallelRead timing out on jenkins

2012-04-10 Thread Todd Lipcon (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250820#comment-13250820
 ] 

Todd Lipcon commented on HDFS-3243:
---

fwiw I tried copying the old TestParallelRead from branch-2 into trunk, and it 
runs just as fast there as it does in branch-2. So this seems like an issue 
with the new test code, rather than a regression in the read performance of the 
existing path.

 TestParallelRead timing out on jenkins
 --

 Key: HDFS-3243
 URL: https://issues.apache.org/jira/browse/HDFS-3243
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: hdfs client, test
Reporter: Todd Lipcon
Assignee: Henry Robinson

 Trunk builds have been failing recently due to a TestParallelRead timeout. It 
 doesn't report in the Jenkins failure list because surefire handles timeouts 
 really poorly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HDFS-3243) TestParallelRead timing out on jenkins

2012-04-10 Thread Henry Robinson (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13250829#comment-13250829
 ] 

Henry Robinson commented on HDFS-3243:
--

Todd mentions that the test does eventually finish, so I don't think this is a 
correctness bug (thankfully). I'm looking to see how the test changes could 
have made this much slower. 

 TestParallelRead timing out on jenkins
 --

 Key: HDFS-3243
 URL: https://issues.apache.org/jira/browse/HDFS-3243
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: hdfs client, test
Reporter: Todd Lipcon
Assignee: Henry Robinson

 Trunk builds have been failing recently due to a TestParallelRead timeout. It 
 doesn't report in the Jenkins failure list because surefire handles timeouts 
 really poorly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HDFS-3243) TestParallelRead timing out on jenkins

2012-04-10 Thread Hadoop QA (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13251028#comment-13251028
 ] 

Hadoop QA commented on HDFS-3243:
-

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12522151/HDFS-3243.0.patch
  against trunk revision .

+1 @author.  The patch does not contain any @author tags.

+1 tests included.  The patch appears to include 1 new or modified test 
files.

+1 javadoc.  The javadoc tool did not generate any warning messages.

+1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

+1 eclipse:eclipse.  The patch built with eclipse:eclipse.

+1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) 
warnings.

+1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

+1 core tests.  The patch passed unit tests in .

+1 contrib tests.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HDFS-Build/2243//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2243//console

This message is automatically generated.

 TestParallelRead timing out on jenkins
 --

 Key: HDFS-3243
 URL: https://issues.apache.org/jira/browse/HDFS-3243
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: hdfs client, test
Reporter: Todd Lipcon
Assignee: Henry Robinson
 Attachments: HDFS-3243.0.patch


 Trunk builds have been failing recently due to a TestParallelRead timeout. It 
 doesn't report in the Jenkins failure list because surefire handles timeouts 
 really poorly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HDFS-3243) TestParallelRead timing out on jenkins

2012-04-10 Thread Todd Lipcon (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13251127#comment-13251127
 ] 

Todd Lipcon commented on HDFS-3243:
---

+1, verified in the test results above that TestParallelRead passed relatively 
quickly.

 TestParallelRead timing out on jenkins
 --

 Key: HDFS-3243
 URL: https://issues.apache.org/jira/browse/HDFS-3243
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: hdfs client, test
Reporter: Todd Lipcon
Assignee: Henry Robinson
 Attachments: HDFS-3243.0.patch


 Trunk builds have been failing recently due to a TestParallelRead timeout. It 
 doesn't report in the Jenkins failure list because surefire handles timeouts 
 really poorly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HDFS-3243) TestParallelRead timing out on jenkins

2012-04-10 Thread Hudson (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13251134#comment-13251134
 ] 

Hudson commented on HDFS-3243:
--

Integrated in Hadoop-Common-trunk-Commit #2046 (See 
[https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2046/])
HDFS-3243. TestParallelRead timing out on jenkins. Contributed by Henry 
Robinson. (Revision 1312029)

 Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1312029
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestParallelReadUtil.java


 TestParallelRead timing out on jenkins
 --

 Key: HDFS-3243
 URL: https://issues.apache.org/jira/browse/HDFS-3243
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: hdfs client, test
Reporter: Todd Lipcon
Assignee: Henry Robinson
 Fix For: 3.0.0

 Attachments: HDFS-3243.0.patch


 Trunk builds have been failing recently due to a TestParallelRead timeout. It 
 doesn't report in the Jenkins failure list because surefire handles timeouts 
 really poorly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HDFS-3243) TestParallelRead timing out on jenkins

2012-04-10 Thread Hudson (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13251131#comment-13251131
 ] 

Hudson commented on HDFS-3243:
--

Integrated in Hadoop-Hdfs-trunk-Commit #2120 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2120/])
HDFS-3243. TestParallelRead timing out on jenkins. Contributed by Henry 
Robinson. (Revision 1312029)

 Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1312029
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestParallelReadUtil.java


 TestParallelRead timing out on jenkins
 --

 Key: HDFS-3243
 URL: https://issues.apache.org/jira/browse/HDFS-3243
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: hdfs client, test
Reporter: Todd Lipcon
Assignee: Henry Robinson
 Fix For: 3.0.0

 Attachments: HDFS-3243.0.patch


 Trunk builds have been failing recently due to a TestParallelRead timeout. It 
 doesn't report in the Jenkins failure list because surefire handles timeouts 
 really poorly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HDFS-3243) TestParallelRead timing out on jenkins

2012-04-10 Thread Hudson (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13251167#comment-13251167
 ] 

Hudson commented on HDFS-3243:
--

Integrated in Hadoop-Mapreduce-trunk-Commit #2059 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2059/])
HDFS-3243. TestParallelRead timing out on jenkins. Contributed by Henry 
Robinson. (Revision 1312029)

 Result = ABORTED
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1312029
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestParallelReadUtil.java


 TestParallelRead timing out on jenkins
 --

 Key: HDFS-3243
 URL: https://issues.apache.org/jira/browse/HDFS-3243
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: hdfs client, test
Reporter: Todd Lipcon
Assignee: Henry Robinson
 Fix For: 3.0.0

 Attachments: HDFS-3243.0.patch


 Trunk builds have been failing recently due to a TestParallelRead timeout. It 
 doesn't report in the Jenkins failure list because surefire handles timeouts 
 really poorly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira