subject:"\[jira\] \[Commented\] \(HDFS\-4261\) TestBalancerWithNodeGroup times out"

[
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550998#comment-13550998
]

Junping Du commented on HDFS-4261:
--

I manually add TestBalancerWithNodeGroup on my test-commit, and following are
result:

{noformat}
+1 overall.

+1 @author. The patch does not contain any @author tags.

+1 tests included. The patch appears to include 3 new or modified tests.

+1 javadoc. The javadoc tool did not generate any warning messages.

+1 javac. The applied patch does not increase the total number of javac
compiler warnings.

+1 findbugs. The patch does not introduce any new Findbugs (version 2.0.1)
warnings.

+1 commit tests. The patch passed commit unit tests.
{noformat}

TestBalancerWithNodeGroup times out
---

Key: HDFS-4261
URL: https://issues.apache.org/jira/browse/HDFS-4261
Project: Hadoop HDFS
Issue Type: Bug
Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
Fix For: 3.0.0

Attachments: HDFS-4261-branch-1.patch, HDFS-4261.patch,
HDFS-4261-v2.patch, HDFS-4261-v3.patch, HDFS-4261-v4.patch,
HDFS-4261-v5.patch, HDFS-4261-v6.patch, HDFS-4261-v7.patch,
HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488,
org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,

org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
test-balancer-with-node-group-timeout.txt

When I manually ran TestBalancerWithNodeGroup, it always timed out in my
machine. Looking at the Jerkins report [build
#3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
TestBalancerWithNodeGroup somehow was skipped so that the problem was not
detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551001#comment-13551001
 ] 

Junping Du commented on HDFS-4261:
--

Plan to lunch test-commit (with TestBalancerWithNodeGroup) 30 times to see the 
results. My local env have Jenkins backed with 4 VMs, so can run 4 times in 
paralleling, but still need more time.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261-branch-1.patch, HDFS-4261.patch, 
 HDFS-4261-v2.patch, HDFS-4261-v3.patch, HDFS-4261-v4.patch, 
 HDFS-4261-v5.patch, HDFS-4261-v6.patch, HDFS-4261-v7.patch, 
 HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-11 Thread Tsz Wo (Nicholas), SZE (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551047#comment-13551047
 ] 

Tsz Wo (Nicholas), SZE commented on HDFS-4261:
--

- The branch-1 patch also has the typo MAX_NO_PENDING_BLOCK_INTERATIONS.  Let's 
fix it here so that we don't have to backport HDFS-4382.
- Should resetData() be inside the while-loop?


 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261-branch-1.patch, HDFS-4261.patch, 
 HDFS-4261-v2.patch, HDFS-4261-v3.patch, HDFS-4261-v4.patch, 
 HDFS-4261-v5.patch, HDFS-4261-v6.patch, HDFS-4261-v7.patch, 
 HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551059#comment-13551059
 ] 

Junping Du commented on HDFS-4261:
--

Oh, sorry to forget to correct stupid typo here.
Yes. resetData() should be in while-loop to work with initNodes(). But 
initNodes() seems to build everything from 0 (different with trunk) so previous 
tests didn't complain. Move this resetData() within while-loop but put it to 
front in case we want to change behaviours in initNodes() as trunk.
Update to v2 patch. Thanks Nicholas for carefully review!

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261-branch-1.patch, HDFS-4261-branch-1-v2.patch, 
 HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, HDFS-4261-v4.patch, 
 HDFS-4261-v5.patch, HDFS-4261-v6.patch, HDFS-4261-v7.patch, 
 HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551064#comment-13551064
 ] 

Junping Du commented on HDFS-4261:
--

To Aaron's previous comments:
{noformat}
Please make sure that whatever gets back-ported to branch-1 also gets 
back-ported to branch-2. I was under the impression that all of this stuff was 
only going to trunk
{noformat}
Thanks for reminder. We can start the backport work soon. BTW, shall we reuse 
JIRAs in HADOOP-8817 (or in HADOOP-8468) or file new ones?   

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261-branch-1.patch, HDFS-4261-branch-1-v2.patch, 
 HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, HDFS-4261-v4.patch, 
 HDFS-4261-v5.patch, HDFS-4261-v6.patch, HDFS-4261-v7.patch, 
 HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-11 Thread Aaron T. Myers (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551475#comment-13551475
 ] 

Aaron T. Myers commented on HDFS-4261:
--

bq. BTW, shall we reuse JIRAs...

I think we should use the same JIRAs as were used for the trunk work, and just 
change the fix version field appropriately when the change is committed to 
branch-2. (Not reusing the JIRAs is the reason why I wasn't aware of the 
branch-1 back-ports.)

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261-branch-1.patch, HDFS-4261-branch-1-v2.patch, 
 HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, HDFS-4261-v4.patch, 
 HDFS-4261-v5.patch, HDFS-4261-v6.patch, HDFS-4261-v7.patch, 
 HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-11 Thread Suresh Srinivas (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551482#comment-13551482
 ] 

Suresh Srinivas commented on HDFS-4261:
---

bq. I think we should use the same JIRAs as were used for the trunk work, and 
just change the fix version field appropriately when the change is committed 
to branch-2. 

I agree, when patches apply to earlier branches with trivial changes. However, 
when a significant rework is needed to port a patch back, I have been asking 
folks to create a separate jira, with an appropriate link between the jiras.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261-branch-1.patch, HDFS-4261-branch-1-v2.patch, 
 HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, HDFS-4261-v4.patch, 
 HDFS-4261-v5.patch, HDFS-4261-v6.patch, HDFS-4261-v7.patch, 
 HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-11 Thread Aaron T. Myers (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551484#comment-13551484
 ] 

Aaron T. Myers commented on HDFS-4261:
--

bq. I agree, when patches apply to earlier branches with trivial changes. 
However, when a significant rework is needed to port a patch back, I have been 
asking folks to create a separate jira, with an appropriate link between the 
jiras.

That's totally reasonable. trunk/branch-2 are so close to each other that the 
back-port is almost always clean or trivial, but you're right that branch-1 
back-ports often warrant a separate JIRA.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261-branch-1.patch, HDFS-4261-branch-1-v2.patch, 
 HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, HDFS-4261-v4.patch, 
 HDFS-4261-v5.patch, HDFS-4261-v6.patch, HDFS-4261-v7.patch, 
 HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551704#comment-13551704
 ] 

Junping Du commented on HDFS-4261:
--

I see. That make sense. Thanks ATM and Suresh.:)

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261-branch-1.patch, HDFS-4261-branch-1-v2.patch, 
 HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, HDFS-4261-v4.patch, 
 HDFS-4261-v5.patch, HDFS-4261-v6.patch, HDFS-4261-v7.patch, 
 HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13549528#comment-13549528
 ] 

Hudson commented on HDFS-4261:
--

Integrated in Hadoop-Yarn-trunk #92 (See 
[https://builds.apache.org/job/Hadoop-Yarn-trunk/92/])
HDFS-4261. Fix bugs in Balaner causing infinite loop and 
TestBalancerWithNodeGroup timeing out.  Contributed by Junping Du (Revision 
1430917)

 Result = SUCCESS
szetszwo : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1430917
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithNodeGroup.java


 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13549610#comment-13549610
 ] 

Hudson commented on HDFS-4261:
--

Integrated in Hadoop-Mapreduce-trunk #1309 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1309/])
HDFS-4261. Fix bugs in Balaner causing infinite loop and 
TestBalancerWithNodeGroup timeing out.  Contributed by Junping Du (Revision 
1430917)

 Result = FAILURE
szetszwo : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1430917
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithNodeGroup.java


 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13549623#comment-13549623
 ] 

Hudson commented on HDFS-4261:
--

Integrated in Hadoop-Hdfs-trunk #1281 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1281/])
HDFS-4261. Fix bugs in Balaner causing infinite loop and 
TestBalancerWithNodeGroup timeing out.  Contributed by Junping Du (Revision 
1430917)

 Result = FAILURE
szetszwo : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1430917
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithNodeGroup.java


 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Ted Yu (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13549833#comment-13549833
 ] 

Ted Yu commented on HDFS-4261:
--

Minor:
{code}
+  if (notChangedIterations = MAX_NOT_CHANGED_INTERATIONS) {
{code}
Looks the constant is misspelled - an extra N following I.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Aaron T. Myers (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550490#comment-13550490
 ] 

Aaron T. Myers commented on HDFS-4261:
--

Whoops! Good catch, Ted. Want to file a JIRA?

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Ted Yu (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550501#comment-13550501
 ] 

Ted Yu commented on HDFS-4261:
--

Created HDFS-4382.

Will upload a patch soon.

Is there plan to fix hanging TestBalancerWithNodeGroup in hadoop 1.1 ?

See HBase QA report:
https://issues.apache.org/jira/browse/HBASE-7529?focusedCommentId=13549790page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13549790

-1 core zombie tests. There are 1 zombie test(s): at 
org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup.testBalancerWithRackLocality(TestBalancerWithNodeGroup.java:220)

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Junping Du (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550735#comment-13550735
 ] 

Junping Du commented on HDFS-4261:
--

Thanks Ted to fix the typo. I will file a JIRA to backport this patch to 
branch-1.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Suresh Srinivas (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550768#comment-13550768
 ] 

Suresh Srinivas commented on HDFS-4261:
---

Please attach a patch to this Jira. I will commit it. No need for a separate 
Jira for such a simple change. 




 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Junping Du (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550773#comment-13550773
 ] 

Junping Du commented on HDFS-4261:
--

Oops. I already filed it before your comments...

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Aaron T. Myers (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550781#comment-13550781
 ] 

Aaron T. Myers commented on HDFS-4261:
--

Have any of the node group-related balancer changes been back-ported to 
branch-1? I was under the impression that none of them have even been 
back-ported to branch-2, let alone branch-1.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Junping Du (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550785#comment-13550785
 ] 

Junping Du commented on HDFS-4261:
--

Hi Aaron, Yes. The backport work is tracked by: 
https://issues.apache.org/jira/browse/HADOOP-8817.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Aaron T. Myers (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550786#comment-13550786
 ] 

Aaron T. Myers commented on HDFS-4261:
--

Gotcha, OK. I wasn't aware of that JIRA. Thanks for pointing it out.

Please make sure that whatever gets back-ported to branch-1 also gets 
back-ported to branch-2. I was under the impression that all of this stuff was 
only going to trunk.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-09 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13548610#comment-13548610
 ] 

Hudson commented on HDFS-4261:
--

Integrated in Hadoop-trunk-Commit #3202 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/3202/])
HDFS-4261. Fix bugs in Balaner causing infinite loop and 
TestBalancerWithNodeGroup timeing out.  Contributed by Junping Du (Revision 
1430917)

 Result = SUCCESS
szetszwo : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1430917
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithNodeGroup.java


 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-09 Thread Aaron T. Myers (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13548745#comment-13548745
 ] 

Aaron T. Myers commented on HDFS-4261:
--

Thanks for committing this, Nicholas. I've filed this JIRA to track the 
intermittent timeout which still occurs: HDFS-4376.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-08 Thread Junping Du (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13547044#comment-13547044
 ] 

Junping Du commented on HDFS-4261:
--

Chris, can you help to verify it again in your env? If issue only happen on 
specific platform, I think we can file a separated jira to track this as above 
3# is a blocking issue.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-08 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13547143#comment-13547143
 ] 

Hadoop QA commented on HDFS-4261:
-

{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12563782/HDFS-4261-v8.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 1 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-hdfs-project/hadoop-hdfs.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HDFS-Build/3794//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3794//console

This message is automatically generated.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-08 Thread Chris Nauroth (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13547176#comment-13547176
 ] 

Chris Nauroth commented on HDFS-4261:
-

+1 for the v8 patch.

I tested it on Windows, and I couldn't repro the infinite loop this time.  I 
don't know that it's completely resolved, but it's certainly passing more 
consistently than current trunk.


 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-08 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13547303#comment-13547303
 ] 

Hadoop QA commented on HDFS-4261:
-

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  
http://issues.apache.org/jira/secure/attachment/12563827/test-balancer-with-node-group-timeout.txt
  against trunk revision .

{color:red}-1 patch{color}.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3801//console

This message is automatically generated.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-08 Thread Junping Du (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13547504#comment-13547504
 ] 

Junping Du commented on HDFS-4261:
--

Thanks Chris and Aaron for verification. +1 to open another JIRA to track this 
very occasional timeout (only one time in looped tests in 1.5 hour).

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, HDFS-4261-v8.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win,
  test-balancer-with-node-group-timeout.txt


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-07 Thread Eli Collins (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13546381#comment-13546381
 ] 

Eli Collins commented on HDFS-4261:
---

Any update Junping?   TestBalancerWithNodeGroup currently fails 100% of the 
time on my local jenkins slave running trunk. We should annotate these test 
methods with timeouts ala HDFS-4061 and HDFS-4008 so we get clean test failures 
in case this regresses.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-03 Thread Chris Nauroth (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13543259#comment-13543259
 ] 

Chris Nauroth commented on HDFS-4261:
-

I just tried testing the v7 patch applied to current branch-trunk-win.  I 
couldn't repro on Mac, but I'm still seeing the infinite loop in about 50% of 
test runs on Windows.  The thread dumps look similar to last time: stuck in 
{{Balancer#waitForMoveCompletion}}.  (The line numbers are different since 
Balancer.java has changed since last time.)


 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-18 Thread Junping Du (JIRA)

[
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13535003#comment-13535003
]

Junping Du commented on HDFS-4261:
--

I think I found the reason. There is another balancer bug (for corner case
only) revealed by TestBalancerWithNodeGroup.testBalancerWithNodeGroup(). In
current code base, when a source node (avg) has a NodeTask to move some size
data to target node ( avg), it will fall into infinite loop if no any block
can be moved due to restraint from replica placement policy. This is not caused
by v6 patch and I can repeat on my linux system even without v6 patch (10%-20%
possibility). I will have a quick fix to it (v7 patch). Chris, please help to
verify v7 patch do works for you (mac and windows). Thanks!

TestBalancerWithNodeGroup times out
---

Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch,
HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, jstack-mac-18567,
jstack-win-5488,
org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,

org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-18 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13535121#comment-13535121
 ] 

Hadoop QA commented on HDFS-4261:
-

{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12561504/HDFS-4261-v7.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 1 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-hdfs-project/hadoop-hdfs.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HDFS-Build/3679//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3679//console

This message is automatically generated.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-18 Thread Suresh Srinivas (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13535356#comment-13535356
 ] 

Suresh Srinivas commented on HDFS-4261:
---

bq. Chris, please help to verify v7 patch do works for you
Chris is off next few days. So testing has to be done without his help.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-18 Thread Junping Du (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13535470#comment-13535470
 ] 

Junping Du commented on HDFS-4261:
--

Thanks Suresh for comments. I think I already did enough tests on my local env 
and I believe previous bug is not related to platform (Win or Mac). I ping 
Chris just because he was volunteering to double check the patch.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-18 Thread Aaron T. Myers (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13535577#comment-13535577
 ] 

Aaron T. Myers commented on HDFS-4261:
--

Hey Junping, I just applied the latest patch and looped it on my machine a few 
times and in one of the test runs I saw the following failure:
{noformat}
Running org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup
Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 54.806 sec  
FAILURE!
testBalancerWithNodeGroup(org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup)
  Time elapsed: 37809 sec   ERROR!
java.util.concurrent.TimeoutException: Rebalancing expected avg utilization to 
become 0.16, but on datanode 127.0.0.1:44127 it remains at 0.04 after more than 
2 msec.
at 
org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup.waitForBalancer(TestBalancerWithNodeGroup.java:149)
at 
org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup.runBalancer(TestBalancerWithNodeGroup.java:176)
at 
org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup.testBalancerWithNodeGroup(TestBalancerWithNodeGroup.java:300)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
at 
org.junit.runners.BlockJUnit4ClassRunner.runNotIgnored(BlockJUnit4ClassRunner.java:79)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:71)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:49)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)
at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at 
org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
at 
org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
at 
org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
at 
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)
at 
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)
{noformat}

Entirely possible this again isn't actually due to your changes, but have you 
seen this error before?

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-18 Thread Junping Du (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13535597#comment-13535597
 ] 

Junping Du commented on HDFS-4261:
--

Hi ATM, Thanks for your input. I run several rounds test (20) on my local env 
but haven't seen this error before. 
In general, this error happens when the cluster is not balanced after run 
balancer. We expected this happen in testBalancerEndInNoMoveProgress() but it 
shouldn't happen in TestBalancerWithNodeGroup.testBalancerWithNodeGroup() case. 
It is possible to be related to my latest changes as it jump out of thread of 
SourceBalancerNode if no blocks can be moved to target node (it is possible in 
this boundary test case) to get rid of infinite loop. It is possible to cause 
some balancerNode to end in unbalanced situation, but should get balanced in 
next balancing iteration (except it always get the same target node).
I need to do more investigation on it. 

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, 
 HDFS-4261-v7.patch, jstack-mac-18567, jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-13 Thread Junping Du (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13531115#comment-13531115
 ] 

Junping Du commented on HDFS-4261:
--

Thanks Chris. The jstack you attached here is very helpful. Like you said, it 
seems to be pending on:   
org.apache.hadoop.hdfs.server.balancer.Balancer.waitForMoveCompletion(Balancer.java:1139).
 
I once doubt if it could be List issue of pendingBlocks as it might add the 
same PendingBlockMove multiple times but delete once. However, the logic of 
add/delete there is right (even for adding pendingBlock to SourceProxy). So, I 
am searching for other hints there.



 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, jstack-mac-18567, 
 jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-12 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13530141#comment-13530141
 ] 

Hadoop QA commented on HDFS-4261:
-

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  
http://issues.apache.org/jira/secure/attachment/12560600/org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win
  against trunk revision .

{color:red}-1 patch{color}.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3649//console

This message is automatically generated.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, jstack-mac-18567, 
 jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-12 Thread Chris Nauroth (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13530166#comment-13530166
 ] 

Chris Nauroth commented on HDFS-4261:
-

Junping, I also wanted to mention that I can reproduce this fairly 
consistently.  It happens for ~20% of my test runs.  If you're having trouble 
getting a repro in your own environment, then I'd be happy to test new patches 
for you.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch, jstack-mac-18567, 
 jstack-win-5488, 
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.mac,
  
 org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup-output.txt.win


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528878#comment-13528878
 ] 

Hudson commented on HDFS-4261:
--

Integrated in Hadoop-Yarn-trunk #62 (See 
[https://builds.apache.org/job/Hadoop-Yarn-trunk/62/])
svn -c -1419192 . for reverting HDFS-4261 since TestBalancerWithNodeGroup 
failed in the recent Jenkins builds. (Revision 1420010)

 Result = FAILURE
szetszwo : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1420010
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithNodeGroup.java


 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528943#comment-13528943
 ] 

Hudson commented on HDFS-4261:
--

Integrated in Hadoop-Hdfs-trunk #1251 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1251/])
svn -c -1419192 . for reverting HDFS-4261 since TestBalancerWithNodeGroup 
failed in the recent Jenkins builds. (Revision 1420010)

 Result = FAILURE
szetszwo : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1420010
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithNodeGroup.java


 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-11 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528993#comment-13528993
 ] 

Hudson commented on HDFS-4261:
--

Integrated in Hadoop-Mapreduce-trunk #1282 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1282/])
svn -c -1419192 . for reverting HDFS-4261 since TestBalancerWithNodeGroup 
failed in the recent Jenkins builds. (Revision 1420010)

 Result = SUCCESS
szetszwo : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1420010
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithNodeGroup.java


 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529015#comment-13529015
 ] 

Junping Du commented on HDFS-4261:
--

I cannot reproduce the failure in may local environment. However, I see the 
similar issue by adjusting sequence of testcases in TestBalancerWithNodeGroup 
which is caused by no cleanup if previous test is end with NO_MOVE_PROGRESS. So 
I adjust the clean up (resetData()) in v5 patch. Let's wait and see the 
pre-commit result.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-11 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529098#comment-13529098
 ] 

Hadoop QA commented on HDFS-4261:
-

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12560385/HDFS-4261-v5.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 1 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:red}-1 core tests{color}.  The patch failed these unit tests in 
hadoop-hdfs-project/hadoop-hdfs:

  
org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HDFS-Build/3635//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3635//console

This message is automatically generated.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-11 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529539#comment-13529539
 ] 

Hadoop QA commented on HDFS-4261:
-

{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12560476/HDFS-4261-v6.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 1 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-hdfs-project/hadoop-hdfs.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HDFS-Build/3643//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3643//console

This message is automatically generated.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-11 Thread Tsz Wo (Nicholas), SZE (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529565#comment-13529565
 ] 

Tsz Wo (Nicholas), SZE commented on HDFS-4261:
--

Question: since a Balancer object is created in each run, do we still need 
resetData(..)?

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529610#comment-13529610
 ] 

Junping Du commented on HDFS-4261:
--

Yes. For each iteration, a new Balancer object is created but the parameter p 
is the old one and passed to constructor of balancer every time. As p contains 
Balancing policy which do accumulation of nodes' capacity, it needs to be 
cleaned up in each iteration. So may be resetData() is still necessary here?
Also, it seems odd that testBalancerWithRackLocality() in Jenkins ends with 
NO_MOVE_PROGRESS but run perfect in my env. Shall we address here or file a 
separated JIRA to track this? 

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-11 Thread Chris Nauroth (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529636#comment-13529636
 ] 

Chris Nauroth commented on HDFS-4261:
-

I've been running with v6 of the patch, and I've occasionally seen it timeout 
waiting for move completion.  I've seen it happen on both Mac and Windows, 
though it seems to be much more prevalent on Windows.  I captured thread dumps. 
 If it's helpful to see those, let me know, and I'll post them.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529646#comment-13529646
 ] 

Junping Du commented on HDFS-4261:
--

Chris, Thanks for comments. Can you tell me the occasionally timeout is 
happened before or after applying v6 patch?  

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-11 Thread Chris Nauroth (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529676#comment-13529676
 ] 

Chris Nauroth commented on HDFS-4261:
-

This happened after I applied the v6 patch.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529684#comment-13529684
 ] 

Junping Du commented on HDFS-4261:
--

Thanks. It is great if you can post the thread dumps.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch, HDFS-4261-v5.patch, HDFS-4261-v6.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13527867#comment-13527867
 ] 

Hudson commented on HDFS-4261:
--

Integrated in Hadoop-Yarn-trunk #61 (See 
[https://builds.apache.org/job/Hadoop-Yarn-trunk/61/])
HDFS-4261. Fix bugs in Balancer that it does not terminate in some cases 
and it checks BlockPlacementPolicy instance incorrectly.  Contributed by 
Junping Du (Revision 1419192)

 Result = SUCCESS
szetszwo : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1419192
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithNodeGroup.java


 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13527914#comment-13527914
 ] 

Hudson commented on HDFS-4261:
--

Integrated in Hadoop-Hdfs-trunk #1250 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1250/])
HDFS-4261. Fix bugs in Balancer that it does not terminate in some cases 
and it checks BlockPlacementPolicy instance incorrectly.  Contributed by 
Junping Du (Revision 1419192)

 Result = FAILURE
szetszwo : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1419192
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithNodeGroup.java


 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13527922#comment-13527922
 ] 

Hudson commented on HDFS-4261:
--

Integrated in Hadoop-Mapreduce-trunk #1281 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1281/])
HDFS-4261. Fix bugs in Balancer that it does not terminate in some cases 
and it checks BlockPlacementPolicy instance incorrectly.  Contributed by 
Junping Du (Revision 1419192)

 Result = FAILURE
szetszwo : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1419192
Files : 
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithNodeGroup.java


 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-10 Thread Tsz Wo (Nicholas), SZE (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528715#comment-13528715
 ] 

Tsz Wo (Nicholas), SZE commented on HDFS-4261:
--

Reverted the patch.

Junping, could you take a look the failure, e.g. [build 
#3626|https://builds.apache.org/job/PreCommit-HDFS-Build/3626/testReport/junit/org.apache.hadoop.hdfs.server.balancer/TestBalancerWithNodeGroup/testBalancerWithRackLocality/]?

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-10 Thread Junping Du (JIRA)


[ 
https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528719#comment-13528719
 ] 

Junping Du commented on HDFS-4261:
--

Sure. I am looking into it now.

 TestBalancerWithNodeGroup times out
 ---

 Key: HDFS-4261
 URL: https://issues.apache.org/jira/browse/HDFS-4261
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: balancer
Affects Versions: 1.0.4, 1.1.1, 2.0.2-alpha
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Junping Du
 Fix For: 3.0.0

 Attachments: HDFS-4261.patch, HDFS-4261-v2.patch, HDFS-4261-v3.patch, 
 HDFS-4261-v4.patch


 When I manually ran TestBalancerWithNodeGroup, it always timed out in my 
 machine.  Looking at the Jerkins report [build 
 #3573|https://builds.apache.org/job/PreCommit-HDFS-Build/3573//testReport/org.apache.hadoop.hdfs.server.balancer/],
  TestBalancerWithNodeGroup somehow was skipped so that the problem was not 
 detected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out