[jira] [Updated] (HDFS-9444) Add utility to find set of available ephemeral ports to ServerSocketUtil

2015-12-03 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9444: --- Description: Unit tests using MiniDFSCluster with namanode-ha enabled need set of port

[jira] [Updated] (HDFS-9444) TestEditLogTailer#testNN1TriggersLogRolls fails bind exception.

2015-11-30 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9444: --- Attachment: HDFS-9444.003.patch Thanks for the comments, [~xiaochen]. bq. Could you add more

[jira] [Updated] (HDFS-9444) TestEditLogTailer#testNN1TriggersLogRolls fails bind exception.

2015-11-27 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9444: --- Assignee: Masatake Iwasaki Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-9444) TestEditLogTailer#testNN1TriggersLogRolls fails bind exception.

2015-11-27 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9444: --- Attachment: HDFS-9444.002.patch > TestEditLogTailer#testNN1TriggersLogRolls fails bind

[jira] [Commented] (HDFS-9444) TestEditLogTailer#testNN1TriggersLogRolls fails bind exception.

2015-11-27 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030004#comment-15030004 ] Masatake Iwasaki commented on HDFS-9444: Thanks for the input, [~ste...@apache.org]. I think the

[jira] [Updated] (HDFS-9444) TestEditLogTailer#testNN1TriggersLogRolls fails bind exception.

2015-11-26 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9444: --- Attachment: HDFS-9444.001.patch > TestEditLogTailer#testNN1TriggersLogRolls fails bind

[jira] [Commented] (HDFS-9444) TestEditLogTailer#testNN1TriggersLogRolls fails bind exception.

2015-11-26 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028407#comment-15028407 ] Masatake Iwasaki commented on HDFS-9444: There is no way to prevent other processes from using the

[jira] [Commented] (HDFS-9423) Fix intermittent failure of TestEditLogTailer

2015-11-23 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022164#comment-15022164 ] Masatake Iwasaki commented on HDFS-9423: Thanks [~walter.k.su] and [~ste...@apache.org]. The

[jira] [Commented] (HDFS-9435) TestBlockRecovery#testRBWReplicas is failing intermittently

2015-11-17 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009959#comment-15009959 ] Masatake Iwasaki commented on HDFS-9435: Thanks for working on this, [~rakeshr]. I think your

[jira] [Created] (HDFS-9437) Add utility to wait for finishing the process of heartbeat and block report

2015-11-17 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-9437: -- Summary: Add utility to wait for finishing the process of heartbeat and block report Key: HDFS-9437 URL: https://issues.apache.org/jira/browse/HDFS-9437 Project:

[jira] [Commented] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-17 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010005#comment-15010005 ] Masatake Iwasaki commented on HDFS-9358: Thanks, [~walter.k.su]! > TestNodeCount#testNodeCount

[jira] [Updated] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-16 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9358: --- Attachment: HDFS-9358.002.patch Thanks for the comment, [~walter.k.su]. bq. 1. We can set

[jira] [Updated] (HDFS-9428) Fix intermittent failure of TestDNFencing.testQueueingWithAppend

2015-11-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9428: --- Attachment: HDFS-9428.001.patch I attached 001. The assertion failed due to checking the

[jira] [Updated] (HDFS-9428) Fix intermittent failure of TestDNFencing.testQueueingWithAppend

2015-11-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9428: --- Status: Patch Available (was: Open) > Fix intermittent failure of

[jira] [Updated] (HDFS-9428) Fix intermittent failure of TestDNFencing.testQueueingWithAppend

2015-11-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9428: --- Status: Open (was: Patch Available) > Fix intermittent failure of

[jira] [Updated] (HDFS-9428) Fix intermittent failure of TestDNFencing.testQueueingWithAppend

2015-11-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9428: --- Status: Patch Available (was: Open) > Fix intermittent failure of

[jira] [Updated] (HDFS-9428) Fix intermittent failure of TestDNFencing.testQueueingWithAppend

2015-11-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9428: --- Attachment: HDFS-9428.002.patch I added the fix to wrong place... I update the patch. > Fix

[jira] [Created] (HDFS-9423) Fix intermittent failure of TestEditLogTailer

2015-11-13 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-9423: -- Summary: Fix intermittent failure of TestEditLogTailer Key: HDFS-9423 URL: https://issues.apache.org/jira/browse/HDFS-9423 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9423) Fix intermittent failure of TestEditLogTailer

2015-11-13 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9423: --- Attachment: HDFS-9423.001.patch > Fix intermittent failure of TestEditLogTailer >

[jira] [Updated] (HDFS-9423) Fix intermittent failure of TestEditLogTailer

2015-11-13 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9423: --- Status: Patch Available (was: Open) > Fix intermittent failure of TestEditLogTailer >

[jira] [Commented] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-13 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003753#comment-15003753 ] Masatake Iwasaki commented on HDFS-9358: Thanks for the confirmation, [~jojochuang]! >

[jira] [Created] (HDFS-9428) Fix intermittent failure of TestDNFencing.testQueueingWithAppend

2015-11-13 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-9428: -- Summary: Fix intermittent failure of TestDNFencing.testQueueingWithAppend Key: HDFS-9428 URL: https://issues.apache.org/jira/browse/HDFS-9428 Project: Hadoop

[jira] [Commented] (HDFS-9428) Fix intermittent failure of TestDNFencing.testQueueingWithAppend

2015-11-13 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004987#comment-15004987 ] Masatake Iwasaki commented on HDFS-9428: {noformat} Running

[jira] [Updated] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2015-11-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9333: --- Attachment: HDFS-9333.002.patch I attached 002 which uses {{ServerSocketUtil#getPort}} to get

[jira] [Updated] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9358: --- Status: Patch Available (was: Open) > TestNodeCount#testNodeCount timed out >

[jira] [Updated] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9358: --- Attachment: HDFS-9358.001.patch Thanks for reporting this, [~jojochuang]. The testNodeCount

[jira] [Updated] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2015-11-11 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9333: --- Status: Patch Available (was: Open) > Some tests using MiniDFSCluster errored complaining

[jira] [Updated] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2015-11-11 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9333: --- Component/s: test > Some tests using MiniDFSCluster errored complaining port in use >

[jira] [Updated] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2015-11-11 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9333: --- Attachment: HDFS-9333.001.patch > Some tests using MiniDFSCluster errored complaining port in

[jira] [Assigned] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-11 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HDFS-9358: -- Assignee: Masatake Iwasaki > TestNodeCount#testNodeCount timed out >

[jira] [Commented] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2015-10-29 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980975#comment-14980975 ] Masatake Iwasaki commented on HDFS-9333: Thanks for reporting this, [~drankye].

[jira] [Assigned] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2015-10-29 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HDFS-9333: -- Assignee: Masatake Iwasaki > Some tests using MiniDFSCluster errored complaining port

[jira] [Commented] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

2015-10-26 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975557#comment-14975557 ] Masatake Iwasaki commented on HDFS-8945: Thanks for the reviews, [~andrew.wang]! > Update the

[jira] [Commented] (HDFS-9225) Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack

2015-10-21 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968255#comment-14968255 ] Masatake Iwasaki commented on HDFS-9225: Thanks, [~andrew.wang]. > Fix intermittent test failure

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-21 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966407#comment-14966407 ] Masatake Iwasaki commented on HDFS-9226: {code} 277 Mockito.doAnswer(new Answer() { 278

[jira] [Commented] (HDFS-9270) TestShortCircuitLocalRead should not leave socket after unit test

2015-10-21 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966437#comment-14966437 ] Masatake Iwasaki commented on HDFS-9270: Thanks, [~cmccabe]. > TestShortCircuitLocalRead should

[jira] [Created] (HDFS-9270) TestShortCircuitLocalRead should not leave socket after unit test

2015-10-20 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-9270: -- Summary: TestShortCircuitLocalRead should not leave socket after unit test Key: HDFS-9270 URL: https://issues.apache.org/jira/browse/HDFS-9270 Project: Hadoop

[jira] [Updated] (HDFS-9270) TestShortCircuitLocalRead should not leave socket after unit test

2015-10-20 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9270: --- Attachment: HDFS-9270.001.patch > TestShortCircuitLocalRead should not leave socket after unit

[jira] [Updated] (HDFS-9270) TestShortCircuitLocalRead should not leave socket after unit test

2015-10-20 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9270: --- Status: Patch Available (was: Open) > TestShortCircuitLocalRead should not leave socket after

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956351#comment-14956351 ] Masatake Iwasaki commented on HDFS-1172: Thanks for the reviews, [~jingzhao]! > Blocks in newly

[jira] [Updated] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2015-10-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8915: --- Attachment: HDFS-8915.002.patch Thanks for checking. HDFS-9139 added fix for the same

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956699#comment-14956699 ] Masatake Iwasaki commented on HDFS-9226: Thanks for the update, [~elserj]. Though the patch looks

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956712#comment-14956712 ] Masatake Iwasaki commented on HDFS-9226: bq. adding in Mockito is also a scary consideration as

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958353#comment-14958353 ] Masatake Iwasaki commented on HDFS-9226: bq. Every other changes in hdfs tests need not verify for

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953305#comment-14953305 ] Masatake Iwasaki commented on HDFS-9226: bq. There is no guard to keep someone from adding code

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-1172: --- Attachment: HDFS-1172.014.patch attaching the same file again to kick jenkins. > Blocks in

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953290#comment-14953290 ] Masatake Iwasaki commented on HDFS-9226: Hmm... Though [test artifacts are intended to be

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-11 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952632#comment-14952632 ] Masatake Iwasaki commented on HDFS-9226: Mockito has been used for a long time by

[jira] [Updated] (HDFS-9225) Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack

2015-10-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9225: --- Attachment: HDFS-9225.001.patch The cause seems to be {{TestBlockManager#addBlockOnNodes}}

[jira] [Updated] (HDFS-9225) Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack

2015-10-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9225: --- Status: Patch Available (was: Open) > Fix intermittent test failure of >

[jira] [Commented] (HDFS-9225) Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack

2015-10-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952155#comment-14952155 ] Masatake Iwasaki commented on HDFS-9225: {noformat}

[jira] [Created] (HDFS-9225) Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack

2015-10-10 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-9225: -- Summary: Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack Key: HDFS-9225 URL: https://issues.apache.org/jira/browse/HDFS-9225

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-1172: --- Attachment: HDFS-1172.014.patch bq. Only nit is we can change the following if condition to if

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-1172: --- Attachment: HDFS-1172.013.patch Thanks, [~jingzhao]! Your comment makes sense. I attached 013.

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-08 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-1172: --- Attachment: HDFS-1172.011.patch I attached updated patch as 011. * pendingReplications is

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-08 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-1172: --- Attachment: HDFS-1172.012.patch I update the patch. * addressed the failure of

[jira] [Commented] (HDFS-9196) TestWebHdfsContentLength fails on trunk

2015-10-06 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14946155#comment-14946155 ] Masatake Iwasaki commented on HDFS-9196: Thanks, [~liuml07]. Checkstyle and release audit warnings

[jira] [Updated] (HDFS-9196) TestWebHdfsContentLength fails on trunk

2015-10-05 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9196: --- Attachment: HDFS-9196.001.patch The cause is the change of WebHdfsFileSystem by HDFS-8979.

[jira] [Commented] (HDFS-9195) TestDelegationTokenForProxyUser.testWebHdfsDoAs fails on trunk

2015-10-05 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943644#comment-14943644 ] Masatake Iwasaki commented on HDFS-9195: The cause seems to be same with HDFS-9196. >

[jira] [Assigned] (HDFS-9196) TestWebHdfsContentLength fails on trunk

2015-10-04 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HDFS-9196: -- Assignee: Masatake Iwasaki > TestWebHdfsContentLength fails on trunk >

[jira] [Commented] (HDFS-9187) Check if tracer is null before using it

2015-10-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940238#comment-14940238 ] Masatake Iwasaki commented on HDFS-9187: {{tracer}} seems to be null if the filssystem instance is

[jira] [Updated] (HDFS-9187) Check if tracer is null before using it

2015-10-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9187: --- Attachment: HDFS-9187.001.patch Tracer without recievers and samplers seems to work as

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940761#comment-14940761 ] Masatake Iwasaki commented on HDFS-1172: bq. We'd better place the new "adding block to pending

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-28 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-1172: --- Attachment: HDFS-1172.010.patch bq. Also if a block's effective replica number (including

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-25 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-1172: --- Attachment: HDFS-1172.009.patch I attached updated patch as 009. * fixed intermittent

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-25 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907769#comment-14907769 ] Masatake Iwasaki commented on HDFS-1172: bq. Looks like the rebased patches only put

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-23 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905669#comment-14905669 ] Masatake Iwasaki commented on HDFS-1172: I'm working on now and will upload patch in few days.

[jira] [Updated] (HDFS-9080) update htrace version to 4.0

2015-09-22 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9080: --- Attachment: tracing-fsshell-put.png > update htrace version to 4.0 >

[jira] [Commented] (HDFS-9080) update htrace version to 4.0

2015-09-22 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902637#comment-14902637 ] Masatake Iwasaki commented on HDFS-9080: Thanks for working on this, [~cmccabe]. I tested the 009

[jira] [Commented] (HDFS-9080) update htrace version to 4.0

2015-09-22 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902653#comment-14902653 ] Masatake Iwasaki commented on HDFS-9080: * hdfs-default.xml: This should be

[jira] [Updated] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2015-09-16 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8915: --- Component/s: test > TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

[jira] [Updated] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2015-09-16 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8915: --- Attachment: HDFS-8915.001.patch I added retry for checking. >

[jira] [Reopened] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2015-09-16 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reopened HDFS-8915: Assignee: Masatake Iwasaki (was: Anu Engineer) I can reproduce this in my local

[jira] [Updated] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2015-09-16 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8915: --- Status: Patch Available (was: Reopened) > TestFSNamesystem.testFSLockGetWaiterCount fails

[jira] [Commented] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2015-09-16 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14791566#comment-14791566 ] Masatake Iwasaki commented on HDFS-8915: bq. With this change I presume that test passes

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-16 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14791567#comment-14791567 ] Masatake Iwasaki commented on HDFS-1172: Thanks for the comment, [~jingzhao]. I'm looking into test

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-1172: --- Attachment: HDFS-1172.008.patch I rebased the patch on current trunk and attached as

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-1172: --- Target Version/s: 2.1.0-beta, 3.0.0, 1.3.0 (was: 3.0.0, 2.1.0-beta, 1.3.0)

[jira] [Commented] (HDFS-8974) Convert docs in xdoc format to markdown

2015-09-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738013#comment-14738013 ] Masatake Iwasaki commented on HDFS-8974: bq. In rolling upgrades document, there are 2 diffs

[jira] [Updated] (HDFS-8974) Convert docs in xdoc format to markdown

2015-09-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8974: --- Attachment: HDFS-8974-branch-2.001.patch I attached patch for branch-2. Compiled doc can be

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738214#comment-14738214 ] Masatake Iwasaki commented on HDFS-1172: Thanks for the update [~azuryy], but the patch can not be

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738222#comment-14738222 ] Masatake Iwasaki commented on HDFS-1172: bq. Thanks for the update Fengdong Yu, but the patch can

[jira] [Commented] (HDFS-8946) Improve choosing datanode storage for block placement

2015-08-28 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718222#comment-14718222 ] Masatake Iwasaki commented on HDFS-8946: Thanks for working on this, [~Hitliuyi]. I

[jira] [Commented] (HDFS-8946) Improve choosing datanode storage for block placement

2015-08-28 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718226#comment-14718226 ] Masatake Iwasaki commented on HDFS-8946: DatanodeDescriptor.java {code} 679

[jira] [Commented] (HDFS-8974) Convert docs in xdoc format to markdown

2015-08-27 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716379#comment-14716379 ] Masatake Iwasaki commented on HDFS-8974: There are no diffs between branch-2 and

[jira] [Updated] (HDFS-8974) Convert docs in xdoc format to markdown

2015-08-27 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8974: --- Attachment: HDFS-8974.001.patch Convert docs in xdoc format to markdown

[jira] [Updated] (HDFS-8974) Convert docs in xdoc format to markdown

2015-08-27 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8974: --- Status: Patch Available (was: Open) Convert docs in xdoc format to markdown

[jira] [Created] (HDFS-8974) Convert docs in xdoc format to markdown

2015-08-27 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-8974: -- Summary: Convert docs in xdoc format to markdown Key: HDFS-8974 URL: https://issues.apache.org/jira/browse/HDFS-8974 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-8974) Convert docs in xdoc format to markdown

2015-08-27 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716375#comment-14716375 ] Masatake Iwasaki commented on HDFS-8974: I uploaded the 001. You can see compiled

[jira] [Commented] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

2015-08-26 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712854#comment-14712854 ] Masatake Iwasaki commented on HDFS-8945: Thanks for the comments, [~andrew.wang]!

[jira] [Commented] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

2015-08-26 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712887#comment-14712887 ] Masatake Iwasaki commented on HDFS-8945: Hmm.. Storage policies wins because rack

[jira] [Commented] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

2015-08-26 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712888#comment-14712888 ] Masatake Iwasaki commented on HDFS-8945: I'm updating the patch based on the

[jira] [Commented] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

2015-08-26 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716108#comment-14716108 ] Masatake Iwasaki commented on HDFS-8945: I attached 002. I did not add explanation

[jira] [Updated] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

2015-08-26 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8945: --- Attachment: HDFS-8945.002.patch Update the description about replica placement in HDFS

[jira] [Created] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

2015-08-24 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-8945: -- Summary: Update the description about replica placement in HDFS Architecture documentation Key: HDFS-8945 URL: https://issues.apache.org/jira/browse/HDFS-8945

[jira] [Commented] (HDFS-8942) Update hyperlink to rack awareness page in HDFS Architecture documentation

2015-08-24 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14709026#comment-14709026 ] Masatake Iwasaki commented on HDFS-8942: Thanks, [~ajisakaa]! Update hyperlink to

[jira] [Updated] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

2015-08-24 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8945: --- Status: Patch Available (was: Open) Update the description about replica placement in HDFS

[jira] [Updated] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

2015-08-24 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8945: --- Attachment: HDFS-8945.001.patch Update the description about replica placement in HDFS

[jira] [Updated] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

2015-08-24 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8945: --- Component/s: documentation Update the description about replica placement in HDFS

[jira] [Updated] (HDFS-8942) Update hyperlink to rack awareness page in HDFS Architecture documentation

2015-08-23 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8942: --- Status: Patch Available (was: Open) Update hyperlink to rack awareness page in HDFS

<    1   2   3   4   5   6   7   8   >