[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2016-04-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242483#comment-15242483 ] Kai Zheng commented on HDFS-7859: - bq. IIUC, persistence is more necessary when we supports custom schemas,

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2016-04-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242464#comment-15242464 ] Rakesh R commented on HDFS-7859: The proposed patch in this JIRA handles saving and loading the schema in

[jira] [Created] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-14 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10297: - Summary: Increase default balance bandwidth and concurrent moves Key: HDFS-10297 URL: https://issues.apache.org/jira/browse/HDFS-10297 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10216) distcp -diff relative path exception

2016-04-14 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242399#comment-15242399 ] Takashi Ohnishi commented on HDFS-10216: Thank you [~jingzhao] for committing ! Thank you

[jira] [Updated] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-04-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9820: Description: A common use scenario (scenaio 1): # create snapshot sx in clusterX, # do some

[jira] [Commented] (HDFS-10224) Implement an asynchronous DistributedFileSystem

2016-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242299#comment-15242299 ] Hadoop QA commented on HDFS-10224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10258) Erasure Coding: support small cluster whose #DataNode < # (Blocks in a BlockGroup)

2016-04-14 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242287#comment-15242287 ] Li Bo commented on HDFS-10258: -- Thanks for Kai's idea, I will try to find a solution with the lowest cost.

[jira] [Updated] (HDFS-9940) Balancer should not use property name dfs.datanode.balance.max.concurrent.moves

2016-04-14 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9940: - Summary: Balancer should not use property name dfs.datanode.balance.max.concurrent.moves (was: Balancer

[jira] [Updated] (HDFS-9940) Balancer should not use property name

2016-04-14 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9940: - Summary: Balancer should not use property name (was: Rename dfs.balancer.max.concurrent.moves to avoid

[jira] [Commented] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242208#comment-15242208 ] Mingliang Liu commented on HDFS-10284: -- I see no related failing tests. >

[jira] [Commented] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242203#comment-15242203 ] Hadoop QA commented on HDFS-10284: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10293) StripedFileTestUtil#readAll flaky

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242189#comment-15242189 ] Mingliang Liu commented on HDFS-10293: -- I don't see related failing tests. Still, I'm surprised that

[jira] [Commented] (HDFS-10289) Balancer configures DNs directly

2016-04-14 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242183#comment-15242183 ] John Zhuge commented on HDFS-10289: --- Split into 2 tasks: * HDFS-10294: Balancer configure DN properties

[jira] [Created] (HDFS-10295) Balancer configures DN properties directly on-demand

2016-04-14 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10295: - Summary: Balancer configures DN properties directly on-demand Key: HDFS-10295 URL: https://issues.apache.org/jira/browse/HDFS-10295 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10296) FileContext.getDelegationTokens() fails to obtain KMS delegation token

2016-04-14 Thread Andreas Neumann (JIRA)
Andreas Neumann created HDFS-10296: -- Summary: FileContext.getDelegationTokens() fails to obtain KMS delegation token Key: HDFS-10296 URL: https://issues.apache.org/jira/browse/HDFS-10296 Project:

[jira] [Updated] (HDFS-10294) Balancer configures DN properties

2016-04-14 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10294: -- Priority: Major (was: Critical) > Balancer configures DN properties >

[jira] [Commented] (HDFS-10293) StripedFileTestUtil#readAll flaky

2016-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242159#comment-15242159 ] Hadoop QA commented on HDFS-10293: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10294) Balancer configures DN properties

2016-04-14 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10294: - Summary: Balancer configures DN properties Key: HDFS-10294 URL: https://issues.apache.org/jira/browse/HDFS-10294 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-04-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242150#comment-15242150 ] Yongjun Zhang commented on HDFS-9820: - Hi [~jingzhao], Thanks for proposing offline discussion, I was

[jira] [Commented] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-04-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242139#comment-15242139 ] Masatake Iwasaki commented on HDFS-9905: [~jojochuang], can you update the patch to address

[jira] [Commented] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-04-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242127#comment-15242127 ] Masatake Iwasaki commented on HDFS-9905: bq. I don't know what would cause SocketTimeoutException

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-04-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242112#comment-15242112 ] Jing Zhao commented on HDFS-9820: - [~yzhangal], I have a very good understanding about HDFS-10263 But

[jira] [Commented] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242094#comment-15242094 ] Xiaoyu Yao commented on HDFS-10207: --- One additional comments on the patch: backoff reconfigure is added

[jira] [Commented] (HDFS-10224) Implement an asynchronous DistributedFileSystem

2016-04-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242061#comment-15242061 ] Xiaobing Zhou commented on HDFS-10224: -- v001 is posted. FutureX is renamed to AsyncX and unit tests

[jira] [Updated] (HDFS-10224) Implement an asynchronous DistributedFileSystem

2016-04-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: HDFS-10224-HDFS-9924.001.patch > Implement an asynchronous DistributedFileSystem >

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-04-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242030#comment-15242030 ] Yongjun Zhang commented on HDFS-9820: - Many thanks [~jingzhao]. Good discussion! 1. {quote} No. This

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-04-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241943#comment-15241943 ] Jing Zhao commented on HDFS-9820: - bq. One small correction: before we do the incremental copy, we create a

[jira] [Commented] (HDFS-10283) o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241932#comment-15241932 ] Mingliang Liu commented on HDFS-10283: -- Failing tests are not related as the changes are only for

[jira] [Updated] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10284: - Attachment: HDFS-10284.001.patch >

[jira] [Commented] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241905#comment-15241905 ] Hudson commented on HDFS-10281: --- FAILURE: Integrated in Hadoop-trunk-Commit #9616 (See

[jira] [Commented] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241897#comment-15241897 ] Mingliang Liu commented on HDFS-10284: -- I found the {{BlockManagerSafeMode$SafeModeMonitor#canLeave}}

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-04-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241868#comment-15241868 ] Yongjun Zhang commented on HDFS-9820: - Thanks a lot [~jingzhao]! My thoughts to share: 1. {quote}

[jira] [Commented] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241859#comment-15241859 ] Mingliang Liu commented on HDFS-10281: -- Thanks for the review and commit, [~kihwal]. >

[jira] [Updated] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10281: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-04-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241844#comment-15241844 ] Eric Payne commented on HDFS-9905: -- bq. java.net.SocksSocketImpl is possible to throw

[jira] [Commented] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241836#comment-15241836 ] Kihwal Lee commented on HDFS-10281: --- The test failures don't seem to be related, as this patch only

[jira] [Commented] (HDFS-10292) Add block id when client got Unable to close file exception

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241815#comment-15241815 ] Mingliang Liu commented on HDFS-10292: -- A space between "block" and {{last}} will be better, but it's

[jira] [Commented] (HDFS-10293) StripedFileTestUtil#readAll flaky

2016-04-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241811#comment-15241811 ] Jing Zhao commented on HDFS-10293: -- +1 pending Jenkins. > StripedFileTestUtil#readAll flaky >

[jira] [Commented] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241808#comment-15241808 ] Hadoop QA commented on HDFS-10281: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241806#comment-15241806 ] Mingliang Liu commented on HDFS-10284: -- [~brahmareddy], would you review this for me? Thanks. >

[jira] [Commented] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241802#comment-15241802 ] Mingliang Liu commented on HDFS-10281: -- Thanks for studying the pre-commit build issue. Let's wait

[jira] [Commented] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241781#comment-15241781 ] Kihwal Lee commented on HDFS-10281: --- https://builds.apache.org/job/PreCommit-HDFS-Build/15143/console It

[jira] [Commented] (HDFS-10292) Add block id when client got Unable to close file exception

2016-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241778#comment-15241778 ] Hudson commented on HDFS-10292: --- FAILURE: Integrated in Hadoop-trunk-Commit #9615 (See

[jira] [Updated] (HDFS-10292) Add block id when client got Unable to close file exception

2016-04-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10292: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-10292) Add block id when client got Unable to close file exception

2016-04-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241761#comment-15241761 ] Kihwal Lee commented on HDFS-10292: --- +1 lgtm. I will commit it shortly. > Add block id when client got

[jira] [Updated] (HDFS-10293) StripedFileTestUtil#readAll flaky

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10293: - Attachment: HDFS-10293.000.patch The code is as following: {code} static int

[jira] [Updated] (HDFS-10293) StripedFileTestUtil#readAll flaky

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10293: - Status: Patch Available (was: Open) > StripedFileTestUtil#readAll flaky >

[jira] [Updated] (HDFS-10293) StripedFileTestUtil#readAll flaky

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10293: - Issue Type: Sub-task (was: Bug) Parent: HDFS-8031 > StripedFileTestUtil#readAll flaky >

[jira] [Created] (HDFS-10293) StripedFileTestUtil#readAll flaky

2016-04-14 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10293: Summary: StripedFileTestUtil#readAll flaky Key: HDFS-10293 URL: https://issues.apache.org/jira/browse/HDFS-10293 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241716#comment-15241716 ] Xiaoyu Yao commented on HDFS-10207: --- [~xiaobingo], can you rebase the patch to the trunk as it won't

[jira] [Commented] (HDFS-10263) Provide symmetric entries in reversed snapshot diff report

2016-04-14 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241707#comment-15241707 ] John Zhuge commented on HDFS-10263: --- Thanks [~yzhangal] for the great report. {{SnapshotDiffReport}} API

[jira] [Commented] (HDFS-7499) Add NFSv4 + Kerberos / client authentication support

2016-04-14 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241677#comment-15241677 ] John Zhuge commented on HDFS-7499: -- Wonder whether we can add an HDFS based layout type for

[jira] [Commented] (HDFS-10286) Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties

2016-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241668#comment-15241668 ] Hudson commented on HDFS-10286: --- FAILURE: Integrated in Hadoop-trunk-Commit #9613 (See

[jira] [Updated] (HDFS-10286) Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties

2016-04-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10286: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-04-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241643#comment-15241643 ] Jing Zhao commented on HDFS-9820: - Let's say we first have snapshot s1 both both source and target (and the

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241634#comment-15241634 ] Mingliang Liu commented on HDFS-10287: -- This will be a good improvement and users of

[jira] [Commented] (HDFS-10216) distcp -diff relative path exception

2016-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241630#comment-15241630 ] Hudson commented on HDFS-10216: --- FAILURE: Integrated in Hadoop-trunk-Commit #9612 (See

[jira] [Commented] (HDFS-10280) Document new dfsadmin command -evictWriters

2016-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241629#comment-15241629 ] Hudson commented on HDFS-10280: --- FAILURE: Integrated in Hadoop-trunk-Commit #9612 (See

[jira] [Updated] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10281: - Attachment: HDFS-10281.001.patch Thanks [~jnp] for reviewing. Re-upload the patch for triggering

[jira] [Commented] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-04-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241612#comment-15241612 ] Masatake Iwasaki commented on HDFS-9905: ...

[jira] [Updated] (HDFS-10280) Document new dfsadmin command -evictWriters

2016-04-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10280: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-04-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241602#comment-15241602 ] Masatake Iwasaki commented on HDFS-9905:

[jira] [Commented] (HDFS-10280) Document new dfsadmin command -evictWriters

2016-04-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241584#comment-15241584 ] Kihwal Lee commented on HDFS-10280: --- +1 lgtm > Document new dfsadmin command -evictWriters >

[jira] [Commented] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-04-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241574#comment-15241574 ] Kihwal Lee commented on HDFS-9905: -- [~eepayne], do you by any chance have any idea about this test

[jira] [Updated] (HDFS-10216) distcp -diff relative path exception

2016-04-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10216: - Priority: Major (was: Critical) > distcp -diff relative path exception >

[jira] [Updated] (HDFS-10216) distcp -diff relative path exception

2016-04-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10216: - Resolution: Fixed Fix Version/s: 2.9.0 Target Version/s: (was: 2.8.0)

[jira] [Updated] (HDFS-10216) distcp -diff relative path exception

2016-04-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10216: - Affects Version/s: (was: 2.6.0) 2.8.0 > distcp -diff relative path exception >

[jira] [Commented] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-04-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241569#comment-15241569 ] Masatake Iwasaki commented on HDFS-9905: {code} private static final int SHORT_SOCKET_TIMEOUT =

[jira] [Commented] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241567#comment-15241567 ] Mingliang Liu commented on HDFS-10284: -- Failing tests are not related. >

[jira] [Commented] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-04-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241555#comment-15241555 ] Masatake Iwasaki commented on HDFS-9905: Hmm... the stacktrace printed by

[jira] [Commented] (HDFS-10282) The VolumeScanner should warn about replica files which are misplaced

2016-04-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241515#comment-15241515 ] Colin Patrick McCabe commented on HDFS-10282: - Thanks, [~kihwal]. > The VolumeScanner should

[jira] [Commented] (HDFS-10280) Document new dfsadmin command -evictWriters

2016-04-14 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241514#comment-15241514 ] Wei-Chiu Chuang commented on HDFS-10280: I had to violate checkstyle warning, because the existing

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-04-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241455#comment-15241455 ] Arpit Agarwal commented on HDFS-9349: - Look for commit ddfe677. > Support reconfiguring

[jira] [Updated] (HDFS-10292) Add block id when client got Unable to close file exception

2016-04-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10292: Affects Version/s: 2.7.2 > Add block id when client got Unable to close file

[jira] [Commented] (HDFS-10280) Document new dfsadmin command -evictWriters

2016-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241426#comment-15241426 ] Hadoop QA commented on HDFS-10280: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10289) Balancer configures DNs directly

2016-04-14 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241396#comment-15241396 ] John Zhuge commented on HDFS-10289: --- Thanks [~anu], I will take a look. > Balancer configures DNs

[jira] [Updated] (HDFS-10216) distcp -diff relative path exception

2016-04-14 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10216: -- Hadoop Flags: Reviewed +1 LGTM > distcp -diff relative path exception >

[jira] [Commented] (HDFS-10292) Add block id when client got Unable to close file exception

2016-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241378#comment-15241378 ] Hadoop QA commented on HDFS-10292: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10289) Balancer configures DNs directly

2016-04-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241375#comment-15241375 ] Anu Engineer commented on HDFS-10289: - As part of diskBalancer work we have added an API that might be

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-04-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241365#comment-15241365 ] Yongjun Zhang commented on HDFS-9820: - Hi [~jingzhao], Thanks a lot for your review and comments!

[jira] [Updated] (HDFS-10292) Add block id when client got Unable to close file exception

2016-04-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10292: Priority: Minor (was: Major) > Add block id when client got Unable to close file

[jira] [Updated] (HDFS-10292) Add block id when client got Unable to close file exception

2016-04-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10292: Status: Patch Available (was: Open) > Add block id when client got Unable to close

[jira] [Updated] (HDFS-10292) Add block id when client got Unable to close file exception

2016-04-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10292: Attachment: HDFS-10292.patch Uploaded the patch, kindly review. > Add block id

[jira] [Created] (HDFS-10292) Add block id when client got Unable to close file exception

2016-04-14 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-10292: --- Summary: Add block id when client got Unable to close file exception Key: HDFS-10292 URL: https://issues.apache.org/jira/browse/HDFS-10292 Project:

[jira] [Assigned] (HDFS-9271) Implement basic NN operations

2016-04-14 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-9271: - Assignee: James Clampffer (was: Aliaksei Sandryhaila) > Implement basic NN operations >

[jira] [Commented] (HDFS-10282) The VolumeScanner should warn about replica files which are misplaced

2016-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241136#comment-15241136 ] Hudson commented on HDFS-10282: --- FAILURE: Integrated in Hadoop-trunk-Commit #9611 (See

[jira] [Commented] (HDFS-10280) Document new dfsadmin command -evictWriters

2016-04-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241110#comment-15241110 ] Kihwal Lee commented on HDFS-10280: --- Kicked the build manually. > Document new dfsadmin command

[jira] [Updated] (HDFS-10282) The VolumeScanner should warn about replica files which are misplaced

2016-04-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10282: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved

[jira] [Commented] (HDFS-10282) The VolumeScanner should warn about replica files which are misplaced

2016-04-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241100#comment-15241100 ] Kihwal Lee commented on HDFS-10282: --- Committed this to trunk and branch-2. > The VolumeScanner should

[jira] [Commented] (HDFS-10282) The VolumeScanner should warn about replica files which are misplaced

2016-04-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241087#comment-15241087 ] Kihwal Lee commented on HDFS-10282: --- +1 > The VolumeScanner should warn about replica files which are

[jira] [Commented] (HDFS-10216) distcp -diff relative path exception

2016-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241080#comment-15241080 ] Hadoop QA commented on HDFS-10216: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10258) Erasure Coding: support small cluster whose #DataNode < # (Blocks in a BlockGroup)

2016-04-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241069#comment-15241069 ] Kai Zheng commented on HDFS-10258: -- Thanks [~libo-intel] for the consideration. It's good to support a

[jira] [Commented] (HDFS-10291) TestShortCircuitLocalRead failing

2016-04-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241066#comment-15241066 ] Steve Loughran commented on HDFS-10291: --- 1. test is doing a short circuited read of a 13 byte file

[jira] [Commented] (HDFS-10291) TestShortCircuitLocalRead failing

2016-04-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241038#comment-15241038 ] Steve Loughran commented on HDFS-10291: --- {code} java.lang.IndexOutOfBoundsException: Requested more

[jira] [Created] (HDFS-10291) TestShortCircuitLocalRead failing

2016-04-14 Thread Steve Loughran (JIRA)
Steve Loughran created HDFS-10291: - Summary: TestShortCircuitLocalRead failing Key: HDFS-10291 URL: https://issues.apache.org/jira/browse/HDFS-10291 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-10216) distcp -diff relative path exception

2016-04-14 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated HDFS-10216: --- Status: Patch Available (was: Open) > distcp -diff relative path exception >

[jira] [Updated] (HDFS-10216) distcp -diff relative path exception

2016-04-14 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated HDFS-10216: --- Attachment: HDFS-10216.4.patch > distcp -diff relative path exception >

[jira] [Commented] (HDFS-10216) distcp -diff relative path exception

2016-04-14 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241012#comment-15241012 ] Takashi Ohnishi commented on HDFS-10216: {quote} * Line 709 is too long * Line 710-711 can be

[jira] [Updated] (HDFS-10216) distcp -diff relative path exception

2016-04-14 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated HDFS-10216: --- Status: Open (was: Patch Available) > distcp -diff relative path exception >

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240996#comment-15240996 ] Walter Su commented on HDFS-9412: - {{TestBalancer}} passes locally. +1 for the last patch. > getBlocks

  1   2   >