[jira] [Commented] (HDFS-9472) concat() API does not give proper exception messages on ./reserved relative path

2015-12-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050269#comment-15050269 ] Rakesh R commented on HDFS-9472: Thanks [~umamaheswararao]. Attached another patch addressi

[jira] [Updated] (HDFS-9472) concat() API does not give proper exception messages on ./reserved relative path

2015-12-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9472: --- Summary: concat() API does not give proper exception messages on ./reserved relative path (was: concat() API d

[jira] [Updated] (HDFS-9472) concat() API does not resolve the .reserved path

2015-12-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9472: --- Description: dfs#concat() API doesn't resolve the {{/.reserved/raw}} path. For example, if the input paths of

[jira] [Updated] (HDFS-9472) concat() API does not resolve the .reserved path

2015-12-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9472: --- Attachment: HDFS-9472-03.patch > concat() API does not resolve the .reserved path > ---

[jira] [Commented] (HDFS-9472) concat() API does not resolve the .reserved path

2015-12-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050261#comment-15050261 ] Uma Maheswara Rao G commented on HDFS-9472: --- nit: {code} throw new IOException("C

[jira] [Commented] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050251#comment-15050251 ] Hudson commented on HDFS-9527: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #681 (See [htt

[jira] [Commented] (HDFS-9522) Cleanup o.a.h.hdfs.protocol.SnapshotDiffReport$DiffReportEntry

2015-12-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050239#comment-15050239 ] John Zhuge commented on HDFS-9522: -- Thanks. > Cleanup o.a.h.hdfs.protocol.SnapshotDiffRep

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050241#comment-15050241 ] Yongjun Zhang commented on HDFS-7916: - Hi [~vinayrpet], Thanks for your reply. My ques

[jira] [Updated] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9519: Status: Patch Available (was: Open) > Some coding improvement in SecondaryNameNode#main > --

[jira] [Commented] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050172#comment-15050172 ] Yongjun Zhang commented on HDFS-9519: - Thanks Xiao. +1 on rev2 pending jenkins test.

[jira] [Commented] (HDFS-9411) HDFS ZoneLabel support

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050090#comment-15050090 ] Vinayakumar B commented on HDFS-9411: - Thanks [~zhz] for taking look here. bq. Are the

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050084#comment-15050084 ] Vinayakumar B commented on HDFS-7916: - {quote}This patch simply ignores the block when

[jira] [Resolved] (HDFS-9529) Extend Erasure Code to support POWER Chip acceleration

2015-12-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-9529. - Resolution: Duplicate Thanks Qijun for confirming this. Resolving this one as dup. > Extend Erasure Code t

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050067#comment-15050067 ] Vinayakumar B commented on HDFS-8578: - HDFS-9536 has been created to follow-up #2, OOM

[jira] [Created] (HDFS-9536) OOM errors during parallel upgrade to Block-ID based layout

2015-12-09 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-9536: --- Summary: OOM errors during parallel upgrade to Block-ID based layout Key: HDFS-9536 URL: https://issues.apache.org/jira/browse/HDFS-9536 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: HDFS-8578-15.patch HDFS-8578-branch-2.7-003.patch Updated patch as sugges

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050038#comment-15050038 ] Vinayakumar B commented on HDFS-8578: - bq. I suggest that we fix #1 first and then fix

[jira] [Commented] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049978#comment-15049978 ] Xiao Chen commented on HDFS-9519: - Thanks Yongjun. I agree with your general idea that we s

[jira] [Updated] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9519: Attachment: HDFS-9519.02.patch > Some coding improvement in SecondaryNameNode#main >

[jira] [Commented] (HDFS-9529) Extend Erasure Code to support POWER Chip acceleration

2015-12-09 Thread wqijun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049970#comment-15049970 ] wqijun commented on HDFS-9529: -- ok, I will put it in Hadoop Common project > Extend Erasure C

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049967#comment-15049967 ] Hadoop QA commented on HDFS-9173: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

2015-12-09 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049962#comment-15049962 ] GAO Rui commented on HDFS-7661: --- [~szetszwo], [~jingzhao], thank you very much for the enligh

[jira] [Commented] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049949#comment-15049949 ] Hudson commented on HDFS-9527: -- FAILURE: Integrated in Hadoop-trunk-Commit #8949 (See [https:

[jira] [Commented] (HDFS-9513) DataNodeManager#getDataNodeStorageInfos not backward compatibility

2015-12-09 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049938#comment-15049938 ] 邓飞 commented on HDFS-9513: -- yes, i will work on it,later upload new patch > DataNodeManager#getDa

[jira] [Commented] (HDFS-9513) DataNodeManager#getDataNodeStorageInfos not backward compatibility

2015-12-09 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049937#comment-15049937 ] 邓飞 commented on HDFS-9513: -- yes, i will work on it,later upload new patch > DataNodeManager#getDa

[jira] [Commented] (HDFS-9513) DataNodeManager#getDataNodeStorageInfos not backward compatibility

2015-12-09 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049936#comment-15049936 ] 邓飞 commented on HDFS-9513: -- yes, i will work on it,later upload new patch > DataNodeManager#getDa

[jira] [Commented] (HDFS-9528) Cleanup namenode audit/log/exception messages

2015-12-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049896#comment-15049896 ] Uma Maheswara Rao G commented on HDFS-9528: --- Thankyou for the cleanup. Seems tes

[jira] [Updated] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9527: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Statu

[jira] [Commented] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049855#comment-15049855 ] Yongjun Zhang commented on HDFS-9519: - Thanks [~xiaochen] for the patch. Can we move t

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049840#comment-15049840 ] Tsz Wo Nicholas Sze commented on HDFS-8578: --- > ... Also, #2 need more discussion

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049820#comment-15049820 ] Tsz Wo Nicholas Sze commented on HDFS-8578: --- There are two different problems: #

[jira] [Commented] (HDFS-9034) "StorageTypeStats" Metric should not count failed storage.

2015-12-09 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049781#comment-15049781 ] Benoy Antony commented on HDFS-9034: I'll review this tomorrow. > "StorageTypeStats" M

[jira] [Updated] (HDFS-9535) Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate

2015-12-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9535: Assignee: Mingliang Liu > Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate > ---

[jira] [Commented] (HDFS-9535) Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate

2015-12-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049755#comment-15049755 ] Jing Zhao commented on HDFS-9535: - The failure is because: # In HDFS-1172 we update the pen

[jira] [Updated] (HDFS-9535) Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate

2015-12-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9535: Description: TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate failed in several Jenkins run (e.g

[jira] [Created] (HDFS-9535) Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate

2015-12-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-9535: --- Summary: Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate Key: HDFS-9535 URL: https://issues.apache.org/jira/browse/HDFS-9535 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049734#comment-15049734 ] Jing Zhao commented on HDFS-9527: - The new patch looks good to me. The failed tests should

[jira] [Commented] (HDFS-9514) TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049709#comment-15049709 ] Yongjun Zhang commented on HDFS-9514: - Thanks [~ste...@apache.org] for reporting the is

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-12-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049705#comment-15049705 ] Chris Nauroth commented on HDFS-9038: - I'm in favor of using {{File#getUsableSpace}} fo

[jira] [Updated] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9519: Attachment: HDFS-9519.01.patch > Some coding improvement in SecondaryNameNode#main >

[jira] [Commented] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049671#comment-15049671 ] Xiao Chen commented on HDFS-9519: - Thanks [~liuml07] and [~aw] for the comments and sorry f

[jira] [Commented] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049658#comment-15049658 ] Konstantin Shvachko commented on HDFS-9516: --- Btw which branch are you running it

[jira] [Commented] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049657#comment-15049657 ] Hadoop QA commented on HDFS-9527: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2015-12-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049649#comment-15049649 ] Zhe Zhang commented on HDFS-9342: - Thanks Walter (and sorry about the late review). The alg

[jira] [Commented] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049644#comment-15049644 ] Konstantin Shvachko commented on HDFS-9516: --- Indeed, looks like an attempt to ren

[jira] [Updated] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-12-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9173: Attachment: HDFS-9173.06.patch Upload a rebased patch for Walter. Also did some minor code cleanup in class

[jira] [Commented] (HDFS-9532) Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049598#comment-15049598 ] Hadoop QA commented on HDFS-9532: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (HDFS-9534) Add CLI command to clear storage policy from a path.

2015-12-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-9534: --- Assignee: Xiaobing Zhou > Add CLI command to clear storage policy from a path. > -

[jira] [Created] (HDFS-9534) Add CLI command to clear storage policy from a path.

2015-12-09 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9534: --- Summary: Add CLI command to clear storage policy from a path. Key: HDFS-9534 URL: https://issues.apache.org/jira/browse/HDFS-9534 Project: Hadoop HDFS Issue Ty

[jira] [Commented] (HDFS-9411) HDFS ZoneLabel support

2015-12-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049509#comment-15049509 ] Zhe Zhang commented on HDFS-9411: - Thanks for the interesting proposal Vinay. Are the file

[jira] [Updated] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9523: -- Attachment: failed_docker_run.txt > libhdfs++: failure to connect to ipv6 host causes CI unit tes

[jira] [Commented] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049494#comment-15049494 ] James Clampffer commented on HDFS-9523: --- [~bobthansen] - I was able to get the shim t

[jira] [Commented] (HDFS-9365) Balaner does not work with the HDFS-6376 HA setup

2015-12-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049416#comment-15049416 ] Tsz Wo Nicholas Sze commented on HDFS-9365: --- Actually, do you mean combined keys

[jira] [Updated] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9527: -- Attachment: h9527_20151209.patch Here is a new patch. h9527_20151209.patch > The return

[jira] [Commented] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049398#comment-15049398 ] Tsz Wo Nicholas Sze commented on HDFS-9527: --- Thanks, Jing. Will fix TestClientPr

[jira] [Updated] (HDFS-9526) DiskBalancer: change htrace...JsonIgnore to codehaus...JsonIgnore

2015-12-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9526: Description: This is to change org.apache.htrace.fasterxml.jackson.annotation.JsonIgnore org.apache.h

[jira] [Updated] (HDFS-9526) DiskBalancer: change htrace...JsonIgnore to codehaus...JsonIgnore

2015-12-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9526: -- Resolution: Fixed Fix Version/s: HDFS-1312 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049367#comment-15049367 ] Chris Nauroth commented on HDFS-9530: - Additionally, Apache Hadoop 2.7.1 has a bug that

[jira] [Commented] (HDFS-9527) The return type of FSNamesystem.getBlockCollection should be changed to INodeFile

2015-12-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049249#comment-15049249 ] Jing Zhao commented on HDFS-9527: - Looks like the failure of TestClientProtocolForPipelineR

[jira] [Updated] (HDFS-9532) Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9532: Status: Patch Available (was: Open) > Detailed exception info is lost in reportTo method of ErrorRep

[jira] [Updated] (HDFS-9532) Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9532: Attachment: HDFS-9532.001.patch Submitted patch 001. Thanks for reviewing. > Detailed exception in

[jira] [Updated] (HDFS-9532) Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9532: Priority: Trivial (was: Major) > Detailed exception info is lost in reportTo method of ErrorReportAc

[jira] [Commented] (HDFS-9533) seen_txid in the shared edits directory is modified during bootstrapping

2015-12-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049203#comment-15049203 ] Kihwal Lee commented on HDFS-9533: -- It turned out a standby namenode was bootstrapped. Thi

[jira] [Created] (HDFS-9533) seen_txid in the shared edits directory is modified during bootstrapping

2015-12-09 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-9533: Summary: seen_txid in the shared edits directory is modified during bootstrapping Key: HDFS-9533 URL: https://issues.apache.org/jira/browse/HDFS-9533 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049200#comment-15049200 ] Yongjun Zhang commented on HDFS-7916: - HI [~rushabh.shah], Thanks for your reply and s

[jira] [Created] (HDFS-9532) Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction

2015-12-09 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9532: --- Summary: Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction Key: HDFS-9532 URL: https://issues.apache.org/jira/browse/HDFS-9532

[jira] [Commented] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049177#comment-15049177 ] Bob Hansen commented on HDFS-9523: -- This passes fine on my local Docker instance with this

[jira] [Commented] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049149#comment-15049149 ] Hadoop QA commented on HDFS-9483: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9526) DiskBalancer: change htrace...JsonIgnore to codehaus...JsonIgnore

2015-12-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049147#comment-15049147 ] Xiaobing Zhou commented on HDFS-9526: - Test failures are not related. Kindly commit it,

[jira] [Updated] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2015-12-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9483: - Attachment: HDFS-9483.001.patch Resubmitting patch to trigger jenkins. > Documenta

[jira] [Commented] (HDFS-9445) Deadlock in datanode

2015-12-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049119#comment-15049119 ] Chris Nauroth commented on HDFS-9445: - [~kihwal] and [~walter.k.su], if I understand co

[jira] [Commented] (HDFS-9529) Extend Erasure Code to support POWER Chip acceleration

2015-12-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049101#comment-15049101 ] Zhe Zhang commented on HDFS-9529: - I agree. This change most likely will happen under {{had

[jira] [Commented] (HDFS-9034) "StorageTypeStats" Metric should not count failed storage.

2015-12-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049052#comment-15049052 ] Surendra Singh Lilhore commented on HDFS-9034: -- Failed tests and checkstyle wa

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-09 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049010#comment-15049010 ] Xiaoyu Yao commented on HDFS-9530: -- This looks like the symptom of HDFS-8072, where RBW re

[jira] [Commented] (HDFS-9458) TestBackupNode always binds to port 50070, which can cause bind failures.

2015-12-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048989#comment-15048989 ] Xiao Chen commented on HDFS-9458: - The test failures and license warnings are unrelated to

[jira] [Commented] (HDFS-9281) Change TestDeleteBlockPool to not explicitly use File to check block pool existence.

2015-12-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048937#comment-15048937 ] Colin Patrick McCabe commented on HDFS-9281: Thanks, [~eddyxu]. {{checkBlockPo

[jira] [Commented] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048912#comment-15048912 ] Hadoop QA commented on HDFS-9523: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9448) Enable valgrind for libhdfspp unit tests

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048867#comment-15048867 ] Bob Hansen commented on HDFS-9448: -- That patch looks good. All of the valgrind tests run

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048850#comment-15048850 ] Hadoop QA commented on HDFS-8578: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9523: - Status: Patch Available (was: Open) > libhdfs++: failure to connect to ipv6 host causes CI unit tests to f

[jira] [Assigned] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen reassigned HDFS-9523: Assignee: Bob Hansen > libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail > ---

[jira] [Updated] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9523: - Attachment: HDFS-9523.HDFS-8707.000.patch Patch: have the RpcConnection try all of the endpoints returned b

[jira] [Commented] (HDFS-9445) Deadlock in datanode

2015-12-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048737#comment-15048737 ] Kihwal Lee commented on HDFS-9445: -- +1. I will commit it this afternoon, if no one objects

[jira] [Commented] (HDFS-8894) Set SO_KEEPALIVE on DN server sockets

2015-12-09 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048708#comment-15048708 ] Kanaka Kumar Avvaru commented on HDFS-8894: --- As commented earlier, the check styl

[jira] [Commented] (HDFS-8836) Skip newline on empty files with getMerge -nl

2015-12-09 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048702#comment-15048702 ] Kanaka Kumar Avvaru commented on HDFS-8836: --- Thanks for taking a look at patch [~

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048664#comment-15048664 ] Allen Wittenauer commented on HDFS-8578: You're misinterpreting the output entirely

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048659#comment-15048659 ] Vinayakumar B commented on HDFS-8578: - I mean. Its falling back to jenkins mode due to

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048653#comment-15048653 ] Brahma Reddy Battula commented on HDFS-9530: [~ferhui] thanks for reporting thi

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048654#comment-15048654 ] Allen Wittenauer commented on HDFS-8578: ... except that message only shows up when

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048644#comment-15048644 ] Vinayakumar B commented on HDFS-8578: - [~aw], yetus is not actually running in docker.

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: HDFS-8578-14.patch HDFS-8578-branch-2.7-002.patch Fixed findbugs and chec

[jira] [Commented] (HDFS-9448) Enable valgrind for libhdfspp unit tests

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048617#comment-15048617 ] Hadoop QA commented on HDFS-9448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9472) concat() API does not resolve the .reserved path

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048605#comment-15048605 ] Hadoop QA commented on HDFS-9472: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048563#comment-15048563 ] Bob Hansen commented on HDFS-9523: -- Removing the line from /etc/hosts that reads :::1 l

[jira] [Updated] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9523: - Summary: libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail (was: libhdfs++: running

[jira] [Commented] (HDFS-9448) Enable valgrind for libhdfspp unit tests

2015-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048535#comment-15048535 ] Hadoop QA commented on HDFS-9448: - (!) A patch to the testing environment has been detected

[jira] [Updated] (HDFS-9448) Enable valgrind for libhdfspp unit tests

2015-12-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9448: - Attachment: HDFS-9448.HDFS-8707.005.patch Path 005: removed gdb from Docker image; it apparently caused yet

[jira] [Created] (HDFS-9531) Can't use windows network drive

2015-12-09 Thread tian (JIRA)
tian created HDFS-9531: -- Summary: Can't use windows network drive Key: HDFS-9531 URL: https://issues.apache.org/jira/browse/HDFS-9531 Project: Hadoop HDFS Issue Type: Bug Components: fs Af

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-09 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048384#comment-15048384 ] Fei Hui commented on HDFS-9530: --- i want to add logs to monitor DataNode DFS Used, Non DFS Use

[jira] [Created] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-09 Thread Fei Hui (JIRA)
Fei Hui created HDFS-9530: - Summary: huge Non-DFS Used in hadoop 2.6.2 & 2.7.1 Key: HDFS-9530 URL: https://issues.apache.org/jira/browse/HDFS-9530 Project: Hadoop HDFS Issue Type: Bug Rep

  1   2   >