[jira] [Updated] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9612: -- Attachment: HDFS-9612.007.patch Rev07: Thanks [~yzhangal] for comments. I uploaded a patch that a

[jira] [Updated] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9648: -- Component/s: namenode > Test TestStartup.testImageChecksum keeps failing > -

[jira] [Updated] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9648: -- Labels: test (was: ) > Test TestStartup.testImageChecksum keeps failing > -

[jira] [Updated] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9648: -- Status: Patch Available (was: Open) > Test TestStartup.testImageChecksum keeps failing > --

[jira] [Updated] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9648: -- Priority: Trivial (was: Major) > Test TestStartup.testImageChecksum keeps failing > ---

[jira] [Updated] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9648: -- Affects Version/s: 3.0.0 > Test TestStartup.testImageChecksum keeps failing > --

[jira] [Assigned] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-9648: - Assignee: Wei-Chiu Chuang > Test TestStartup.testImageChecksum keeps failing > --

[jira] [Updated] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9648: -- Attachment: HDFS-9648.001.patch Rev01: match the new exception message. > Test TestStartup.testI

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097717#comment-15097717 ] Hadoop QA commented on HDFS-8999: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097695#comment-15097695 ] Hadoop QA commented on HDFS-9624: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8430) Erasure coding: compute file checksum for stripe files

2016-01-13 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097692#comment-15097692 ] Kai Zheng commented on HDFS-8430: - Thanks Nicholas for the great elaborating and confirming

[jira] [Commented] (HDFS-8430) Erasure coding: compute file checksum for stripe files

2016-01-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097645#comment-15097645 ] Tsz Wo Nicholas Sze commented on HDFS-8430: --- [~drankye], sorry for the late reply

[jira] [Updated] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9648: -- Description: I saw the Jenkins log shows TestStartup.testImageChecksum has been failing consecut

[jira] [Updated] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9648: -- Assignee: (was: Wei-Chiu Chuang) > Test TestStartup.testImageChecksum keeps failing > --

[jira] [Assigned] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-9648: - Assignee: Wei-Chiu Chuang > Test TestStartup.testImageChecksum keeps failing > --

[jira] [Updated] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9648: -- Description: I saw the Jenkins log shows TestStartup.testImageChecksum has been failing consecut

[jira] [Created] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9648: - Summary: Test TestStartup.testImageChecksum keeps failing Key: HDFS-9648 URL: https://issues.apache.org/jira/browse/HDFS-9648 Project: Hadoop HDFS Issue T

[jira] [Updated] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-13 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9624: Attachment: HDFS-9624.006.patch Sorry for Wang, I misunderstand your meaning of timer injection. I use the f

[jira] [Commented] (HDFS-9635) Add one more volume choosing policy with considering volume IO load

2016-01-13 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097541#comment-15097541 ] Kai Zheng commented on HDFS-9635: - Just in case it can help, regarding volume choosing poli

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097538#comment-15097538 ] Hadoop QA commented on HDFS-9646: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-13 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097523#comment-15097523 ] Kai Zheng commented on HDFS-9646: - The patch is a great fix along with good refactorings. S

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097511#comment-15097511 ] Tsz Wo Nicholas Sze commented on HDFS-9646: --- Thanks [~tfukudom] and [~jingzhao].

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-13 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097502#comment-15097502 ] Kai Sasaki commented on HDFS-9646: -- Hello, [~jingzhao] BTW, the patch seems to include the

[jira] [Updated] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8999: -- Attachment: h8999_20160114.patch Oops, the index calculated was incorrect in the last pat

[jira] [Commented] (HDFS-9595) DiskBalancer : Add cancelPlan RPC

2016-01-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097454#comment-15097454 ] Arpit Agarwal commented on HDFS-9595: - The patch looks great. Nitpick typo - _Cancels a

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-13 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097447#comment-15097447 ] Kai Zheng commented on HDFS-9646: - Oh, I got your point. You want to only read and recover

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-13 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097443#comment-15097443 ] Kai Zheng commented on HDFS-9646: - Hi [~jingzhao], The patch looks great! I'm reading it a

[jira] [Commented] (HDFS-9517) Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes

2016-01-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097406#comment-15097406 ] Hudson commented on HDFS-9517: -- FAILURE: Integrated in Hadoop-trunk-Commit #9104 (See [https:

[jira] [Updated] (HDFS-9517) Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes

2016-01-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9517: --- Resolution: Fixed Fix Version/s: 2.9.0 Target Version/s: 2.9.0

[jira] [Commented] (HDFS-9493) Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk

2016-01-13 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097368#comment-15097368 ] Lei (Eddy) Xu commented on HDFS-9493: - [~vinodkv] Thanks for reminding me! Cherry picke

[jira] [Updated] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9646: Status: Patch Available (was: Open) > ErasureCodingWorker may fail when recovering data blocks with length l

[jira] [Updated] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9646: Attachment: HDFS-9646.000.patch Upload a patch to fix the recover length calculation in ErasureCodingWorker.

[jira] [Commented] (HDFS-9466) TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky

2016-01-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097350#comment-15097350 ] Colin Patrick McCabe commented on HDFS-9466: Hmm. Can you be clearer on what t

[jira] [Commented] (HDFS-9597) BaseReplicationPolicyTest should update data node stats after adding a data node

2016-01-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097351#comment-15097351 ] Vinod Kumar Vavilapalli commented on HDFS-9597: --- [~benoyantony], there is a b

[jira] [Commented] (HDFS-9493) Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk

2016-01-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097348#comment-15097348 ] Vinod Kumar Vavilapalli commented on HDFS-9493: --- [~eddyxu], there is a branch

[jira] [Commented] (HDFS-9517) Make TestDistCpUtils.testUnpackAttributes testable

2016-01-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097346#comment-15097346 ] Colin Patrick McCabe commented on HDFS-9517: +1. Thanks, [~jojochuang]. > Mak

[jira] [Updated] (HDFS-9517) Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes

2016-01-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9517: --- Summary: Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes (was: Ma

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097320#comment-15097320 ] Hadoop QA commented on HDFS-8999: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9647) DiskBalancer : Add getRuntimeSettings

2016-01-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9647: --- Attachment: HDFS-9647-HDFS-1312.001.patch This patch depends on HDFS-9645. Attaching patch for code rev

[jira] [Created] (HDFS-9647) DiskBalancer : Add getRuntimeSettings

2016-01-13 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9647: -- Summary: DiskBalancer : Add getRuntimeSettings Key: HDFS-9647 URL: https://issues.apache.org/jira/browse/HDFS-9647 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-13 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097238#comment-15097238 ] James Clampffer commented on HDFS-9628: --- Looks good to me, +1. > libhdfs++: Implemen

[jira] [Comment Edited] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097214#comment-15097214 ] Jing Zhao edited comment on HDFS-9646 at 1/13/16 10:59 PM: --- {{Era

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097214#comment-15097214 ] Jing Zhao commented on HDFS-9646: - {{ErasureCodingWorker#ReconstructAndTransferBlock}} uses

[jira] [Commented] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097207#comment-15097207 ] Yongjun Zhang commented on HDFS-9612: - Thanks for [~jojochuang]'s work here and [~3opan

[jira] [Commented] (HDFS-9631) Restarting namenode after deleting a directory with snapshot will fail

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097203#comment-15097203 ] Wei-Chiu Chuang commented on HDFS-9631: --- I know [~yzhangal] has hit a similar issue i

[jira] [Commented] (HDFS-9466) TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky

2016-01-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097201#comment-15097201 ] Wei-Chiu Chuang commented on HDFS-9466: --- [~cmccabe] Xiao is right about what I though

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097200#comment-15097200 ] Jing Zhao commented on HDFS-9646: - The failure can also be reproduced with the following ch

[jira] [Updated] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9646: Attachment: test-reconstruct-stripe-file.patch Upload the unit test from [~tfukudom] that can reproduce the i

[jira] [Commented] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

2016-01-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097195#comment-15097195 ] Arpit Agarwal commented on HDFS-9415: - bq. If what you want to say is that trailing spa

[jira] [Created] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-13 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-9646: --- Summary: ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block Key: HDFS-9646 URL: https://issues.apache.org/jira/browse/HDFS-9646

[jira] [Commented] (HDFS-9289) Make DataStreamer#block thread safe and verify genStamp in commitBlock

2016-01-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097181#comment-15097181 ] Vinod Kumar Vavilapalli commented on HDFS-9289: --- Pulled this into 2.7.2 to ke

[jira] [Updated] (HDFS-9289) Make DataStreamer#block thread safe and verify genStamp in commitBlock

2016-01-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9289: -- Fix Version/s: (was: 2.7.3) (was: 3.0.0)

[jira] [Updated] (HDFS-9431) DistributedFileSystem#concat fails if the target path is relative.

2016-01-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9431: -- Fix Version/s: (was: 2.7.3) (was: 2.8.0)

[jira] [Updated] (HDFS-8615) Correct HTTP method in WebHDFS document

2016-01-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8615: -- Fix Version/s: (was: 2.7.3) (was: 2.8.0)

[jira] [Commented] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2016-01-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097143#comment-15097143 ] Hadoop QA commented on HDFS-9094: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

2016-01-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097033#comment-15097033 ] Daniel Templeton commented on HDFS-9415: My concern is that we clearly state that t

[jira] [Commented] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

2016-01-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097024#comment-15097024 ] Arpit Agarwal commented on HDFS-9415: - Also IME customers routinely skip the trailing s

[jira] [Commented] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

2016-01-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096997#comment-15096997 ] Arpit Agarwal commented on HDFS-9415: - The test case does make it explicit that we acce

[jira] [Commented] (HDFS-9643) libhdfs++: Support async cancellation of read operations

2016-01-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096969#comment-15096969 ] Hadoop QA commented on HDFS-9643: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

2016-01-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096968#comment-15096968 ] Daniel Templeton commented on HDFS-9415: Just because there's a test case, it doesn

[jira] [Commented] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

2016-01-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096950#comment-15096950 ] Xiaobing Zhou commented on HDFS-9415: - Yes, that's valid. There is one test case in Te

[jira] [Commented] (HDFS-9635) Add one more volume choosing policy with considering volume IO load

2016-01-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096928#comment-15096928 ] Anu Engineer commented on HDFS-9635: [~java8964] Thanks for comments. I am looking at t

[jira] [Updated] (HDFS-9643) libhdfs++: Support async cancellation of read operations

2016-01-13 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9643: -- Status: Patch Available (was: Open) > libhdfs++: Support async cancellation of read operations >

[jira] [Updated] (HDFS-9643) libhdfs++: Support async cancellation of read operations

2016-01-13 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9643: -- Attachment: HDFS-9643.HDFS-8707.000.patch Initial patch, I've manually tested it but need to sort

[jira] [Commented] (HDFS-9635) Add one more volume choosing policy with considering volume IO load

2016-01-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096871#comment-15096871 ] Andrew Wang commented on HDFS-9635: --- Hmm, so to clarify, do you plan to extend AvailableS

[jira] [Commented] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2016-01-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096858#comment-15096858 ] Xiaobing Zhou commented on HDFS-9094: - Thanks [~arpitagarwal] for review, patch V004 fi

[jira] [Updated] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2016-01-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9094: Attachment: HDFS-9094-HDFS-9000.004.patch > Add command line option to ask NameNode reload configurat

[jira] [Commented] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096845#comment-15096845 ] Andrew Wang commented on HDFS-9624: --- Hi [~linyiqun] thanks for revving the patch, First

[jira] [Resolved] (HDFS-6221) Webhdfs should recover from dead DNs

2016-01-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-6221. -- Resolution: Not A Problem > Webhdfs should recover from dead DNs > >

[jira] [Commented] (HDFS-6221) Webhdfs should recover from dead DNs

2016-01-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096830#comment-15096830 ] Kihwal Lee commented on HDFS-6221: -- bq. We've repeatedly observed the jetty acceptor threa

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2016-01-13 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096827#comment-15096827 ] Chris Trezzo commented on HDFS-1312: I will dial into the call as well. Thanks for post

[jira] [Commented] (HDFS-9613) Avoid checking file checksums after copy when possible

2016-01-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096784#comment-15096784 ] Yongjun Zhang commented on HDFS-9613: - HI [~drankye], Thanks for clarifying and sorry

[jira] [Updated] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8999: -- Attachment: h8999_20160113.patch h8999_20160113.patch: adds a test and fixes some bugs.

[jira] [Commented] (HDFS-9047) Retire libwebhdfs

2016-01-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096592#comment-15096592 ] Hudson commented on HDFS-9047: -- FAILURE: Integrated in Hadoop-trunk-Commit #9100 (See [https:

[jira] [Resolved] (HDFS-3917) Remove JNI code from libwebhdfs (C client library)

2016-01-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-3917. -- Resolution: Not A Problem libwebhdfs has been removed. > Remove JNI code from libwebhdfs (C client libra

[jira] [Commented] (HDFS-9047) Retire libwebhdfs

2016-01-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096566#comment-15096566 ] Kihwal Lee commented on HDFS-9047: -- Also fixed the BUILDING.txt in trunk, branch-2 and bra

[jira] [Commented] (HDFS-9047) Retire libwebhdfs

2016-01-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096557#comment-15096557 ] Kihwal Lee commented on HDFS-9047: -- Removed from branch-2.7. > Retire libwebhdfs > --

[jira] [Commented] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096553#comment-15096553 ] Hadoop QA commented on HDFS-9628: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096512#comment-15096512 ] Hadoop QA commented on HDFS-9628: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-13 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9628: - Attachment: HDFS-9628.HDFS-8707.010.patch New patch: catch up new code with rebase > libhdfs++: Implement

[jira] [Updated] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-13 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9628: - Attachment: HDFS-9628.HDFS-8707.008.patch New patch: fixed hdfs_builder_test main function > libhdfs++: Im

[jira] [Updated] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-13 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9628: - Attachment: HDFS-9628.HDFS-8707.009.patch New patch: rebased on latest HDFS-8707 > libhdfs++: Implement bu

[jira] [Commented] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096432#comment-15096432 ] Hadoop QA commented on HDFS-9624: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9636) libhdfs++: for consistency, include files should be in hdfspp

2016-01-13 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9636: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to HDFS-8707. Thank

[jira] [Updated] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-13 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9624: Attachment: HDFS-9624.005.patch Thanks [~andrew.wang] for comments. I found that do timer injection in this

[jira] [Commented] (HDFS-9635) Add one more volume choosing policy with considering volume IO load

2016-01-13 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096274#comment-15096274 ] Yong Zhang commented on HDFS-9635: -- As guys discussed in HDFS-8538, especially you mention

[jira] [Commented] (HDFS-9635) Add one more volume choosing policy with considering volume IO load

2016-01-13 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096240#comment-15096240 ] Yong Zhang commented on HDFS-9635: -- Hi [~andrew.wang], thanks for your comment. BlockPlace

[jira] [Commented] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

2016-01-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096192#comment-15096192 ] Daniel Templeton commented on HDFS-9415: ' * ' is valid? I thought only one space

[jira] [Commented] (HDFS-8430) Erasure coding: compute file checksum for stripe files

2016-01-13 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095978#comment-15095978 ] Kai Zheng commented on HDFS-8430: - Well, I may wait some other days for some comments. Anyh

[jira] [Reopened] (HDFS-7346) Erasure Coding: perform stripping erasure encoding work given block reader and writer

2016-01-13 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo reopened HDFS-7346: - > Erasure Coding: perform stripping erasure encoding work given block reader > and writer > --

[jira] [Updated] (HDFS-7346) Erasure Coding: perform stripping erasure encoding work given block reader and writer

2016-01-13 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7346: Release Note: (was: The jira is very old and close it because we'll not handle it in the near future.) > Erasure C