[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-10 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050286#comment-15050286 ] Fei Hui commented on HDFS-9530: --- [hdfs@worker-1 ~]$ hadoop version Hadoop 2.6.2 and i am sur

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050428#comment-15050428 ] Hadoop QA commented on HDFS-8578: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9472) concat() API does not give proper exception messages on ./reserved relative path

2015-12-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050446#comment-15050446 ] Uma Maheswara Rao G commented on HDFS-9472: --- Thanks Rakesh. I think you missed to

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2015-12-10 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050453#comment-15050453 ] Fei Hui commented on HDFS-9530: --- dfs.namenode.resource.du.reserved 1073741824

[jira] [Commented] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050540#comment-15050540 ] Hadoop QA commented on HDFS-9519: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9472) concat() API does not give proper exception messages on ./reserved relative path

2015-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050564#comment-15050564 ] Hadoop QA commented on HDFS-9472: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-12-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050607#comment-15050607 ] Brahma Reddy Battula commented on HDFS-9038: Ok.will wait till [~arpitagarwal]

[jira] [Commented] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-10 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050612#comment-15050612 ] Bob Hansen commented on HDFS-9523: -- [~James Clampffer] - was that with this patch applied?

[jira] [Created] (HDFS-9537) libhdfs++: implement HDFSConfiguration class

2015-12-10 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-9537: Summary: libhdfs++: implement HDFSConfiguration class Key: HDFS-9537 URL: https://issues.apache.org/jira/browse/HDFS-9537 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9514) TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed

2015-12-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051028#comment-15051028 ] Wei-Chiu Chuang commented on HDFS-9514: --- Thanks Yongjun for the review. Logging a Thr

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-12-10 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051032#comment-15051032 ] Kihwal Lee commented on HDFS-7916: -- If the namenode in service successfully received a rep

[jira] [Commented] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051140#comment-15051140 ] James Clampffer commented on HDFS-9523: --- Yep, just checked. > libhdfs++: failure to

[jira] [Created] (HDFS-9538) libhdfs++: load configuration from files

2015-12-10 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-9538: Summary: libhdfs++: load configuration from files Key: HDFS-9538 URL: https://issues.apache.org/jira/browse/HDFS-9538 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9538) libhdfs++: load configuration from files

2015-12-10 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051168#comment-15051168 ] Bob Hansen commented on HDFS-9538: -- Proposed design: * Add methods to LoadFromFile and Ov

[jira] [Created] (HDFS-9539) libhdfs++: enable default configuration files

2015-12-10 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-9539: Summary: libhdfs++: enable default configuration files Key: HDFS-9539 URL: https://issues.apache.org/jira/browse/HDFS-9539 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9539) libhdfs++: enable default configuration files

2015-12-10 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051173#comment-15051173 ] Bob Hansen commented on HDFS-9539: -- Proposed design: * Have a step in the CMake file use x

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-12-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051198#comment-15051198 ] Junping Du commented on HDFS-9263: -- Move it out to 2.6.4 given the JIRA is not updated for

[jira] [Updated] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-12-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9263: - Target Version/s: 3.0.0, 2.7.3, 2.6.4 (was: 3.0.0, 2.7.3, 2.6.3) > tests are using /test/build/data; break

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-12-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8791: - Target Version/s: 2.8.0, 2.7.3, 2.6.4 (was: 2.8.0, 2.7.3, 2.6.3) > block ID-based DN storage layout can be

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-12-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051195#comment-15051195 ] Junping Du commented on HDFS-8791: -- Working on 2.6.3-RC0 now, move it out to 2.6.4. > blo

[jira] [Updated] (HDFS-9537) libhdfs++: implement HDFSConfiguration class

2015-12-10 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9537: - Attachment: HDFS-9537.HDFS-8707.000.patch > libhdfs++: implement HDFSConfiguration class >

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-12-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051217#comment-15051217 ] Arpit Agarwal commented on HDFS-9038: - Sorry for the delay in responding, I am out this

[jira] [Updated] (HDFS-9537) libhdfs++: implement HDFSConfiguration class

2015-12-10 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9537: - Status: Patch Available (was: Open) > libhdfs++: implement HDFSConfiguration class > -

[jira] [Comment Edited] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-12-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051217#comment-15051217 ] Arpit Agarwal edited comment on HDFS-9038 at 12/10/15 4:55 PM: --

[jira] [Updated] (HDFS-9472) concat() API does not give proper exception messages on ./reserved relative path

2015-12-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9472: --- Attachment: HDFS-9472-04.patch > concat() API does not give proper exception messages on ./reserved relative >

[jira] [Updated] (HDFS-5328) MiniDFSCluster times out at startup

2015-12-10 Thread Rob Vesse (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Vesse updated HDFS-5328: Attachment: HDFS-5328.001.patch Add a patch which makes the startup timeout configurable both via the deprec

[jira] [Commented] (HDFS-9472) concat() API does not give proper exception messages on ./reserved relative path

2015-12-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051242#comment-15051242 ] Rakesh R commented on HDFS-9472: Thanks again [~umamaheswararao], I've corrected the same a

[jira] [Updated] (HDFS-5328) MiniDFSCluster times out at startup

2015-12-10 Thread Rob Vesse (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Vesse updated HDFS-5328: Status: Patch Available (was: Open) Patch makes the suggested change of providing a configurable setting for

[jira] [Updated] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

2015-12-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9038: Summary: DFS reserved space is erroneously counted towards non-DFS used. (was: Reserved space is err

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

2015-12-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051260#comment-15051260 ] Arpit Agarwal commented on HDFS-9038: - I also edited the Jira title to mention "DFS res

[jira] [Commented] (HDFS-9537) libhdfs++: implement HDFSConfiguration class

2015-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051301#comment-15051301 ] Hadoop QA commented on HDFS-9537: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9537) libhdfs++: implement HDFSConfiguration class

2015-12-10 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051326#comment-15051326 ] Bob Hansen commented on HDFS-9537: -- Question for reviewers: The design of the Configurati

[jira] [Commented] (HDFS-9519) Some coding improvement in SecondaryNameNode#main

2015-12-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051334#comment-15051334 ] Xiao Chen commented on HDFS-9519: - The failed tests license warnings are not related. > So

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2015-12-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051408#comment-15051408 ] Xiao Chen commented on HDFS-7553: - I met a similar reoccurrence of this failure in a run of

[jira] [Created] (HDFS-9540) Handle SafeModeException in ReportBadBlockAction#reportTo

2015-12-10 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9540: --- Summary: Handle SafeModeException in ReportBadBlockAction#reportTo Key: HDFS-9540 URL: https://issues.apache.org/jira/browse/HDFS-9540 Project: Hadoop HDFS Iss

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2015-12-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051427#comment-15051427 ] Xiao Chen commented on HDFS-7553: - Not sure if [~xieliang007] is still working on this, but

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-12-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051424#comment-15051424 ] Yongjun Zhang commented on HDFS-7916: - Thanks [~kihwal], I created HDFS-9540 accordingl

[jira] [Updated] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2015-12-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7553: Attachment: HDFS-7553.repro.patch > fix the TestDFSUpgradeWithHA due to BindException > -

[jira] [Updated] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

2015-12-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9038: --- Attachment: HDFS-9038-006.patch > DFS reserved space is erroneously counted towards non

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-10 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051472#comment-15051472 ] Chris Trezzo commented on HDFS-8578: I agree with [~szetszwo] let's fix the OOM part in

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

2015-12-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051473#comment-15051473 ] Brahma Reddy Battula commented on HDFS-9038: [~arpitagarwal] updated previous p

[jira] [Commented] (HDFS-9472) concat() API does not give proper exception messages on ./reserved relative path

2015-12-10 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051482#comment-15051482 ] Uma Maheswara Rao G commented on HDFS-9472: --- +1 on the latest patch. Pending Jenk

[jira] [Commented] (HDFS-9532) Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction

2015-12-10 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051497#comment-15051497 ] Andrew Wang commented on HDFS-9532: --- +1 thanks Yongjun! > Detailed exception info is los

[jira] [Updated] (HDFS-9528) Cleanup namenode audit/log/exception messages

2015-12-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9528: -- Attachment: h9528_20151210.patch Thanks Uma! Here is the new patch addressing your comme

[jira] [Commented] (HDFS-5328) MiniDFSCluster times out at startup

2015-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051507#comment-15051507 ] Hadoop QA commented on HDFS-5328: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9472) concat() API does not give proper exception messages on ./reserved relative path

2015-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051556#comment-15051556 ] Hadoop QA commented on HDFS-9472: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9325) Allow the location of hadoop source tree resources to be passed to CMake during a build.

2015-12-10 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9325: - Summary: Allow the location of hadoop source tree resources to be passed to CMake during a build. (was: Al

[jira] [Assigned] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-10 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov reassigned HDFS-9516: -- Assignee: Plamen Jeliazkov > truncate file fails with data dirs on multiple disks >

[jira] [Commented] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-10 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051608#comment-15051608 ] Plamen Jeliazkov commented on HDFS-9516: Attaching patch which highlights [~bograd]

[jira] [Updated] (HDFS-6054) MiniQJMHACluster should not use static port to avoid binding failure in unit test

2015-12-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6054: Attachment: (was: HDFS-6054.002.patch) > MiniQJMHACluster should not use static port to avoid bin

[jira] [Updated] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-10 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-9516: --- Attachment: HDFS-9516_testFailures.patch > truncate file fails with data dirs on multiple disks

[jira] [Updated] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-10 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-9516: --- Attachment: (was: HDFS-9516_testFailures.patch) > truncate file fails with data dirs on mul

[jira] [Updated] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-10 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-9516: --- Attachment: HDFS-9516_testFailures.patch > truncate file fails with data dirs on multiple disks

[jira] [Updated] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-10 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-9516: --- Attachment: HDFS-9516_1.patch Attaching first patch (_1) with proposed fix. I've left the asser

[jira] [Work started] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-10 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9516 started by Plamen Jeliazkov. -- > truncate file fails with data dirs on multiple disks > -

[jira] [Updated] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-10 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-9516: --- Attachment: HDFS-9516_2.patch Attaching second patch (_2) with same fix but the assert statemen

[jira] [Updated] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-10 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-9516: --- Status: Patch Available (was: In Progress) > truncate file fails with data dirs on multiple di

[jira] [Updated] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-12-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9173: Attachment: HDFS-9173.07.patch Fix unit test failures. > Erasure Coding: Lease recovery for striped file > -

[jira] [Commented] (HDFS-6054) MiniQJMHACluster should not use static port to avoid binding failure in unit test

2015-12-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051650#comment-15051650 ] Zhe Zhang commented on HDFS-6054: - Thanks Yongjun for the work. The patch LGTM overall. I h

[jira] [Updated] (HDFS-9371) Code cleanup for DatanodeManager

2015-12-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9371: Attachment: HDFS-9371.003.patch Rebase the patch. > Code cleanup for DatanodeManager > -

[jira] [Updated] (HDFS-9371) Code cleanup for DatanodeManager

2015-12-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9371: Attachment: (was: HDFS-9371.003.patch) > Code cleanup for DatanodeManager > -

[jira] [Updated] (HDFS-9371) Code cleanup for DatanodeManager

2015-12-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9371: Attachment: HDFS-9371.003.patch > Code cleanup for DatanodeManager > > >

[jira] [Comment Edited] (HDFS-9371) Code cleanup for DatanodeManager

2015-12-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051656#comment-15051656 ] Jing Zhao edited comment on HDFS-9371 at 12/10/15 9:12 PM: --- Rebas

[jira] [Updated] (HDFS-9537) libhdfs++: implement HDFSConfiguration class

2015-12-10 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9537: - Attachment: HDFS-9537.HDFS-8707.001.patch New patch: added a ConfigurationLoader class. Given that the fil

[jira] [Updated] (HDFS-9514) TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed

2015-12-10 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9514: -- Attachment: HDFS-9514.003.patch Rev03: Remove fail() in catch. It is redundant. Just let it throw

[jira] [Commented] (HDFS-8860) Remove unused Replica copyOnWrite code

2015-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051708#comment-15051708 ] Hudson commented on HDFS-8860: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8952 (See [https:

[jira] [Commented] (HDFS-9528) Cleanup namenode audit/log/exception messages

2015-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051709#comment-15051709 ] Hadoop QA commented on HDFS-9528: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9528) Cleanup namenode audit/log/exception messages

2015-12-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051723#comment-15051723 ] Xiaoyu Yao commented on HDFS-9528: -- +1 for h9528_20151210.patch > Cleanup namenode audit/

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

2015-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051734#comment-15051734 ] Hadoop QA commented on HDFS-9038: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9514) TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed

2015-12-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051755#comment-15051755 ] Yongjun Zhang commented on HDFS-9514: - Thanks Wei-Chiu, +1 on rev3 pending jenkins. >

[jira] [Updated] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

2015-12-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9541: --- Affects Version/s: (was: 1.0.0) 0.20.1 Issue Type:

[jira] [Created] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

2015-12-10 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-9541: -- Summary: Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB Key: HDFS-9541 URL: https://issues.apache.org/jira/browse/HDFS-9541

[jira] [Updated] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

2015-12-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9541: --- Attachment: HDFS-9541.001.patch > Add hdfsStreamBuilder API to libhdfs to support defau

[jira] [Updated] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

2015-12-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9541: --- Status: Patch Available (was: Open) > Add hdfsStreamBuilder API to libhdfs to support

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051796#comment-15051796 ] Tsz Wo Nicholas Sze commented on HDFS-8578: --- Thanks [~vinayrpet] for the new patc

[jira] [Commented] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

2015-12-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051798#comment-15051798 ] Colin Patrick McCabe commented on HDFS-9541: This patch is compatible since it

[jira] [Commented] (HDFS-9528) Cleanup namenode audit/log/exception messages

2015-12-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051799#comment-15051799 ] Tsz Wo Nicholas Sze commented on HDFS-9528: --- Thanks [~xyao]. It seems that some

[jira] [Reopened] (HDFS-8860) Remove unused Replica copyOnWrite code

2015-12-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu reopened HDFS-8860: - > Remove unused Replica copyOnWrite code > -- > > K

[jira] [Resolved] (HDFS-8860) Remove unused Replica copyOnWrite code

2015-12-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu resolved HDFS-8860. - Resolution: Invalid Revert the change. {{FinalizedReplica}} can return a valid {{unlinked}} value.

[jira] [Created] (HDFS-9542) Move BlockIdManager from FSNamesystem to BlockManager

2015-12-10 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-9542: --- Summary: Move BlockIdManager from FSNamesystem to BlockManager Key: HDFS-9542 URL: https://issues.apache.org/jira/browse/HDFS-9542 Project: Hadoop HDFS Issue Type: Sub

[jira] [Updated] (HDFS-9542) Move BlockIdManager from FSNamesystem to BlockManager

2015-12-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9542: Attachment: HDFS-9542.000.patch The patch mainly moves blockIdManager into BlockManager and also does some s

[jira] [Updated] (HDFS-9542) Move BlockIdManager from FSNamesystem to BlockManager

2015-12-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9542: Component/s: namenode > Move BlockIdManager from FSNamesystem to BlockManager > -

[jira] [Updated] (HDFS-9542) Move BlockIdManager from FSNamesystem to BlockManager

2015-12-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9542: Status: Patch Available (was: Open) > Move BlockIdManager from FSNamesystem to BlockManager > --

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2015-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051873#comment-15051873 ] Hadoop QA commented on HDFS-7553: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2015-12-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051879#comment-15051879 ] Xiao Chen commented on HDFS-7553: - Jenkins failed desperately on the patch reproducing the

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

2015-12-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051894#comment-15051894 ] Chris Nauroth commented on HDFS-9038: - I took patch v006 for a more thorough test run.

[jira] [Created] (HDFS-9543) DiskBalancer : Add Data mover

2015-12-10 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9543: -- Summary: DiskBalancer : Add Data mover Key: HDFS-9543 URL: https://issues.apache.org/jira/browse/HDFS-9543 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-9544) DiskBalancer : Command utitlities

2015-12-10 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9544: -- Summary: DiskBalancer : Command utitlities Key: HDFS-9544 URL: https://issues.apache.org/jira/browse/HDFS-9544 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-9545) DiskBalancer : Add Plan Command

2015-12-10 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9545: -- Summary: DiskBalancer : Add Plan Command Key: HDFS-9545 URL: https://issues.apache.org/jira/browse/HDFS-9545 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-9546) DiskBalancer : Add Execute command

2015-12-10 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9546: -- Summary: DiskBalancer : Add Execute command Key: HDFS-9546 URL: https://issues.apache.org/jira/browse/HDFS-9546 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-9547) DiskBalancer : Add user documentation

2015-12-10 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9547: -- Summary: DiskBalancer : Add user documentation Key: HDFS-9547 URL: https://issues.apache.org/jira/browse/HDFS-9547 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9469) DiskBalancer : Add Planner

2015-12-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051919#comment-15051919 ] Anu Engineer commented on HDFS-9469: Test failures are not related. > DiskBalancer :

[jira] [Commented] (HDFS-9535) Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate

2015-12-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051963#comment-15051963 ] Masatake Iwasaki commented on HDFS-9535: Thanks for reporting this. {code} fi

[jira] [Commented] (HDFS-9535) Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate

2015-12-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051981#comment-15051981 ] Masatake Iwasaki commented on HDFS-9535: bq. For the first block, it is possible th

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

2015-12-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051986#comment-15051986 ] Colin Patrick McCabe commented on HDFS-8562: Thanks for reporting this. I thin

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

2015-12-10 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051994#comment-15051994 ] Kai Zheng commented on HDFS-8562: - Thanks [~cmccabe] for the interests. We have a rough pro

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8578: -- Attachment: h8578_20151210.patch h8578_20151210.patch: execute hardlink tasks in parallel

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

2015-12-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052039#comment-15052039 ] Vinayakumar B commented on HDFS-9038: - Thanks [~cnauroth] for the explanation. Lets go

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

2015-12-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052049#comment-15052049 ] Vinayakumar B commented on HDFS-9038: - Meanwhile, [~brahmareddy], forgot to update the

[jira] [Updated] (HDFS-9538) libhdfs++: load configuration from files

2015-12-10 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9538: - Attachment: HDFS-9538.HDFS-9537.000.patch Patch implements LoadFromFile and friends, along with default sea

  1   2   >