[jira] [Updated] (HDFS-9780) RollingFileSystemSink doesn't work on secure clusters

2016-03-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated HDFS-9780: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Res

[jira] [Updated] (HDFS-9709) DiskBalancer : Add tests for disk balancer using a Mock Mover class.

2016-03-15 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9709: --- Attachment: HDFS-9709-HDFS-1312.002.patch [~eddyxu] Thanks for your comments. I have rewritten this pat

[jira] [Updated] (HDFS-9709) DiskBalancer : Add tests for disk balancer using a Mock Mover class.

2016-03-15 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9709: --- Status: Patch Available (was: Open) > DiskBalancer : Add tests for disk balancer using a Mock Mover cl

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-03-15 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196867#comment-15196867 ] Jingcheng Du commented on HDFS-9668: Thanks for pointing this out, [~szetszwo]. bq. One

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-03-15 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196860#comment-15196860 ] Jingcheng Du commented on HDFS-9668: Thanks [~cmccabe]. bq. I wonder if, as a first st

[jira] [Updated] (HDFS-9951) Use string constants for XML tags in OfflineImageReconstructor

2016-03-15 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9951: Attachment: HDFS-9551.003.patch Update the latest patch for addressing the comments and fixing the checkstyle

[jira] [Resolved] (HDFS-10171) Balancer should log config values

2016-03-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-10171. --- Resolution: Duplicate Fix Version/s: 2.8.0 {noformat} 2016-03-15 22:42:31,618 [Thread-0] INFO

[jira] [Updated] (HDFS-9262) Support reconfiguring dfs.datanode.lazywriter.interval.sec without DN restart

2016-03-15 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Attachment: HDFS-9262-HDFS-9000.005.patch V005 is rebased on trunk. > Support reconfiguring dfs.data

[jira] [Commented] (HDFS-9857) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]

2016-03-15 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196786#comment-15196786 ] Zhe Zhang commented on HDFS-9857: - Thanks Rakesh. +1 pending Jenkins. Nice work here! > Er

[jira] [Updated] (HDFS-10171) Balancer should log config values

2016-03-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10171: -- Description: To improve supportability, Balancer should log config values. (was: To improve supportabil

[jira] [Created] (HDFS-10171) Balancer should log config values and iteration termination reasons

2016-03-15 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10171: - Summary: Balancer should log config values and iteration termination reasons Key: HDFS-10171 URL: https://issues.apache.org/jira/browse/HDFS-10171 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-15 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196761#comment-15196761 ] Lin Yiqun commented on HDFS-9904: - Thanks [~kihwal] for commit! > testCheckpointCancellati

[jira] [Commented] (HDFS-9857) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]

2016-03-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196759#comment-15196759 ] Rakesh R commented on HDFS-9857: Thanks [~zhz] for the reviews. I've attached patch address

[jira] [Updated] (HDFS-9857) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]

2016-03-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9857: --- Attachment: HDFS-9857-02.patch > Erasure Coding: Rename replication-based names in BlockManager to more > gene

[jira] [Commented] (HDFS-9960) OzoneHandler : Add localstorage support for keys

2016-03-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196745#comment-15196745 ] Chris Nauroth commented on HDFS-9960: - Hi [~anu]. It looks like these Checkstyle and F

[jira] [Updated] (HDFS-9961) Ozone: Add buckets commands to CLI

2016-03-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9961: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) +1

[jira] [Updated] (HDFS-9952) Expose FSNamesystem lock wait time as metrics

2016-03-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9952: Attachment: HDFS-9952-01.patch Attaching the patch. > Expose FSNamesystem lock wait time as metrics

[jira] [Updated] (HDFS-9952) Expose FSNamesystem lock wait time as metrics

2016-03-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9952: Status: Patch Available (was: Open) > Expose FSNamesystem lock wait time as metrics > --

[jira] [Commented] (HDFS-9959) add log when block removed from last live datanode

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196729#comment-15196729 ] Hadoop QA commented on HDFS-9959: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-15 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9847: Attachment: HDFS-9847.004.patch That's a good idea. Update the latest patch for addressing comments. > HDFS

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

2016-03-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196712#comment-15196712 ] John Zhuge commented on HDFS-9940: -- I like 2) better because all rebalance configuration i

[jira] [Commented] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-03-15 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196709#comment-15196709 ] Brahma Reddy Battula commented on HDFS-9917: I meant to say,we can avoid RPC to

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

2016-03-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196705#comment-15196705 ] John Zhuge commented on HDFS-9940: -- [~yzhangal], great idea if we don't have to manually c

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196701#comment-15196701 ] Hadoop QA commented on HDFS-9349: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

2016-03-15 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8901: Attachment: HDFS-8901-v5.patch Rebased. > Use ByteBuffer in striping positional read > -

[jira] [Commented] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-03-15 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196635#comment-15196635 ] Brahma Reddy Battula commented on HDFS-9917: bq. I suggest that NN could just i

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-03-15 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8905: Attachment: HDFS-8905-v9.patch Rebased one more time. > Refactor DFSInputStream#ReaderStrategy > ---

[jira] [Commented] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2016-03-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196630#comment-15196630 ] Vinayakumar B commented on HDFS-9260: - How about bringing this into branch-2? > Improv

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

2016-03-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196566#comment-15196566 ] Yongjun Zhang commented on HDFS-9940: - Hi Guys, I wonder if this can be a balancer con

[jira] [Updated] (HDFS-9954) Test RPC timeout fix of HADOOP-12672 against HDFS

2016-03-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9954: --- Resolution: Invalid Status: Resolved (was: Patch Available) It turned out that creatin

[jira] [Commented] (HDFS-9857) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]

2016-03-15 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196506#comment-15196506 ] Zhe Zhang commented on HDFS-9857: - Seems the patch needs a small rebase. I also found a nit

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196503#comment-15196503 ] Arpit Agarwal commented on HDFS-9349: - Thank you for updating the patch [~xiaobingo]. T

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

2016-03-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196482#comment-15196482 ] John Zhuge commented on HDFS-9940: -- Balancer uses config {{dfs.datanode.balance.max.concur

[jira] [Assigned] (HDFS-8210) Ozone: Implement storage container manager

2016-03-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reassigned HDFS-8210: --- Assignee: Chris Nauroth (was: Jitendra Nath Pandey) > Ozone: Implement storage container mana

[jira] [Commented] (HDFS-9956) LDAP PERFORMANCE ISSUE AND FAIL OVER

2016-03-15 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196443#comment-15196443 ] Allen Wittenauer commented on HDFS-9956: is a naming services caching daemon being

[jira] [Updated] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-15 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Attachment: HDFS-9349-HDFS-9000.005.patch > Support reconfiguring fs.protected.directories without NN

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-15 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196437#comment-15196437 ] Xiaobing Zhou commented on HDFS-9349: - V005 is rebased on trunk. > Support reconfiguri

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

2016-03-15 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196389#comment-15196389 ] Tsz Wo Nicholas Sze commented on HDFS-9940: --- dfs.balancer.max.concurrent.moves is

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196374#comment-15196374 ] Arpit Agarwal commented on HDFS-9668: - bq. It means one slow operation of finalizeBlock

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

2016-03-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196363#comment-15196363 ] John Zhuge commented on HDFS-9940: -- +1 HDFS-7466 > Rename dfs.balancer.max.concurrent.mov

[jira] [Assigned] (HDFS-7285) Erasure Coding Support inside HDFS

2016-03-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers reassigned HDFS-7285: Assignee: Zhe Zhang (was: Matt Hardy) > Erasure Coding Support inside HDFS > --

[jira] [Assigned] (HDFS-7285) Erasure Coding Support inside HDFS

2016-03-15 Thread Matt Hardy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Hardy reassigned HDFS-7285: Assignee: Matt Hardy (was: Zhe Zhang) > Erasure Coding Support inside HDFS > --

[jira] [Updated] (HDFS-9959) add log when block removed from last live datanode

2016-03-15 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yunjiong zhao updated HDFS-9959: Attachment: HDFS-9959.1.patch Update patch: 1. log after release the write lock 2. change error to in

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-03-15 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196237#comment-15196237 ] Tsz Wo Nicholas Sze commented on HDFS-9668: --- > Currently, read operations have no

[jira] [Commented] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-03-15 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196158#comment-15196158 ] Tsz Wo Nicholas Sze commented on HDFS-9917: --- > Before Full BR, all pending IBRs w

[jira] [Commented] (HDFS-10170) DiskBalancer: Force rebase diskbalancer branch

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195995#comment-15195995 ] Arpit Agarwal commented on HDFS-10170: -- +1 for force rebase to make DiskBalancer test

[jira] [Updated] (HDFS-8457) Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8457: Fix Version/s: (was: HDFS-7240) > Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functiona

[jira] [Updated] (HDFS-8661) DataNode should filter the set of NameSpaceInfos passed to Datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8661: Fix Version/s: (was: HDFS-7240) > DataNode should filter the set of NameSpaceInfos passed to Data

[jira] [Updated] (HDFS-8679) Move DatasetSpi to new package

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8679: Fix Version/s: (was: HDFS-7240) > Move DatasetSpi to new package > --

[jira] [Updated] (HDFS-8392) DataNode support for multiple datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8392: Fix Version/s: (was: HDFS-7240) > DataNode support for multiple datasets > --

[jira] [Resolved] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8677. - Resolution: Fixed We'll revisit FsDataset changes later. > Ozone: Introduce KeyValueContainerDatas

[jira] [Resolved] (HDFS-8679) Move DatasetSpi to new package

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8679. - Resolution: Later We'll revisit FsDataset changes later. > Move DatasetSpi to new package > --

[jira] [Resolved] (HDFS-8661) DataNode should filter the set of NameSpaceInfos passed to Datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8661. - Resolution: Later We'll revisit FsDataset changes later. > DataNode should filter the set of NameS

[jira] [Reopened] (HDFS-8679) Move DatasetSpi to new package

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8679: - > Move DatasetSpi to new package > -- > > Key: HDFS-8679 >

[jira] [Reopened] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8677: - > Ozone: Introduce KeyValueContainerDatasetSpi > > >

[jira] [Resolved] (HDFS-8457) Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8457. - Resolution: Later We'll revisit FsDataset changes later. > Ozone: Refactor FsDatasetSpi to pull up

[jira] [Reopened] (HDFS-8661) DataNode should filter the set of NameSpaceInfos passed to Datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8661: - > DataNode should filter the set of NameSpaceInfos passed to Datasets > ---

[jira] [Resolved] (HDFS-8392) DataNode support for multiple datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8392. - Resolution: Later We'll revisit FsDataset changes later. > DataNode support for multiple datasets

[jira] [Reopened] (HDFS-8457) Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8457: - > Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into > parent interface > --

[jira] [Reopened] (HDFS-8392) DataNode support for multiple datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8392: - > DataNode support for multiple datasets > -- > > K

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195976#comment-15195976 ] Andrew Wang commented on HDFS-3702: --- Since we're just adding a flag to the existing {{cre

[jira] [Updated] (HDFS-8210) Ozone: Implement storage container manager

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8210: Fix Version/s: (was: HDFS-7240) > Ozone: Implement storage container manager > -

[jira] [Reopened] (HDFS-8210) Ozone: Implement storage container manager

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8210: - We've rebased the branch and this change was left out. Reopening the Jira. > Ozone: Implement storage

[jira] [Resolved] (HDFS-10170) DiskBalancer: Force rebase diskbalancer branch

2016-03-15 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-10170. - Resolution: Fixed > DiskBalancer: Force rebase diskbalancer branch > -

[jira] [Created] (HDFS-10170) DiskBalancer: Force rebase diskbalancer branch

2016-03-15 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-10170: --- Summary: DiskBalancer: Force rebase diskbalancer branch Key: HDFS-10170 URL: https://issues.apache.org/jira/browse/HDFS-10170 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195908#comment-15195908 ] Colin Patrick McCabe commented on HDFS-7648: Hi [~rakesh_r], can you rebase the

[jira] [Updated] (HDFS-7648) Verify that HDFS blocks are in the correct datanode directories

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7648: --- Summary: Verify that HDFS blocks are in the correct datanode directories (was: Verify

[jira] [Resolved] (HDFS-9955) DataNode won't self-heal after some block dirs were manually misplaced

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-9955. Resolution: Duplicate > DataNode won't self-heal after some block dirs were manually

[jira] [Commented] (HDFS-9951) Use string constants for XML tags in OfflineImageReconstructor

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195795#comment-15195795 ] Colin Patrick McCabe commented on HDFS-9951: Thanks for working on this. Can y

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195791#comment-15195791 ] Arpit Agarwal commented on HDFS-3702: - Thanks [~stack], [~eddyxu]. It would be great i

[jira] [Comment Edited] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195782#comment-15195782 ] Colin Patrick McCabe edited comment on HDFS-9668 at 3/15/16 5:48 PM:

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195782#comment-15195782 ] Colin Patrick McCabe commented on HDFS-9668: Hi [~jingcheng...@intel.com], Tha

[jira] [Comment Edited] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195782#comment-15195782 ] Colin Patrick McCabe edited comment on HDFS-9668 at 3/15/16 5:47 PM:

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-03-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195706#comment-15195706 ] Ming Ma commented on HDFS-9579: --- Thanks [~liuml07]! Any comments from others? > Provide byt

[jira] [Commented] (HDFS-9895) Remove DataNode#conf because there is already a copy in the base class

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195689#comment-15195689 ] Colin Patrick McCabe commented on HDFS-9895: I think this JIRA was misleadingly

[jira] [Updated] (HDFS-9895) Remove DataNode#conf because there is already a reference to it in the base class

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9895: --- Summary: Remove DataNode#conf because there is already a reference to it in the base cl

[jira] [Updated] (HDFS-9931) Remove NameNode#conf because there is already a reference to it in the base class

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9931: --- Summary: Remove NameNode#conf because there is already a reference to it in the base cl

[jira] [Comment Edited] (HDFS-9895) Remove DataNode#conf because there is already a reference to it in the base class

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195689#comment-15195689 ] Colin Patrick McCabe edited comment on HDFS-9895 at 3/15/16 5:13 PM:

[jira] [Updated] (HDFS-9895) Remove DataNode#conf because there is already a copy in the base class

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9895: --- Description: Since DataNode inherits ReconfigurableBase with Configured as base class w

[jira] [Updated] (HDFS-9895) Remove DataNode#conf because there is already a copy in the base class

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9895: --- Summary: Remove DataNode#conf because there is already a copy in the base class (was:

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195658#comment-15195658 ] Arpit Agarwal commented on HDFS-9847: - Thank you [~linyiqun]. I don't think we need get

[jira] [Commented] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195578#comment-15195578 ] Hudson commented on HDFS-9904: -- FAILURE: Integrated in Hadoop-trunk-Commit #9464 (See [https:

[jira] [Resolved] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-9904. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 > testCheckpointCancellationDur

[jira] [Commented] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195554#comment-15195554 ] Kihwal Lee commented on HDFS-9904: -- I've committed this to trunk through branch-2.7. Thank

[jira] [Updated] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9904: - Assignee: Lin Yiqun > testCheckpointCancellationDuringUpload occasionally fails >

[jira] [Commented] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195531#comment-15195531 ] Kihwal Lee commented on HDFS-9904: -- +1 I've verified that the config is only set for the s

[jira] [Commented] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195522#comment-15195522 ] Hadoop QA commented on HDFS-9694: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195406#comment-15195406 ] Hadoop QA commented on HDFS-9847: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9945) Datanode command for evicting writers

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195386#comment-15195386 ] Kihwal Lee commented on HDFS-9945: -- HDFS-2043 TestHFlush HDFS-9780 TestRollingFileSystemSi

[jira] [Commented] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195362#comment-15195362 ] Kihwal Lee commented on HDFS-6532: -- Still happening. {noformat} testCorruptionDuringWrt(o

[jira] [Created] (HDFS-10169) TestEditLog.testBatchedSyncWithClosedLogs sometimes fails.

2016-03-15 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-10169: - Summary: TestEditLog.testBatchedSyncWithClosedLogs sometimes fails. Key: HDFS-10169 URL: https://issues.apache.org/jira/browse/HDFS-10169 Project: Hadoop HDFS Issu

[jira] [Commented] (HDFS-2043) TestHFlush failing intermittently

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195338#comment-15195338 ] Kihwal Lee commented on HDFS-2043: -- This seems to be an actual race in the code. > TestHF

[jira] [Commented] (HDFS-2043) TestHFlush failing intermittently

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195335#comment-15195335 ] Kihwal Lee commented on HDFS-2043: -- This is how it fails nowadays in precommit. {noformat}

[jira] [Commented] (HDFS-9928) Make HDFS commands guide up to date

2016-03-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195315#comment-15195315 ] Wei-Chiu Chuang commented on HDFS-9928: --- Thanks [~iwasakims]! > Make HDFS commands g

[jira] [Commented] (HDFS-9961) Ozone: Add buckets commands to CLI

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195302#comment-15195302 ] Hadoop QA commented on HDFS-9961: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9928) Make HDFS commands guide up to date

2016-03-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195205#comment-15195205 ] Hudson commented on HDFS-9928: -- FAILURE: Integrated in Hadoop-trunk-Commit #9463 (See [https:

[jira] [Updated] (HDFS-9928) Make HDFS commands guide up to date

2016-03-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9928: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Target Ve

[jira] [Commented] (HDFS-9928) Make HDFS commands guide up to date

2016-03-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195148#comment-15195148 ] Masatake Iwasaki commented on HDFS-9928: +1 > Make HDFS commands guide up to date

[jira] [Commented] (HDFS-9960) OzoneHandler : Add localstorage support for keys

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195096#comment-15195096 ] Hadoop QA commented on HDFS-9960: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9951) Use string constants for XML tags in OfflineImageReconstructor

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195069#comment-15195069 ] Hadoop QA commented on HDFS-9951: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

  1   2   3   4   5   6   >