[jira] [Updated] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-04-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11530: - Attachment: HDFS-11530.010.patch > Use HDFS specific network topology to choose datanode in > BlockPlacem

[jira] [Commented] (HDFS-10506) OIV's ReverseXML processor cannot reconstruct some snapshot details

2017-04-12 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967162#comment-15967162 ] Akira Ajisaka commented on HDFS-10506: -- Hi [~andrew.wang] and [~jojochuang], I'd like

[jira] [Commented] (HDFS-11631) Block Storage : allow cblock server to be started from hdfs command

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967160#comment-15967160 ] Anu Engineer commented on HDFS-11631: - * Replace commands with something like cli ? h

[jira] [Commented] (HDFS-11582) Block Storage : add SCSI target access daemon

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967155#comment-15967155 ] Anu Engineer commented on HDFS-11582: - [~vagarychen] Thank you for updating the patch.

[jira] [Commented] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

2017-04-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967134#comment-15967134 ] Hadoop QA commented on HDFS-11604: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11569) Ozone: Implement listKey function for KeyManager

2017-04-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967102#comment-15967102 ] Weiwei Yang commented on HDFS-11569: Thanks [~anu]! > Ozone: Implement listKey functi

[jira] [Commented] (HDFS-11649) Ozone: SCM: CLI: Add shell code placeholder classes

2017-04-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967093#comment-15967093 ] Weiwei Yang commented on HDFS-11649: Hi [~vagarychen] Thanks for starting working on

[jira] [Commented] (HDFS-11652) Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals

2017-04-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967045#comment-15967045 ] Hadoop QA commented on HDFS-11652: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-11615) FSNamesystemLock metrics can be inaccurate due to millisecond precision

2017-04-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967018#comment-15967018 ] Hadoop QA commented on HDFS-11615: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

2017-04-12 Thread Lin Zeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Zeng updated HDFS-11604: Attachment: HDFS-11604-v1.patch > Define and parse erasure code codecs, schemas and policies > -

[jira] [Updated] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

2017-04-12 Thread Lin Zeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Zeng updated HDFS-11604: Attachment: (was: HDFS-11664-v1.patch) > Define and parse erasure code codecs, schemas and policies > --

[jira] [Commented] (HDFS-10996) Ability to specify per-file EC policy at create time

2017-04-12 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967005#comment-15967005 ] SammiChen commented on HDFS-10996: -- Thanks [~andrew.wang] for the review! > Ability to s

[jira] [Updated] (HDFS-11652) Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11652: --- Attachment: HDFS-11652.002.patch Few mistakes crept in, 002 patch. > Improve ECSchema and ErasureCodi

[jira] [Updated] (HDFS-11652) Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11652: --- Attachment: HDFS-11652.001.patch > Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals

[jira] [Commented] (HDFS-11652) Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966986#comment-15966986 ] Andrew Wang commented on HDFS-11652: [~jojochuang] you noticed the ID issue over on an

[jira] [Updated] (HDFS-11652) Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11652: --- Attachment: (was: HDFS-11652.001.patch) > Improve ECSchema and ErasureCodingPolicy toString, hashC

[jira] [Updated] (HDFS-11652) Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11652: --- Status: Patch Available (was: Open) > Improve ECSchema and ErasureCodingPolicy toString, hashCode, eq

[jira] [Updated] (HDFS-11652) Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11652: --- Attachment: HDFS-11652.001.patch Patch attached. * Switched over to using EqualsBuilder and HashBuild

[jira] [Updated] (HDFS-11603) Improve slow mirror/disk warnings in BlockReceiver

2017-04-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11603: - Attachment: HDFS-11603-branch-2.01.patch Attaching a branch-2 patch. This needed a slight change t

[jira] [Created] (HDFS-11652) Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals

2017-04-12 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11652: -- Summary: Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals Key: HDFS-11652 URL: https://issues.apache.org/jira/browse/HDFS-11652 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11634) Optimize BlockIterator when interating starts in the middle.

2017-04-12 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966967#comment-15966967 ] Vinitha Reddy Gankidi commented on HDFS-11634: -- It's a good improvement. One

[jira] [Commented] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-04-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966960#comment-15966960 ] Hadoop QA commented on HDFS-10999: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11582) Block Storage : add SCSI target access daemon

2017-04-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966930#comment-15966930 ] Hadoop QA commented on HDFS-11582: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11644) DFSStripedOutputStream should not implement Syncable

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966925#comment-15966925 ] Andrew Wang commented on HDFS-11644: Good idea on isSyncable. I'm still peeved that ch

[jira] [Commented] (HDFS-11634) Optimize BlockIterator when interating starts in the middle.

2017-04-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966916#comment-15966916 ] Zhe Zhang commented on HDFS-11634: -- Thanks [~shv] for the patch and [~shahrs87] for the r

[jira] [Updated] (HDFS-11630) TestThrottledAsyncCheckerTimeout fails intermittently in Jenkins builds

2017-04-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11630: - Fix Version/s: 2.9.0 Thanks [~hanishakoneru]. I've committed the branch-2 patch. > TestThrottledA

[jira] [Updated] (HDFS-11615) FSNamesystemLock metrics can be inaccurate due to millisecond precision

2017-04-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-11615: --- Attachment: HDFS-11615.001.patch Ah, thanks [~zhz], didn't realize there was precedent for this alread

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966901#comment-15966901 ] Hadoop QA commented on HDFS-11384: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11560) Expose slow disks via NameNode JMX

2017-04-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11560: - Fix Version/s: 2.9.0 Component/s: namenode +1 for the branch-2 patch, I've committed this. T

[jira] [Commented] (HDFS-11634) Optimize BlockIterator when interating starts in the middle.

2017-04-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966878#comment-15966878 ] Hadoop QA commented on HDFS-11634: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-11644) DFSStripedOutputStream should not implement Syncable

2017-04-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966871#comment-15966871 ] Manoj Govindassamy commented on HDFS-11644: --- [~andrew.wang], [~ste...@apache.org

[jira] [Comment Edited] (HDFS-11569) Ozone: Implement listKey function for KeyManager

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966764#comment-15966764 ] Anu Engineer edited comment on HDFS-11569 at 4/12/17 11:28 PM: -

[jira] [Commented] (HDFS-11615) FSNamesystemLock metrics can be inaccurate due to millisecond precision

2017-04-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966800#comment-15966800 ] Zhe Zhang commented on HDFS-11615: -- bq. "XxxNanosAvgTime" is reasonable but I'm hesitant

[jira] [Updated] (HDFS-11470) Ozone: SCM: CLI: Design SCM Command line interface

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11470: Attachment: storage-container-manager-cli-003.pdf [~xyao] Thanks for the coments. The v3 version of

[jira] [Commented] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966788#comment-15966788 ] Manoj Govindassamy commented on HDFS-11402: --- Above unit test failure is not rela

[jira] [Updated] (HDFS-11630) TestThrottledAsyncCheckerTimeout fails intermittently in Jenkins builds

2017-04-12 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11630: -- Attachment: HDFS-11630-branch-2.001.patch > TestThrottledAsyncCheckerTimeout fails intermittentl

[jira] [Updated] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-04-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10999: -- Attachment: HDFS-10999.02.patch Thanks for the review [~tasanuma0829]. Separated the MBe

[jira] [Commented] (HDFS-11630) TestThrottledAsyncCheckerTimeout fails intermittently in Jenkins builds

2017-04-12 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966775#comment-15966775 ] Hanisha Koneru commented on HDFS-11630: --- Thank you [~arpitagarwal] for committing th

[jira] [Updated] (HDFS-11560) Expose slow disks via NameNode JMX

2017-04-12 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11560: -- Attachment: HDFS-11560-branch-2.001.patch > Expose slow disks via NameNode JMX > ---

[jira] [Updated] (HDFS-11569) Ozone: Implement listKey function for KeyManager

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11569: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Reso

[jira] [Commented] (HDFS-11649) Ozone: SCM: CLI: Add shell code placeholder classes

2017-04-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966763#comment-15966763 ] Hadoop QA commented on HDFS-11649: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11615) FSNamesystemLock metrics can be inaccurate due to millisecond precision

2017-04-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966751#comment-15966751 ] Erik Krogen commented on HDFS-11615: I would have suggested just adding an optional ti

[jira] [Assigned] (HDFS-11470) Ozone: SCM: CLI: Design SCM Command line interface

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-11470: --- Assignee: Anu Engineer (was: Xiaoyu Yao) > Ozone: SCM: CLI: Design SCM Command line interfac

[jira] [Comment Edited] (HDFS-11582) Block Storage : add SCSI target access daemon

2017-04-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966739#comment-15966739 ] Chen Liang edited comment on HDFS-11582 at 4/12/17 10:18 PM: -

[jira] [Updated] (HDFS-11582) Block Storage : add SCSI target access daemon

2017-04-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11582: -- Attachment: HDFS-11582-HDFS-7240.006.patch Seems the v005 patch has some conflicts with the branch. The

[jira] [Commented] (HDFS-11644) DFSStripedOutputStream should not implement Syncable

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966723#comment-15966723 ] Andrew Wang commented on HDFS-11644: Looking at this, it's not pretty. FileSystem retu

[jira] [Commented] (HDFS-11558) BPServiceActor thread name is too long

2017-04-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966725#comment-15966725 ] Junping Du commented on HDFS-11558: --- No worry. Mingliang. I will keep tracking. :) > BP

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2017-04-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966719#comment-15966719 ] Junping Du commented on HDFS-11163: --- You are welcome, [~cnauroth]! :) > Mover should mo

[jira] [Comment Edited] (HDFS-11470) Ozone: SCM: CLI: Design SCM Command line interface

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966713#comment-15966713 ] Anu Engineer edited comment on HDFS-11470 at 4/12/17 10:03 PM: -

[jira] [Commented] (HDFS-11470) Ozone: SCM: CLI: Design SCM Command line interface

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966713#comment-15966713 ] Anu Engineer commented on HDFS-11470: - Just moving this JIRA to patch available state

[jira] [Updated] (HDFS-11470) Ozone: SCM: CLI: Design SCM Command line interface

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11470: Status: Patch Available (was: Open) > Ozone: SCM: CLI: Design SCM Command line interface >

[jira] [Updated] (HDFS-11470) Ozone: SCM: CLI: Design SCM Command line interface

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11470: Summary: Ozone: SCM: CLI: Design SCM Command line interface (was: Ozone: SCM: Add SCM CLI) > Ozone

[jira] [Updated] (HDFS-11649) Ozone: SCM: CLI: Add shell code placeholder classes

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11649: Summary: Ozone: SCM: CLI: Add shell code placeholder classes (was: Ozone : add SCM CLI shell code

[jira] [Commented] (HDFS-11569) Ozone: Implement listKey function for KeyManager

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966707#comment-15966707 ] Anu Engineer commented on HDFS-11569: - +1, Thanks for updating this patch and getting

[jira] [Commented] (HDFS-11558) BPServiceActor thread name is too long

2017-04-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966698#comment-15966698 ] Mingliang Liu commented on HDFS-11558: -- Sorry I missed the call for cutting of {{bran

[jira] [Updated] (HDFS-11634) Optimize BlockIterator when interating starts in the middle.

2017-04-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11634: --- Attachment: HDFS-11634.004.patch Addressing checkstyle warnings. Thanks for the review

[jira] [Updated] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11384: --- Attachment: HDFS-11384.005.patch Addressing the checkstyle warning. Not seeing failure

[jira] [Commented] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966691#comment-15966691 ] Andrew Wang commented on HDFS-11643: Agree, at least for the balancer, I think for now

[jira] [Commented] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966680#comment-15966680 ] Andrew Wang commented on HDFS-9260: --- One other question from our team, what's the typical

[jira] [Commented] (HDFS-11582) Block Storage : add SCSI target access daemon

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966674#comment-15966674 ] Anu Engineer commented on HDFS-11582: - [~vagarychen] Can you please verify that you ar

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2017-04-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966659#comment-15966659 ] Chris Nauroth commented on HDFS-11163: -- [~djp], sorry I missed the email update on th

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-04-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1590#comment-1590 ] Hadoop QA commented on HDFS-11530: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11558) BPServiceActor thread name is too long

2017-04-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966628#comment-15966628 ] Junping Du commented on HDFS-11558: --- Hi [~liuml07], thanks for review and commit. As my

[jira] [Commented] (HDFS-11648) Lazy construct the IIP pathname

2017-04-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966624#comment-15966624 ] Junping Du commented on HDFS-11648: --- Hi [~kihwal], thanks for review and commit. As my e

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2017-04-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966620#comment-15966620 ] Junping Du commented on HDFS-11163: --- Hi [~cnauroth], thanks for review and commit. As my

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-04-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966610#comment-15966610 ] Arpit Agarwal commented on HDFS-11530: -- Thanks for the great work [~linyiqun] and [~v

[jira] [Commented] (HDFS-11504) Ozone: SCM: Add AllocateBlock/DeleteBlock/GetBlock APIs

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966603#comment-15966603 ] Anu Engineer commented on HDFS-11504: - [~xyao] Thanks for the patch. Some comments bel

[jira] [Updated] (HDFS-11649) Ozone : add SCM CLI shell code placeholder classes

2017-04-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11649: -- Attachment: HDFS-11649-HDFS-7240.002.patch Post v002 patch to address the warnings. > Ozone : add SCM C

[jira] [Commented] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966590#comment-15966590 ] Hadoop QA commented on HDFS-11402: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11558) BPServiceActor thread name is too long

2017-04-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11558: - Fix Version/s: 2.8.1 > BPServiceActor thread name is too long > --

[jira] [Assigned] (HDFS-11644) DFSStripedOutputStream should not implement Syncable

2017-04-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy reassigned HDFS-11644: - Assignee: Manoj Govindassamy > DFSStripedOutputStream should not implement Syncab

[jira] [Commented] (HDFS-11644) DFSStripedOutputStream should not implement Syncable

2017-04-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966566#comment-15966566 ] Manoj Govindassamy commented on HDFS-11644: --- [~andrew.wang], sure, will work thi

[jira] [Commented] (HDFS-11644) DFSStripedOutputStream should not implement Syncable

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966557#comment-15966557 ] Andrew Wang commented on HDFS-11644: [~manojg] want to pick this one up? > DFSStriped

[jira] [Commented] (HDFS-11649) Ozone : add SCM CLI shell code placeholder classes

2017-04-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966548#comment-15966548 ] Hadoop QA commented on HDFS-11649: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10996) Ability to specify per-file EC policy at create time

2017-04-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966506#comment-15966506 ] Hudson commented on HDFS-10996: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-11565) Use compact identifiers for built-in ECPolicies in HdfsFileStatus

2017-04-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966505#comment-15966505 ] Hudson commented on HDFS-11565: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-11648) Lazy construct the IIP pathname

2017-04-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11648: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.1 3.0.0-alpha3

[jira] [Updated] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-04-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11530: -- Attachment: HDFS-11530.009.patch Realized that there is a minor small bug in v008 patch, post v009 patch

[jira] [Commented] (HDFS-11615) FSNamesystemLock metrics can be inaccurate due to millisecond precision

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966470#comment-15966470 ] Andrew Wang commented on HDFS-11615: Hi Erik, What's your proposal for new names? I'm

[jira] [Commented] (HDFS-11651) Add a public API for specifying an EC policy at create time

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966460#comment-15966460 ] Andrew Wang commented on HDFS-11651: One idea is that we add a new public interface to

[jira] [Commented] (HDFS-10996) Ability to specify per-file EC policy at create time

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966461#comment-15966461 ] Andrew Wang commented on HDFS-10996: FYI that I filed HDFS-11651 to expose this as a p

[jira] [Updated] (HDFS-11642) Block Storage: fix TestCBlockCLI and TestCBlockServerPersistence cleanup

2017-04-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11642: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Block Storage: fix TestCBlockCLI an

[jira] [Created] (HDFS-11651) Add a public API for specifying an EC policy at create time

2017-04-12 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11651: -- Summary: Add a public API for specifying an EC policy at create time Key: HDFS-11651 URL: https://issues.apache.org/jira/browse/HDFS-11651 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11313) Segmented Block Reports

2017-04-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966458#comment-15966458 ] Daryn Sharp commented on HDFS-11313: Very clever design, but as I hinted before, I hav

[jira] [Updated] (HDFS-10996) Ability to specify per-file EC policy at create time

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10996: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch Available

[jira] [Created] (HDFS-11650) Ozone: fix the consistently timeout test testUpgradeFromRel22Image

2017-04-12 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11650: - Summary: Ozone: fix the consistently timeout test testUpgradeFromRel22Image Key: HDFS-11650 URL: https://issues.apache.org/jira/browse/HDFS-11650 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11648) Lazy construct the IIP pathname

2017-04-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966454#comment-15966454 ] Hudson commented on HDFS-11648: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-11645) DataXceiver thread should log the actual error when getting InvalidMagicNumberException

2017-04-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966455#comment-15966455 ] Hudson commented on HDFS-11645: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-11565) Use compact identifiers for built-in ECPolicies in HdfsFileStatus

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966451#comment-15966451 ] Andrew Wang commented on HDFS-11565: Committed to trunk, thanks again Wei-chiu for rev

[jira] [Updated] (HDFS-11565) Use compact identifiers for built-in ECPolicies in HdfsFileStatus

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11565: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 Release Note: Some of the existing fields in

[jira] [Commented] (HDFS-11565) Use compact identifiers for built-in ECPolicies in HdfsFileStatus

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966445#comment-15966445 ] Andrew Wang commented on HDFS-11565: I'll fix the unused import on commit, thanks for

[jira] [Commented] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2017-04-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966423#comment-15966423 ] Andrew Wang commented on HDFS-9260: --- Hi Daryn, I talked to our people who help run this

[jira] [Commented] (HDFS-11642) Block Storage: fix TestCBlockCLI and TestCBlockServerPersistence cleanup

2017-04-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966421#comment-15966421 ] Chen Liang commented on HDFS-11642: --- Thanks [~xyao] for working on this! v001 patch LGTM

[jira] [Updated] (HDFS-11635) Block Storage: Add metrics for Container Flushes.

2017-04-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11635: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Block Storage: Add metrics for Cont

[jira] [Updated] (HDFS-11645) DataXceiver thread should log the actual error when getting InvalidMagicNumberException

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11645: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3 Target

[jira] [Updated] (HDFS-11558) BPServiceActor thread name is too long

2017-04-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11558: - Attachment: HDFS-11558-branch-2.8.006.patch Posted branch-2.8 patch. > BPServiceActor thread name

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2017-04-12 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966369#comment-15966369 ] Surendra Singh Lilhore commented on HDFS-11163: --- Thanks [~cnauroth] for revi

[jira] [Commented] (HDFS-11645) DataXceiver thread should log the actual error when getting InvalidMagicNumberException

2017-04-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966358#comment-15966358 ] Anu Engineer commented on HDFS-11645: - [~hanishakoneru] Thanks for the review. +1 from

[jira] [Commented] (HDFS-11565) Use compact identifiers for built-in ECPolicies in HdfsFileStatus

2017-04-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966353#comment-15966353 ] Wei-Chiu Chuang commented on HDFS-11565: +1 after fixing the checkstyle warning. T

[jira] [Commented] (HDFS-11648) Lazy construct the IIP pathname

2017-04-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966351#comment-15966351 ] Kihwal Lee commented on HDFS-11648: --- +1 simple, yet effective. > Lazy construct the IIP

  1   2   >