[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225318#comment-16225318 ] Chris Douglas commented on HDFS-7878: - Folks, can this get a definitive review? I think

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225308#comment-16225308 ] Hadoop QA commented on HDFS-12665: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-10-30 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225298#comment-16225298 ] Elek, Marton commented on HDFS-12734: - Yes, currently it requires the hugo files, but

[jira] [Updated] (HDFS-12718) Ozone: fix thread number calculation in CBlockManager

2017-10-30 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12718: Attachment: HDFS-12718-HDFS-7240.002.patch Patch is improved according to the suggestion. I also imp

[jira] [Issue Comment Deleted] (HDFS-2139) Fast copy for HDFS.

2017-10-30 Thread feiwei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwei updated HDFS-2139: - Comment: was deleted (was: In FsDatasetImpl.java , You should modify to ensure synchronization public void hardL

[jira] [Commented] (HDFS-12718) Ozone: fix thread number calculation in CBlockManager

2017-10-30 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225284#comment-16225284 ] Elek, Marton commented on HDFS-12718: - Yes, I also considered this option as well, and

[jira] [Commented] (HDFS-206) Support for head in FSShell

2017-10-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225278#comment-16225278 ] Sean Mackrory commented on HDFS-206: Ah - you know what? I didn't see that the last argu

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2017-10-30 Thread feiwei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225268#comment-16225268 ] feiwei commented on HDFS-2139: -- In FsDatasetImpl.java , You should modify to ensure synchroni

[jira] [Commented] (HDFS-12738) Namenode logs many "SSL renegotiate denied" warnings after enable HTTPS for HDFS

2017-10-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225248#comment-16225248 ] Kihwal Lee commented on HDFS-12738: --- How frequent is it relative to the request rate? >

[jira] [Commented] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225234#comment-16225234 ] Hadoop QA commented on HDFS-12667: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11294) libhdfs++: Segfault in HA failover if DNS lookup for both Namenodes fails

2017-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11294: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed this to HDFS-8707

[jira] [Commented] (HDFS-12718) Ozone: fix thread number calculation in CBlockManager

2017-10-30 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225224#comment-16225224 ] Mukul Kumar Singh commented on HDFS-12718: -- Thanks for working on this issue [~el

[jira] [Updated] (HDFS-206) Support for head in FSShell

2017-10-30 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-206: Status: Patch Available (was: Open) Thanks for the review Sean! I've removed the -f and added the finally blo

[jira] [Updated] (HDFS-206) Support for head in FSShell

2017-10-30 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-206: Status: Open (was: Patch Available) > Support for head in FSShell > --- > >

[jira] [Updated] (HDFS-206) Support for head in FSShell

2017-10-30 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-206: Attachment: HDFS-206.003.patch > Support for head in FSShell > --- > >

[jira] [Updated] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-10-30 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12698: Status: Open (was: Patch Available) Moving back to inprogress, to check the failing tests. > Ozone

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-10-30 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Attachment: HDFS-12665-HDFS-9806.003.patch Attaching patch that rebased on the latest HDFS-11902 patch.

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-10-30 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Status: Patch Available (was: Open) > [AliasMap] Create a version of the AliasMap that runs in memory i

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-10-30 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Status: Open (was: Patch Available) > [AliasMap] Create a version of the AliasMap that runs in memory i

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-10-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225110#comment-16225110 ] Sean Mackrory commented on HDFS-11096: -- Re: test4tests, the whole patch is tests. Sho

[jira] [Comment Edited] (HDFS-206) Support for head in FSShell

2017-10-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225096#comment-16225096 ] Sean Mackrory edited comment on HDFS-206 at 10/30/17 3:11 PM: --

[jira] [Commented] (HDFS-206) Support for head in FSShell

2017-10-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225096#comment-16225096 ] Sean Mackrory commented on HDFS-206: This looks pretty good to me. A couple of nitpicks:

[jira] [Commented] (HDFS-12724) Add retry logic when data node block moves while reading

2017-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225092#comment-16225092 ] James Clampffer commented on HDFS-12724: Nice [~mdeepak]! Overall the code change

[jira] [Commented] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-30 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225083#comment-16225083 ] Rushabh S Shah commented on HDFS-12667: --- bq. Some preliminary comments: [~xiaochen]:

[jira] [Updated] (HDFS-7240) Object store in HDFS

2017-10-30 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-7240: Attachment: HDFS-7240.004.patch > Object store in HDFS > > >

[jira] [Updated] (HDFS-7240) Object store in HDFS

2017-10-30 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-7240: Attachment: (was: HDFS-7240.004.patch) > Object store in HDFS > > >

[jira] [Updated] (HDFS-7240) Object store in HDFS

2017-10-30 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-7240: Attachment: (was: HDFS-7240.004.patch) > Object store in HDFS > > >

[jira] [Updated] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-10-30 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12720: - Attachment: HDFS-12720-HDFS-7240.003.patch > Ozone: Ratis options are not passed from KSM

[jira] [Commented] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-10-30 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225022#comment-16225022 ] Mukul Kumar Singh commented on HDFS-12720: -- Thanks for the review [~nandakumar131

[jira] [Commented] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2017-10-30 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225020#comment-16225020 ] Gabor Bota commented on HDFS-12116: --- Hi Xiao, What's the current status on this issue?

[jira] [Updated] (HDFS-12745) Ozone: XceiverClientManager should cache objects based on pipeline name

2017-10-30 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12745: - Description: With just the standalone pipeline, a new pipeline was created for each and e

[jira] [Created] (HDFS-12745) Ozone: XceiverClientManager should cache objects based on pipeline name

2017-10-30 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12745: Summary: Ozone: XceiverClientManager should cache objects based on pipeline name Key: HDFS-12745 URL: https://issues.apache.org/jira/browse/HDFS-12745 Project

[jira] [Comment Edited] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224885#comment-16224885 ] Weiwei Yang edited comment on HDFS-12443 at 10/30/17 1:05 PM: --

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224885#comment-16224885 ] Weiwei Yang commented on HDFS-12443: Hi [~linyiqun] Please take a look at the pdf I j

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224875#comment-16224875 ] Weiwei Yang commented on HDFS-12443: Hi [~linyiqun] Sorry for the late review, was pr

[jira] [Updated] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12443: --- Attachment: HDFS-12443-SCM-blockdeletion-throttle.pdf > Ozone: Improve SCM block deletion throttling a

[jira] [Comment Edited] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-10-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224827#comment-16224827 ] Yiqun Lin edited comment on HDFS-12474 at 10/30/17 12:32 PM: -

[jira] [Commented] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-10-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224827#comment-16224827 ] Yiqun Lin commented on HDFS-12474: -- Thanks for working on this, [~nandakumar131]. Some co

[jira] [Commented] (HDFS-12742) Add support for KSM --expunge command

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224811#comment-16224811 ] Weiwei Yang commented on HDFS-12742: Hi [~shashikant] Sounds nice to me, +[~anu], [~x

[jira] [Commented] (HDFS-12742) Add support for KSM --expunge command

2017-10-30 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224800#comment-16224800 ] Shashikant Banerjee commented on HDFS-12742: Hi [~cheersyang], The idea here

[jira] [Updated] (HDFS-12719) Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch

2017-10-30 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12719: - Attachment: HDFS-12719-HDFS-7240.001.patch > Ozone: Fix checkstyle, javac, whitespace issu

[jira] [Comment Edited] (HDFS-12742) Add support for KSM --expunge command

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224742#comment-16224742 ] Weiwei Yang edited comment on HDFS-12742 at 10/30/17 11:33 AM: -

[jira] [Commented] (HDFS-12742) Add support for KSM --expunge command

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224742#comment-16224742 ] Weiwei Yang commented on HDFS-12742: Hi [~shashikant] Sorry my earlier comment is mis

[jira] [Commented] (HDFS-12717) 'hdfs namenode -help' command will not work when Namenode is Running

2017-10-30 Thread Harshakiran Reddy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224730#comment-16224730 ] Harshakiran Reddy commented on HDFS-12717: -- [~aw] any idea on this..? > 'hdfs n

[jira] [Commented] (HDFS-12742) Add support for KSM --expunge command

2017-10-30 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224719#comment-16224719 ] Shashikant Banerjee commented on HDFS-12742: Hi [~cheersyang], Thanks for the

[jira] [Commented] (HDFS-12742) Add support for KSM --expunge command

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224626#comment-16224626 ] Weiwei Yang commented on HDFS-12742: Hi [~shashikant] I am confused with this patch,

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-30 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224526#comment-16224526 ] Kai Zheng commented on HDFS-12682: -- Thanks for the work and discussions here. I thought t

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224451#comment-16224451 ] Weiwei Yang commented on HDFS-7060: --- Hi [~yangjiandan] Your latest patch looks good to m

<    1   2