[jira] [Updated] (HDFS-15226) Ranger integrates HDFS and discovers NPE

2020-03-16 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15226: -- Description: When I integrated ranger1.2 with Hadoop2.7.6, the following NPE error occurred when executing hdf

[jira] [Updated] (HDFS-15226) Ranger integrates HDFS and discovers NPE

2020-03-16 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15226: -- Attachment: (was: image-2020-03-16-14-01-03-078.png) > Ranger integrates HDFS and discovers NPE > -

[jira] [Updated] (HDFS-15226) Ranger integrates HDFS and discovers NPE

2020-03-16 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15226: -- Description: When I integrated ranger1.2 with Hadoop2.7.6, the following NPE error occurred when executing hdf

[jira] [Commented] (HDFS-15226) Ranger integrates HDFS and discovers NPE

2020-03-16 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060206#comment-17060206 ] Brahma Reddy Battula commented on HDFS-15226: - Hope you are asking "HDFS-1261

[jira] [Resolved] (HDFS-15226) Ranger integrates HDFS and discovers NPE

2020-03-16 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi resolved HDFS-15226. --- Resolution: Fixed > Ranger integrates HDFS and discovers NPE > > >

[jira] [Commented] (HDFS-15226) Ranger integrates HDFS and discovers NPE

2020-03-16 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060216#comment-17060216 ] bianqi commented on HDFS-15226: --- Thanks for your reply, I understand. > Ranger integrates

[jira] [Reopened] (HDFS-15226) Ranger integrates HDFS and discovers NPE

2020-03-16 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reopened HDFS-15226: - > Ranger integrates HDFS and discovers NPE >

[jira] [Resolved] (HDFS-15226) Ranger integrates HDFS and discovers NPE

2020-03-16 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula resolved HDFS-15226. - Fix Version/s: (was: 3.2.1) (was: 3.2.0) Targ

[jira] [Created] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread krishna reddy (Jira)
krishna reddy created HDFS-15227: Summary: FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks Key: HDFS-15227 URL: https://issue

[jira] [Assigned] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDFS-15227: --- Assignee: Ayush Saxena > FSCK -upgradedomains is failing for upgradedomains when more than 2

[jira] [Commented] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060252#comment-17060252 ] Ayush Saxena commented on HDFS-15227: - Thanx [~mkris.re...@gmail.com] for the report,

[jira] [Commented] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2020-03-16 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060305#comment-17060305 ] Ahmed Hussein commented on HDFS-10499: -- the failed test case is not related to the p

[jira] [Updated] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15227: Attachment: TestToRepro.patch > FSCK -upgradedomains is failing for upgradedomains when more than 2

[jira] [Commented] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060328#comment-17060328 ] Ayush Saxena commented on HDFS-15227: - I have put a patch that can (by means of break

[jira] [Updated] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15227: Status: Patch Available (was: Open) > FSCK -upgradedomains is failing for upgradedomains when more

[jira] [Updated] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15227: Attachment: HDFS-15227-01.patch > FSCK -upgradedomains is failing for upgradedomains when more than

[jira] [Commented] (HDFS-15223) FSCK fails if one namenode is not available

2020-03-16 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060332#comment-17060332 ] Íñigo Goiri commented on HDFS-15223: Thanks for bringing this up. A couple comments:

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2020-03-16 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060352#comment-17060352 ] Íñigo Goiri commented on HDFS-6874: --- * We can fix the NoWhitespaceAfter checkstyles. * I

[jira] [Updated] (HDFS-15223) FSCK fails if one namenode is not available

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15223: Attachment: HDFS-15223-02.patch > FSCK fails if one namenode is not available > ---

[jira] [Commented] (HDFS-15223) FSCK fails if one namenode is not available

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060358#comment-17060358 ] Ayush Saxena commented on HDFS-15223: - Thanx [~ferhui] and [~elgoiri] for the reviews

[jira] [Updated] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14919: Attachment: screenshot-1.png > Provide Non DFS Used per DataNode in DataNode UI > -

[jira] [Commented] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060367#comment-17060367 ] Ayush Saxena commented on HDFS-14919: - Thanx [~leosun08] for the update. Seems Workin

[jira] [Commented] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-16 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060377#comment-17060377 ] Íñigo Goiri commented on HDFS-14919: It looks good to me, what's the issue with the c

[jira] [Commented] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-16 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060382#comment-17060382 ] Hadoop QA commented on HDFS-14919: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060383#comment-17060383 ] Ayush Saxena commented on HDFS-14919: - Nothing as such, may be just my eyes have got

[jira] [Updated] (HDFS-15214) WebHDFS: Add snapshot counts to Content Summary

2020-03-16 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15214: - Attachment: HDFS-15214.004.patch > WebHDFS: Add snapshot counts to Content Summary >

[jira] [Commented] (HDFS-15214) WebHDFS: Add snapshot counts to Content Summary

2020-03-16 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060404#comment-17060404 ] hemanthboyina commented on HDFS-15214: -- thanks for the review [~elgoiri] i have upd

[jira] [Commented] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-16 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060415#comment-17060415 ] Íñigo Goiri commented on HDFS-14919: +1 on [^HDFS-14919.003.patch]. > Provide Non DF

[jira] [Commented] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-03-16 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060421#comment-17060421 ] Íñigo Goiri commented on HDFS-15221: Thanks [~hadoop_yangyun] for the update. Minor c

[jira] [Commented] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060436#comment-17060436 ] Hadoop QA commented on HDFS-15227: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15214) WebHDFS: Add snapshot counts to Content Summary

2020-03-16 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060522#comment-17060522 ] Hadoop QA commented on HDFS-15214: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-03-16 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15221: Status: Open (was: Patch Available) > Add checking of effective filesystem during initializing storage loc

[jira] [Updated] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-03-16 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15221: Attachment: HDFS-15221-006.patch Status: Patch Available (was: Open) > Add checking of effective f

[jira] [Commented] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-03-16 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060582#comment-17060582 ] Yang Yun commented on HDFS-15221: - Thanks [~elgoiri] for the review. Updated new path HD

[jira] [Comment Edited] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-03-16 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060582#comment-17060582 ] Yang Yun edited comment on HDFS-15221 at 3/17/20, 2:22 AM: --- Tha

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-03-16 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060600#comment-17060600 ] Siddharth Wagle commented on HDFS-15154: We could fallback to not have the deprec

[jira] [Updated] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-16 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Summary: expired SampleStat need to be removed from SlowPeersReport (was: expired SlowPeersReport

[jira] [Updated] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-16 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Attachment: HDFS-14783-002.patch > expired SampleStat need to be removed from SlowPeersReport > ---

[jira] [Comment Edited] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-03-16 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060600#comment-17060600 ] Siddharth Wagle edited comment on HDFS-15154 at 3/17/20, 3:50 AM: -

[jira] [Updated] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-16 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Description: SlowPeersReport is calculated by the SampleStat between tow dn, so it can present on

[jira] [Commented] (HDFS-14783) expired SampleStat need to be removed from SlowPeersReport

2020-03-16 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060623#comment-17060623 ] Haibin Huang commented on HDFS-14783: - [~ayushtkn] [~elgoiri] , can you take a look f

[jira] [Commented] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060656#comment-17060656 ] Surendra Singh Lilhore commented on HDFS-15227: --- Thanks [~ayushtkn] for pat

[jira] [Comment Edited] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060656#comment-17060656 ] Surendra Singh Lilhore edited comment on HDFS-15227 at 3/17/20, 6:17 AM: --