[jira] [Commented] (HDFS-15227) NPE if the last block changes from COMMITTED to COMPLETE during FSCK

2020-03-21 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064182#comment-17064182 ] Hudson commented on HDFS-15227: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Assigned] (HDFS-15219) DFS Client will stuck when ResponseProcessor.run throw Error

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDFS-15219: --- Assignee: zhengchenyu > DFS Client will stuck when ResponseProcessor.run throw Error > -

[jira] [Commented] (HDFS-15193) Improving the error message for missing `dfs.namenode.rpc-address.$NAMESERVICE`

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064181#comment-17064181 ] Ayush Saxena commented on HDFS-15193: - Thanx [~ctest.team]  v004 LGTM +1 Lets wait

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064180#comment-17064180 ] Ayush Saxena commented on HDFS-15051: - [~hexiaoqiao] plans taking this ahead? > RBF:

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064179#comment-17064179 ] Ayush Saxena commented on HDFS-13377: - Thanx [~hadoop_yangyun]  for the patch. LGTM

[jira] [Updated] (HDFS-15227) NPE if the last block changes from COMMITTED to COMPLETE during FSCK

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15227: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolve

[jira] [Commented] (HDFS-15227) NPE if the last block changes from COMMITTED to COMPLETE during FSCK

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064177#comment-17064177 ] Ayush Saxena commented on HDFS-15227: - Committed to trunk. Thanx [~surendrasingh] [~

[jira] [Commented] (HDFS-15196) RBF: RouterRpcServer getListing cannot list large dirs correctly

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064175#comment-17064175 ] Ayush Saxena commented on HDFS-15196: - Yes, at the end, the listing will be complete

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064174#comment-17064174 ] Ayush Saxena commented on HDFS-15154: - Thanx [~swagle]  patch LGTM {code:java} fina

[jira] [Commented] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064157#comment-17064157 ] Haibin Huang commented on HDFS-14783: - [~elgoiri] thakns for suggestion, i have updat

[jira] [Updated] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibin Huang updated HDFS-14783: Attachment: HDFS-14783-005.patch > Expired SampleStat needs to be removed from SlowPeersReport > --

[jira] [Commented] (HDFS-15231) Improve write efficiency by optimizing RocksDB.open

2020-03-21 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064146#comment-17064146 ] runzhiwang commented on HDFS-15231: --- Sorry, should report to HDDS. > Improve write eff

[jira] [Created] (HDFS-15231) Improve write efficiency by optimizing RocksDB.open

2020-03-21 Thread runzhiwang (Jira)
runzhiwang created HDFS-15231: - Summary: Improve write efficiency by optimizing RocksDB.open Key: HDFS-15231 URL: https://issues.apache.org/jira/browse/HDFS-15231 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-15231) Improve write efficiency by optimizing RocksDB.open

2020-03-21 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang resolved HDFS-15231. --- Resolution: Fixed > Improve write efficiency by optimizing RocksDB.open > ---

[jira] [Commented] (HDFS-15196) RBF: RouterRpcServer getListing cannot list large dirs correctly

2020-03-21 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064094#comment-17064094 ] Fengnan Li commented on HDFS-15196: --- [~ayushtkn] Thanks for the explanation. I agree th

[jira] [Commented] (HDFS-15227) NPE if the last block changes from COMMITTED to COMPLETE during FSCK

2020-03-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064081#comment-17064081 ] Wei-Chiu Chuang commented on HDFS-15227: LGTM. Thanks Ayush for the great work he

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-03-21 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064058#comment-17064058 ] Siddharth Wagle commented on HDFS-15154: Thanks [~ayushtkn] for the review. 14 =

[jira] [Updated] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-03-21 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-15154: --- Attachment: HDFS-15154.14.patch > Allow only hdfs superusers the ability to assign HDFS stora

[jira] [Comment Edited] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064020#comment-17064020 ] Ayush Saxena edited comment on HDFS-15154 at 3/21/20, 7:18 PM:

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064020#comment-17064020 ] Ayush Saxena commented on HDFS-15154: - Thanx [~swagle] for the patch. Looks Good, Jus

[jira] [Updated] (HDFS-15227) NPE if the last block changes from COMMITTED to COMPLETE during FSCK

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15227: Summary: NPE if the last block changes from COMMITTED to COMPLETE during FSCK (was: FSCK -upgraded

[jira] [Commented] (HDFS-15196) RBF: RouterRpcServer getListing cannot list large dirs correctly

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064011#comment-17064011 ] Ayush Saxena commented on HDFS-15196: - For the end user, the remaining entries aren't

[jira] [Comment Edited] (HDFS-15191) EOF when reading legacy buffer in BlockTokenIdentifier

2020-03-21 Thread Steven Rand (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063999#comment-17063999 ] Steven Rand edited comment on HDFS-15191 at 3/21/20, 5:57 PM: -

[jira] [Updated] (HDFS-15229) Truncate info should be logged at INFO level

2020-03-21 Thread Ravuri Sushma sree (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravuri Sushma sree updated HDFS-15229: -- Attachment: HDFS-15229.001.patch > Truncate info should be logged at INFO level >

[jira] [Commented] (HDFS-15191) EOF when reading legacy buffer in BlockTokenIdentifier

2020-03-21 Thread Steven Rand (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063999#comment-17063999 ] Steven Rand commented on HDFS-15191: Also, I noticed that the original implementation

[jira] [Commented] (HDFS-15191) EOF when reading legacy buffer in BlockTokenIdentifier

2020-03-21 Thread Steven Rand (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063995#comment-17063995 ] Steven Rand commented on HDFS-15191: [~vagarychen] I looked at this some more, and fo

[jira] [Commented] (HDFS-15214) WebHDFS: Add snapshot counts to Content Summary

2020-03-21 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063985#comment-17063985 ] Hudson commented on HDFS-15214: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Commented] (HDFS-15214) WebHDFS: Add snapshot counts to Content Summary

2020-03-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063983#comment-17063983 ] Takanobu Asanuma commented on HDFS-15214: - Hi, [~quanli] {quote} Tried testing th

[jira] [Updated] (HDFS-15214) WebHDFS: Add snapshot counts to Content Summary

2020-03-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15214: Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Avail

[jira] [Commented] (HDFS-15214) WebHDFS: Add snapshot counts to Content Summary

2020-03-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063974#comment-17063974 ] Takanobu Asanuma commented on HDFS-15214: - [~elgoiri] Thanks for your review. I w

[jira] [Updated] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15169: --- Attachment: HDFS-15169.001.patch Assignee: Xiaoqiao He Status: Patch Available (was: Op

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-21 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063944#comment-17063944 ] Íñigo Goiri commented on HDFS-15075: Yetus is misbehaving these days Anyway, a co

[jira] [Commented] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063943#comment-17063943 ] Íñigo Goiri commented on HDFS-14783: Thanks [~huanghaibin] I think this safer. * In c

[jira] [Commented] (HDFS-15214) WebHDFS: Add snapshot counts to Content Summary

2020-03-21 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063941#comment-17063941 ] Íñigo Goiri commented on HDFS-15214: Thanks [~tasanuma], I had missed that... I was t

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063838#comment-17063838 ] Xiaoqiao He commented on HDFS-15075: Considering HDFS-15113 has pushed to trunk, shou

[jira] [Updated] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15075: --- Attachment: HDFS-15075.005.patch > Remove process command timing from BPServiceActor > --

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-21 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063806#comment-17063806 ] Aiphago commented on HDFS-15180: ok,I'll fix later > DataNode FsDatasetImpl Fine-Graine

[jira] [Comment Edited] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063805#comment-17063805 ] Xiaoqiao He edited comment on HDFS-15180 at 3/21/20, 7:57 AM: -

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063805#comment-17063805 ] Xiaoqiao He commented on HDFS-15180: Not sure why Jenkins report not attach here. Jus

[jira] [Updated] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-21 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15180: --- Attachment: HDFS-15180.003.patch > DataNode FsDatasetImpl Fine-Grained Locking via BlockPool. >

[jira] [Comment Edited] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063802#comment-17063802 ] Haibin Huang edited comment on HDFS-14783 at 3/21/20, 7:28 AM:

[jira] [Commented] (HDFS-14783) Expired SampleStat needs to be removed from SlowPeersReport

2020-03-21 Thread Haibin Huang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063802#comment-17063802 ] Haibin Huang commented on HDFS-14783: - Thanks [~elgoiri] for suggestion, i think chan