[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064020#comment-17064020 ] Ayush Saxena commented on HDFS-15154: - Thanx [~swagle] for the patch. Looks Good, Jus

[jira] [Updated] (HDFS-15227) NPE if the last block changes from COMMITTED to COMPLETE during FSCK

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15227: Summary: NPE if the last block changes from COMMITTED to COMPLETE during FSCK (was: FSCK -upgraded

[jira] [Commented] (HDFS-15196) RBF: RouterRpcServer getListing cannot list large dirs correctly

2020-03-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064011#comment-17064011 ] Ayush Saxena commented on HDFS-15196: - For the end user, the remaining entries aren't

[jira] [Commented] (HDFS-15196) RBF: RouterRpcServer getListing cannot list large dirs correctly

2020-03-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063494#comment-17063494 ] Ayush Saxena commented on HDFS-15196: - Thanx Everyone. Seems fine. A minor doubt : Do

[jira] [Updated] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15200: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolve

[jira] [Commented] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17062780#comment-17062780 ] Ayush Saxena commented on HDFS-15200: - Committed to trunk. Thanx Everyone for the rev

[jira] [Updated] (HDFS-15223) FSCK fails if one namenode is not available

2020-03-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15223: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolve

[jira] [Commented] (HDFS-15223) FSCK fails if one namenode is not available

2020-03-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17062728#comment-17062728 ] Ayush Saxena commented on HDFS-15223: - I triggered jenkins again, but it didn't put

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-03-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061831#comment-17061831 ] Ayush Saxena commented on HDFS-15154: - Thanx [~swagle] for the patch. Couldn't actual

[jira] [Commented] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061827#comment-17061827 ] Ayush Saxena commented on HDFS-15200: - Thanx Everyone, If no further comments will pu

[jira] [Commented] (HDFS-15223) FSCK fails if one namenode is not available

2020-03-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061826#comment-17061826 ] Ayush Saxena commented on HDFS-15223: - [~elgoiri] can you help review v2.. > FSCK fa

[jira] [Updated] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14919: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolve

[jira] [Commented] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060383#comment-17060383 ] Ayush Saxena commented on HDFS-14919: - Nothing as such, may be just my eyes have got

[jira] [Commented] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060367#comment-17060367 ] Ayush Saxena commented on HDFS-14919: - Thanx [~leosun08] for the update. Seems Workin

[jira] [Updated] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14919: Attachment: screenshot-1.png > Provide Non DFS Used per DataNode in DataNode UI > -

[jira] [Commented] (HDFS-15223) FSCK fails if one namenode is not available

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060358#comment-17060358 ] Ayush Saxena commented on HDFS-15223: - Thanx [~ferhui] and [~elgoiri] for the reviews

[jira] [Updated] (HDFS-15223) FSCK fails if one namenode is not available

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15223: Attachment: HDFS-15223-02.patch > FSCK fails if one namenode is not available > ---

[jira] [Updated] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15227: Status: Patch Available (was: Open) > FSCK -upgradedomains is failing for upgradedomains when more

[jira] [Updated] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15227: Attachment: HDFS-15227-01.patch > FSCK -upgradedomains is failing for upgradedomains when more than

[jira] [Commented] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060328#comment-17060328 ] Ayush Saxena commented on HDFS-15227: - I have put a patch that can (by means of break

[jira] [Updated] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15227: Attachment: TestToRepro.patch > FSCK -upgradedomains is failing for upgradedomains when more than 2

[jira] [Commented] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060252#comment-17060252 ] Ayush Saxena commented on HDFS-15227: - Thanx [~mkris.re...@gmail.com] for the report,

[jira] [Assigned] (HDFS-15227) FSCK -upgradedomains is failing for upgradedomains when more than 2 million blocks present in hdfs and write in progress of some blocks

2020-03-16 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDFS-15227: --- Assignee: Ayush Saxena > FSCK -upgradedomains is failing for upgradedomains when more than 2

[jira] [Commented] (HDFS-15223) FSCK fails if one namenode is not available

2020-03-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059772#comment-17059772 ] Ayush Saxena commented on HDFS-15223: - Uploaded fix. Please Review!!! > FSCK fails i

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-03-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059767#comment-17059767 ] Ayush Saxena commented on HDFS-15154: - [~swagle] But If the old configuration isn't r

[jira] [Commented] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059704#comment-17059704 ] Ayush Saxena commented on HDFS-14919: - [~leosun08] seems it is still not working. I g

[jira] [Updated] (HDFS-15223) FSCK fails if one namenode is not available

2020-03-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15223: Status: Patch Available (was: Open) > FSCK fails if one namenode is not available > --

[jira] [Updated] (HDFS-15223) FSCK fails if one namenode is not available

2020-03-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15223: Attachment: HDFS-15223-01.patch > FSCK fails if one namenode is not available > ---

[jira] [Created] (HDFS-15223) FSCK fails if one namenode is not available

2020-03-15 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-15223: --- Summary: FSCK fails if one namenode is not available Key: HDFS-15223 URL: https://issues.apache.org/jira/browse/HDFS-15223 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-15197) [SBN read] Change ObserverRetryOnActiveException log to debug

2020-03-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15197: Fix Version/s: 2.10.1 3.2.2 3.1.4 3.3.0

[jira] [Commented] (HDFS-15193) Improving the error message for missing `dfs.namenode.rpc-address.$NAMESERVICE`

2020-03-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059615#comment-17059615 ] Ayush Saxena commented on HDFS-15193: - Thanx [~ctest.team] for the patch. LGTM can yo

[jira] [Updated] (HDFS-15159) Prevent adding same DN multiple times in PendingReconstructionBlocks

2020-03-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15159: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolve

[jira] [Commented] (HDFS-15159) Prevent adding same DN multiple times in PendingReconstructionBlocks

2020-03-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059598#comment-17059598 ] Ayush Saxena commented on HDFS-15159: - v004 LGTM +1 > Prevent adding same DN multipl

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-03-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059594#comment-17059594 ] Ayush Saxena commented on HDFS-15154: - Thanx [~swagle] almost looks good. Regarding d

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-03-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059412#comment-17059412 ] Ayush Saxena commented on HDFS-13377: - Thanx [~hadoop_yangyun] for the update. Just m

[jira] [Commented] (HDFS-14919) Provide Non DFS Used per DataNode in DataNode UI

2020-03-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059376#comment-17059376 ] Ayush Saxena commented on HDFS-14919: - Thanx [~leosun08] Can you recheck, the patch d

[jira] [Comment Edited] (HDFS-15222) HDFS: Output message of ""hdfs fsck -list-corruptfileblocks" command is not correct

2020-03-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059358#comment-17059358 ] Ayush Saxena edited comment on HDFS-15222 at 3/14/20, 1:42 PM:

[jira] [Commented] (HDFS-15222) HDFS: Output message of ""hdfs fsck -list-corruptfileblocks" command is not correct

2020-03-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059358#comment-17059358 ] Ayush Saxena commented on HDFS-15222: - Seems similar to HDFS-14971 > HDFS: Output me

[jira] [Commented] (HDFS-14902) RBF: NullPointer When Misconfigured

2020-03-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059356#comment-17059356 ] Ayush Saxena commented on HDFS-14902: - [~tasanuma] anything blocking here? > RBF: Nu

[jira] [Commented] (HDFS-15197) [SBN read] Change ObserverRetryOnActiveException log to debug

2020-03-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059348#comment-17059348 ] Ayush Saxena commented on HDFS-15197: - v001 LGTM +1 > [SBN read] Change ObserverRet

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-03-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059338#comment-17059338 ] Ayush Saxena commented on HDFS-13377: - Thanx [~elgoiri] for taking a look. for ugi,do

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-03-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059335#comment-17059335 ] Ayush Saxena commented on HDFS-15154: - The same logic should be done for {{unsetStora

[jira] [Commented] (HDFS-15159) Prevent adding same DN multiple times in PendingReconstructionBlocks

2020-03-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059313#comment-17059313 ] Ayush Saxena commented on HDFS-15159: - bq. to make sure whether same DN getting added

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-03-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058863#comment-17058863 ] Ayush Saxena commented on HDFS-13377: - [~elgoiri] any cycles for review? > The owner

[jira] [Updated] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15155: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolve

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058861#comment-17058861 ] Ayush Saxena commented on HDFS-15155: - Committed to trunk. Thanx [~huanghaibin] for t

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058857#comment-17058857 ] Ayush Saxena commented on HDFS-15155: - v005 LGTM +1 > writeIoRate of DataNodeVolumeM

[jira] [Commented] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058433#comment-17058433 ] Ayush Saxena commented on HDFS-15211: - Thanx [~surendrasingh] for the review. Have re

[jira] [Commented] (HDFS-15220) FSCK calls are redirecting to Active NN

2020-03-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058428#comment-17058428 ] Ayush Saxena commented on HDFS-15220: - FSCK is used to fetch replica details and even

[jira] [Commented] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058364#comment-17058364 ] Ayush Saxena commented on HDFS-15200: - Thanx [~elgoiri] for the review. The default t

[jira] [Commented] (HDFS-15155) writeIoRate of DataNodeVolumeMetrics is never used

2020-03-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058363#comment-17058363 ] Ayush Saxena commented on HDFS-15155: - Thanx [~huanghaibin] for the patch. Minor doub

[jira] [Commented] (HDFS-15159) Prevent adding same DN multiple times in PendingReconstructionBlocks

2020-03-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058356#comment-17058356 ] Ayush Saxena commented on HDFS-15159: - Why this is written twice : {code:java} +

[jira] [Updated] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15211: Attachment: HDFS-15211-05.patch > EC: File write hangs during close in case of Exception during upd

[jira] [Updated] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15211: Attachment: HDFS-15211-04.patch > EC: File write hangs during close in case of Exception during upd

[jira] [Commented] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057975#comment-17057975 ] Ayush Saxena commented on HDFS-15200: - Fixed Checkstyle. [~aajisaka] [~elgoiri] can y

[jira] [Updated] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15200: Attachment: HDFS-15200-05.patch > Delete Corrupt Replica Immediately Irrespective of Replicas On St

[jira] [Commented] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-10 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056652#comment-17056652 ] Ayush Saxena commented on HDFS-15211: - Test failures not related. [~brahmareddy] [~su

[jira] [Updated] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15211: Attachment: HDFS-15211-03.patch > EC: File write hangs during close in case of Exception during upd

[jira] [Updated] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15211: Attachment: (was: HDFS-15211-03.patch) > EC: File write hangs during close in case of Exception

[jira] [Updated] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15211: Attachment: HDFS-15211-03.patch > EC: File write hangs during close in case of Exception during upd

[jira] [Commented] (HDFS-15209) Lease recovery: namenode not able to commitBlockSynchronization if client comes back and closes the file beforehand

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17053704#comment-17053704 ] Ayush Saxena commented on HDFS-15209: - Thanx [~NickyYe] for the report. Seems your pa

[jira] [Updated] (HDFS-15209) Lease recovery: namenode not able to commitBlockSynchronization if client comes back and closes the file beforehand

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15209: Fix Version/s: (was: 3.1.3) (was: 3.1.2) > Lease recovery: namenode not

[jira] [Commented] (HDFS-15193) Improving the error message for missing `dfs.namenode.rpc-address.$NAMESERVICE`

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17053661#comment-17053661 ] Ayush Saxena commented on HDFS-15193: - Thanx [~ctest.team] for the patch. Instead of

[jira] [Updated] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15211: Attachment: HDFS-15211-02.patch > EC: File write hangs during close in case of Exception during upd

[jira] [Commented] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17053513#comment-17053513 ] Ayush Saxena commented on HDFS-15200: - Thanx [~elgoiri] for the review bq. Finally, i

[jira] [Updated] (HDFS-15212) TestEncryptionZones.testVersionAndSuiteNegotiation fails in trunk

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15212: Status: Patch Available (was: Open) > TestEncryptionZones.testVersionAndSuiteNegotiation fails in

[jira] [Updated] (HDFS-15212) TestEncryptionZones.testVersionAndSuiteNegotiation fails in trunk

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15212: Attachment: HDFS-15212-01.patch > TestEncryptionZones.testVersionAndSuiteNegotiation fails in trunk

[jira] [Created] (HDFS-15212) TestEncryptionZones.testVersionAndSuiteNegotiation fails in trunk

2020-03-06 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-15212: --- Summary: TestEncryptionZones.testVersionAndSuiteNegotiation fails in trunk Key: HDFS-15212 URL: https://issues.apache.org/jira/browse/HDFS-15212 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15211: Attachment: HDFS-15211-01.patch > EC: File write hangs during close in case of Exception during upd

[jira] [Updated] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15211: Status: Patch Available (was: Open) > EC: File write hangs during close in case of Exception durin

[jira] [Updated] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15200: Attachment: HDFS-15200-04.patch > Delete Corrupt Replica Immediately Irrespective of Replicas On St

[jira] [Commented] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17053453#comment-17053453 ] Ayush Saxena commented on HDFS-15211: - Attached a test to reproduce the issue. Made a

[jira] [Updated] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15211: Attachment: TestToRepro-01.patch > EC: File write hangs during close in case of Exception during up

[jira] [Updated] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15211: Attachment: Thread-Dump-02 > EC: File write hangs during close in case of Exception during updatePi

[jira] [Updated] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15211: Target Version/s: 3.3.0 > EC: File write hangs during close in case of Exception during updatePipel

[jira] [Updated] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15211: Affects Version/s: 3.3.0 3.1.1 3.2.1 > EC: File write

[jira] [Commented] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17053441#comment-17053441 ] Ayush Saxena commented on HDFS-15211: - Attached Thread Dump > EC: File write hangs d

[jira] [Updated] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15211: Attachment: Thread-Dump > EC: File write hangs during close in case of Exception during updatePipel

[jira] [Created] (HDFS-15211) EC: File write hangs during close in case of Exception during updatePipeline

2020-03-06 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-15211: --- Summary: EC: File write hangs during close in case of Exception during updatePipeline Key: HDFS-15211 URL: https://issues.apache.org/jira/browse/HDFS-15211 Project: Had

[jira] [Commented] (HDFS-15120) Refresh BlockPlacementPolicy at runtime.

2020-03-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17053207#comment-17053207 ] Ayush Saxena commented on HDFS-15120: - Hi [~LiJinglun] Sorry messed this up with some

[jira] [Commented] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17051972#comment-17051972 ] Ayush Saxena commented on HDFS-15200: - Thanx [~aajisaka] for the review. Have fixed i

[jira] [Commented] (HDFS-15120) Refresh BlockPlacementPolicy at runtime.

2020-03-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17051825#comment-17051825 ] Ayush Saxena commented on HDFS-15120: - Hi [~LiJinglun] Observed one problem here, thi

[jira] [Updated] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15200: Attachment: HDFS-15200-03.patch > Delete Corrupt Replica Immediately Irrespective of Replicas On St

[jira] [Updated] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15200: Attachment: (was: HDFS-15200-03.patch) > Delete Corrupt Replica Immediately Irrespective of Rep

[jira] [Updated] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15200: Attachment: HDFS-15200-03.patch > Delete Corrupt Replica Immediately Irrespective of Replicas On St

[jira] [Commented] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17050504#comment-17050504 ] Ayush Saxena commented on HDFS-15200: - Thanx [~aajisaka] I have made it configurable

[jira] [Updated] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15200: Attachment: HDFS-15200-02.patch > Delete Corrupt Replica Immediately Irrespective of Replicas On St

[jira] [Updated] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15200: Attachment: HDFS-15200-01.patch > Delete Corrupt Replica Immediately Irrespective of Replicas On St

[jira] [Updated] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15200: Status: Patch Available (was: Open) > Delete Corrupt Replica Immediately Irrespective of Replicas

[jira] [Commented] (HDFS-15196) RBF: RouterRpcServer getListing cannot list large dirs correctly

2020-03-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049898#comment-17049898 ] Ayush Saxena commented on HDFS-15196: - On a thought, the namenode returns entries in

[jira] [Commented] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049552#comment-17049552 ] Ayush Saxena commented on HDFS-15200: - Thanx [~weichiu] During transition, it is by

[jira] [Commented] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049161#comment-17049161 ] Ayush Saxena commented on HDFS-15200: - [~surendrasingh] [~elgoiri] Thoughts on this?

[jira] [Created] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-03-02 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-15200: --- Summary: Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage Key: HDFS-15200 URL: https://issues.apache.org/jira/browse/HDFS-15200 Project: Ha

[jira] [Commented] (HDFS-15198) RBF: In Secure Mode, Router can't refresh other router's mountTableEntries

2020-03-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048644#comment-17048644 ] Ayush Saxena commented on HDFS-15198: - Seems the test is almost copy of {{TestRouterM

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-29 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048487#comment-17048487 ] Ayush Saxena commented on HDFS-13377: - Seems fine. Better we get one more review. [~w

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-29 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048370#comment-17048370 ] Ayush Saxena commented on HDFS-13377: - [~hadoop_yangyun] I have a doubt here, As of

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-29 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048324#comment-17048324 ] Ayush Saxena commented on HDFS-13377: - On a second look, Seems we should check {{isPe

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15033: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolve

[jira] [Commented] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048172#comment-17048172 ] Ayush Saxena commented on HDFS-15033: - +1 > Support to save replica cached files to

[jira] [Commented] (HDFS-15199) NPE in BlockSender

2020-02-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17047849#comment-17047849 ] Ayush Saxena commented on HDFS-15199: - The exception won't be swallowed. It would be

<    10   11   12   13   14   15   16   17   18   19   >