[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419823#comment-15419823 ] Colin P. McCabe commented on HDFS-10301: I don't think the heartbeat is the right

[jira] [Updated] (HDFS-10752) Several log refactoring/improvement suggestion in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemo Chen updated HDFS-10752: - Description: As per conversation with [~vrushalic], we merged HDFS-10749, HDFS-10750, HDFS-10751, HDFS-10

[jira] [Updated] (HDFS-10752) Several log refactoring/improvement suggestion in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemo Chen updated HDFS-10752: - Description: As per conversation with [~vrushalic], we merged HDFS-10749, HDFS-10750, HDFS-10751, HDFS-10

[jira] [Updated] (HDFS-10752) Several log refactoring/improvement suggestion in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemo Chen updated HDFS-10752: - Description: As per conversation with [~vrushalic], we merged HDFS-10749, HDFS-10750, HDFS-10751, HDFS-10

[jira] [Updated] (HDFS-10752) Several log refactoring/improvement suggestion in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemo Chen updated HDFS-10752: - Description: As per conversation with [~vrushalic], we merged HDFS-10749, HDFS-10750, HDFS-10751, HDFS-10

[jira] [Updated] (HDFS-10752) Several log refactoring/improvement suggestion in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemo Chen updated HDFS-10752: - Description: As per conversation with [~vrushalic], we merged HDFS-10749, HDFS-10750, HDFS-10751, HDFS-10

[jira] [Updated] (HDFS-10752) Several log refactoring/improvement suggestion in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemo Chen updated HDFS-10752: - Description: As per conversation with [~vrushalic], we merged HDFS-10749, HDFS-10750, HDFS-10751, HDFS-10

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419709#comment-15419709 ] Hadoop QA commented on HDFS-9696: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419682#comment-15419682 ] Jitendra Nath Pandey commented on HDFS-10757: - [~asuresh], thanks for explaini

[jira] [Updated] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9696: - Attachment: HDFS-9696.v2.patch > Garbage snapshot records lingering forever > -

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419584#comment-15419584 ] Kihwal Lee commented on HDFS-9696: -- It looks like these tests failed because the snapshot

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419494#comment-15419494 ] Tsz Wo Nicholas Sze commented on HDFS-9696: --- The test failures seem related. Ple

[jira] [Commented] (HDFS-10747) o.a.h.hdfs.tools.DebugAdmin usage message is misleading

[ https://issues.apache.org/jira/browse/HDFS-10747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419480#comment-15419480 ] Mingliang Liu commented on HDFS-10747: -- Thanks for the review, [~jojochuang]. > o.a.

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419449#comment-15419449 ] Hadoop QA commented on HDFS-9696: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9696: - Attachment: HDFS-9696.patch Attaching a patch containing a unit test. > Garbage snapshot records lingerin

[jira] [Updated] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9696: - Status: Patch Available (was: Reopened) > Garbage snapshot records lingering forever > ---

[jira] [Commented] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419311#comment-15419311 ] Hadoop QA commented on HDFS-10760: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419293#comment-15419293 ] Virajith Jalaparti commented on HDFS-10636: --- Hi [~eddyxu], Thank you for the c

[jira] [Commented] (HDFS-10755) TestDecommissioningStatus BindException Failure

[ https://issues.apache.org/jira/browse/HDFS-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419248#comment-15419248 ] Eric Badger commented on HDFS-10755: The pre-commit test failure is unrelated to the p

[jira] [Commented] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419234#comment-15419234 ] Arun Suresh commented on HDFS-10757: Hmmm... I think I remember the context for why it

[jira] [Comment Edited] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419234#comment-15419234 ] Arun Suresh edited comment on HDFS-10757 at 8/12/16 6:09 PM: -

[jira] [Commented] (HDFS-10746) libhdfs++: synchronize access to working_directory and bytes_read_.

[ https://issues.apache.org/jira/browse/HDFS-10746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419201#comment-15419201 ] Hadoop QA commented on HDFS-10746: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-10760: Status: Patch Available (was: Open) > DataXceiver#run() should not log InvalidToken excepti

[jira] [Updated] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-10760: Assignee: Pan Yuxuan > DataXceiver#run() should not log InvalidToken exception as an error >

[jira] [Moved] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved HADOOP-13492 to HDFS-10760: -- Affects Version/s: (was: 3.0.0-alpha1)

[jira] [Commented] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419141#comment-15419141 ] James Clampffer commented on HDFS-10679: Awesome patch! Your benchmarks demonstrat

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419139#comment-15419139 ] Tsz Wo Nicholas Sze commented on HDFS-9696: --- [~kihwal], the idea is simple and gr

[jira] [Updated] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9696: - Target Version/s: 2.6.5, 2.7.4 > Garbage snapshot records lingering forever > -

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419099#comment-15419099 ] Kihwal Lee commented on HDFS-9696: -- Does something like this make sense? Saving a diff se

[jira] [Assigned] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-9696: Assignee: Kihwal Lee > Garbage snapshot records lingering forever >

[jira] [Updated] (HDFS-10746) libhdfs++: synchronize access to working_directory and bytes_read_.

[ https://issues.apache.org/jira/browse/HDFS-10746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10746: - Attachment: HDFS-10746.HDFS-8707.001.patch Reattaching for a CI run > libhdfs++: synchronize acce

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419080#comment-15419080 ] Kihwal Lee commented on HDFS-9696: -- One basic sanity check can be done for cases where the

[jira] [Commented] (HDFS-10746) libhdfs++: synchronize access to working_directory and bytes_read_.

[ https://issues.apache.org/jira/browse/HDFS-10746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419077#comment-15419077 ] James Clampffer commented on HDFS-10746: Looks good to me, +1. Will commit once C

[jira] [Updated] (HDFS-10740) libhdfs++: Implement recursive directory generator

[ https://issues.apache.org/jira/browse/HDFS-10740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10740: --- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: Implement recu

[jira] [Commented] (HDFS-10740) libhdfs++: Implement recursive directory generator

[ https://issues.apache.org/jira/browse/HDFS-10740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419033#comment-15419033 ] James Clampffer commented on HDFS-10740: Committed to HDFS-8707. Thanks [~anatoli

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419007#comment-15419007 ] Yongjun Zhang commented on HDFS-9696: - Thanks for the info [~kihwal]! > Garbage snaps

[jira] [Created] (HDFS-10759) Change fsimage bool isStriped from boolean to an enum

Ewan Higgs created HDFS-10759: - Summary: Change fsimage bool isStriped from boolean to an enum Key: HDFS-10759 URL: https://issues.apache.org/jira/browse/HDFS-10759 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-10755) TestDecommissioningStatus BindException Failure

[ https://issues.apache.org/jira/browse/HDFS-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418985#comment-15418985 ] Hadoop QA commented on HDFS-10755: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10758) ReconfigurableBase can log sensitive information

[ https://issues.apache.org/jira/browse/HDFS-10758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418982#comment-15418982 ] Sean Busbey commented on HDFS-10758: bq. I think a generic mechanism for redacting se

[jira] [Created] (HDFS-10758) ReconfigurableBase can log sensitive information

Sean Mackrory created HDFS-10758: Summary: ReconfigurableBase can log sensitive information Key: HDFS-10758 URL: https://issues.apache.org/jira/browse/HDFS-10758 Project: Hadoop HDFS Issue Ty

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418942#comment-15418942 ] Kihwal Lee commented on HDFS-9696: -- It turns out that HDFS-9406 is not related to this iss

[jira] [Reopened] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reopened HDFS-9696: -- Assignee: (was: Yongjun Zhang) > Garbage snapshot records lingering forever > -

[jira] [Updated] (HDFS-10755) TestDecommissioningStatus BindException Failure

[ https://issues.apache.org/jira/browse/HDFS-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10755: --- Attachment: HDFS-10755.002.patch Attaching patch to address the checkstyle comments. Both of the test

[jira] [Commented] (HDFS-10747) o.a.h.hdfs.tools.DebugAdmin usage message is misleading

[ https://issues.apache.org/jira/browse/HDFS-10747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418830#comment-15418830 ] Wei-Chiu Chuang commented on HDFS-10747: Yes the usage is misleading. Thanks [~liu

[jira] [Commented] (HDFS-10731) FSDirectory#verifyMaxDirItems does not log path name

[ https://issues.apache.org/jira/browse/HDFS-10731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418813#comment-15418813 ] Hudson commented on HDFS-10731: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10268 (See [ht

[jira] [Updated] (HDFS-10731) FSDirectory#verifyMaxDirItems does not log path name

[ https://issues.apache.org/jira/browse/HDFS-10731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10731: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Availabl

[jira] [Assigned] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat

[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein reassigned HDFS-10754: Assignee: Anatoli Shein > libhdfs++: Create tools directory and implement hdfs_cat > --

[jira] [Commented] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418759#comment-15418759 ] Wei-Chiu Chuang commented on HDFS-10609: [~xiaochen] would you mind to take a look

[jira] [Updated] (HDFS-8312) Trash does not descent into child directories to check for permissions

[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-8312: -- Priority: Critical (was: Major) > Trash does not descent into child directories to check for permissions

[jira] [Commented] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418409#comment-15418409 ] Jitendra Nath Pandey commented on HDFS-10757: - I think storing the {{actualU

[jira] [Updated] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8668: Attachment: HDFS-8668-v9.patch > Erasure Coding: revisit buffer used for encoding and decoding. > ---

[jira] [Commented] (HDFS-8312) Trash does not descent into child directories to check for permissions

[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418538#comment-15418538 ] Weiwei Yang commented on HDFS-8312: --- Attached a test case demonstrated this issue, see [^

[jira] [Updated] (HDFS-8312) Trash does not descent into child directories to check for permissions

[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-8312: -- Attachment: HDFS-8312-testcase.patch > Trash does not descent into child directories to check for permiss

[jira] [Commented] (HDFS-9530) ReservedSpace is not cleared for abandoned Blocks

[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418460#comment-15418460 ] Brahma Reddy Battula commented on HDFS-9530: Ok.thanks for feedback allen. > R

[jira] [Commented] (HDFS-9530) ReservedSpace is not cleared for abandoned Blocks

[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418458#comment-15418458 ] Brahma Reddy Battula commented on HDFS-9530: Ok.. thanks arpit.. Even I ran bef

[jira] [Commented] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418447#comment-15418447 ] Jitendra Nath Pandey commented on HDFS-10757: - If the currentUgi is a proxy us