[jira] [Commented] (HDFS-12925) Ozone: Container : Add key versioning support-2

2017-12-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293667#comment-16293667 ] genericqa commented on HDFS-12925: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-12-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293664#comment-16293664 ] genericqa commented on HDFS-12292: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12933) Improve logging when DFSStripedOutputStream failed to read some blocks

2017-12-15 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-12933: Summary: Improve logging when DFSStripedOutputStream failed to read some blocks Key: HDFS-12933 URL: https://issues.apache.org/jira/browse/HDFS-12933 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12904) Add DataTransferThrottler to the Datanode transfers

2017-12-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293654#comment-16293654 ] genericqa commented on HDFS-12904: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12779) [READ] Allow cluster id to be specified to the Image generation tool

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293597#comment-16293597 ] Hudson commented on HDFS-12779: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12912) [READ] Fix configuration and implementation of LevelDB-based alias maps

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293614#comment-16293614 ] Hudson commented on HDFS-12912: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12605) [READ] TestNameNodeProvidedImplementation#testProvidedDatanodeFailures fails after rebase

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293591#comment-16293591 ] Hudson commented on HDFS-12605: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12874) [READ] Documentation for provided storage

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293611#comment-16293611 ] Hudson commented on HDFS-12874: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12905) [READ] Handle decommissioning and under-maintenance Datanodes with Provided storage.

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293612#comment-16293612 ] Hudson commented on HDFS-12905: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293602#comment-16293602 ] Hudson commented on HDFS-12685: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12778) [READ] Report multiple locations for PROVIDED blocks

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293600#comment-16293600 ] Hudson commented on HDFS-12778: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12789) [READ] Image generation tool does not close an opened stream

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293595#comment-16293595 ] Hudson commented on HDFS-12789: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12887) [READ] Allow Datanodes with Provided volumes to start when blocks with the same id exist locally

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293609#comment-16293609 ] Hudson commented on HDFS-12887: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12712) [9806] Code style cleanup

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293615#comment-16293615 ] Hudson commented on HDFS-12712: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12885) Add visibility/stability annotations

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293605#comment-16293605 ] Hudson commented on HDFS-12885: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12776) [READ] Increasing replication for PROVIDED files should create local replicas

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293596#comment-16293596 ] Hudson commented on HDFS-12776: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293592#comment-16293592 ] Hudson commented on HDFS-11902: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12894) [READ] Skip setting block count of ProvidedDatanodeStorageInfo on DN registration update

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293607#comment-16293607 ] Hudson commented on HDFS-12894: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293603#comment-16293603 ] Hudson commented on HDFS-12665: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12893) [READ] Support replication of Provided blocks with non-default topologies.

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293613#comment-16293613 ] Hudson commented on HDFS-12893: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293606#comment-16293606 ] Hudson commented on HDFS-12713: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12775) [READ] Fix reporting of Provided volumes

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293599#comment-16293599 ] Hudson commented on HDFS-12775: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12903) [READ] Fix closing streams in ImageWriter

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293610#comment-16293610 ] Hudson commented on HDFS-12903: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293601#comment-16293601 ] Hudson commented on HDFS-12809: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-11640) [READ] Datanodes should use a unique identifier when reading from external stores

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293608#comment-16293608 ] Hudson commented on HDFS-11640: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12591) [READ] Implement LevelDBFileRegionFormat

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293604#comment-16293604 ] Hudson commented on HDFS-12591: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12671) [READ] Test NameNode restarts when PROVIDED is configured

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293594#comment-16293594 ] Hudson commented on HDFS-12671: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293598#comment-16293598 ] Hudson commented on HDFS-12777: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293593#comment-16293593 ] Hudson commented on HDFS-12607: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12289) [READ] HDFS-12091 breaks the tests for provided block reads

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293588#comment-16293588 ] Hudson commented on HDFS-12289: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-11673) [READ] Handle failures of Datanode with PROVIDED storage

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293585#comment-16293585 ] Hudson commented on HDFS-11673: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12584) [READ] Fix errors in image generation tool from latest rebase

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293590#comment-16293590 ] Hudson commented on HDFS-12584: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-11791) [READ] Test for increasing replication of provided files.

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293583#comment-16293583 ] Hudson commented on HDFS-11791: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12091) [READ] Check that the replicas served from a {{ProvidedVolumeImpl}} belong to the correct external storage

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293586#comment-16293586 ] Hudson commented on HDFS-12091: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-10706) [READ] Add tool generating FSImage from external store

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293578#comment-16293578 ] Hudson commented on HDFS-10706: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-11653) [READ] ProvidedReplica should return an InputStream that is bounded by its length

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293580#comment-16293580 ] Hudson commented on HDFS-11653: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-11792) [READ] Test cases for ProvidedVolumeDF and ProviderBlockIteratorImpl

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293584#comment-16293584 ] Hudson commented on HDFS-11792: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-12093) [READ] Share remoteFS between ProvidedReplica instances.

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293587#comment-16293587 ] Hudson commented on HDFS-12093: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-11703) [READ] Tests for ProvidedStorageMap

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293582#comment-16293582 ] Hudson commented on HDFS-11703: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-11663) [READ] Fix NullPointerException in ProvidedBlocksBuilder

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293581#comment-16293581 ] Hudson commented on HDFS-11663: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-11190) [READ] Namenode support for data stored in external stores.

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293579#comment-16293579 ] Hudson commented on HDFS-11190: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Commented] (HDFS-10675) [READ] Datanode support to read from external stores.

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293577#comment-16293577 ] Hudson commented on HDFS-10675: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13391 (See

[jira] [Updated] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

2017-12-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-9806: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Target

[jira] [Commented] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

2017-12-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293569#comment-16293569 ] Chris Douglas commented on HDFS-9806: - The merge vote [passed|https://s.apache.org/tqLt] Merged to

[jira] [Updated] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

2017-12-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-9806: Release Note: Provided storage allows data stored outside HDFS to be mapped to and addressed from

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-12-15 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293558#comment-16293558 ] KaiXinXIaoLei commented on HDFS-12292: -- I also meet this problem by running "hdfs dfsadmin -safemode

[jira] [Commented] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

2017-12-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293555#comment-16293555 ] Junping Du commented on HDFS-12920: --- bq. An alternative to reverting the change is to deprecate the old

[jira] [Resolved] (HDFS-12903) [READ] Fix closing streams in ImageWriter

2017-12-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas resolved HDFS-12903. -- Resolution: Fixed > [READ] Fix closing streams in ImageWriter >

[jira] [Issue Comment Deleted] (HDFS-12903) [READ] Fix closing streams in ImageWriter

2017-12-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12903: - Comment: was deleted (was: Checked locally, this suppresses the warning correctly. Reverted the

[jira] [Commented] (HDFS-12903) [READ] Fix closing streams in ImageWriter

2017-12-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293550#comment-16293550 ] Chris Douglas commented on HDFS-12903: -- Checked locally, this suppresses the warning correctly.

[jira] [Commented] (HDFS-12903) [READ] Fix closing streams in ImageWriter

2017-12-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293547#comment-16293547 ] Chris Douglas commented on HDFS-12903: -- Checked locally, this suppresses the warning correctly.

[jira] [Updated] (HDFS-12903) [READ] Fix closing streams in ImageWriter

2017-12-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12903: - Attachment: HDFS-12903-HDFS-9806.002.patch > [READ] Fix closing streams in ImageWriter >

[jira] [Resolved] (HDFS-12929) There is error message when hdfs dfsadmin is run against a ViewFS config

2017-12-15 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei resolved HDFS-12929. -- Resolution: Duplicate https://issues.apache.org/jira/browse/HDFS-12292 > There is error

[jira] [Commented] (HDFS-12903) [READ] Fix closing streams in ImageWriter

2017-12-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293542#comment-16293542 ] Chris Douglas commented on HDFS-12903: -- This reappears in spotbugs 3.1.1. It's spurious, as

[jira] [Reopened] (HDFS-12903) [READ] Fix closing streams in ImageWriter

2017-12-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas reopened HDFS-12903: -- > [READ] Fix closing streams in ImageWriter > - > >

[jira] [Updated] (HDFS-12904) Add DataTransferThrottler to the Datanode transfers

2017-12-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12904: --- Attachment: HDFS-12904.002.patch > Add DataTransferThrottler to the Datanode transfers >

[jira] [Commented] (HDFS-12904) Add DataTransferThrottler to the Datanode transfers

2017-12-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293524#comment-16293524 ] Íñigo Goiri commented on HDFS-12904: Actually, [~lukmajercak] and [~thinktaocs] went through the code

[jira] [Updated] (HDFS-12925) Ozone: Container : Add key versioning support-2

2017-12-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12925: -- Attachment: HDFS-12925-HDFS-7240.004.patch Latest Jenkins build failed again, resubmit v003 patch as

[jira] [Commented] (HDFS-3745) fsck prints that it's using KSSL even when it's in fact using SPNEGO for authentication

2017-12-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293509#comment-16293509 ] genericqa commented on HDFS-3745: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-12-15 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293428#comment-16293428 ] Misha Dmitriev commented on HDFS-12051: --- There are some test failures again. They seem unrelated -

[jira] [Commented] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

2017-12-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293424#comment-16293424 ] Arpit Agarwal commented on HDFS-12920: -- [~djp], does presence of any unit-suffixed values in the

[jira] [Created] (HDFS-12932) Confusing LOG message for block replication

2017-12-15 Thread Chao Sun (JIRA)
Chao Sun created HDFS-12932: --- Summary: Confusing LOG message for block replication Key: HDFS-12932 URL: https://issues.apache.org/jira/browse/HDFS-12932 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-12-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293395#comment-16293395 ] genericqa commented on HDFS-12051: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12925) Ozone: Container : Add key versioning support-2

2017-12-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293378#comment-16293378 ] genericqa commented on HDFS-12925: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12641) Backport HDFS-11755 into branch-2.7 to fix a regression in HDFS-11445

2017-12-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293370#comment-16293370 ] genericqa commented on HDFS-12641: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12917) Fix description errors in testErasureCodingConf.xml

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293332#comment-16293332 ] Hudson commented on HDFS-12917: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13389 (See

[jira] [Updated] (HDFS-12917) Fix description errors in testErasureCodingConf.xml

2017-12-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12917: -- Resolution: Fixed Target Version/s: 3.1.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-12917) Fix description errors in testErasureCodingConf.xml

2017-12-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293301#comment-16293301 ] Chen Liang commented on HDFS-12917: --- Thanks [~candychencan] for the updated patch! +1 on v002 patch,

[jira] [Assigned] (HDFS-12917) Fix description errors in testErasureCodingConf.xml

2017-12-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-12917: - Assignee: chencan > Fix description errors in testErasureCodingConf.xml >

[jira] [Updated] (HDFS-12925) Ozone: Container : Add key versioning support-2

2017-12-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12925: -- Attachment: HDFS-12925-HDFS-7240.003.patch v003 patch fixes the checkstyle and javadoc issue, findbug

[jira] [Comment Edited] (HDFS-12925) Ozone: Container : Add key versioning support-2

2017-12-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293273#comment-16293273 ] Chen Liang edited comment on HDFS-12925 at 12/15/17 9:31 PM: - v003 patch fixes

[jira] [Updated] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-12881: -- Resolution: Fixed Fix Version/s: 2.7.6 2.8.4 2.9.1

[jira] [Commented] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293222#comment-16293222 ] Jason Lowe commented on HDFS-12881: --- Thanks for the branch-2 patch! +1 lgtm. I agree the unit tests

[jira] [Commented] (HDFS-10477) Stop decommission a rack of DataNodes caused NameNode fail over to standby

2017-12-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293196#comment-16293196 ] genericqa commented on HDFS-10477: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10614) Appended blocks can be closed even before IBRs from DataNodes

2017-12-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293195#comment-16293195 ] genericqa commented on HDFS-10614: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10348) Namenode report bad block method doesn't check whether the block belongs to datanode before adding it to corrupt replicas map.

2017-12-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293193#comment-16293193 ] genericqa commented on HDFS-10348: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-12-15 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Attachment: HDFS-12051.05.patch > Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to

[jira] [Updated] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-12-15 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Status: Patch Available (was: In Progress) > Intern INOdeFileAttributes$SnapshotCopy.name

[jira] [Updated] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-12-15 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Status: In Progress (was: Patch Available) > Intern INOdeFileAttributes$SnapshotCopy.name

[jira] [Commented] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-12-15 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293109#comment-16293109 ] Misha Dmitriev commented on HDFS-12051: --- Test failures above (some with OOM) look rather strange. I

[jira] [Commented] (HDFS-12904) Add DataTransferThrottler to the Datanode transfers

2017-12-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293097#comment-16293097 ] genericqa commented on HDFS-12904: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

2017-12-15 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293090#comment-16293090 ] genericqa commented on HDFS-12818: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12070) Failed block recovery leaves files open indefinitely and at risk for data loss

2017-12-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292994#comment-16292994 ] Kihwal Lee edited comment on HDFS-12070 at 12/15/17 7:20 PM: - To complete the

[jira] [Commented] (HDFS-12799) Ozone: SCM: Close containers: extend SCMCommandResponseProto with SCMCloseContainerCmdResponseProto

2017-12-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293035#comment-16293035 ] Chen Liang commented on HDFS-12799: --- Thanks [~elek] for the update! Looks like there were compilation

[jira] [Commented] (HDFS-12927) Update erasure coding doc to address unsupported APIs

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293020#comment-16293020 ] Hudson commented on HDFS-12927: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13388 (See

[jira] [Updated] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

2017-12-15 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9806: - Status: Patch Available (was: Open) > Allow HDFS block replicas to be provided by an

[jira] [Updated] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

2017-12-15 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9806: - Attachment: HDFS-9806.003.patch Posting a rebased patch with all changes in HDFS-9806

[jira] [Assigned] (HDFS-12070) Failed block recovery leaves files open indefinitely and at risk for data loss

2017-12-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-12070: - Assignee: Kihwal Lee > Failed block recovery leaves files open indefinitely and at risk for data

[jira] [Commented] (HDFS-12070) Failed block recovery leaves files open indefinitely and at risk for data loss

2017-12-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292994#comment-16292994 ] Kihwal Lee commented on HDFS-12070: --- To complete the history lesson, I traced down when {{closeFile}}

[jira] [Updated] (HDFS-12927) Update erasure coding doc to address unsupported APIs

2017-12-15 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12927: - Resolution: Fixed Fix Version/s: 3.0.1 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12819) Setting/Unsetting EC policy shows warning if the directory is not empty

2017-12-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292974#comment-16292974 ] Hudson commented on HDFS-12819: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13387 (See

[jira] [Commented] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-15 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292963#comment-16292963 ] Ajay Kumar commented on HDFS-12881: --- All test failures for branch-2 passed locally. > Output streams

[jira] [Assigned] (HDFS-12885) Add visibility/stability annotations

2017-12-15 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti reassigned HDFS-12885: - Assignee: Chris Douglas > Add visibility/stability annotations >

[jira] [Updated] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

2017-12-15 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9806: - Status: Open (was: Patch Available) > Allow HDFS block replicas to be provided by an

[jira] [Commented] (HDFS-12712) [9806] Code style cleanup

2017-12-15 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292962#comment-16292962 ] Virajith Jalaparti commented on HDFS-12712: --- Thanks for taking a look [~elgoiri]. Committing

[jira] [Updated] (HDFS-12712) [9806] Code style cleanup

2017-12-15 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12712: -- Resolution: Fixed Status: Resolved (was: Patch Available) > [9806] Code style

[jira] [Updated] (HDFS-12819) Setting/Unsetting EC policy shows warning if the directory is not empty

2017-12-15 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12819: - Resolution: Fixed Fix Version/s: 3.0.1 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12712) [9806] Code style cleanup

2017-12-15 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292939#comment-16292939 ] Íñigo Goiri commented on HDFS-12712: Not sure why Yetus is giving all the deprecations on earth but

[jira] [Comment Edited] (HDFS-12070) Failed block recovery leaves files open indefinitely and at risk for data loss

2017-12-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292929#comment-16292929 ] Kihwal Lee edited comment on HDFS-12070 at 12/15/17 5:59 PM: - bq. the PD needs

[jira] [Commented] (HDFS-12070) Failed block recovery leaves files open indefinitely and at risk for data loss

2017-12-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16292929#comment-16292929 ] Kihwal Lee commented on HDFS-12070: --- bq. the PD needs to ... tell the namenode to exclude the failed

  1   2   >