[jira] [Updated] (HDFS-10172) hdfs erasurecode command should remove the redundant -usage option

[ https://issues.apache.org/jira/browse/HDFS-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10172: --- Labels: newbie (was: ) > hdfs erasurecode command should remove the redundant -usage option > ---

[jira] [Commented] (HDFS-9857) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]

[ https://issues.apache.org/jira/browse/HDFS-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197486#comment-15197486 ] Zhe Zhang commented on HDFS-9857: - Thanks Rakesh for the update. {{testMetasaveAfterDelete}

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198253#comment-15198253 ] Arpit Agarwal commented on HDFS-3702: - Hi Andrew, there is still much plumbing required

[jira] [Commented] (HDFS-9857) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]

[ https://issues.apache.org/jira/browse/HDFS-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198435#comment-15198435 ] Zhe Zhang commented on HDFS-9857: - Thanks Rakesh, +1 on the patch and I'll commit shortly.

[jira] [Updated] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9847: Attachment: HDFS-9847.006.patch > HDFS configuration without time unit name should accept friendly time units

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203088#comment-15203088 ] Lin Yiqun commented on HDFS-9847: - Thanks [~arpiagariu] for review. {quote} Up-converting a

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203081#comment-15203081 ] Yongjun Zhang commented on HDFS-9820: - A hopefully improved version is on the way ...

[jira] [Commented] (HDFS-3677) dfs.namenode.edits.dir.required missing from hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201702#comment-15201702 ] Akira AJISAKA commented on HDFS-3677: - The test failures look unrelated to the patch. C

[jira] [Commented] (HDFS-9405) When starting a file, NameNode should generate EDEK in a separate thread

[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1519#comment-1519 ] Hadoop QA commented on HDFS-9405: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9949) Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is cleared

[ https://issues.apache.org/jira/browse/HDFS-9949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9949: --- Summary: Add a test case to ensure that the DataNode does not regenerate its UUID when

[jira] [Commented] (HDFS-10173) Typo in DataXceiverServer

[ https://issues.apache.org/jira/browse/HDFS-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197761#comment-15197761 ] Michael Han commented on HDFS-10173: [~andrew.wang] PTAL > Typo in DataXceiverServer

[jira] [Commented] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198596#comment-15198596 ] Kai Zheng commented on HDFS-9694: - Thanks [~umamaheswararao] for the reminding! I had thoug

[jira] [Updated] (HDFS-3677) dfs.namenode.edits.dir.required missing from hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-3677: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Com

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197327#comment-15197327 ] Hadoop QA commented on HDFS-9847: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (HDFS-3316) jsvc should be listed as a dependency for "package" and "bin-package"

[ https://issues.apache.org/jira/browse/HDFS-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-3316. Resolution: Won't Fix closing as stale, as branch-1 is effectively EOLed. > jsvc should be

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200335#comment-15200335 ] Andrew Wang commented on HDFS-10175: Hi [~liuml07], we spent some effort optimizing th

[jira] [Updated] (HDFS-8673) HDFS reports file already exists if there is a file/dir name end with ._COPYING_

[ https://issues.apache.org/jira/browse/HDFS-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated HDFS-8673: -- Attachment: HADOOP-8673.004.patch Sorry about the lateness. I add warning messages "Please delete it first" in t

[jira] [Updated] (HDFS-9405) When starting a file, NameNode should generate EDEK in a separate thread

[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9405: Attachment: HDFS-9405.08.patch > When starting a file, NameNode should generate EDEK in a separate thread > -

[jira] [Updated] (HDFS-9952) Expose FSNamesystem lock wait time as metrics

[ https://issues.apache.org/jira/browse/HDFS-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9952: Attachment: HDFS-9952-03.patch > Expose FSNamesystem lock wait time as metrics >

[jira] [Commented] (HDFS-10173) Typo in DataXceiverServer

[ https://issues.apache.org/jira/browse/HDFS-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198049#comment-15198049 ] Andrew Wang commented on HDFS-10173: LGTM to me too, thanks for the find and fix Micha

[jira] [Commented] (HDFS-9885) In distcp cmd ouput, Display name should be given for org.apache.hadoop.tools.mapred.CopyMapper$Counter.

[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200092#comment-15200092 ] John Zhuge commented on HDFS-9885: -- My bad, it seems "_" is necessary because {{org.apach

[jira] [Commented] (HDFS-9634) webhdfs client side exceptions don't provide enough details

[ https://issues.apache.org/jira/browse/HDFS-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202068#comment-15202068 ] Eric Payne commented on HDFS-9634: -- [~jojochuang], Thanks for reviewing the functionality

[jira] [Commented] (HDFS-10177) a wrong number of the bytes read are copied into native buffer in hdfsRead()

[ https://issues.apache.org/jira/browse/HDFS-10177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203020#comment-15203020 ] Gabor Liptak commented on HDFS-10177: - Also present in {{hadoop-hdfs-project/hadoop-h

[jira] [Updated] (HDFS-9874) Long living DataXceiver threads cause volume shutdown to block.

[ https://issues.apache.org/jira/browse/HDFS-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9874: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved (was:

[jira] [Commented] (HDFS-10183) Prevent race condition during class initialization

[ https://issues.apache.org/jira/browse/HDFS-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201814#comment-15201814 ] Daryn Sharp commented on HDFS-10183: No disagreement with the change, but just curious

[jira] [Created] (HDFS-10174) Add HTrace support to the Balancer

Colin Patrick McCabe created HDFS-10174: --- Summary: Add HTrace support to the Balancer Key: HDFS-10174 URL: https://issues.apache.org/jira/browse/HDFS-10174 Project: Hadoop HDFS Issue Ty

[jira] [Commented] (HDFS-9405) When starting a file, NameNode should generate EDEK in a separate thread

[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198161#comment-15198161 ] Xiao Chen commented on HDFS-9405: - Thanks Andrew. Will address the comments, except: bq. Do

[jira] [Updated] (HDFS-7661) Erasure coding: support hflush and hsync

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7661: -- Issue Type: New Feature (was: Sub-task) Parent: (was: HDFS-8031) > Erasure c

[jira] [Created] (HDFS-10181) TestHFlush frequently fails due to theadInterrupt

Lin Yiqun created HDFS-10181: Summary: TestHFlush frequently fails due to theadInterrupt Key: HDFS-10181 URL: https://issues.apache.org/jira/browse/HDFS-10181 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-9885) In distcp cmd ouput, Display name should be given for org.apache.hadoop.tools.mapred.CopyMapper$Counter.

[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9885: - Affects Version/s: 2.7.1 Status: Patch Available (was: Open) > In d

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197652#comment-15197652 ] Yongjun Zhang commented on HDFS-9940: - Hi [~jzhuge], I like 2) too. Thanks for bringin

[jira] [Commented] (HDFS-9809) Abstract implementation-specific details from the datanode

[ https://issues.apache.org/jira/browse/HDFS-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202333#comment-15202333 ] Virajith Jalaparti commented on HDFS-9809: -- The motivation behind this JIRA is HDF

[jira] [Updated] (HDFS-10182) Hedged read might overwrite user's buf

[ https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-10182: Description: In DFSInputStream::hedgedFetchBlockByteRange, during the first attempt, the passed-in

[jira] [Commented] (HDFS-9956) LDAP PERFORMANCE ISSUE AND FAIL OVER

[ https://issues.apache.org/jira/browse/HDFS-9956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197274#comment-15197274 ] sanjay kenganahalli vamanna commented on HDFS-9956: --- Allen, Thanks for re

[jira] [Updated] (HDFS-10173) Typo in DataXceiverServer

[ https://issues.apache.org/jira/browse/HDFS-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Han updated HDFS-10173: --- Attachment: HDFS-10173.1.patch > Typo in DataXceiverServer > - > >

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198105#comment-15198105 ] Yongjun Zhang commented on HDFS-9940: - Thanks Nicholas. See {code} commit 9d817fa1b14b

[jira] [Commented] (HDFS-10178) Permanent write failures can happen if pipeline recoveries occur for the first packet

[ https://issues.apache.org/jira/browse/HDFS-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200948#comment-15200948 ] Hadoop QA commented on HDFS-10178: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201011#comment-15201011 ] Tsz Wo Nicholas Sze commented on HDFS-3702: --- How about adding the local node to t

[jira] [Updated] (HDFS-9949) Testcase for catching DN UUID regeneration regression

[ https://issues.apache.org/jira/browse/HDFS-9949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-9949: -- Description: In the following scenario, in releases without HDFS-8211, the DN may regenerate its UUIDs unintenti

[jira] [Commented] (HDFS-10179) Ozone: Adding logging support

[ https://issues.apache.org/jira/browse/HDFS-10179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200740#comment-15200740 ] Anu Engineer commented on HDFS-10179: - Here is an example of how the logs look like, F

[jira] [Commented] (HDFS-9860) Backport HDFS-9638 to branch-2.7.

[ https://issues.apache.org/jira/browse/HDFS-9860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197818#comment-15197818 ] Akira AJISAKA commented on HDFS-9860: - Committed this to branch-2.7. Thanks [~jojochuan

[jira] [Commented] (HDFS-10183) Prevent race condition during class initialization

[ https://issues.apache.org/jira/browse/HDFS-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201793#comment-15201793 ] Chris Nauroth commented on HDFS-10183: -- [~pavgustinov], very nice find. Thank you fo

[jira] [Commented] (HDFS-8840) Inconsistent log level practice

[ https://issues.apache.org/jira/browse/HDFS-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198320#comment-15198320 ] songwanging commented on HDFS-8840: --- I Quickly check all hadoop source files using my aut

[jira] [Updated] (HDFS-10179) Ozone: Adding logging support

[ https://issues.apache.org/jira/browse/HDFS-10179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10179: - Fix Version/s: HDFS-7240 > Ozone: Adding logging support > - > >

[jira] [Commented] (HDFS-10180) Ozone: Refactor container Namespace

[ https://issues.apache.org/jira/browse/HDFS-10180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200981#comment-15200981 ] Hadoop QA commented on HDFS-10180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Work started] (HDFS-10173) Typo in DataXceiverServer

[ https://issues.apache.org/jira/browse/HDFS-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10173 started by Michael Han. -- > Typo in DataXceiverServer > - > > Key: HDFS

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202974#comment-15202974 ] Hudson commented on HDFS-9579: -- FAILURE: Integrated in Hadoop-trunk-Commit #9478 (See [https:

[jira] [Updated] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9847: Attachment: HDFS-9847.005.patch The failed unit tests look many, but it seems not related, update the patch f

[jira] [Commented] (HDFS-9959) add log when block removed from last live datanode

[ https://issues.apache.org/jira/browse/HDFS-9959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202137#comment-15202137 ] yunjiong zhao commented on HDFS-9959: - I understand, thanks. > add log when block remo

[jira] [Updated] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-9579: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (wa

[jira] [Updated] (HDFS-10179) Ozone: Adding logging support

[ https://issues.apache.org/jira/browse/HDFS-10179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10179: - Resolution: Fixed Status: Resolved (was: Patch Available) I confirmed that the test failu

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198077#comment-15198077 ] Tsz Wo Nicholas Sze commented on HDFS-9940: --- {quote} Per the current implementati

[jira] [Commented] (HDFS-9952) Expose FSNamesystem lock wait time as metrics

[ https://issues.apache.org/jira/browse/HDFS-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197587#comment-15197587 ] Vinayakumar B commented on HDFS-9952: - Thanks [~daryn] for review. bq. I'm not sure if

[jira] [Updated] (HDFS-9960) OzoneHandler : Add localstorage support for keys

[ https://issues.apache.org/jira/browse/HDFS-9960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9960: Resolution: Fixed Status: Resolved (was: Patch Available) I confirmed that the test failures

[jira] [Commented] (HDFS-9885) In distcp cmd ouput, Display name should be given for org.apache.hadoop.tools.mapred.CopyMapper$Counter.

[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199344#comment-15199344 ] Surendra Singh Lilhore commented on HDFS-9885: -- After v1 patch distcp job outp

[jira] [Updated] (HDFS-10182) Hedged read might overwrite user's buf

[ https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-10182: Description: In DFSInputStream::hedgedFetchBlockByteRange, during the first attempt, the passed-in

[jira] [Commented] (HDFS-10179) Ozone: Adding logging support

[ https://issues.apache.org/jira/browse/HDFS-10179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201023#comment-15201023 ] Hadoop QA commented on HDFS-10179: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9820: Status: Patch Available (was: Open) > Improve distcp to support efficient restore to an earlier snap

[jira] [Commented] (HDFS-9860) Update Documentation for HADOOP-11009

[ https://issues.apache.org/jira/browse/HDFS-9860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197810#comment-15197810 ] Akira AJISAKA commented on HDFS-9860: - LGTM, +1. > Update Documentation for HADOOP-110

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200103#comment-15200103 ] Mingliang Liu commented on HDFS-7661: - According to the current design, we need to brea

[jira] [Commented] (HDFS-10173) Typo in DataXceiverServer

[ https://issues.apache.org/jira/browse/HDFS-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198033#comment-15198033 ] Aaron Fabbri commented on HDFS-10173: - +1 > Typo in DataXceiverServer > -

[jira] [Updated] (HDFS-3677) dfs.namenode.edits.dir.required missing from hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-3677: Hadoop Flags: Reviewed Target Version/s: 2.8.0 Status: Patch Available (was: Op

[jira] [Commented] (HDFS-10181) TestHFlush frequently fails due to theadInterrupt

[ https://issues.apache.org/jira/browse/HDFS-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201207#comment-15201207 ] Hadoop QA commented on HDFS-10181: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-9405) Warmup NameNode EDEK caches in background thread

[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9405: Attachment: HDFS-9405.12.patch Patch 12 to fix the above. Thanks again Andrew. > Warmup NameNode EDEK caches

[jira] [Commented] (HDFS-9952) Expose FSNamesystem lock wait time as metrics

[ https://issues.apache.org/jira/browse/HDFS-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201224#comment-15201224 ] Hadoop QA commented on HDFS-9952: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-7648) Verify that HDFS blocks are in the correct datanode directories

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201941#comment-15201941 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- Agree that it should print out the a

[jira] [Commented] (HDFS-9405) Warmup NameNode EDEK caches in background thread

[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202174#comment-15202174 ] Andrew Wang commented on HDFS-9405: --- Aha, I see. I think we can pass the fields in as par

[jira] [Commented] (HDFS-9857) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]

[ https://issues.apache.org/jira/browse/HDFS-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198339#comment-15198339 ] Hadoop QA commented on HDFS-9857: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9960) OzoneHandler : Add localstorage support for keys

[ https://issues.apache.org/jira/browse/HDFS-9960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201020#comment-15201020 ] Hadoop QA commented on HDFS-9960: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10178) Permanent write failures can happen if pipeline recoveries occur for the first packet

[ https://issues.apache.org/jira/browse/HDFS-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201813#comment-15201813 ] Hadoop QA commented on HDFS-10178: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198193#comment-15198193 ] James Clampffer commented on HDFS-9118: --- bq. The downside of this approach is that al

[jira] [Commented] (HDFS-10173) Typo in DataXceiverServer

[ https://issues.apache.org/jira/browse/HDFS-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198573#comment-15198573 ] Hadoop QA commented on HDFS-10173: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10177) a wrong number of the bytes read are copied into native buffer in hdfsRead()

[ https://issues.apache.org/jira/browse/HDFS-10177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10177: --- Labels: newbie (was: ) > a wrong number of the bytes read are copied into native buffer in hdfsRead()

[jira] [Updated] (HDFS-9405) When starting a file, NameNode should generate EDEK in a separate thread

[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9405: Attachment: HDFS-9405.11.patch checkstyle: New member var 'conf' hides a field in some methods me: sorry, ren

[jira] [Commented] (HDFS-10178) Permanent write failures can happen if pipeline recoveries occur for the first packet

[ https://issues.apache.org/jira/browse/HDFS-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201425#comment-15201425 ] Kihwal Lee commented on HDFS-10178: --- I should probably make {{BlockScanner}}/{{VolumeSca

[jira] [Commented] (HDFS-10177) a wrong number of the bytes read are copied into native buffer in hdfsRead()

[ https://issues.apache.org/jira/browse/HDFS-10177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198883#comment-15198883 ] Yongtao Yang commented on HDFS-10177: - I know {{readDirect()}} is used most of the tim

[jira] [Commented] (HDFS-9709) DiskBalancer : Add tests for disk balancer using a Mock Mover class.

[ https://issues.apache.org/jira/browse/HDFS-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201123#comment-15201123 ] Hadoop QA commented on HDFS-9709: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9960) OzoneHandler : Add localstorage support for keys

[ https://issues.apache.org/jira/browse/HDFS-9960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200282#comment-15200282 ] Chris Nauroth commented on HDFS-9960: - Hi [~anu]. This looks good overall. Here are a

[jira] [Updated] (HDFS-9960) OzoneHandler : Add localstorage support for keys

[ https://issues.apache.org/jira/browse/HDFS-9960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9960: --- Attachment: HDFS-9960-HDFS-7240.004.patch Attaching the right patch. > OzoneHandler : Add localstorage

[jira] [Commented] (HDFS-9951) Use string constants for XML tags in OfflineImageReconstructor

[ https://issues.apache.org/jira/browse/HDFS-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200798#comment-15200798 ] Lin Yiqun commented on HDFS-9951: - I have looked the log, the test {{TestOfflineImageViewer

[jira] [Updated] (HDFS-10183) Prevent race condition during class initialization

[ https://issues.apache.org/jira/browse/HDFS-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10183: - Status: Patch Available (was: Open) > Prevent race condition during class initialization > --

[jira] [Updated] (HDFS-2043) TestHFlush failing intermittently

[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-2043: Attachment: HDFS.001.patch I also found this test failed frequently recently. I created a duplicate jira HDF

[jira] [Commented] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198392#comment-15198392 ] Hadoop QA commented on HDFS-9958: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10176) WebHdfs LISTSTATUS does not offer any sorting

[ https://issues.apache.org/jira/browse/HDFS-10176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200709#comment-15200709 ] Romain Rigaux commented on HDFS-10176: -- Sorting on the existing files. For example,

[jira] [Updated] (HDFS-9949) Testcase for catching DN UUID regeneration regression

[ https://issues.apache.org/jira/browse/HDFS-9949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-9949: -- Attachment: HDFS-9949.001.patch Thank you for reviewing [~cmccabe]! Agreed, I should've used a smaller sleep. Up

[jira] [Commented] (HDFS-3677) dfs.namenode.edits.dir.required missing from hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201877#comment-15201877 ] Hudson commented on HDFS-3677: -- FAILURE: Integrated in Hadoop-trunk-Commit #9474 (See [https:

[jira] [Commented] (HDFS-10181) TestHFlush frequently fails due to theadInterrupt

[ https://issues.apache.org/jira/browse/HDFS-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201055#comment-15201055 ] Brahma Reddy Battula commented on HDFS-10181: - [~linyiqun] thanks for working

[jira] [Commented] (HDFS-9960) OzoneHandler : Add localstorage support for keys

[ https://issues.apache.org/jira/browse/HDFS-9960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201073#comment-15201073 ] Anu Engineer commented on HDFS-9960: Test failure is not related to this patch. But it

[jira] [Commented] (HDFS-8673) HDFS reports file already exists if there is a file/dir name end with ._COPYING_

[ https://issues.apache.org/jira/browse/HDFS-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201312#comment-15201312 ] Hadoop QA commented on HDFS-8673: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9634) webhdfs client side exceptions don't provide enough details

[ https://issues.apache.org/jira/browse/HDFS-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202188#comment-15202188 ] Wei-Chiu Chuang commented on HDFS-9634: --- Thanks for the explanation, Eric. I did mad

[jira] [Updated] (HDFS-3677) dfs.namenode.edits.dir.required missing from hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-3677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-3677: Component/s: documentation > dfs.namenode.edits.dir.required missing from hdfs-default.xml >

[jira] [Commented] (HDFS-10180) Ozone: Refactor container Namespace

[ https://issues.apache.org/jira/browse/HDFS-10180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201075#comment-15201075 ] Anu Engineer commented on HDFS-10180: - Test failures are not related to this patch. >

[jira] [Commented] (HDFS-10183) Prevent race condition during class initialization

[ https://issues.apache.org/jira/browse/HDFS-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201847#comment-15201847 ] Pavel Avgustinov commented on HDFS-10183: - [~daryn] -- no concrete issues, though

[jira] [Commented] (HDFS-10178) Permanent write failures can happen if pipeline recoveries occur for the first packet

[ https://issues.apache.org/jira/browse/HDFS-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200464#comment-15200464 ] Kihwal Lee commented on HDFS-10178: --- Datanodes logs something like this: {noformat} jav

[jira] [Updated] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9820: Attachment: HDFS-9820.001.patch Attaching patch rev 001. A summary: * Built on top of HDFS-8828, HDF

[jira] [Created] (HDFS-10182) Hedged read might overwrite user's buf

zhouyingchao created HDFS-10182: --- Summary: Hedged read might overwrite user's buf Key: HDFS-10182 URL: https://issues.apache.org/jira/browse/HDFS-10182 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197908#comment-15197908 ] Arpit Agarwal commented on HDFS-9668: - I never said holding locks while doing disk io i

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198021#comment-15198021 ] Yongjun Zhang commented on HDFS-9940: - Hi [~szetszwo], Thanks for your comment. Per t

[jira] [Updated] (HDFS-10175) add per-operation stats to FileSystem.Statistics

[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-10175: Assignee: Mingliang Liu > add per-operation stats to FileSystem.Statistics > ---

[jira] [Updated] (HDFS-9960) OzoneHandler : Add localstorage support for keys

[ https://issues.apache.org/jira/browse/HDFS-9960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9960: --- Attachment: HDFS-9960-HDFS-7240.002.patch [~cnauroth] Thanks for the code review comments. This patch a

  1   2   >