[jira] [Commented] (HDDS-1728) Add metrics for leader's latency in ContainerStateMachine

2019-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880070#comment-16880070 ] Hudson commented on HDDS-1728: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #168

[jira] [Commented] (HDFS-14171) Performance improvement in Tailing EditLog

2019-07-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880072#comment-16880072 ] Wei-Chiu Chuang commented on HDFS-14171: [~hexiaoqiao] would you elaborate what i

[jira] [Updated] (HDFS-12862) CacheDirective becomes invalid when NN restart or make a transition to Active

2019-07-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12862: --- Summary: CacheDirective becomes invalid when NN restart or make a transition to Active (was:

[jira] [Updated] (HDFS-12862) CacheDirective becomes invalid when NN restart or failover

2019-07-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12862: --- Summary: CacheDirective becomes invalid when NN restart or failover (was: CacheDirective bec

[jira] [Commented] (HDFS-12862) CacheDirective becomes invalid when NN restart or failover

2019-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880082#comment-16880082 ] Hudson commented on HDFS-12862: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Commented] (HDFS-12862) CacheDirective becomes invalid when NN restart or failover

2019-07-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880081#comment-16880081 ] Wei-Chiu Chuang commented on HDFS-12862: +1 > CacheDirective becomes invalid whe

[jira] [Updated] (HDFS-12862) CacheDirective becomes invalid when NN restart or failover

2019-07-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12862: --- Fix Version/s: 3.3.0 > CacheDirective becomes invalid when NN restart or failover > -

[jira] [Updated] (HDFS-12862) CacheDirective becomes invalid when NN restart or failover

2019-07-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12862: --- Attachment: HDFS-12862.branch-3.1.patch > CacheDirective becomes invalid when NN restart or f

[jira] [Commented] (HDFS-14171) Performance improvement in Tailing EditLog

2019-07-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880086#comment-16880086 ] He Xiaoqiao commented on HDFS-14171: [~jojochuang], this JIRA can improve edit tailin

[jira] [Updated] (HDFS-12862) CacheDirective becomes invalid when NN restart or failover

2019-07-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12862: --- Fix Version/s: 3.2.1 > CacheDirective becomes invalid when NN restart or failover > -

[jira] [Commented] (HDFS-12862) CacheDirective becomes invalid when NN restart or failover

2019-07-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880087#comment-16880087 ] Wei-Chiu Chuang commented on HDFS-12862: Pushed 007 patch to trunk. The patch app

[jira] [Updated] (HDFS-14622) [Dynamometer] State transition err when CCM( HDFS Centralized Cache Management) feature is used

2019-07-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14622: --- Summary: [Dynamometer] State transition err when CCM( HDFS Centralized Cache Management) feat

[jira] [Commented] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880100#comment-16880100 ] Hadoop QA commented on HDFS-12703: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-14635) Support to refresh the rack awareness dynamically

2019-07-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880104#comment-16880104 ] Wei-Chiu Chuang commented on HDFS-14635: Not familiar with this part of code. Is

[jira] [Commented] (HDFS-14635) Support to refresh the rack awareness dynamically

2019-07-08 Thread liying (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880110#comment-16880110 ] liying commented on HDFS-14635: --- Thanks Wei-Chiu Chuang for the helpful feedback!  Yes , it

[jira] [Commented] (HDFS-14632) Reduce useless #getNumLiveDataNodes call in SafeModeMonitor

2019-07-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880116#comment-16880116 ] Yiqun Lin commented on HDFS-14632: -- Thanks for filling this, [~hexiaoqiao]. Some review

[jira] [Work logged] (HDDS-1717) MR Job fails as OMFailoverProxyProvider has dependency hadoop-3.2

2019-07-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1717?focusedWorklogId=273151&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-273151 ] ASF GitHub Bot logged work on HDDS-1717: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1748) Error message for 3 way commit failure is not verbose

2019-07-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1748?focusedWorklogId=273152&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-273152 ] ASF GitHub Bot logged work on HDDS-1748: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-565) Introduce block committing logic during new block allocation and file close.

2019-07-08 Thread wangyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880128#comment-16880128 ] wangyi commented on HDFS-565: - Why do you want to add this  parameter  (Block previous) in addB

[jira] [Work logged] (HDDS-1748) Error message for 3 way commit failure is not verbose

2019-07-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1748?focusedWorklogId=273164&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-273164 ] ASF GitHub Bot logged work on HDDS-1748: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1748) Error message for 3 way commit failure is not verbose

2019-07-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1748?focusedWorklogId=273165&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-273165 ] ASF GitHub Bot logged work on HDDS-1748: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1748) Error message for 3 way commit failure is not verbose

2019-07-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1748?focusedWorklogId=273163&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-273163 ] ASF GitHub Bot logged work on HDDS-1748: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1750) Add block allocation metric for pipelines in SCM

2019-07-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1750?focusedWorklogId=273185&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-273185 ] ASF GitHub Bot logged work on HDDS-1750: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc.

2019-07-08 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880158#comment-16880158 ] Ayush Saxena commented on HDFS-14633: - Firstly, To clear : {quote}Another concern is

[jira] [Comment Edited] (HDFS-14546) Document block placement policies

2019-07-08 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880164#comment-16880164 ] Ayush Saxena edited comment on HDFS-14546 at 7/8/19 9:55 AM: -

[jira] [Commented] (HDFS-14546) Document block placement policies

2019-07-08 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880164#comment-16880164 ] Ayush Saxena commented on HDFS-14546: - Hi [~Amithsha] can you handle the comments, Th

[jira] [Commented] (HDFS-12862) CacheDirective becomes invalid when NN restart or failover

2019-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880166#comment-16880166 ] Hadoop QA commented on HDFS-12862: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Work logged] (HDDS-1748) Error message for 3 way commit failure is not verbose

2019-07-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1748?focusedWorklogId=273209&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-273209 ] ASF GitHub Bot logged work on HDDS-1748: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when rename and setStoragePolicy etc.

2019-07-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Summary: The StorageType quota and consume in QuotaFeature is not handled when rename and setStoragePolicy et

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when rename and setStoragePolicy etc.

2019-07-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Description: The NameNode manages the global state of the cluster. We should always take NameNode's records

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when rename and setStoragePolicy etc.

2019-07-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Description: The NameNode manages the global state of the cluster. We should always take NameNode's records

[jira] [Work logged] (HDDS-1750) Add block allocation metric for pipelines in SCM

2019-07-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1750?focusedWorklogId=273229&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-273229 ] ASF GitHub Bot logged work on HDDS-1750: Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-13476) HDFS (Hadoop/HDP 2.7.3.2.6.4.0-91) reports CORRUPT files

2019-07-08 Thread panlijie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880250#comment-16880250 ] panlijie edited comment on HDFS-13476 at 7/8/19 11:58 AM: -- {{ [~

[jira] [Commented] (HDFS-13476) HDFS (Hadoop/HDP 2.7.3.2.6.4.0-91) reports CORRUPT files

2019-07-08 Thread panlijie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880250#comment-16880250 ] panlijie commented on HDFS-13476: - h1.  [~brahmareddy] HDP 2.7.3.2.6.4.0-91 is not the ha

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-08 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.006.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in me

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-08 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: (was: HDFS-14313.006.patch) > Get hdfs used space from FsDatasetImpl#volumeMap#Replic

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-08 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.006.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in me

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-08 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880257#comment-16880257 ] Lisheng Sun commented on HDFS-14313: Thank [~jojochuang] [~hexiaoqiao] for reviewing.

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when rename and setStoragePolicy etc.

2019-07-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Description: The NameNode manages the global state of the cluster. We should always take NameNode's records

[jira] [Created] (HDDS-1770) SCM crashes when ReplicationManager is trying to re-replicate under replicated containers

2019-07-08 Thread Nanda kumar (JIRA)
Nanda kumar created HDDS-1770: - Summary: SCM crashes when ReplicationManager is trying to re-replicate under replicated containers Key: HDDS-1770 URL: https://issues.apache.org/jira/browse/HDDS-1770 Proje

[jira] [Commented] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when rename and setStoragePolicy etc.

2019-07-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880323#comment-16880323 ] Jinglun commented on HDFS-14633: Hi [~ayushtkn], thanks for your explanation of backward

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when rename and setStoragePolicy etc.

2019-07-08 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Attachment: HDFS-14633-testcases-explanation > The StorageType quota and consume in QuotaFeature is not handl

[jira] [Updated] (HDFS-14632) Reduce useless #getNumLiveDataNodes call in SafeModeMonitor

2019-07-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14632: --- Attachment: HDFS-14632.004.patch > Reduce useless #getNumLiveDataNodes call in SafeModeMonitor >

[jira] [Commented] (HDFS-14632) Reduce useless #getNumLiveDataNodes call in SafeModeMonitor

2019-07-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880334#comment-16880334 ] He Xiaoqiao commented on HDFS-14632: [~linyiqun], Thanks for your reviews. It seems t

[jira] [Work logged] (HDDS-1550) MiniOzoneCluster is not shutting down all the threads during shutdown.

2019-07-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1550?focusedWorklogId=273292&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-273292 ] ASF GitHub Bot logged work on HDDS-1550: Author: ASF GitHub Bot

[jira] [Work stopped] (HDFS-2472) Extend UnderReplicatedBlocks queue to give blocks whose existing copies are all on a single rack priority over multi-rack blocks

2019-07-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-2472 stopped by Steve Loughran. > Extend UnderReplicatedBlocks queue to give blocks whose existing copies are >

[jira] [Updated] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-07-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12703: --- Attachment: HDFS-12703.007.patch > Exceptions are fatal to decommissioning monitor >

[jira] [Commented] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-07-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880348#comment-16880348 ] He Xiaoqiao commented on HDFS-12703: update patch [^HDFS-12703.007.patch] and fix che

[jira] [Commented] (HDFS-14622) [Dynamometer] State transition err when CCM( HDFS Centralized Cache Management) feature is used

2019-07-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880362#comment-16880362 ] He Xiaoqiao commented on HDFS-14622: Hi [~tanyuxin], I found this issue was reported

[jira] [Commented] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-07-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880367#comment-16880367 ] He Xiaoqiao commented on HDFS-14563: Hi watchers, sorry for the late update, I just w

[jira] [Updated] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2019-07-08 Thread Sean Chow (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Chow updated HDFS-14476: - Attachment: HDFS-14476.00.patch > lock too long when fix inconsistent blocks between disk and in-memory >

[jira] [Updated] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2019-07-08 Thread Sean Chow (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Chow updated HDFS-14476: - Attachment: datanode-with-patch-14476.png > lock too long when fix inconsistent blocks between disk and i

[jira] [Commented] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2019-07-08 Thread Sean Chow (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880426#comment-16880426 ] Sean Chow commented on HDFS-14476: -- I've add a patch here to process inconsistent blocks

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880454#comment-16880454 ] Hadoop QA commented on HDFS-14313: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-14593) RBF: RouterAdmin should be able to remove expired routers from Routers Information

2019-07-08 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-14593: Attachment: HDFS-14593.004.patch > RBF: RouterAdmin should be able to remove expired router

[jira] [Updated] (HDFS-14536) It's safe to remove synchronized from reconcile scan

2019-07-08 Thread Sean Chow (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Chow updated HDFS-14536: - Attachment: HDFS-14536.00.patch > It's safe to remove synchronized from reconcile scan >

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880463#comment-16880463 ] Hadoop QA commented on HDFS-14313: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-14536) It's safe to remove synchronized from reconcile scan

2019-07-08 Thread Sean Chow (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Chow updated HDFS-14536: - Description: I found all my my request blocked in every 6 hours and use jstack to dump threads: {code:ja

[jira] [Commented] (HDFS-14034) Support getQuotaUsage API in WebHDFS

2019-07-08 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880464#comment-16880464 ] Chao Sun commented on HDFS-14034: - Thanks [~jojochuang] for taking a look! I think we can

[jira] [Updated] (HDFS-14536) It's safe to remove synchronized from reconcile scan

2019-07-08 Thread Sean Chow (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Chow updated HDFS-14536: - Attachment: reconcile-with-synchronized.png > It's safe to remove synchronized from reconcile scan >

[jira] [Updated] (HDFS-14536) It's safe to remove synchronized from reconcile scan

2019-07-08 Thread Sean Chow (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Chow updated HDFS-14536: - Attachment: reconcile-with-removing-synchronized.png > It's safe to remove synchronized from reconcile sc

[jira] [Commented] (HDFS-14536) It's safe to remove synchronized from reconcile scan

2019-07-08 Thread Sean Chow (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880466#comment-16880466 ] Sean Chow commented on HDFS-14536: -- This patch remove {{ynchronized(dataset)}} from {{sc

[jira] [Commented] (HDFS-14593) RBF: RouterAdmin should be able to remove expired routers from Routers Information

2019-07-08 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880475#comment-16880475 ] Takanobu Asanuma commented on HDFS-14593: - Thanks for your review, [~elgoiri]! Up

[jira] [Updated] (HDFS-14593) RBF: Implement deletion feature for expired records

2019-07-08 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-14593: Summary: RBF: Implement deletion feature for expired records (was: RBF: RouterAdmin should

[jira] [Commented] (HDFS-14593) RBF: Implement deletion feature for expired records

2019-07-08 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880477#comment-16880477 ] Takanobu Asanuma commented on HDFS-14593: - Updated the title of this jira. > RBF

[jira] [Updated] (HDFS-14593) RBF: Implement deletion feature for expired records in State Store

2019-07-08 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-14593: Summary: RBF: Implement deletion feature for expired records in State Store (was: RBF: Imp

[jira] [Commented] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880487#comment-16880487 ] Hadoop QA commented on HDFS-12703: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-14632) Reduce useless #getNumLiveDataNodes call in SafeModeMonitor

2019-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880492#comment-16880492 ] Hadoop QA commented on HDFS-14632: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-8789) Block Placement policy migrator

2019-07-08 Thread Stephen O'Donnell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880506#comment-16880506 ] Stephen O'Donnell commented on HDFS-8789: - I've been looking into upgradeDomain (U

[jira] [Work logged] (HDDS-1550) MiniOzoneCluster is not shutting down all the threads during shutdown.

2019-07-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1550?focusedWorklogId=273364&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-273364 ] ASF GitHub Bot logged work on HDDS-1550: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14593) RBF: Implement deletion feature for expired records in State Store

2019-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880523#comment-16880523 ] Hadoop QA commented on HDFS-14593: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-14625) Make DefaultAuditLogger class in FSnamesystem to Abstract

2019-07-08 Thread hemanthboyina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-14625: - Attachment: HDFS-14625(2).patch > Make DefaultAuditLogger class in FSnamesystem to Abstract > --

[jira] [Commented] (HDFS-14593) RBF: Implement deletion feature for expired records in State Store

2019-07-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880549#comment-16880549 ] Íñigo Goiri commented on HDFS-14593: Some comments on [^HDFS-14593.004.patch]: * Cach

[jira] [Commented] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-07-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880555#comment-16880555 ] Íñigo Goiri commented on HDFS-12703: Just a couple minor comments: * There is an extr

[jira] [Updated] (HDDS-1725) pv-test example to test csi is not working

2019-07-08 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-1725: -- Priority: Blocker (was: Major) > pv-test example to test csi is not working > -

[jira] [Updated] (HDDS-1705) Recon: Add estimatedTotalCount to the response of containers and containers/{id} endpoints

2019-07-08 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-1705: -- Target Version/s: 0.5.0 (was: 0.4.1) > Recon: Add estimatedTotalCount to the response of containers and

[jira] [Commented] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-07-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880562#comment-16880562 ] Íñigo Goiri commented on HDFS-14563: Thanks [~hexiaoqiao] for the design doc. A few c

[jira] [Updated] (HDDS-1681) TestNodeReportHandler failing because of NPE

2019-07-08 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDDS-1681: Target Version/s: 0.5.0 (was: 0.5.0, 0.4.1) > TestNodeReportHandler failing because of NPE

[jira] [Assigned] (HDDS-1658) RaftRetryFailureException & AlreadyClosedException should not exclude pipeline from client

2019-07-08 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-1658: --- Assignee: Shashikant Banerjee (was: Nanda kumar) > RaftRetryFailureException & Alrea

[jira] [Updated] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-07-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12703: --- Attachment: HDFS-12703.008.patch > Exceptions are fatal to decommissioning monitor >

[jira] [Updated] (HDDS-1610) applyTransaction failure should not be lost on restart

2019-07-08 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-1610: -- Target Version/s: 0.5.0 (was: 0.4.1) > applyTransaction failure should not be lost on restart > ---

[jira] [Resolved] (HDDS-1644) Overload RpcClient#createKey to pass non-default acls

2019-07-08 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar resolved HDDS-1644. -- Resolution: Won't Fix > Overload RpcClient#createKey to pass non-default acls >

[jira] [Updated] (HDDS-1565) Rename k8s-dev and k8s-dev-push profiles to docker and docker-push

2019-07-08 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-1565: --- Target Version/s: 0.5.0 (was: 0.4.1) > Rename k8s-dev and k8s-dev-push profiles to docker and docker-

[jira] [Commented] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-07-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880567#comment-16880567 ] He Xiaoqiao commented on HDFS-12703: [~elgoiri], Thanks for your reviews. [^HDFS-1270

[jira] [Updated] (HDDS-1585) Add LICENSE.txt and NOTICE.txt to Ozone Recon Web

2019-07-08 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-1585: -- Priority: Blocker (was: Major) > Add LICENSE.txt and NOTICE.txt to Ozone Recon Web > --

[jira] [Assigned] (HDDS-1036) container replica state in datanode should be QUASI-CLOSED if the datanode is isolated from other two datanodes in 3 datanode cluster

2019-07-08 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-1036: --- Assignee: Nanda kumar (was: Mukul Kumar Singh) > container replica state in datanode

[jira] [Commented] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-07-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880573#comment-16880573 ] He Xiaoqiao commented on HDFS-14563: Thanks [~elgoiri] for your comments. I will upda

[jira] [Assigned] (HDDS-1303) Support native ACL for Ozone

2019-07-08 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar reassigned HDDS-1303: Assignee: Ajay Kumar (was: Anu Engineer) > Support native ACL for Ozone >

[jira] [Work logged] (HDDS-1705) Recon: Add estimatedTotalCount to the response of containers and containers/{id} endpoints

2019-07-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1705?focusedWorklogId=273422&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-273422 ] ASF GitHub Bot logged work on HDDS-1705: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1717) MR Job fails as OMFailoverProxyProvider has dependency hadoop-3.2

2019-07-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1717?focusedWorklogId=273427&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-273427 ] ASF GitHub Bot logged work on HDDS-1717: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1717) MR Job fails as OMFailoverProxyProvider has dependency hadoop-3.2

2019-07-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1717?focusedWorklogId=273426&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-273426 ] ASF GitHub Bot logged work on HDDS-1717: Author: ASF GitHub Bot

[jira] [Resolved] (HDDS-1305) Robot test containers: hadoop client can't access o3fs

2019-07-08 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton resolved HDDS-1305. Resolution: Duplicate Thanks to report this issue. It will be fixed in HDDS-1717   (Based on the t

[jira] [Assigned] (HDFS-14622) [Dynamometer] State transition err when CCM( HDFS Centralized Cache Management) feature is used

2019-07-08 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-14622: -- Assignee: Erik Krogen > [Dynamometer] State transition err when CCM( HDFS Centralized Cache >

[jira] [Resolved] (HDDS-1338) ozone shell commands are throwing InvocationTargetException

2019-07-08 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton resolved HDDS-1338. Resolution: Duplicate > ozone shell commands are throwing InvocationTargetException > --

[jira] [Commented] (HDFS-14284) RBF: Log Router identifier when reporting exceptions

2019-07-08 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880596#comment-16880596 ] Ayush Saxena commented on HDFS-14284: - IIUC Don't we unwrap every exception in Router

[jira] [Created] (HDDS-1771) Add slow IO disk test to fault injection test

2019-07-08 Thread Eric Yang (JIRA)
Eric Yang created HDDS-1771: --- Summary: Add slow IO disk test to fault injection test Key: HDDS-1771 URL: https://issues.apache.org/jira/browse/HDDS-1771 Project: Hadoop Distributed Data Store Issue

[jira] [Commented] (HDFS-12748) NameNode memory leak when accessing webhdfs GETHOMEDIRECTORY

2019-07-08 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880600#comment-16880600 ] Erik Krogen commented on HDFS-12748: Sorry for my late reply; I was on vacation last

[jira] [Updated] (HDDS-1771) Add slow IO disk test to fault injection test

2019-07-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HDDS-1771: Description: In fault injection test, one possible simulation is to create slow disk IO. This test can ass

[jira] [Comment Edited] (HDFS-12748) NameNode memory leak when accessing webhdfs GETHOMEDIRECTORY

2019-07-08 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880600#comment-16880600 ] Erik Krogen edited comment on HDFS-12748 at 7/8/19 6:13 PM: S

[jira] [Created] (HDDS-1772) Add disk full test to fault injection test

2019-07-08 Thread Eric Yang (JIRA)
Eric Yang created HDDS-1772: --- Summary: Add disk full test to fault injection test Key: HDDS-1772 URL: https://issues.apache.org/jira/browse/HDDS-1772 Project: Hadoop Distributed Data Store Issue Ty

  1   2   3   4   >