[jira] [Created] (HBASE-25914) Provide slow/large logs on RegionServer UI

2021-05-24 Thread Zhuoyue Huang (Jira)
Zhuoyue Huang created HBASE-25914: - Summary: Provide slow/large logs on RegionServer UI Key: HBASE-25914 URL: https://issues.apache.org/jira/browse/HBASE-25914 Project: HBase Issue Type: Impr

Re: [DISCUSS] Implement and release HBASE-24749 (an hfile tracker that allows for avoiding renames)

2021-05-24 Thread Duo Zhang
Just go ahead Josh, I haven't started to write the design doc yet. Thank you for your help! Josh Elser 于2021年5月25日周二 上午1:45写道: > Without completely opening Pandora's box, I will say we definitely have > multiple ways we can solve the metadata management for tracking (e.g. in > meta, in some oth

[jira] [Created] (HBASE-25913) Introduce EnvironmentEdge.currentTimeAdvancing

2021-05-24 Thread Andrew Kyle Purtell (Jira)
Andrew Kyle Purtell created HBASE-25913: --- Summary: Introduce EnvironmentEdge.currentTimeAdvancing Key: HBASE-25913 URL: https://issues.apache.org/jira/browse/HBASE-25913 Project: HBase

[jira] [Resolved] (HBASE-25513) When the table is turned on normalize, the first region may not be merged even the size is 0

2021-05-24 Thread Nick Dimiduk (Jira)
[ https://issues.apache.org/jira/browse/HBASE-25513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk resolved HBASE-25513. -- Resolution: Fixed > When the table is turned on normalize, the first region may not be merged

Re: [DISCUSS] Implement and release HBASE-24749 (an hfile tracker that allows for avoiding renames)

2021-05-24 Thread Duo Zhang
Oh, sorry. Missed that. I think the key point here is we should not have partial storefiles in the data directory if we want to downgrade. This is possible by setting the flag to false first to prevent new partial storefiles, and then use a HBCK command to remove all the partial storefiles? And in

[jira] [Created] (HBASE-25912) Ban System.currentTimeMillis with a build enforcer

2021-05-24 Thread Andrew Kyle Purtell (Jira)
Andrew Kyle Purtell created HBASE-25912: --- Summary: Ban System.currentTimeMillis with a build enforcer Key: HBASE-25912 URL: https://issues.apache.org/jira/browse/HBASE-25912 Project: HBase

[jira] [Created] (HBASE-25911) Replace uses of System.currentTimeMillis with EnvironmentEdgeManager.currentTime

2021-05-24 Thread Andrew Kyle Purtell (Jira)
Andrew Kyle Purtell created HBASE-25911: --- Summary: Replace uses of System.currentTimeMillis with EnvironmentEdgeManager.currentTime Key: HBASE-25911 URL: https://issues.apache.org/jira/browse/HBASE-25911

[jira] [Created] (HBASE-25910) Fix TestClusterPortAssignment.testClusterPortAssignment test and re-enable it.

2021-05-24 Thread Victor Li (Jira)
Victor Li created HBASE-25910: - Summary: Fix TestClusterPortAssignment.testClusterPortAssignment test and re-enable it. Key: HBASE-25910 URL: https://issues.apache.org/jira/browse/HBASE-25910 Project: HBa

[jira] [Reopened] (HBASE-25534) Honor TableDescriptor settings earlier in normalization

2021-05-24 Thread Nick Dimiduk (Jira)
[ https://issues.apache.org/jira/browse/HBASE-25534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk reopened HBASE-25534: -- Reopen for backport to branch-2. > Honor TableDescriptor settings earlier in normalization >

[jira] [Reopened] (HBASE-25513) When the table is turned on normalize, the first region may not be merged even the size is 0

2021-05-24 Thread Nick Dimiduk (Jira)
[ https://issues.apache.org/jira/browse/HBASE-25513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk reopened HBASE-25513: -- Missed backport to branch-2. > When the table is turned on normalize, the first region may not be

[jira] [Created] (HBASE-25909) Improve logging in "packaging and integration" stage

2021-05-24 Thread Nick Dimiduk (Jira)
Nick Dimiduk created HBASE-25909: Summary: Improve logging in "packaging and integration" stage Key: HBASE-25909 URL: https://issues.apache.org/jira/browse/HBASE-25909 Project: HBase Issue Ty

Re: [DISCUSS] Implement and release HBASE-24749 (an hfile tracker that allows for avoiding renames)

2021-05-24 Thread Josh Elser
Without completely opening Pandora's box, I will say we definitely have multiple ways we can solve the metadata management for tracking (e.g. in meta, in some other system table, in some other system, in a per-store file). Each of them have pro's and con's, and each of them has "favor" as to wh

Re: [DISCUSS] Implement and release HBASE-24749 (an hfile tracker that allows for avoiding renames)

2021-05-24 Thread Josh Elser
I got pulled into a call with some folks from S3 at the last minute late week. There was a comment made in passing about reading the latest, written version of a file. At the moment, I didn't want to digress into that because of immutable HFiles. However, if we're tracking files-per-store in

[jira] [Created] (HBASE-25908) Exclude jakarta.activation-api

2021-05-24 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HBASE-25908: --- Summary: Exclude jakarta.activation-api Key: HBASE-25908 URL: https://issues.apache.org/jira/browse/HBASE-25908 Project: HBase Issue Type: Improvement

Re: [DISCUSS] Implement and release HBASE-24749 (an hfile tracker that allows for avoiding renames)

2021-05-24 Thread Andrew Purtell
The important detail is first there is an upgrade to a version that can support the new store layout across the whole cluster, so there will be no rolling upgrade related issues when the new layout is enabled. The new layout can be enabled with a new site config, a shell command to set a schema fe

Re: [DISCUSS] Implement and release HBASE-24749 (an hfile tracker that allows for avoiding renames)

2021-05-24 Thread Andrew Purtell
> I do not think it should be a table level config. It should be a cluster level config. We only have one FileSystem so it is useless to let different tables have different ways to store hfile list. The perspective that claims this "useless" is a limited perspective. In our clusters, we value fea

Re: [DISCUSS] Implement and release HBASE-24749 (an hfile tracker that allows for avoiding renames)

2021-05-24 Thread Andrew Purtell
> And for downgrading, usually we do not support downgrading from a major version upgrading, so it is not a big problem. You missed an earlier comment from me. Our team requires this to be released in a branch-2 version or we can't use it. Therefore I am not in favor of any solution that requires

[jira] [Created] (HBASE-25907) Move StoreFlushContext out of HStore and make it pluggable

2021-05-24 Thread Wellington Chevreuil (Jira)
Wellington Chevreuil created HBASE-25907: Summary: Move StoreFlushContext out of HStore and make it pluggable Key: HBASE-25907 URL: https://issues.apache.org/jira/browse/HBASE-25907 Project: HB

[jira] [Resolved] (HBASE-25899) Improve efficiency of SnapshotHFileCleaner

2021-05-24 Thread Xiaolin Ha (Jira)
[ https://issues.apache.org/jira/browse/HBASE-25899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaolin Ha resolved HBASE-25899. Fix Version/s: 2.5.0 3.0.0-alpha-1 Resolution: Fixed > Improve efficienc

[jira] [Resolved] (HBASE-25873) Refactor and cleanup the code for CostFunction

2021-05-24 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-25873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-25873. --- Fix Version/s: 2.5.0 3.0.0-alpha-1 Hadoop Flags: Reviewed Resolution:

[jira] [Resolved] (HBASE-25791) UI of master-status to show a recent history of that why balancer was rejected to run

2021-05-24 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-25791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-25791. --- Resolution: Cannot Reproduce Cherry-picked to branch-2.4. > UI of master-status to show a recent hi

[jira] [Reopened] (HBASE-25791) UI of master-status to show a recent history of that why balancer was rejected to run

2021-05-24 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-25791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang reopened HBASE-25791: --- > UI of master-status to show a recent history of that why balancer was > rejected to run > -

[jira] [Created] (HBASE-25906) UI of master-status to show a recent history of balancer desicion

2021-05-24 Thread Zhuoyue Huang (Jira)
Zhuoyue Huang created HBASE-25906: - Summary: UI of master-status to show a recent history of balancer desicion Key: HBASE-25906 URL: https://issues.apache.org/jira/browse/HBASE-25906 Project: HBase

[jira] [Created] (HBASE-25905) Limit the shutdown time of WAL

2021-05-24 Thread Xiaolin Ha (Jira)
Xiaolin Ha created HBASE-25905: -- Summary: Limit the shutdown time of WAL Key: HBASE-25905 URL: https://issues.apache.org/jira/browse/HBASE-25905 Project: HBase Issue Type: Improvement