[hbase] branch branch-2 updated: HBASE-27340 Artifacts with resolved profiles (#4740)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2 by this push:
new 0f29423cc53 HBASE-27340 Artifacts with resolved profiles (#4740)
0f29423cc53 is described below
commit 0f29423cc5339ddb47ee0009c82a822f4b4b6c70
Author: Michael Stack
AuthorDate: Fri Sep 2 16:43:29 2022 -0700
HBASE-27340 Artifacts with resolved profiles (#4740)
Make it so our published poms carry the minimum needed to run
an hbase; the published pom has no profiles -- the profiles
specified at build time are resolved, their dependencies inlined,
and then they are stripped -- and no build-time, or plugins
dependencies or properties, etc. Resultant poms have explicit
hadoop lib versions baked in -- no more being able to choose
hbase with hadoop2 or haddop3 at downstream build time by setting
a '-Dhadoop.profile=X.0'.
Pattern is to add profiles when none in sub-modules when
the flatten plugin complains it can't resolve an hadoop
dependency's 'version' (e.g. hadoop-common, hadoop-hdfs).
Adding the hadoop-2.0 and hadoop-3.0 profiles in the sub-module
make it so the flatten plugin can figure 'hadoop.version'
definitively.
Another spin on the above happens when profiles already exist
in submodule but the flatten plugin is complaining it can't
figure figure version on an hadoop dependency NOT under
profiles. Below, we move the delinquent hadoop dependency under
existing profiles (minikdc was the usual dependency outside
profiles in sub-modules that flatten complained about).
Sometimes, moving an hadoop dependency under a profile, there
would be excludes on the local dependency. If the parent pom
excludes section was missing the local excludes, we added them
up to the parent module so all excluding is done up there in
the parent profile dependencyManagement section.
* hbase-asyncfs/pom.xml
* hbase-endpoint/pom.xml
* hbase-examples/pom.xml
* hbase-http/pom.xml
* hbase-rest/pom.xml
* hbase-server/pom.xml
Move the minikdc under profiles so it picks up appropriate hadoop
version
when the flatten plugin runs.
* hbase-hadoop2-compat/pom.xml
Add hadoop2 and hadoop3 profiles and move hadoop-common, etc.
under them so we pick up appropriate hadoop version when flatten
plugin runs.
* hbase-mapreduce/pom.xml
Move hadoop dependencies under profiles so right version is
available when the flatten plugin runs.
* hbase-shaded/hbase-shaded-testing-util/pom.xml
Add profiles for hadoop-2.0 and hadoop-3.0 and move the
hadoop dependencies under them.
pom.xml
Add the flatten plugin with the flatten profiles enabled.
Add a few excludes on hadoop profiles picked up from sub-modules.
E.g. exclude bouncycastle bcprov-jdk15 when we include minikdc.
Signed-off-by: Andrew Purtell
Signed-off-by: Duo Zhang
---
hbase-asyncfs/pom.xml | 21 ++--
hbase-endpoint/pom.xml | 15 ++-
hbase-examples/pom.xml | 21 ++--
hbase-hadoop2-compat/pom.xml | 67
hbase-http/pom.xml | 15 ++-
hbase-mapreduce/pom.xml| 144 +++--
hbase-rest/pom.xml | 15 ++-
hbase-server/pom.xml | 21 ++--
hbase-shaded/hbase-shaded-testing-util/pom.xml | 101 -
pom.xml| 74 -
10 files changed, 344 insertions(+), 150 deletions(-)
diff --git a/hbase-asyncfs/pom.xml b/hbase-asyncfs/pom.xml
index 3c1bda04903..a0136d59cd6 100644
--- a/hbase-asyncfs/pom.xml
+++ b/hbase-asyncfs/pom.xml
@@ -78,17 +78,6 @@
bcprov-jdk15on
test
-
- org.apache.hadoop
- hadoop-minikdc
- test
-
-
- bouncycastle
- bcprov-jdk15
-
-
-
org.apache.kerby
kerb-client
@@ -204,6 +193,11 @@
hadoop-minicluster
test
+
+ org.apache.hadoop
+ hadoop-minikdc
+ test
+
org.slf4j
@@ -349,6 +344,11 @@
${netty.hadoop.version}
test
+
+ org.apache.hadoop
+ hadoop-minikdc
+ test
+
javax.activation
javax.activation-api
+ ${javax.activation.version}
runtime
@@ -198,6 +177,50 @@ limitations under
[hbase] branch branch-2.5 updated: HBASE-27340 Artifacts with resolved profiles (#4740)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.5
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.5 by this push:
new 71cf98f63f2 HBASE-27340 Artifacts with resolved profiles (#4740)
71cf98f63f2 is described below
commit 71cf98f63f2527e912cf49f089eb11108b174e35
Author: Michael Stack
AuthorDate: Fri Sep 2 16:43:29 2022 -0700
HBASE-27340 Artifacts with resolved profiles (#4740)
Make it so our published poms carry the minimum needed to run
an hbase; the published pom has no profiles -- the profiles
specified at build time are resolved, their dependencies inlined,
and then they are stripped -- and no build-time, or plugins
dependencies or properties, etc. Resultant poms have explicit
hadoop lib versions baked in -- no more being able to choose
hbase with hadoop2 or haddop3 at downstream build time by setting
a '-Dhadoop.profile=X.0'.
Pattern is to add profiles when none in sub-modules when
the flatten plugin complains it can't resolve an hadoop
dependency's 'version' (e.g. hadoop-common, hadoop-hdfs).
Adding the hadoop-2.0 and hadoop-3.0 profiles in the sub-module
make it so the flatten plugin can figure 'hadoop.version'
definitively.
Another spin on the above happens when profiles already exist
in submodule but the flatten plugin is complaining it can't
figure figure version on an hadoop dependency NOT under
profiles. Below, we move the delinquent hadoop dependency under
existing profiles (minikdc was the usual dependency outside
profiles in sub-modules that flatten complained about).
Sometimes, moving an hadoop dependency under a profile, there
would be excludes on the local dependency. If the parent pom
excludes section was missing the local excludes, we added them
up to the parent module so all excluding is done up there in
the parent profile dependencyManagement section.
* hbase-asyncfs/pom.xml
* hbase-endpoint/pom.xml
* hbase-examples/pom.xml
* hbase-http/pom.xml
* hbase-rest/pom.xml
* hbase-server/pom.xml
Move the minikdc under profiles so it picks up appropriate hadoop
version
when the flatten plugin runs.
* hbase-hadoop2-compat/pom.xml
Add hadoop2 and hadoop3 profiles and move hadoop-common, etc.
under them so we pick up appropriate hadoop version when flatten
plugin runs.
* hbase-mapreduce/pom.xml
Move hadoop dependencies under profiles so right version is
available when the flatten plugin runs.
* hbase-shaded/hbase-shaded-testing-util/pom.xml
Add profiles for hadoop-2.0 and hadoop-3.0 and move the
hadoop dependencies under them.
pom.xml
Add the flatten plugin with the flatten profiles enabled.
Add a few excludes on hadoop profiles picked up from sub-modules.
E.g. exclude bouncycastle bcprov-jdk15 when we include minikdc.
Signed-off-by: Andrew Purtell
Signed-off-by: Duo Zhang
---
hbase-asyncfs/pom.xml | 21 ++--
hbase-endpoint/pom.xml | 15 ++-
hbase-examples/pom.xml | 21 ++--
hbase-hadoop2-compat/pom.xml | 67
hbase-http/pom.xml | 15 ++-
hbase-mapreduce/pom.xml| 144 +++--
hbase-rest/pom.xml | 15 ++-
hbase-server/pom.xml | 21 ++--
hbase-shaded/hbase-shaded-testing-util/pom.xml | 101 -
pom.xml| 74 -
10 files changed, 344 insertions(+), 150 deletions(-)
diff --git a/hbase-asyncfs/pom.xml b/hbase-asyncfs/pom.xml
index 58e50085afa..32cc1a4c373 100644
--- a/hbase-asyncfs/pom.xml
+++ b/hbase-asyncfs/pom.xml
@@ -78,17 +78,6 @@
bcprov-jdk15on
test
-
- org.apache.hadoop
- hadoop-minikdc
- test
-
-
- bouncycastle
- bcprov-jdk15
-
-
-
org.apache.kerby
kerb-client
@@ -204,6 +193,11 @@
hadoop-minicluster
test
+
+ org.apache.hadoop
+ hadoop-minikdc
+ test
+
org.slf4j
@@ -349,6 +344,11 @@
${netty.hadoop.version}
test
+
+ org.apache.hadoop
+ hadoop-minikdc
+ test
+
javax.activation
javax.activation-api
+ ${javax.activation.version}
runtime
@@ -198,6 +177,50 @@ limitations
[hbase] branch branch-2.5 updated: HBASE-27338 brotli compression lib tests fail on arm64 (#4735)
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch branch-2.5 in repository https://gitbox.apache.org/repos/asf/hbase.git The following commit(s) were added to refs/heads/branch-2.5 by this push: new 9e080d02e61 HBASE-27338 brotli compression lib tests fail on arm64 (#4735) 9e080d02e61 is described below commit 9e080d02e61167b0a479d4e21557b64dd412d43a Author: Michael Stack AuthorDate: Mon Aug 29 09:11:52 2022 -0700 HBASE-27338 brotli compression lib tests fail on arm64 (#4735) Up the brotli lib from 1.7.1 to 1.8.0 Signed-off-by: Bryan Beaudreault Signed-off-by: Andrew Purtell --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index 6a19f0c9afa..c134c59f9a3 100644 --- a/pom.xml +++ b/pom.xml @@ -632,7 +632,7 @@ 3.12.0 0.21 -1.7.1 +1.8.0 1.8.0 1.1.8.4 1.9
[hbase] branch branch-2 updated: HBASE-27338 brotli compression lib tests fail on arm64 (#4735)
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch branch-2 in repository https://gitbox.apache.org/repos/asf/hbase.git The following commit(s) were added to refs/heads/branch-2 by this push: new 0640efac7e9 HBASE-27338 brotli compression lib tests fail on arm64 (#4735) 0640efac7e9 is described below commit 0640efac7e93f418b3ead65ec55571dcd1e650c5 Author: Michael Stack AuthorDate: Mon Aug 29 09:11:52 2022 -0700 HBASE-27338 brotli compression lib tests fail on arm64 (#4735) Up the brotli lib from 1.7.1 to 1.8.0 Signed-off-by: Bryan Beaudreault Signed-off-by: Andrew Purtell --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index 16c3cf8de52..a135f05ea7a 100644 --- a/pom.xml +++ b/pom.xml @@ -632,7 +632,7 @@ 3.12.0 0.21 -1.7.1 +1.8.0 1.8.0 1.1.8.4 1.9
[hbase] branch master updated: HBASE-27338 brotli compression lib tests fail on arm64 (#4735)
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hbase.git The following commit(s) were added to refs/heads/master by this push: new f6b4eb791a1 HBASE-27338 brotli compression lib tests fail on arm64 (#4735) f6b4eb791a1 is described below commit f6b4eb791a17493104820473e86e4b44df8db64a Author: Michael Stack AuthorDate: Mon Aug 29 09:11:52 2022 -0700 HBASE-27338 brotli compression lib tests fail on arm64 (#4735) Up the brotli lib from 1.7.1 to 1.8.0 Signed-off-by: Bryan Beaudreault Signed-off-by: Andrew Purtell --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index 02f1b670217..f1e6173d840 100644 --- a/pom.xml +++ b/pom.xml @@ -855,7 +855,7 @@ 3.12.0 0.21 -1.7.1 +1.8.0 1.8.0 1.1.8.4 1.9
[hbase] branch branch-2.5 updated: HBASE-26982 Add index and bloom filter statistics of LruBlockCache on… (#4376)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.5
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.5 by this push:
new 3980e6d087e HBASE-26982 Add index and bloom filter statistics of
LruBlockCache on… (#4376)
3980e6d087e is described below
commit 3980e6d087ed4d1225993b54ab856c28bd9db5e4
Author: liangxs
AuthorDate: Tue Aug 16 02:09:36 2022 +0800
HBASE-26982 Add index and bloom filter statistics of LruBlockCache on…
(#4376)
Signed-off-by: Andrew Purtell
Signed-off-by: stack
---
.../apache/hadoop/hbase/io/hfile/BlockType.java| 9
.../hbase/tmpl/regionserver/BlockCacheTmpl.jamon | 29 ++-
.../hadoop/hbase/io/hfile/LruBlockCache.java | 57 +++---
3 files changed, 86 insertions(+), 9 deletions(-)
diff --git
a/hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
b/hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
index 3bd98e6388c..9b8a6bbfe2c 100644
--- a/hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
+++ b/hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
@@ -215,4 +215,13 @@ public enum BlockType {
return this == DATA || this == ENCODED_DATA;
}
+ /** Returns whether this block category is index */
+ public final boolean isIndex() {
+return this.getCategory() == BlockCategory.INDEX;
+ }
+
+ /** Returns whether this block category is bloom filter */
+ public final boolean isBloom() {
+return this.getCategory() == BlockCategory.BLOOM;
+ }
}
diff --git
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheTmpl.jamon
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheTmpl.jamon
index f7abdc80dd3..7f4d0063dc1 100644
---
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheTmpl.jamon
+++
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheTmpl.jamon
@@ -37,6 +37,7 @@ org.apache.hadoop.hbase.io.hfile.CachedBlock;
org.apache.hadoop.conf.Configuration;
org.apache.hadoop.hbase.io.hfile.CacheConfig;
org.apache.hadoop.hbase.io.hfile.BlockCache;
+org.apache.hadoop.hbase.io.hfile.LruBlockCache;
org.apache.hadoop.hbase.io.hfile.bucket.BucketCacheStats;
org.apache.hadoop.hbase.io.hfile.bucket.BucketCache;
org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator;
@@ -284,6 +285,8 @@ are combined counts. Request count is sum of hits and
misses.
String bcName = bc.getClass().getSimpleName();
int maxCachedBlocksByFile = BlockCacheUtil.getMaxCachedBlocksByFile(config);
+ boolean lru = bc instanceof LruBlockCache;
+
boolean bucketCache = bc.getClass().getSimpleName().equals("BucketCache");
BucketCacheStats bucketCacheStats = null;
BucketAllocator bucketAllocator = null;
@@ -328,7 +331,19 @@ are combined counts. Request count is sum of hits and
misses.
Count of DATA Blocks
+<%if lru %>
+
+Index Block Count
+<% String.format("%,d", ((LruBlockCache)bc).getIndexBlockCount())
%>
+Count of INDEX Blocks
+
+Bloom Block Count
+<% String.format("%,d", ((LruBlockCache)bc).getBloomBlockCount())
%>
+Count of BLOOM Blocks
+
+
+
Size of Blocks
<% TraditionalBinaryPrefix.long2String(bc.getCurrentSize(), "B",
1) %>
Size of Blocks
@@ -340,7 +355,19 @@ are combined counts. Request count is sum of hits and
misses.
Size of DATA Blocks
-<& evictions_tmpl; bc = bc; &>
+<%if lru %>
+
+Size of Index Blocks
+<%
TraditionalBinaryPrefix.long2String(((LruBlockCache)bc).getCurrentIndexSize(),
"B", 1) %>
+Size of INDEX Blocks
+
+
+Size of Bloom Blocks
+<%
TraditionalBinaryPrefix.long2String(((LruBlockCache)bc).getCurrentBloomSize(),
"B", 1) %>
+Size of BLOOM Blocks
+
+
+ <& evictions_tmpl; bc = bc; &>
<& hits_tmpl; bc = bc; &>
<%if bucketCache %>
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruBlockCache.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruBlockCache.java
index 74514aa4a55..a689605a584 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruBlockCache.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruBlockCache.java
@@ -174,13 +174,25 @@ public class LruBlockCache implements
FirstLevelBlockCache {
private final AtomicLong size;
/** Current size of data blocks */
- private final LongAdder dataBlockSize;
+ private final LongAdder dataBlockSize = new LongAdder();
+
+ /** Current size of index blocks */
+ privat
[hbase] branch branch-2 updated: HBASE-26982 Add index and bloom filter statistics of LruBlockCache on… (#4376)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2 by this push:
new aaad3a70774 HBASE-26982 Add index and bloom filter statistics of
LruBlockCache on… (#4376)
aaad3a70774 is described below
commit aaad3a70774ce6546489d0579047b27eee620848
Author: liangxs
AuthorDate: Tue Aug 16 02:09:36 2022 +0800
HBASE-26982 Add index and bloom filter statistics of LruBlockCache on…
(#4376)
Signed-off-by: Andrew Purtell
Signed-off-by: stack
---
.../apache/hadoop/hbase/io/hfile/BlockType.java| 9
.../hbase/tmpl/regionserver/BlockCacheTmpl.jamon | 29 ++-
.../hadoop/hbase/io/hfile/LruBlockCache.java | 57 +++---
3 files changed, 86 insertions(+), 9 deletions(-)
diff --git
a/hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
b/hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
index 3bd98e6388c..9b8a6bbfe2c 100644
--- a/hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
+++ b/hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
@@ -215,4 +215,13 @@ public enum BlockType {
return this == DATA || this == ENCODED_DATA;
}
+ /** Returns whether this block category is index */
+ public final boolean isIndex() {
+return this.getCategory() == BlockCategory.INDEX;
+ }
+
+ /** Returns whether this block category is bloom filter */
+ public final boolean isBloom() {
+return this.getCategory() == BlockCategory.BLOOM;
+ }
}
diff --git
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheTmpl.jamon
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheTmpl.jamon
index f7abdc80dd3..7f4d0063dc1 100644
---
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheTmpl.jamon
+++
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheTmpl.jamon
@@ -37,6 +37,7 @@ org.apache.hadoop.hbase.io.hfile.CachedBlock;
org.apache.hadoop.conf.Configuration;
org.apache.hadoop.hbase.io.hfile.CacheConfig;
org.apache.hadoop.hbase.io.hfile.BlockCache;
+org.apache.hadoop.hbase.io.hfile.LruBlockCache;
org.apache.hadoop.hbase.io.hfile.bucket.BucketCacheStats;
org.apache.hadoop.hbase.io.hfile.bucket.BucketCache;
org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocator;
@@ -284,6 +285,8 @@ are combined counts. Request count is sum of hits and
misses.
String bcName = bc.getClass().getSimpleName();
int maxCachedBlocksByFile = BlockCacheUtil.getMaxCachedBlocksByFile(config);
+ boolean lru = bc instanceof LruBlockCache;
+
boolean bucketCache = bc.getClass().getSimpleName().equals("BucketCache");
BucketCacheStats bucketCacheStats = null;
BucketAllocator bucketAllocator = null;
@@ -328,7 +331,19 @@ are combined counts. Request count is sum of hits and
misses.
Count of DATA Blocks
+<%if lru %>
+
+Index Block Count
+<% String.format("%,d", ((LruBlockCache)bc).getIndexBlockCount())
%>
+Count of INDEX Blocks
+
+Bloom Block Count
+<% String.format("%,d", ((LruBlockCache)bc).getBloomBlockCount())
%>
+Count of BLOOM Blocks
+
+
+
Size of Blocks
<% TraditionalBinaryPrefix.long2String(bc.getCurrentSize(), "B",
1) %>
Size of Blocks
@@ -340,7 +355,19 @@ are combined counts. Request count is sum of hits and
misses.
Size of DATA Blocks
-<& evictions_tmpl; bc = bc; &>
+<%if lru %>
+
+Size of Index Blocks
+<%
TraditionalBinaryPrefix.long2String(((LruBlockCache)bc).getCurrentIndexSize(),
"B", 1) %>
+Size of INDEX Blocks
+
+
+Size of Bloom Blocks
+<%
TraditionalBinaryPrefix.long2String(((LruBlockCache)bc).getCurrentBloomSize(),
"B", 1) %>
+Size of BLOOM Blocks
+
+
+ <& evictions_tmpl; bc = bc; &>
<& hits_tmpl; bc = bc; &>
<%if bucketCache %>
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruBlockCache.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruBlockCache.java
index 74514aa4a55..a689605a584 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruBlockCache.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruBlockCache.java
@@ -174,13 +174,25 @@ public class LruBlockCache implements
FirstLevelBlockCache {
private final AtomicLong size;
/** Current size of data blocks */
- private final LongAdder dataBlockSize;
+ private final LongAdder dataBlockSize = new LongAdder();
+
+ /** Current size of index blocks */
+ privat
[hbase] branch master updated (9215066e2b8 -> 8ec02c025ee)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hbase.git from 9215066e2b8 HBASE-27221 Bump spotless version to 2.24.1 (#4693) add 8ec02c025ee HBASE-26982 Add index and bloom filter statistics of LruBlockCache on… (#4376) No new revisions were added by this update. Summary of changes: .../apache/hadoop/hbase/io/hfile/BlockType.java| 9 .../hbase/tmpl/regionserver/BlockCacheTmpl.jamon | 29 ++- .../hadoop/hbase/io/hfile/LruBlockCache.java | 57 +++--- 3 files changed, 86 insertions(+), 9 deletions(-)
[hbase-site] 02/02: Adding links to talk by Javier Maestro and David Pope of Facebook that was missing from 2016 hbasecon operations track at Javier's request... see below:
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hbase-site.git commit f1c3008536e5b21e57a1c627dfbff0dc202a4734 Author: stack AuthorDate: Mon Jan 3 09:59:35 2022 -0800 Adding links to talk by Javier Maestro and David Pope of Facebook that was missing from 2016 hbasecon operations track at Javier's request... see below: From: "J. Javier Maestro" Date: Fri, 3 Dec 2021 13:38:12 + Message-ID: Subject: An email from time past! To: st...@duboce.net Hi Michael! We briefly met at HBaseCon West 2016, I used to work as a Production Engineer in the HBase Facebook team with Elliot Clark, Mikhail Antonov, etc. I'm writing out of the blue with a weird request for some help to mend the HBaseCon pages =F0=9F=98=85 I (together with another co-worker) presented a talk on containerizing HBase. I don't particularly enjoy presenting in conferences, so I've only done it two times in my professional career. However, that HBase talk went quite well and I was happy with it. So, fast-forward a few years, I went to refresh my LinkedIn and... when I went looking in the HBaseCon website / archive page for the record of the talk, there was nothing to be found. It was gone, as if we never gave the talk. I remember that, at the time, we were told that some talks would not be recorded because they had some issues / complaints from Facebook in the past... and that's my best guess as to what happened to the talk. Not being recorded, I guess someone just removed the entry from the table thinking that it might have never happened. I feel a bit silly asking for some help about this, since it's something pretty small and insignificant, but at the same time, since I've never done many public talks, it did make me feel a bit sad that the only official record of it is now gone like tears in the rain XXD I tried a couple years ago to send an email to d...@hbase.apache.org but I never heard back. Since you have been so involved with the HBase project and the community, I thought you might know someone I could talk to directly and see if they could add the record of the talk to the HBaseCon and Archives pages (http://hbase.apache.org/www.hbasecon.com/ and https://hbase.apache.org/hbasecon-archives.html). The slides from the talk are here: https://speakerdeck.com/jjmaestro/hbasecon-2016-west-containerizing-apache- hbase-clusters Again, sorry for the cold-email and thanks a ton in advance for your time and help! Cheers, Javier --- hbasecon-archives.html | 17 + www.hbasecon.com/index.html | 19 +-- 2 files changed, 34 insertions(+), 2 deletions(-) diff --git a/hbasecon-archives.html b/hbasecon-archives.html index 4b093e5a..5b13396 100644 --- a/hbasecon-archives.html +++ b/hbasecon-archives.html @@ -2328,6 +2328,7 @@ HBaseCon West Presentations Recordings | https://www.youtube.com/watch?v=HQaU6_p1onAlist=PLe-h9HrA9qfDVOeNh1l_T5HvwvkO9raWyindex=19;>Recording) + @@ -2342,6 +2343,22 @@ HBaseCon West Presentations Recordings | https://www.youtube.com/watch?v=KUafRI5BN5Mlist=PLe-h9HrA9qfDVOeNh1l_T5HvwvkO9raWyindex=7;>Recording) + + + + + + + + + David Pope Javier Maestro (Facebook) + + + Containerizing HBase clusters (https://speakerdeck.com/jjmaestro/hbasecon-2016-west-containerizing-apache-hbase-clusters;>Slides) + + + + diff --git a/www.hbasecon.com/index.html b/www.hbasecon.com/index.html index f565709..5adb359 100644 --- a/www.hbasecon.com/index.html +++ b/www.hbasecon.com/index.html @@ -184,13 +184,28 @@ Solving Multi-tenancy and G1GC in Apache HBase (http://www.slideshare.net/HBaseCon/solving-multitenancy-and-g1gc-in-apache-hbase-64638385;>Slides | https://www.youtube.com/watch?v=KUafRI5BN5Mlist=PLe-h9HrA9qfDVOeNh1l_T5HvwvkO9raWyindex=7;>Recording) - + + + + + +David Pope and Javier Maestro (Facebook) + +Containerizing HBase clusters (https://speakerdeck.com/jjmaestro/hbasecon-2016-west-containerizing-apache-hbase-clusters;>Slides) + + + + + Viplava Madasu (HPE) and Michael Stack (Cloudera) / Liqi Yi and Shylaja Kokoori (Intel) BigBucket Cache, Texas Edition (http://www.slideshare.net/HBaseCon/bigbucket-cache-texas-edition;>Slides) / Breaking the Sound Barrier with Persistent Memory (http://www.slideshare.net/HBaseCon/breaking-the-sound-barrier-with-persistent-memory-64638211;>Slides) (https://www.youtube.com/watch?v=V3o4An1pVkUlist=PLe-h9HrA9qfDVOeNh1l_T5HvwvkO9raWyinde
[hbase-site] 01/02: Add synopsis of Duo's email to the dev/user lists on hbaseconasia2019. Add links to talks and photos.
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hbase-site.git commit c8920484d1bc621310538c8e4188e6c209e839db Author: stack AuthorDate: Tue Aug 20 10:53:29 2019 -0700 Add synopsis of Duo's email to the dev/user lists on hbaseconasia2019. Add links to talks and photos. --- hbasecon-archives.html | 16 1 file changed, 16 insertions(+) diff --git a/hbasecon-archives.html b/hbasecon-archives.html index a039207..4b093e5a 100644 --- a/hbasecon-archives.html +++ b/hbasecon-archives.html @@ -14,6 +14,22 @@ +2019 HBaseCon Asia Presentations +2019 talks are available on https://www.slideshare.net/search/slideshow?searchfrom=headerq=hbaseconasia2019ud=anyft=alllang=ensort=;>slideshare. + +There were roughly 500+ attendees and more than 20 presentations. There was also a developer meeting on the day after the conference (The notes from the meeting +were posted to the hbase dev list). Here are photos of https://drive.google.com/file/d/11_fQJ2Uh5Gz3Bcw3KzurF5g01UGzbPAH/view?usp=drive_web;>all speakers and some guests from Xiaomi. +Here is +https://drive.google.com/file/d/1OSE5fQ_H-oClWW_8DFh_SwnuNM0k6nh_/view?usp=drive_web;>a picture of the committers who were present. +From left to right: Guanghao Zhang, Zheng Hu, Phil Yang(Zhe Yang), Allan +Yang(Wenlong Yang), Duo Zhang, Yu Li, Wellington Chevreuil, Anoop Sam John, +Ramkrishna S. Vasudevan, Chunhui Shen, Guangxu Cheng, and Heng Chen. This is the +https://drive.google.com/file/d/1Y8lTV-vM7NWROMCPXPYWzx5n_9rmqu4k/view?usp=drive_web;>main hall of the conference. +More pictures can be found https://live.photoplus.cn/activity/live/pc/66810531/#/;>here. +An article from Xiaomi http://blog.mi.com/en/2019/07/21/xiaomi-amplifies-commitment-to-open-source-software;>tells about the conference. +Thanks the HBase community and thanks all the speakersattendees. See you next year on HBaseConAsia 2020! +(Above taken from an email to the hbase mailing lists by Duo Zhang.) + 2018 HBaseCon Asia Presentations See the HBase Blog, https://blogs.apache.org/hbase/entry/beijing-in-summertime-hbaseconasia2018;>Beijing in Summertime: HBaseCon2018. 2018
[hbase-site] branch asf-site updated (a176412 -> f1c3008)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/hbase-site.git. from a176412 INFRA-10751 Empty commit new c892048 Add synopsis of Duo's email to the dev/user lists on hbaseconasia2019. Add links to talks and photos. new f1c3008 Adding links to talk by Javier Maestro and David Pope of Facebook that was missing from 2016 hbasecon operations track at Javier's request... see below: The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: hbasecon-archives.html | 33 + www.hbasecon.com/index.html | 19 +-- 2 files changed, 50 insertions(+), 2 deletions(-)
[hbase] 01/01: HBASE-23584 cache filestatus in storefileinfo
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch HBASE-23584.master
in repository https://gitbox.apache.org/repos/asf/hbase.git
commit b9a425b73b7a5fb654ee14c2425cf1b8b49640f1
Author: yuhuiyang
AuthorDate: Tue Aug 31 10:47:16 2021 -0700
HBASE-23584 cache filestatus in storefileinfo
---
.../apache/hadoop/hbase/regionserver/HRegion.java | 3 +-
.../hadoop/hbase/regionserver/StoreFileInfo.java | 246 +++--
2 files changed, 127 insertions(+), 122 deletions(-)
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
index 22e3901..4837528 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
@@ -1291,8 +1291,7 @@ public class HRegion implements HeapSize,
PropagatingConfigurationObserver, Regi
// Only construct StoreFileInfo object if its not a hfile, save obj
// creation
StoreFileInfo storeFileInfo = new StoreFileInfo(conf, fs, status);
- hdfsBlocksDistribution.add(storeFileInfo
- .computeHDFSBlocksDistribution(fs));
+
hdfsBlocksDistribution.add(storeFileInfo.computeHDFSBlocksDistribution());
} else if (StoreFileInfo.isHFile(p)) {
// If its a HFile, then lets just add to the block distribution
// lets not create more objects here, not even another
HDFSBlocksDistribution
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFileInfo.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFileInfo.java
index 5eaab23..c2f5700 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFileInfo.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFileInfo.java
@@ -1,5 +1,4 @@
-/**
- *
+/*
* Licensed to the Apache Software Foundation (ASF) under one
* or more contributor license agreements. See the NOTICE file
* distributed with this work for additional information
@@ -18,13 +17,11 @@
*/
package org.apache.hadoop.hbase.regionserver;
-
import java.io.FileNotFoundException;
import java.io.IOException;
import java.util.concurrent.atomic.AtomicInteger;
import java.util.regex.Matcher;
import java.util.regex.Pattern;
-
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FileStatus;
import org.apache.hadoop.fs.FileSystem;
@@ -46,7 +43,8 @@ import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
/**
- * Describe a StoreFile (hfile, reference, link)
+ * StoreFile info.
+ * The info could be for a plain storefile/hfile or it could be a reference or
link to a storefile.
*/
@InterfaceAudience.Private
public class StoreFileInfo {
@@ -112,6 +110,16 @@ public class StoreFileInfo {
final AtomicInteger refCount = new AtomicInteger(0);
/**
+ * Cached fileStatus.
+ * Used selectively. Cache the FileStatus if this StoreFileInfo is for a
plain StoreFile.
+ * Save on having to go to the filesystem every time (costly). We cannot
cache FileStatus if this
+ * StoreFileInfo is for a link or for a reference that might in turn be to a
link. The file behind
+ * a link can move during the lifetime of this StoreFileInfo invalidating
what we might have
+ * cached here; do a lookup of FileStatus every time when a link to be safe.
+ */
+ private FileStatus cachedFileStatus = null;
+
+ /**
* Create a Store File Info
* @param conf the {@link Configuration} to use
* @param fs The current file system to use.
@@ -135,37 +143,32 @@ public class StoreFileInfo {
this.primaryReplica = primaryReplica;
this.noReadahead = this.conf.getBoolean(STORE_FILE_READER_NO_READAHEAD,
DEFAULT_STORE_FILE_READER_NO_READAHEAD);
-Path p = initialPath;
-if (HFileLink.isHFileLink(p)) {
- // HFileLink
+if (HFileLink.isHFileLink(initialPath)) {
this.reference = null;
- this.link = HFileLink.buildFromHFileLinkPattern(conf, p);
- LOG.trace("{} is a link", p);
-} else if (isReference(p)) {
- this.reference = Reference.read(fs, p);
- Path referencePath = getReferredToFile(p);
- if (HFileLink.isHFileLink(referencePath)) {
-// HFileLink Reference
-this.link = HFileLink.buildFromHFileLinkPattern(conf, referencePath);
- } else {
-// Reference
-this.link = null;
- }
- LOG.trace("{} is a {} reference to {}", p, reference.getFileRegion(),
referencePath);
-} else if (isHFile(p) || isMobFile(p) || isMobRefFile(p)) {
- // HFile
- if (fileStatus != null) {
-this.createdTimestamp = fileStatus.getModificationTime();
-this.size = fileStatus.getLen();
- } else {
-FileStatus fStatus = fs.getFi
[hbase] branch HBASE-23584.master created (now b9a425b)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch HBASE-23584.master in repository https://gitbox.apache.org/repos/asf/hbase.git. at b9a425b HBASE-23584 cache filestatus in storefileinfo This branch includes the following new commits: new b9a425b HBASE-23584 cache filestatus in storefileinfo The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[hbase] branch master updated: HBASE-26103 Deprecate BufferedMutatorParams#pool method (#3635)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/master by this push:
new a0864ed HBASE-26103 Deprecate BufferedMutatorParams#pool method
(#3635)
a0864ed is described below
commit a0864ed3bc47a02635c8aa69a98cbf99c5070d6c
Author: Rushabh Shah
AuthorDate: Mon Aug 30 13:21:32 2021 -0400
HBASE-26103 Deprecate BufferedMutatorParams#pool method (#3635)
Signed-off-by: Anoop Sam John
Signed-off-by: stack
---
.../org/apache/hadoop/hbase/client/BufferedMutatorParams.java | 8
1 file changed, 8 insertions(+)
diff --git
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/BufferedMutatorParams.java
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/BufferedMutatorParams.java
index e71a1d3..54c133b 100644
---
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/BufferedMutatorParams.java
+++
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/BufferedMutatorParams.java
@@ -144,6 +144,11 @@ public class BufferedMutatorParams implements Cloneable {
return this;
}
+ /**
+ * @deprecated Since 3.0.0-alpha-2, will be removed in 4.0.0. You can not
set it anymore.
+ * BufferedMutator will use Connection's ExecutorService.
+ */
+ @Deprecated
public ExecutorService getPool() {
return pool;
}
@@ -151,7 +156,10 @@ public class BufferedMutatorParams implements Cloneable {
/**
* Override the default executor pool defined by the {@code
hbase.htable.threads.*}
* configuration values.
+ * @deprecated Since 3.0.0-alpha-2, will be removed in 4.0.0. You can not
set it anymore.
+ * BufferedMutator will use Connection's ExecutorService.
*/
+ @Deprecated
public BufferedMutatorParams pool(ExecutorService pool) {
this.pool = pool;
return this;
[hbase] branch branch-2 updated (f2f99ae -> 1016020)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch branch-2 in repository https://gitbox.apache.org/repos/asf/hbase.git. from f2f99ae Amend HBASE-26187 UTs, adding a check for Split procedure completion before proceeding with test logic. (#3598) add 1016020 HBASE-24337 Backport HBASE-23968 to branch-2 (#3588) No new revisions were added by this update. Summary of changes: .../hadoop/hbase/mob/DefaultMobStoreCompactor.java | 26 +++ .../apache/hadoop/hbase/regionserver/HRegion.java | 16 ++-- .../apache/hadoop/hbase/regionserver/HStore.java | 14 .../regionserver/compactions/CloseChecker.java | 80 .../hbase/regionserver/compactions/Compactor.java | 26 +++ .../hadoop/hbase/regionserver/TestCompaction.java | 86 +- .../regionserver/compactions/TestCloseChecker.java | 80 7 files changed, 274 insertions(+), 54 deletions(-) create mode 100644 hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/CloseChecker.java create mode 100644 hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/compactions/TestCloseChecker.java
[hbase] branch master updated: HBASE-24842 make export snapshot report size can be config (#2233)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/master by this push:
new dc8196f HBASE-24842 make export snapshot report size can be config
(#2233)
dc8196f is described below
commit dc8196faf4873516d8d7325516f01ad4cdf13166
Author: Yechao Chen
AuthorDate: Tue Aug 17 08:15:00 2021 +0800
HBASE-24842 make export snapshot report size can be config (#2233)
Signed-off-by: stack
---
.../main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java | 5 -
1 file changed, 4 insertions(+), 1 deletion(-)
diff --git
a/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java
b/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java
index c5650c3..42881be 100644
---
a/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java
+++
b/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java
@@ -112,6 +112,7 @@ public class ExportSnapshot extends AbstractHBaseTool
implements Tool {
private static final String CONF_OUTPUT_ROOT = "snapshot.export.output.root";
private static final String CONF_INPUT_ROOT = "snapshot.export.input.root";
private static final String CONF_BUFFER_SIZE = "snapshot.export.buffer.size";
+ private static final String CONF_REPORT_SIZE = "snapshot.export.report.size";
private static final String CONF_MAP_GROUP =
"snapshot.export.default.map.group";
private static final String CONF_BANDWIDTH_MB =
"snapshot.export.map.bandwidth.mb";
private static final String CONF_MR_JOB_NAME = "mapreduce.job.name";
@@ -172,6 +173,7 @@ public class ExportSnapshot extends AbstractHBaseTool
implements Tool {
private String filesUser;
private short filesMode;
private int bufferSize;
+private int reportSize;
private FileSystem outputFs;
private Path outputArchive;
@@ -219,6 +221,7 @@ public class ExportSnapshot extends AbstractHBaseTool
implements Tool {
int defaultBlockSize = Math.max((int)
outputFs.getDefaultBlockSize(outputRoot), BUFFER_SIZE);
bufferSize = conf.getInt(CONF_BUFFER_SIZE, defaultBlockSize);
LOG.info("Using bufferSize=" + StringUtils.humanReadableInt(bufferSize));
+ reportSize = conf.getInt(CONF_REPORT_SIZE, REPORT_SIZE);
for (Counter c : Counter.values()) {
context.getCounter(c).increment(0);
@@ -423,7 +426,7 @@ public class ExportSnapshot extends AbstractHBaseTool
implements Tool {
totalBytesWritten += bytesRead;
reportBytes += bytesRead;
- if (reportBytes >= REPORT_SIZE) {
+ if (reportBytes >= reportSize) {
context.getCounter(Counter.BYTES_COPIED).increment(reportBytes);
context.setStatus(String.format(statusMessage,
StringUtils.humanReadableInt(totalBytesWritten),
[hbase] branch branch-2 updated: HBASE-24570 connection#close throws NPE
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2 by this push:
new 13c5cfa HBASE-24570 connection#close throws NPE
13c5cfa is described below
commit 13c5cfa361c99e4019b20b170c61664f2db19b20
Author: Bo Cui
AuthorDate: Sat Jul 18 10:26:00 2020 +0800
HBASE-24570 connection#close throws NPE
---
.../java/org/apache/hadoop/hbase/client/ConnectionImplementation.java | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)
diff --git
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
index c88908f..936f7f5 100644
---
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
+++
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
@@ -2113,7 +2113,9 @@ class ConnectionImplementation implements
ClusterConnection, Closeable {
this.metrics.shutdown();
}
this.closed = true;
-registry.close();
+if (this.registry != null) {
+ registry.close();
+}
this.stubs.clear();
if (clusterStatusListener != null) {
clusterStatusListener.close();
[hbase] branch branch-2.4 updated: HBASE-24570 connection#close throws NPE
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 125544a HBASE-24570 connection#close throws NPE
125544a is described below
commit 125544acfa0395e0043053ae9da209ba65a7e32c
Author: Bo Cui
AuthorDate: Sat Jul 18 10:26:00 2020 +0800
HBASE-24570 connection#close throws NPE
---
.../java/org/apache/hadoop/hbase/client/ConnectionImplementation.java | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)
diff --git
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
index 9145c55..cfbc19c 100644
---
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
+++
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
@@ -2116,7 +2116,9 @@ class ConnectionImplementation implements
ClusterConnection, Closeable {
this.metrics.shutdown();
}
this.closed = true;
-registry.close();
+if (this.registry != null) {
+ registry.close();
+}
this.stubs.clear();
if (clusterStatusListener != null) {
clusterStatusListener.close();
[hbase] branch branch-2.3 updated: HBASE-24570 connection#close throws NPE
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.3 by this push:
new 77674b2 HBASE-24570 connection#close throws NPE
77674b2 is described below
commit 77674b2b9f39527c0cdde7bed854679272882bf3
Author: Bo Cui
AuthorDate: Sat Jul 18 10:26:00 2020 +0800
HBASE-24570 connection#close throws NPE
---
.../java/org/apache/hadoop/hbase/client/ConnectionImplementation.java | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)
diff --git
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
index 4d2a41f..2b28642 100644
---
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
+++
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
@@ -2050,7 +2050,9 @@ class ConnectionImplementation implements
ClusterConnection, Closeable {
this.metrics.shutdown();
}
this.closed = true;
-registry.close();
+if (this.registry != null) {
+ registry.close();
+}
this.stubs.clear();
if (clusterStatusListener != null) {
clusterStatusListener.close();
[hbase] branch master updated: HBASE-24652 master-status UI make date type fields sortable
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/master by this push:
new 356cfe9 HBASE-24652 master-status UI make date type fields sortable
356cfe9 is described below
commit 356cfe9351fadef6043fc6c15e85154d8058ee78
Author: eomiks
AuthorDate: Mon Jun 29 01:18:45 2020 +0900
HBASE-24652 master-status UI make date type fields sortable
---
.../apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon | 12
1 file changed, 12 insertions(+)
diff --git
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
index cce8a12..87b8289 100644
---
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
+++
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
@@ -452,8 +452,20 @@ AssignmentManager assignmentManager =
master.getAssignmentManager();
return $.tablesorter.formatFloat( s.replace(/,/g,'') );
}, type: "numeric"
});
+$.tablesorter.addParser(
+{
+id: "dateTime",
+is: function (s) {
+return
/^([a-zA-Z]{3}\s){2}\d{2}\s\d{2}:\d{2}:\d{2}\s[a-zA-Z]{3}\s\d{4}$/.test(s);
+}, format: function (s) {
+var split = s.split(" ");
+var time = Date.parse(split[1] + " " + split[2] + " " +
split[3] + " " + split[5]);
+return $.tablesorter.formatFloat(time);
+}, type: "numeric"
+});
$("#baseStatsTable").tablesorter({
headers: {
+1: {sorter: 'dateTime'},
4: {sorter: 'separator'},
5: {sorter: 'separator'}
}
[hbase] branch branch-2 updated: HBASE-24652 master-status UI make date type fields sortable
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2 by this push:
new 5eac407 HBASE-24652 master-status UI make date type fields sortable
5eac407 is described below
commit 5eac40794475587afb480c9c529dd4b95d269150
Author: eomiks
AuthorDate: Mon Jun 29 01:18:45 2020 +0900
HBASE-24652 master-status UI make date type fields sortable
---
.../apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon | 12
1 file changed, 12 insertions(+)
diff --git
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
index 480d11d..0d96a84 100644
---
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
+++
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
@@ -452,8 +452,20 @@ AssignmentManager assignmentManager =
master.getAssignmentManager();
return $.tablesorter.formatFloat( s.replace(/,/g,'') );
}, type: "numeric"
});
+$.tablesorter.addParser(
+{
+id: "dateTime",
+is: function (s) {
+return
/^([a-zA-Z]{3}\s){2}\d{2}\s\d{2}:\d{2}:\d{2}\s[a-zA-Z]{3}\s\d{4}$/.test(s);
+}, format: function (s) {
+var split = s.split(" ");
+var time = Date.parse(split[1] + " " + split[2] + " " +
split[3] + " " + split[5]);
+return $.tablesorter.formatFloat(time);
+}, type: "numeric"
+});
$("#baseStatsTable").tablesorter({
headers: {
+1: {sorter: 'dateTime'},
4: {sorter: 'separator'},
5: {sorter: 'separator'}
}
[hbase] branch branch-2.4 updated: HBASE-24652 master-status UI make date type fields sortable
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 96015e9 HBASE-24652 master-status UI make date type fields sortable
96015e9 is described below
commit 96015e9669158d5b0426814628adad825fa91f4e
Author: eomiks
AuthorDate: Mon Jun 29 01:18:45 2020 +0900
HBASE-24652 master-status UI make date type fields sortable
---
.../apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon | 12
1 file changed, 12 insertions(+)
diff --git
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
index dcedb28..8cebaaa 100644
---
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
+++
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
@@ -453,8 +453,20 @@ AssignmentManager assignmentManager =
master.getAssignmentManager();
return $.tablesorter.formatFloat( s.replace(/,/g,'') );
}, type: "numeric"
});
+$.tablesorter.addParser(
+{
+id: "dateTime",
+is: function (s) {
+return
/^([a-zA-Z]{3}\s){2}\d{2}\s\d{2}:\d{2}:\d{2}\s[a-zA-Z]{3}\s\d{4}$/.test(s);
+}, format: function (s) {
+var split = s.split(" ");
+var time = Date.parse(split[1] + " " + split[2] + " " +
split[3] + " " + split[5]);
+return $.tablesorter.formatFloat(time);
+}, type: "numeric"
+});
$("#baseStatsTable").tablesorter({
headers: {
+1: {sorter: 'dateTime'},
4: {sorter: 'separator'},
5: {sorter: 'separator'}
}
[hbase] branch branch-2.3 updated: HBASE-24652 master-status UI make date type fields sortable
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.3 by this push:
new 9091b2c HBASE-24652 master-status UI make date type fields sortable
9091b2c is described below
commit 9091b2c51aa56f7606b2bad0a69585763e44c0cf
Author: eomiks
AuthorDate: Mon Jun 29 01:18:45 2020 +0900
HBASE-24652 master-status UI make date type fields sortable
---
.../apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon | 12
1 file changed, 12 insertions(+)
diff --git
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
index e41a3aa..ebcf472 100644
---
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
+++
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
@@ -450,8 +450,20 @@ AssignmentManager assignmentManager =
master.getAssignmentManager();
return $.tablesorter.formatFloat( s.replace(/,/g,'') );
}, type: "numeric"
});
+$.tablesorter.addParser(
+{
+id: "dateTime",
+is: function (s) {
+return
/^([a-zA-Z]{3}\s){2}\d{2}\s\d{2}:\d{2}:\d{2}\s[a-zA-Z]{3}\s\d{4}$/.test(s);
+}, format: function (s) {
+var split = s.split(" ");
+var time = Date.parse(split[1] + " " + split[2] + " " +
split[3] + " " + split[5]);
+return $.tablesorter.formatFloat(time);
+}, type: "numeric"
+});
$("#baseStatsTable").tablesorter({
headers: {
+1: {sorter: 'dateTime'},
4: {sorter: 'separator'},
5: {sorter: 'separator'}
}
[hbase] branch master updated (1c71cb2 -> 19f5ad5)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hbase.git. from 1c71cb2 HBASE-26037 Implement namespace and table level access control for thrift & thrift2 (#3437) add 19f5ad5 HBASE-26200 Revert "HBASE-25165 Change 'State time' in UI so sorts (#2508)" No new revisions were added by this update. Summary of changes: .../org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[hbase] branch branch-2 updated (e08b364 -> 63c57d7)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch branch-2 in repository https://gitbox.apache.org/repos/asf/hbase.git. from e08b364 HBASE-26196 Support configuration override for remote cluster of HFileOutputFormat locality sensitive (#3582) add 63c57d7 HBASE-26200 Revert "HBASE-25165 Change 'State time' in UI so sorts (#2508)" No new revisions were added by this update. Summary of changes: .../org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[hbase] branch branch-2.4 updated: HBASE-26200 Revert "HBASE-25165 Change 'State time' in UI so sorts (#2508)"
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 2ad7905 HBASE-26200 Revert "HBASE-25165 Change 'State time' in UI so
sorts (#2508)"
2ad7905 is described below
commit 2ad7905ddc1c1dcf4c04b386852ee175c15df81a
Author: stack
AuthorDate: Mon Aug 16 13:46:05 2021 -0700
HBASE-26200 Revert "HBASE-25165 Change 'State time' in UI so sorts (#2508)"
This reverts commit d07d181ea4a9da316659bb21fd4fffc979b5f77a.
---
.../org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon
index 5878361..a3067ee 100644
---
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon
+++
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon
@@ -121,7 +121,7 @@ Arrays.sort(serverNames);
<& serverNameLink; serverName=serverName; &>
-<% java.time.Instant.ofEpochMilli(startcode) %>
+<% new Date(startcode) %>
<% TraditionalBinaryPrefix.long2String(lastContact, "s", 1) %>
<% version %>
<% String.format("%,.0f", requestsPerSecond) %>
[hbase] branch branch-2.3 updated: HBASE-26200 Revert "HBASE-25165 Change 'State time' in UI so sorts"
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.3 by this push:
new 3433ec8 HBASE-26200 Revert "HBASE-25165 Change 'State time' in UI so
sorts"
3433ec8 is described below
commit 3433ec84a5f3fa00af0c561d3252bf8691904f3c
Author: stack
AuthorDate: Mon Aug 16 13:44:07 2021 -0700
HBASE-26200 Revert "HBASE-25165 Change 'State time' in UI so sorts"
This reverts commit 976205fba05197d224a0b23aab88ad34dbdfaae9.
---
.../org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon
index 5878361..a3067ee 100644
---
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon
+++
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon
@@ -121,7 +121,7 @@ Arrays.sort(serverNames);
<& serverNameLink; serverName=serverName; &>
-<% java.time.Instant.ofEpochMilli(startcode) %>
+<% new Date(startcode) %>
<% TraditionalBinaryPrefix.long2String(lastContact, "s", 1) %>
<% version %>
<% String.format("%,.0f", requestsPerSecond) %>
[hbase] branch master updated (ad7e2ce -> 1c71cb2)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hbase.git.
from ad7e2ce HBASE-26196 Support configuration override for remote cluster
of HFileOutputFormat locality sensitive (#3582)
add 1c71cb2 HBASE-26037 Implement namespace and table level access
control for thrift & thrift2 (#3437)
No new revisions were added by this update.
Summary of changes:
.../hbase/thrift/ThriftHBaseServiceHandler.java| 48 +
.../hadoop/hbase/thrift/ThriftUtilities.java | 18 +
.../hbase/thrift/generated/AlreadyExists.java |2 +-
.../hbase/thrift/generated/BatchMutation.java |2 +-
.../hbase/thrift/generated/ColumnDescriptor.java |2 +-
.../hadoop/hbase/thrift/generated/Hbase.java | 2362 ++--
.../hadoop/hbase/thrift/generated/IOError.java | 60 +-
.../hbase/thrift/generated/IllegalArgument.java|2 +-
.../hadoop/hbase/thrift/generated/Mutation.java|2 +-
.../thrift/generated/TAccessControlEntity.java | 820 ++
.../hadoop/hbase/thrift/generated/TAppend.java |2 +-
.../hadoop/hbase/thrift/generated/TCell.java |2 +-
.../hadoop/hbase/thrift/generated/TColumn.java |2 +-
.../hadoop/hbase/thrift/generated/TIncrement.java |2 +-
...ThriftServerType.java => TPermissionScope.java} | 21 +-
.../hadoop/hbase/thrift/generated/TRegionInfo.java |2 +-
.../hadoop/hbase/thrift/generated/TRowResult.java |2 +-
.../hadoop/hbase/thrift/generated/TScan.java |2 +-
.../hbase/thrift/generated/TThriftServerType.java |2 +-
.../hbase/thrift2/ThriftHBaseServiceHandler.java | 48 +
.../hadoop/hbase/thrift2/ThriftUtilities.java | 17 +
.../thrift2/generated/TAccessControlEntity.java| 807 ++
.../hadoop/hbase/thrift2/generated/TAppend.java|2 +-
.../hbase/thrift2/generated/TAuthorization.java|2 +-
.../hbase/thrift2/generated/TBloomFilterType.java |2 +-
.../hbase/thrift2/generated/TCellVisibility.java |2 +-
.../hadoop/hbase/thrift2/generated/TColumn.java|2 +-
.../thrift2/generated/TColumnFamilyDescriptor.java |2 +-
.../hbase/thrift2/generated/TColumnIncrement.java |2 +-
.../hbase/thrift2/generated/TColumnValue.java |2 +-
.../hbase/thrift2/generated/TCompareOperator.java |2 +-
.../thrift2/generated/TCompressionAlgorithm.java |2 +-
.../hbase/thrift2/generated/TConsistency.java |2 +-
.../thrift2/generated/TDataBlockEncoding.java |2 +-
.../hadoop/hbase/thrift2/generated/TDelete.java|2 +-
.../hbase/thrift2/generated/TDeleteType.java |2 +-
.../hbase/thrift2/generated/TDurability.java |2 +-
.../hbase/thrift2/generated/TFilterByOperator.java |2 +-
.../hadoop/hbase/thrift2/generated/TGet.java |2 +-
.../hbase/thrift2/generated/THBaseService.java | 2982
.../hbase/thrift2/generated/THRegionInfo.java |2 +-
.../hbase/thrift2/generated/THRegionLocation.java |2 +-
.../hadoop/hbase/thrift2/generated/TIOError.java | 104 +-
.../hbase/thrift2/generated/TIllegalArgument.java |2 +-
.../hadoop/hbase/thrift2/generated/TIncrement.java |2 +-
.../hbase/thrift2/generated/TKeepDeletedCells.java |2 +-
.../hbase/thrift2/generated/TLogQueryFilter.java |2 +-
.../hadoop/hbase/thrift2/generated/TLogType.java |2 +-
.../hadoop/hbase/thrift2/generated/TMutation.java |2 +-
.../thrift2/generated/TNamespaceDescriptor.java|2 +-
.../hbase/thrift2/generated/TOnlineLogRecord.java |2 +-
...FilterByOperator.java => TPermissionScope.java} | 16 +-
.../hadoop/hbase/thrift2/generated/TPut.java |2 +-
.../hadoop/hbase/thrift2/generated/TReadType.java |2 +-
.../hadoop/hbase/thrift2/generated/TResult.java|2 +-
.../hbase/thrift2/generated/TRowMutations.java |2 +-
.../hadoop/hbase/thrift2/generated/TScan.java |2 +-
.../hbase/thrift2/generated/TServerName.java |2 +-
.../hbase/thrift2/generated/TTableDescriptor.java |2 +-
.../hadoop/hbase/thrift2/generated/TTableName.java |2 +-
.../hbase/thrift2/generated/TThriftServerType.java |2 +-
.../hadoop/hbase/thrift2/generated/TTimeRange.java |2 +-
.../org/apache/hadoop/hbase/thrift/Hbase.thrift| 30 +
.../org/apache/hadoop/hbase/thrift2/hbase.thrift | 29 +
.../thrift2/TestThriftHBaseServiceHandler.java | 84 +
65 files changed, 6720 insertions(+), 826 deletions(-)
create mode 100644
hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/generated/TAccessControlEntity.java
copy
hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/generated/{TThriftServerType.java
=> TPermissionScope.java} (67%)
create mode 100644
hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift2/generated/TAccessControlEntity.java
copy
hbase-thrift/src/
[hbase] branch branch-2.4 updated: HBASE-26196 Support configuration override for remote cluster of HFileOutputFormat locality sensitive (#3582)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 6cc26c2 HBASE-26196 Support configuration override for remote cluster
of HFileOutputFormat locality sensitive (#3582)
6cc26c2 is described below
commit 6cc26c2487b471a294e0c4dbeed68884cd39ad46
Author: bitterfox
AuthorDate: Tue Aug 17 02:26:25 2021 +0900
HBASE-26196 Support configuration override for remote cluster of
HFileOutputFormat locality sensitive (#3582)
Signed-off-by: stack
---
.../hadoop/hbase/mapreduce/HFileOutputFormat2.java | 26 +++---
.../hbase/mapreduce/TestHFileOutputFormat2.java| 9
2 files changed, 32 insertions(+), 3 deletions(-)
diff --git
a/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java
b/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java
index 02b5768..2187de0 100644
---
a/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java
+++
b/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java
@@ -31,6 +31,7 @@ import java.util.ArrayList;
import java.util.Arrays;
import java.util.List;
import java.util.Map;
+import java.util.Map.Entry;
import java.util.Set;
import java.util.TreeMap;
import java.util.TreeSet;
@@ -176,12 +177,14 @@ public class HFileOutputFormat2
static final String MULTI_TABLE_HFILEOUTPUTFORMAT_CONF_KEY =
"hbase.mapreduce.use.multi.table.hfileoutputformat";
+ public static final String REMOTE_CLUSTER_CONF_PREFIX =
+"hbase.hfileoutputformat.remote.cluster.";
public static final String REMOTE_CLUSTER_ZOOKEEPER_QUORUM_CONF_KEY =
-"hbase.hfileoutputformat.remote.cluster.zookeeper.quorum";
+REMOTE_CLUSTER_CONF_PREFIX + "zookeeper.quorum";
public static final String REMOTE_CLUSTER_ZOOKEEPER_CLIENT_PORT_CONF_KEY =
-"hbase.hfileoutputformat.remote.cluster.zookeeper." +
HConstants.CLIENT_PORT_STR;
+REMOTE_CLUSTER_CONF_PREFIX + "zookeeper." + HConstants.CLIENT_PORT_STR;
public static final String REMOTE_CLUSTER_ZOOKEEPER_ZNODE_PARENT_CONF_KEY =
-"hbase.hfileoutputformat.remote.cluster." +
HConstants.ZOOKEEPER_ZNODE_PARENT;
+REMOTE_CLUSTER_CONF_PREFIX + HConstants.ZOOKEEPER_ZNODE_PARENT;
public static final String STORAGE_POLICY_PROPERTY =
HStore.BLOCK_STORAGE_POLICY_KEY;
public static final String STORAGE_POLICY_PROPERTY_CF_PREFIX =
STORAGE_POLICY_PROPERTY + ".";
@@ -379,6 +382,23 @@ public class HFileOutputFormat2
newConf.set(HConstants.ZOOKEEPER_ZNODE_PARENT, parent);
}
+for (Entry entry : conf) {
+ String key = entry.getKey();
+ if (REMOTE_CLUSTER_ZOOKEEPER_QUORUM_CONF_KEY.equals(key) ||
+ REMOTE_CLUSTER_ZOOKEEPER_CLIENT_PORT_CONF_KEY.equals(key) ||
+ REMOTE_CLUSTER_ZOOKEEPER_ZNODE_PARENT_CONF_KEY.equals(key)) {
+// Handled them above
+continue;
+ }
+
+ if (entry.getKey().startsWith(REMOTE_CLUSTER_CONF_PREFIX)) {
+String originalKey =
entry.getKey().substring(REMOTE_CLUSTER_CONF_PREFIX.length());
+if (!originalKey.isEmpty()) {
+ newConf.set(originalKey, entry.getValue());
+}
+ }
+}
+
return newConf;
}
diff --git
a/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat2.java
b/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat2.java
index f94df25..f4cc385 100644
---
a/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat2.java
+++
b/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat2.java
@@ -96,6 +96,7 @@ import org.apache.hadoop.hbase.regionserver.HRegion;
import org.apache.hadoop.hbase.regionserver.HStore;
import org.apache.hadoop.hbase.regionserver.TestHRegionFileSystem;
import org.apache.hadoop.hbase.regionserver.TimeRangeTracker;
+import org.apache.hadoop.hbase.security.SecurityConstants;
import org.apache.hadoop.hbase.security.User;
import org.apache.hadoop.hbase.testclassification.LargeTests;
import org.apache.hadoop.hbase.testclassification.VerySlowMapReduceTests;
@@ -1612,6 +1613,11 @@ public class TestHFileOutputFormat2 {
assertEquals(confB.get(HConstants.ZOOKEEPER_ZNODE_PARENT),
jobConf.get(HFileOutputFormat2.REMOTE_CLUSTER_ZOOKEEPER_ZNODE_PARENT_CONF_KEY));
+ String bSpecificConfigKey = "my.override.config.for.b";
+ String bSpecificConfigValue = "b-specific-value";
+ jobConf.set(HFileOutputFormat2.REMOTE_CLUSTER_CONF_PREFIX +
bSpecificConfigKey,
+bSpecificConfigValue)
[hbase] branch branch-2 updated: HBASE-26196 Support configuration override for remote cluster of HFileOutputFormat locality sensitive (#3582)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2 by this push:
new e08b364 HBASE-26196 Support configuration override for remote cluster
of HFileOutputFormat locality sensitive (#3582)
e08b364 is described below
commit e08b3642a76961036b51e6959d46590367d8f257
Author: bitterfox
AuthorDate: Tue Aug 17 02:26:25 2021 +0900
HBASE-26196 Support configuration override for remote cluster of
HFileOutputFormat locality sensitive (#3582)
Signed-off-by: stack
---
.../hadoop/hbase/mapreduce/HFileOutputFormat2.java | 26 +++---
.../hbase/mapreduce/TestHFileOutputFormat2.java| 9
2 files changed, 32 insertions(+), 3 deletions(-)
diff --git
a/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java
b/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java
index 17143e4..ca7c9a3 100644
---
a/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java
+++
b/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java
@@ -31,6 +31,7 @@ import java.util.ArrayList;
import java.util.Arrays;
import java.util.List;
import java.util.Map;
+import java.util.Map.Entry;
import java.util.Set;
import java.util.TreeMap;
import java.util.TreeSet;
@@ -176,12 +177,14 @@ public class HFileOutputFormat2
static final String MULTI_TABLE_HFILEOUTPUTFORMAT_CONF_KEY =
"hbase.mapreduce.use.multi.table.hfileoutputformat";
+ public static final String REMOTE_CLUSTER_CONF_PREFIX =
+"hbase.hfileoutputformat.remote.cluster.";
public static final String REMOTE_CLUSTER_ZOOKEEPER_QUORUM_CONF_KEY =
-"hbase.hfileoutputformat.remote.cluster.zookeeper.quorum";
+REMOTE_CLUSTER_CONF_PREFIX + "zookeeper.quorum";
public static final String REMOTE_CLUSTER_ZOOKEEPER_CLIENT_PORT_CONF_KEY =
-"hbase.hfileoutputformat.remote.cluster.zookeeper." +
HConstants.CLIENT_PORT_STR;
+REMOTE_CLUSTER_CONF_PREFIX + "zookeeper." + HConstants.CLIENT_PORT_STR;
public static final String REMOTE_CLUSTER_ZOOKEEPER_ZNODE_PARENT_CONF_KEY =
-"hbase.hfileoutputformat.remote.cluster." +
HConstants.ZOOKEEPER_ZNODE_PARENT;
+REMOTE_CLUSTER_CONF_PREFIX + HConstants.ZOOKEEPER_ZNODE_PARENT;
public static final String STORAGE_POLICY_PROPERTY =
HStore.BLOCK_STORAGE_POLICY_KEY;
public static final String STORAGE_POLICY_PROPERTY_CF_PREFIX =
STORAGE_POLICY_PROPERTY + ".";
@@ -379,6 +382,23 @@ public class HFileOutputFormat2
newConf.set(HConstants.ZOOKEEPER_ZNODE_PARENT, parent);
}
+for (Entry entry : conf) {
+ String key = entry.getKey();
+ if (REMOTE_CLUSTER_ZOOKEEPER_QUORUM_CONF_KEY.equals(key) ||
+ REMOTE_CLUSTER_ZOOKEEPER_CLIENT_PORT_CONF_KEY.equals(key) ||
+ REMOTE_CLUSTER_ZOOKEEPER_ZNODE_PARENT_CONF_KEY.equals(key)) {
+// Handled them above
+continue;
+ }
+
+ if (entry.getKey().startsWith(REMOTE_CLUSTER_CONF_PREFIX)) {
+String originalKey =
entry.getKey().substring(REMOTE_CLUSTER_CONF_PREFIX.length());
+if (!originalKey.isEmpty()) {
+ newConf.set(originalKey, entry.getValue());
+}
+ }
+}
+
return newConf;
}
diff --git
a/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat2.java
b/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat2.java
index f94df25..f4cc385 100644
---
a/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat2.java
+++
b/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat2.java
@@ -96,6 +96,7 @@ import org.apache.hadoop.hbase.regionserver.HRegion;
import org.apache.hadoop.hbase.regionserver.HStore;
import org.apache.hadoop.hbase.regionserver.TestHRegionFileSystem;
import org.apache.hadoop.hbase.regionserver.TimeRangeTracker;
+import org.apache.hadoop.hbase.security.SecurityConstants;
import org.apache.hadoop.hbase.security.User;
import org.apache.hadoop.hbase.testclassification.LargeTests;
import org.apache.hadoop.hbase.testclassification.VerySlowMapReduceTests;
@@ -1612,6 +1613,11 @@ public class TestHFileOutputFormat2 {
assertEquals(confB.get(HConstants.ZOOKEEPER_ZNODE_PARENT),
jobConf.get(HFileOutputFormat2.REMOTE_CLUSTER_ZOOKEEPER_ZNODE_PARENT_CONF_KEY));
+ String bSpecificConfigKey = "my.override.config.for.b";
+ String bSpecificConfigValue = "b-specific-value";
+ jobConf.set(HFileOutputFormat2.REMOTE_CLUSTER_CONF_PREFIX +
bSpecificConfigKey,
+bSpecificConfigValue)
[hbase] branch master updated: HBASE-26196 Support configuration override for remote cluster of HFileOutputFormat locality sensitive (#3582)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/master by this push:
new ad7e2ce HBASE-26196 Support configuration override for remote cluster
of HFileOutputFormat locality sensitive (#3582)
ad7e2ce is described below
commit ad7e2cefc8aa624084f49183bdbf60d7ddda8d10
Author: bitterfox
AuthorDate: Tue Aug 17 02:26:25 2021 +0900
HBASE-26196 Support configuration override for remote cluster of
HFileOutputFormat locality sensitive (#3582)
Signed-off-by: stack
---
.../hadoop/hbase/mapreduce/HFileOutputFormat2.java | 26 +++---
.../hbase/mapreduce/TestHFileOutputFormat2.java| 9
2 files changed, 32 insertions(+), 3 deletions(-)
diff --git
a/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java
b/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java
index dd42661..43bb594 100644
---
a/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java
+++
b/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java
@@ -32,6 +32,7 @@ import java.util.ArrayList;
import java.util.Arrays;
import java.util.List;
import java.util.Map;
+import java.util.Map.Entry;
import java.util.Set;
import java.util.TreeMap;
import java.util.TreeSet;
@@ -163,12 +164,14 @@ public class HFileOutputFormat2
static final String MULTI_TABLE_HFILEOUTPUTFORMAT_CONF_KEY =
"hbase.mapreduce.use.multi.table.hfileoutputformat";
+ public static final String REMOTE_CLUSTER_CONF_PREFIX =
+"hbase.hfileoutputformat.remote.cluster.";
public static final String REMOTE_CLUSTER_ZOOKEEPER_QUORUM_CONF_KEY =
-"hbase.hfileoutputformat.remote.cluster.zookeeper.quorum";
+REMOTE_CLUSTER_CONF_PREFIX + "zookeeper.quorum";
public static final String REMOTE_CLUSTER_ZOOKEEPER_CLIENT_PORT_CONF_KEY =
-"hbase.hfileoutputformat.remote.cluster.zookeeper." +
HConstants.CLIENT_PORT_STR;
+REMOTE_CLUSTER_CONF_PREFIX + "zookeeper." + HConstants.CLIENT_PORT_STR;
public static final String REMOTE_CLUSTER_ZOOKEEPER_ZNODE_PARENT_CONF_KEY =
-"hbase.hfileoutputformat.remote.cluster." +
HConstants.ZOOKEEPER_ZNODE_PARENT;
+REMOTE_CLUSTER_CONF_PREFIX + HConstants.ZOOKEEPER_ZNODE_PARENT;
public static final String STORAGE_POLICY_PROPERTY =
HStore.BLOCK_STORAGE_POLICY_KEY;
public static final String STORAGE_POLICY_PROPERTY_CF_PREFIX =
STORAGE_POLICY_PROPERTY + ".";
@@ -361,6 +364,23 @@ public class HFileOutputFormat2
newConf.set(HConstants.ZOOKEEPER_ZNODE_PARENT, parent);
}
+for (Entry entry : conf) {
+ String key = entry.getKey();
+ if (REMOTE_CLUSTER_ZOOKEEPER_QUORUM_CONF_KEY.equals(key) ||
+ REMOTE_CLUSTER_ZOOKEEPER_CLIENT_PORT_CONF_KEY.equals(key) ||
+ REMOTE_CLUSTER_ZOOKEEPER_ZNODE_PARENT_CONF_KEY.equals(key)) {
+// Handled them above
+continue;
+ }
+
+ if (entry.getKey().startsWith(REMOTE_CLUSTER_CONF_PREFIX)) {
+String originalKey =
entry.getKey().substring(REMOTE_CLUSTER_CONF_PREFIX.length());
+if (!originalKey.isEmpty()) {
+ newConf.set(originalKey, entry.getValue());
+}
+ }
+}
+
return newConf;
}
diff --git
a/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat2.java
b/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat2.java
index 12f1a62..f45eb4f 100644
---
a/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat2.java
+++
b/hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat2.java
@@ -102,6 +102,7 @@ import org.apache.hadoop.hbase.regionserver.HRegion;
import org.apache.hadoop.hbase.regionserver.HStore;
import org.apache.hadoop.hbase.regionserver.TestHRegionFileSystem;
import org.apache.hadoop.hbase.regionserver.TimeRangeTracker;
+import org.apache.hadoop.hbase.security.SecurityConstants;
import org.apache.hadoop.hbase.security.User;
import org.apache.hadoop.hbase.testclassification.LargeTests;
import org.apache.hadoop.hbase.testclassification.VerySlowMapReduceTests;
@@ -1693,6 +1694,11 @@ public class TestHFileOutputFormat2 {
assertEquals(confB.get(HConstants.ZOOKEEPER_ZNODE_PARENT),
jobConf.get(HFileOutputFormat2.REMOTE_CLUSTER_ZOOKEEPER_ZNODE_PARENT_CONF_KEY));
+ String bSpecificConfigKey = "my.override.config.for.b";
+ String bSpecificConfigValue = "b-specific-value";
+ jobConf.set(HFileOutputFormat2.REMOTE_CLUSTER_CONF_PREFIX +
bSpecificConfigKey,
+bSpecificConfigValue);
+
[hbase] branch branch-2 updated: Revert "HBASE-26122: Implement an optional maximum size for Gets, after which a partial result is returned (#3532)"
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2 by this push:
new 243e861 Revert "HBASE-26122: Implement an optional maximum size for
Gets, after which a partial result is returned (#3532)"
243e861 is described below
commit 243e861985b9003b33e1d02e20195dd926162680
Author: stack
AuthorDate: Wed Aug 11 07:41:22 2021 -0700
Revert "HBASE-26122: Implement an optional maximum size for Gets, after
which a partial result is returned (#3532)"
This reverts commit 8f16e34eb277097678de73aab1d242c959511ef7.
---
.../java/org/apache/hadoop/hbase/client/Get.java | 23 --
.../apache/hadoop/hbase/protobuf/ProtobufUtil.java | 2 +-
.../hadoop/hbase/shaded/protobuf/ProtobufUtil.java | 9 +--
.../src/main/protobuf/Client.proto | 2 -
.../apache/hadoop/hbase/regionserver/HRegion.java | 36 +++--
.../hadoop/hbase/regionserver/RSRpcServices.java | 10 +--
.../hbase/TestPartialResultsFromClientSide.java| 48
.../hadoop/hbase/regionserver/TestHRegion.java | 85 --
8 files changed, 13 insertions(+), 202 deletions(-)
diff --git a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/Get.java
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/Get.java
index 53b7154..a671b9f 100644
--- a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/Get.java
+++ b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/Get.java
@@ -76,7 +76,6 @@ public class Get extends Query implements Row {
private boolean checkExistenceOnly = false;
private boolean closestRowBefore = false;
private Map> familyMap = new
TreeMap<>(Bytes.BYTES_COMPARATOR);
- private long maxResultSize = -1;
/**
* Create a Get operation for the specified row.
@@ -340,21 +339,6 @@ public class Get extends Query implements Row {
return this;
}
- /**
- * Set the maximum result size. The default is -1; this means that no
specific
- * maximum result size will be set for this Get.
- *
- * If set to a value greater than zero, the server may respond with a Result
where
- * {@link Result#mayHaveMoreCellsInRow()} is true. The user is required to
handle
- * this case.
- *
- * @param maxResultSize The maximum result size in bytes
- */
- public Get setMaxResultSize(long maxResultSize) {
-this.maxResultSize = maxResultSize;
-return this;
- }
-
/* Accessors */
/**
@@ -475,13 +459,6 @@ public class Get extends Query implements Row {
}
/**
- * @return the maximum result size in bytes. See {@link
#setMaxResultSize(long)}
- */
- public long getMaxResultSize() {
-return maxResultSize;
- }
-
- /**
* Compile the details beyond the scope of getFingerprint (row, columns,
* timestamps, etc.) into a Map along with the fingerprinted information.
* Useful for debugging, logging, and administration tools.
diff --git
a/hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
b/hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
index 1c17866..5a01af9 100644
---
a/hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
+++
b/hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
@@ -1382,7 +1382,7 @@ public final class ProtobufUtil {
return (cells == null || cells.isEmpty())
? (proto.getStale() ? EMPTY_RESULT_STALE : EMPTY_RESULT)
-: Result.create(cells, null, proto.getStale(), proto.getPartial());
+: Result.create(cells, null, proto.getStale());
}
diff --git
a/hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ProtobufUtil.java
b/hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ProtobufUtil.java
index d6c7811..c2544f6 100644
---
a/hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ProtobufUtil.java
+++
b/hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ProtobufUtil.java
@@ -592,9 +592,6 @@ public final class ProtobufUtil {
if (proto.hasLoadColumnFamiliesOnDemand()) {
get.setLoadColumnFamiliesOnDemand(proto.getLoadColumnFamiliesOnDemand());
}
-if (proto.hasMaxResultSize()) {
- get.setMaxResultSize(proto.getMaxResultSize());
-}
return get;
}
@@ -1259,9 +1256,6 @@ public final class ProtobufUtil {
if (loadColumnFamiliesOnDemand != null) {
builder.setLoadColumnFamiliesOnDemand(loadColumnFamiliesOnDemand);
}
-if (get.getMaxResultSize() > 0) {
- builder.setMaxResultSize(get.getMaxResultSize());
-}
return builder.build();
}
@@ -1463,7 +1457,6 @@ public final class ProtobufUtil {
ClientProtos.Result.Builder builder = ClientProtos.Result.newBuilder();
builder.setAssociatedCellCount(size);
[hbase] branch branch-2 updated: HBASE-26122: Implement an optional maximum size for Gets, after which a partial result is returned (#3532)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2 by this push:
new 8f16e34 HBASE-26122: Implement an optional maximum size for Gets,
after which a partial result is returned (#3532)
8f16e34 is described below
commit 8f16e34eb277097678de73aab1d242c959511ef7
Author: Bryan Beaudreault
AuthorDate: Tue Aug 10 23:38:06 2021 -0400
HBASE-26122: Implement an optional maximum size for Gets, after which a
partial result is returned (#3532)
Signed-off-by: stack
---
.../java/org/apache/hadoop/hbase/client/Get.java | 23 ++
.../apache/hadoop/hbase/protobuf/ProtobufUtil.java | 2 +-
.../hadoop/hbase/shaded/protobuf/ProtobufUtil.java | 9 ++-
.../src/main/protobuf/Client.proto | 2 +
.../apache/hadoop/hbase/regionserver/HRegion.java | 36 ++---
.../hadoop/hbase/regionserver/RSRpcServices.java | 10 ++-
.../hbase/TestPartialResultsFromClientSide.java| 48
.../hadoop/hbase/regionserver/TestHRegion.java | 85 ++
8 files changed, 202 insertions(+), 13 deletions(-)
diff --git a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/Get.java
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/Get.java
index a671b9f..53b7154 100644
--- a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/Get.java
+++ b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/Get.java
@@ -76,6 +76,7 @@ public class Get extends Query implements Row {
private boolean checkExistenceOnly = false;
private boolean closestRowBefore = false;
private Map> familyMap = new
TreeMap<>(Bytes.BYTES_COMPARATOR);
+ private long maxResultSize = -1;
/**
* Create a Get operation for the specified row.
@@ -339,6 +340,21 @@ public class Get extends Query implements Row {
return this;
}
+ /**
+ * Set the maximum result size. The default is -1; this means that no
specific
+ * maximum result size will be set for this Get.
+ *
+ * If set to a value greater than zero, the server may respond with a Result
where
+ * {@link Result#mayHaveMoreCellsInRow()} is true. The user is required to
handle
+ * this case.
+ *
+ * @param maxResultSize The maximum result size in bytes
+ */
+ public Get setMaxResultSize(long maxResultSize) {
+this.maxResultSize = maxResultSize;
+return this;
+ }
+
/* Accessors */
/**
@@ -459,6 +475,13 @@ public class Get extends Query implements Row {
}
/**
+ * @return the maximum result size in bytes. See {@link
#setMaxResultSize(long)}
+ */
+ public long getMaxResultSize() {
+return maxResultSize;
+ }
+
+ /**
* Compile the details beyond the scope of getFingerprint (row, columns,
* timestamps, etc.) into a Map along with the fingerprinted information.
* Useful for debugging, logging, and administration tools.
diff --git
a/hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
b/hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
index 5a01af9..1c17866 100644
---
a/hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
+++
b/hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
@@ -1382,7 +1382,7 @@ public final class ProtobufUtil {
return (cells == null || cells.isEmpty())
? (proto.getStale() ? EMPTY_RESULT_STALE : EMPTY_RESULT)
-: Result.create(cells, null, proto.getStale());
+: Result.create(cells, null, proto.getStale(), proto.getPartial());
}
diff --git
a/hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ProtobufUtil.java
b/hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ProtobufUtil.java
index c2544f6..d6c7811 100644
---
a/hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ProtobufUtil.java
+++
b/hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ProtobufUtil.java
@@ -592,6 +592,9 @@ public final class ProtobufUtil {
if (proto.hasLoadColumnFamiliesOnDemand()) {
get.setLoadColumnFamiliesOnDemand(proto.getLoadColumnFamiliesOnDemand());
}
+if (proto.hasMaxResultSize()) {
+ get.setMaxResultSize(proto.getMaxResultSize());
+}
return get;
}
@@ -1256,6 +1259,9 @@ public final class ProtobufUtil {
if (loadColumnFamiliesOnDemand != null) {
builder.setLoadColumnFamiliesOnDemand(loadColumnFamiliesOnDemand);
}
+if (get.getMaxResultSize() > 0) {
+ builder.setMaxResultSize(get.getMaxResultSize());
+}
return builder.build();
}
@@ -1457,6 +1463,7 @@ public final class ProtobufUtil {
ClientProtos.Result.Builder builder = ClientProtos.Result.newBuilder();
builder.setAssociatedCellCount(size);
builder.setStale(result.isStale());
+builde
[hbase] branch branch-2.4 updated: HBASE-6908: Add pluggable rpc queue implementation (#3522)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 66f931c HBASE-6908: Add pluggable rpc queue implementation (#3522)
66f931c is described below
commit 66f931c4337d1e7946abdbeba7688a429252778b
Author: Richard Marscher
AuthorDate: Mon Aug 9 15:54:18 2021 -0400
HBASE-6908: Add pluggable rpc queue implementation (#3522)
Can pass in a FQCN to load as the call queue implementation.
Standardized arguments to the constructor are the max queue length, the
PriorityFunction, and the Configuration.
`PluggableBlockingQueue` abstract class provided to help guide the
correct constructor signature
Hard fails if the class fails to load as a `BlockingQueue`
Signed-off-by: stack
---
.../hadoop/hbase/ipc/PluggableBlockingQueue.java | 55
.../hbase/ipc/PluggableRpcQueueNotFound.java | 34 +
.../org/apache/hadoop/hbase/ipc/RpcExecutor.java | 55 +++-
.../hadoop/hbase/ipc/SimpleRpcScheduler.java | 3 +-
.../hadoop/hbase/ipc/TestPluggableQueueImpl.java | 155 +
.../hadoop/hbase/ipc/TestSimpleRpcScheduler.java | 75 ++
6 files changed, 372 insertions(+), 5 deletions(-)
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/PluggableBlockingQueue.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/PluggableBlockingQueue.java
new file mode 100644
index 000..0b88b6c
--- /dev/null
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/PluggableBlockingQueue.java
@@ -0,0 +1,55 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.hadoop.hbase.ipc;
+
+import java.util.concurrent.BlockingQueue;
+import org.apache.hadoop.conf.Configuration;
+import org.apache.yetus.audience.InterfaceAudience;
+import org.apache.yetus.audience.InterfaceStability;
+
+/**
+ * Abstract class template for defining a pluggable blocking queue
implementation to be used
+ * by the 'pluggable' call queue type in the RpcExecutor.
+ *
+ * The intention is that the constructor shape helps re-inforce the expected
parameters needed
+ * to match up to how the RpcExecutor will instantiate instances of the queue.
+ *
+ * If the implementation class implements the
+ * {@link org.apache.hadoop.hbase.conf.ConfigurationObserver} interface, it
will also be wired
+ * into configuration changes.
+ *
+ * Instantiation requires a constructor with {@code
+ * final int maxQueueLength,
+ * final PriorityFunction priority,
+ * final Configuration conf)}
+ * as the arguments.
+ */
+@InterfaceAudience.Public
+@InterfaceStability.Evolving
+public abstract class PluggableBlockingQueue implements
BlockingQueue {
+ protected final int maxQueueLength;
+ protected final PriorityFunction priority;
+ protected final Configuration conf;
+
+ public PluggableBlockingQueue(final int maxQueueLength,
+final PriorityFunction priority, final Configuration conf) {
+this.maxQueueLength = maxQueueLength;
+this.priority = priority;
+this.conf = conf;
+ }
+}
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/PluggableRpcQueueNotFound.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/PluggableRpcQueueNotFound.java
new file mode 100644
index 000..dade53c
--- /dev/null
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/PluggableRpcQueueNotFound.java
@@ -0,0 +1,34 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed un
[hbase] branch branch-2 updated (57361bb -> 79a6dc6)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch branch-2 in repository https://gitbox.apache.org/repos/asf/hbase.git. from 57361bb HBASE-26176 Correct regex in hbase-personality.sh (#3567) add 79a6dc6 HBASE-6908: Add pluggable rpc queue implementation (#3522) No new revisions were added by this update. Summary of changes: .../hadoop/hbase/ipc/PluggableBlockingQueue.java | 55 .../hbase/ipc/PluggableRpcQueueNotFound.java | 14 +- .../org/apache/hadoop/hbase/ipc/RpcExecutor.java | 55 +++- .../hadoop/hbase/ipc/SimpleRpcScheduler.java | 3 +- .../hadoop/hbase/ipc/TestPluggableQueueImpl.java | 155 + .../hadoop/hbase/ipc/TestSimpleRpcScheduler.java | 75 ++ 6 files changed, 348 insertions(+), 9 deletions(-) create mode 100644 hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/PluggableBlockingQueue.java copy hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/OnePhaseProcedure.java => hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/PluggableRpcQueueNotFound.java (68%) create mode 100644 hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestPluggableQueueImpl.java
[hbase] branch master updated: HBASE-6908: Add pluggable rpc queue implementation (#3522)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/master by this push:
new 7f614ce HBASE-6908: Add pluggable rpc queue implementation (#3522)
7f614ce is described below
commit 7f614ce77eee8b30533c81c7cbeba7b8975eeb6f
Author: Richard Marscher
AuthorDate: Mon Aug 9 15:54:18 2021 -0400
HBASE-6908: Add pluggable rpc queue implementation (#3522)
Can pass in a FQCN to load as the call queue implementation.
Standardized arguments to the constructor are the max queue length, the
PriorityFunction, and the Configuration.
`PluggableBlockingQueue` abstract class provided to help guide the
correct constructor signature
Hard fails if the class fails to load as a `BlockingQueue`
Signed-off-by: stack
---
.../hadoop/hbase/ipc/PluggableBlockingQueue.java | 55
.../hbase/ipc/PluggableRpcQueueNotFound.java | 34 +
.../org/apache/hadoop/hbase/ipc/RpcExecutor.java | 55 +++-
.../hadoop/hbase/ipc/SimpleRpcScheduler.java | 3 +-
.../hadoop/hbase/ipc/TestPluggableQueueImpl.java | 155 +
.../hadoop/hbase/ipc/TestSimpleRpcScheduler.java | 75 ++
6 files changed, 372 insertions(+), 5 deletions(-)
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/PluggableBlockingQueue.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/PluggableBlockingQueue.java
new file mode 100644
index 000..0b88b6c
--- /dev/null
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/PluggableBlockingQueue.java
@@ -0,0 +1,55 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.hadoop.hbase.ipc;
+
+import java.util.concurrent.BlockingQueue;
+import org.apache.hadoop.conf.Configuration;
+import org.apache.yetus.audience.InterfaceAudience;
+import org.apache.yetus.audience.InterfaceStability;
+
+/**
+ * Abstract class template for defining a pluggable blocking queue
implementation to be used
+ * by the 'pluggable' call queue type in the RpcExecutor.
+ *
+ * The intention is that the constructor shape helps re-inforce the expected
parameters needed
+ * to match up to how the RpcExecutor will instantiate instances of the queue.
+ *
+ * If the implementation class implements the
+ * {@link org.apache.hadoop.hbase.conf.ConfigurationObserver} interface, it
will also be wired
+ * into configuration changes.
+ *
+ * Instantiation requires a constructor with {@code
+ * final int maxQueueLength,
+ * final PriorityFunction priority,
+ * final Configuration conf)}
+ * as the arguments.
+ */
+@InterfaceAudience.Public
+@InterfaceStability.Evolving
+public abstract class PluggableBlockingQueue implements
BlockingQueue {
+ protected final int maxQueueLength;
+ protected final PriorityFunction priority;
+ protected final Configuration conf;
+
+ public PluggableBlockingQueue(final int maxQueueLength,
+final PriorityFunction priority, final Configuration conf) {
+this.maxQueueLength = maxQueueLength;
+this.priority = priority;
+this.conf = conf;
+ }
+}
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/PluggableRpcQueueNotFound.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/PluggableRpcQueueNotFound.java
new file mode 100644
index 000..dade53c
--- /dev/null
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/PluggableRpcQueueNotFound.java
@@ -0,0 +1,34 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed un
[hbase] branch branch-2.3 updated: HBASE-26170 handleTooBigRequest in NettyRpcServer didn't skip enough bytes (#3564)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.3 by this push:
new 73175c7 HBASE-26170 handleTooBigRequest in NettyRpcServer didn't skip
enough bytes (#3564)
73175c7 is described below
commit 73175c74e51a7e9bf1453f6b92859f9879333187
Author: Xiaolin Ha
AuthorDate: Thu Aug 5 23:05:26 2021 +0800
HBASE-26170 handleTooBigRequest in NettyRpcServer didn't skip enough bytes
(#3564)
Signed-off-by: stack
---
.../hadoop/hbase/ipc/NettyRpcFrameDecoder.java | 3 ++-
.../hbase/client/TestRequestTooBigException.java | 26 --
2 files changed, 16 insertions(+), 13 deletions(-)
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcFrameDecoder.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcFrameDecoder.java
index c46fe78..6891243 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcFrameDecoder.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcFrameDecoder.java
@@ -87,7 +87,6 @@ public class NettyRpcFrameDecoder extends
ByteToMessageDecoder {
NettyRpcServer.LOG.warn(requestTooBigMessage);
if (connection.connectionHeaderRead) {
-in.skipBytes(FRAME_LENGTH_FIELD_LENGTH);
handleTooBigRequest(in);
return;
}
@@ -107,6 +106,7 @@ public class NettyRpcFrameDecoder extends
ByteToMessageDecoder {
}
private void handleTooBigRequest(ByteBuf in) throws IOException {
+in.skipBytes(FRAME_LENGTH_FIELD_LENGTH);
in.markReaderIndex();
int preIndex = in.readerIndex();
int headerSize = readRawVarint32(in);
@@ -118,6 +118,7 @@ public class NettyRpcFrameDecoder extends
ByteToMessageDecoder {
}
if (in.readableBytes() < headerSize) {
+ NettyRpcServer.LOG.debug("headerSize is larger than readableBytes");
in.resetReaderIndex();
return;
}
diff --git
a/hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRequestTooBigException.java
b/hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRequestTooBigException.java
index 5f7f154..f81b3d4 100644
---
a/hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRequestTooBigException.java
+++
b/hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRequestTooBigException.java
@@ -17,8 +17,8 @@
*/
package org.apache.hadoop.hbase.client;
+import static org.apache.hadoop.hbase.ipc.RpcServer.MAX_REQUEST_SIZE;
import static org.junit.Assert.assertTrue;
-
import org.apache.hadoop.hbase.HBaseClassTestRule;
import org.apache.hadoop.hbase.HBaseTestingUtility;
import org.apache.hadoop.hbase.TableName;
@@ -48,6 +48,7 @@ public class TestRequestTooBigException {
@BeforeClass
public static void setUpBeforeClass() throws Exception {
+TEST_UTIL.getConfiguration().setInt(MAX_REQUEST_SIZE, 1);
TEST_UTIL.startMiniCluster();
}
@@ -64,17 +65,18 @@ public class TestRequestTooBigException {
TEST_UTIL.waitTableAvailable(tableName.getName(), 5000);
try {
byte[] value = new byte[2 * 2014 * 1024];
-
- Put p = new Put(Bytes.toBytes("bigrow"));
- // big request = 400*2 M
- for (int i = 0; i < 400; i++) {
-p.addColumn(family, Bytes.toBytes("someQualifier" + i), value);
- }
- try {
-table.put(p);
-assertTrue("expected RequestTooBigException", false);
- } catch (RequestTooBigException e) {
-assertTrue("expected RequestTooBigException", true);
+ for (int m = 0; m < 1; m++) {
+Put p = new Put(Bytes.toBytes("bigrow"));
+// big request = 400*2 M
+for (int i = 0; i < 400; i++) {
+ p.addColumn(family, Bytes.toBytes("someQualifier" + i), value);
+}
+try {
+ table.put(p);
+ assertTrue("expected RequestTooBigException", false);
+} catch (RequestTooBigException e) {
+ assertTrue("expected RequestTooBigException", true);
+}
}
} finally {
table.close();
[hbase] branch branch-2.4 updated: HBASE-26170 handleTooBigRequest in NettyRpcServer didn't skip enough bytes (#3564)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 2ea2f80 HBASE-26170 handleTooBigRequest in NettyRpcServer didn't skip
enough bytes (#3564)
2ea2f80 is described below
commit 2ea2f800b05c15b478d5e077148e34e4145cff09
Author: Xiaolin Ha
AuthorDate: Thu Aug 5 23:05:26 2021 +0800
HBASE-26170 handleTooBigRequest in NettyRpcServer didn't skip enough bytes
(#3564)
Signed-off-by: stack
---
.../hadoop/hbase/ipc/NettyRpcFrameDecoder.java | 3 ++-
.../hbase/client/TestRequestTooBigException.java | 26 --
2 files changed, 16 insertions(+), 13 deletions(-)
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcFrameDecoder.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcFrameDecoder.java
index c46fe78..6891243 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcFrameDecoder.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcFrameDecoder.java
@@ -87,7 +87,6 @@ public class NettyRpcFrameDecoder extends
ByteToMessageDecoder {
NettyRpcServer.LOG.warn(requestTooBigMessage);
if (connection.connectionHeaderRead) {
-in.skipBytes(FRAME_LENGTH_FIELD_LENGTH);
handleTooBigRequest(in);
return;
}
@@ -107,6 +106,7 @@ public class NettyRpcFrameDecoder extends
ByteToMessageDecoder {
}
private void handleTooBigRequest(ByteBuf in) throws IOException {
+in.skipBytes(FRAME_LENGTH_FIELD_LENGTH);
in.markReaderIndex();
int preIndex = in.readerIndex();
int headerSize = readRawVarint32(in);
@@ -118,6 +118,7 @@ public class NettyRpcFrameDecoder extends
ByteToMessageDecoder {
}
if (in.readableBytes() < headerSize) {
+ NettyRpcServer.LOG.debug("headerSize is larger than readableBytes");
in.resetReaderIndex();
return;
}
diff --git
a/hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRequestTooBigException.java
b/hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRequestTooBigException.java
index 5f7f154..f81b3d4 100644
---
a/hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRequestTooBigException.java
+++
b/hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRequestTooBigException.java
@@ -17,8 +17,8 @@
*/
package org.apache.hadoop.hbase.client;
+import static org.apache.hadoop.hbase.ipc.RpcServer.MAX_REQUEST_SIZE;
import static org.junit.Assert.assertTrue;
-
import org.apache.hadoop.hbase.HBaseClassTestRule;
import org.apache.hadoop.hbase.HBaseTestingUtility;
import org.apache.hadoop.hbase.TableName;
@@ -48,6 +48,7 @@ public class TestRequestTooBigException {
@BeforeClass
public static void setUpBeforeClass() throws Exception {
+TEST_UTIL.getConfiguration().setInt(MAX_REQUEST_SIZE, 1);
TEST_UTIL.startMiniCluster();
}
@@ -64,17 +65,18 @@ public class TestRequestTooBigException {
TEST_UTIL.waitTableAvailable(tableName.getName(), 5000);
try {
byte[] value = new byte[2 * 2014 * 1024];
-
- Put p = new Put(Bytes.toBytes("bigrow"));
- // big request = 400*2 M
- for (int i = 0; i < 400; i++) {
-p.addColumn(family, Bytes.toBytes("someQualifier" + i), value);
- }
- try {
-table.put(p);
-assertTrue("expected RequestTooBigException", false);
- } catch (RequestTooBigException e) {
-assertTrue("expected RequestTooBigException", true);
+ for (int m = 0; m < 1; m++) {
+Put p = new Put(Bytes.toBytes("bigrow"));
+// big request = 400*2 M
+for (int i = 0; i < 400; i++) {
+ p.addColumn(family, Bytes.toBytes("someQualifier" + i), value);
+}
+try {
+ table.put(p);
+ assertTrue("expected RequestTooBigException", false);
+} catch (RequestTooBigException e) {
+ assertTrue("expected RequestTooBigException", true);
+}
}
} finally {
table.close();
[hbase] branch master updated: HBASE-26170 handleTooBigRequest in NettyRpcServer didn't skip enough bytes (#3564)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/master by this push:
new c9383f2 HBASE-26170 handleTooBigRequest in NettyRpcServer didn't skip
enough bytes (#3564)
c9383f2 is described below
commit c9383f2c89eb632c436b0caf7d6fc2383987553d
Author: Xiaolin Ha
AuthorDate: Thu Aug 5 23:05:26 2021 +0800
HBASE-26170 handleTooBigRequest in NettyRpcServer didn't skip enough bytes
(#3564)
Signed-off-by: stack
---
.../hadoop/hbase/ipc/NettyRpcFrameDecoder.java | 3 ++-
.../hbase/client/TestRequestTooBigException.java | 26 --
2 files changed, 16 insertions(+), 13 deletions(-)
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcFrameDecoder.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcFrameDecoder.java
index c46fe78..6891243 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcFrameDecoder.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcFrameDecoder.java
@@ -87,7 +87,6 @@ public class NettyRpcFrameDecoder extends
ByteToMessageDecoder {
NettyRpcServer.LOG.warn(requestTooBigMessage);
if (connection.connectionHeaderRead) {
-in.skipBytes(FRAME_LENGTH_FIELD_LENGTH);
handleTooBigRequest(in);
return;
}
@@ -107,6 +106,7 @@ public class NettyRpcFrameDecoder extends
ByteToMessageDecoder {
}
private void handleTooBigRequest(ByteBuf in) throws IOException {
+in.skipBytes(FRAME_LENGTH_FIELD_LENGTH);
in.markReaderIndex();
int preIndex = in.readerIndex();
int headerSize = readRawVarint32(in);
@@ -118,6 +118,7 @@ public class NettyRpcFrameDecoder extends
ByteToMessageDecoder {
}
if (in.readableBytes() < headerSize) {
+ NettyRpcServer.LOG.debug("headerSize is larger than readableBytes");
in.resetReaderIndex();
return;
}
diff --git
a/hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRequestTooBigException.java
b/hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRequestTooBigException.java
index 291f0e2..70d6c55 100644
---
a/hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRequestTooBigException.java
+++
b/hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRequestTooBigException.java
@@ -17,8 +17,8 @@
*/
package org.apache.hadoop.hbase.client;
+import static org.apache.hadoop.hbase.ipc.RpcServer.MAX_REQUEST_SIZE;
import static org.junit.Assert.assertTrue;
-
import org.apache.hadoop.hbase.HBaseClassTestRule;
import org.apache.hadoop.hbase.HBaseTestingUtil;
import org.apache.hadoop.hbase.TableName;
@@ -48,6 +48,7 @@ public class TestRequestTooBigException {
@BeforeClass
public static void setUpBeforeClass() throws Exception {
+TEST_UTIL.getConfiguration().setInt(MAX_REQUEST_SIZE, 1);
TEST_UTIL.startMiniCluster();
}
@@ -64,17 +65,18 @@ public class TestRequestTooBigException {
TEST_UTIL.waitTableAvailable(tableName.getName(), 5000);
try {
byte[] value = new byte[2 * 2014 * 1024];
-
- Put p = new Put(Bytes.toBytes("bigrow"));
- // big request = 400*2 M
- for (int i = 0; i < 400; i++) {
-p.addColumn(family, Bytes.toBytes("someQualifier" + i), value);
- }
- try {
-table.put(p);
-assertTrue("expected RequestTooBigException", false);
- } catch (RequestTooBigException e) {
-assertTrue("expected RequestTooBigException", true);
+ for (int m = 0; m < 1; m++) {
+Put p = new Put(Bytes.toBytes("bigrow"));
+// big request = 400*2 M
+for (int i = 0; i < 400; i++) {
+ p.addColumn(family, Bytes.toBytes("someQualifier" + i), value);
+}
+try {
+ table.put(p);
+ assertTrue("expected RequestTooBigException", false);
+} catch (RequestTooBigException e) {
+ assertTrue("expected RequestTooBigException", true);
+}
}
} finally {
table.close();
[hbase] branch master updated (63d4970 -> 679ba95)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hbase.git. from 63d4970 HBASE-26150 Let region server also carry ClientMetaService (#3550) add 679ba95 HBASE-26153 [create-release] Use cmd-line defined env (#3542) No new revisions were added by this update. Summary of changes: dev-support/create-release/do-release-docker.sh | 24 +++--- dev-support/create-release/release-util.sh | 44 ++--- 2 files changed, 36 insertions(+), 32 deletions(-)
[hbase] annotated tag rel/2.3.6 updated (7414579 -> acbf259)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to annotated tag rel/2.3.6 in repository https://gitbox.apache.org/repos/asf/hbase.git. *** WARNING: tag rel/2.3.6 was modified! *** from 7414579 (commit) to acbf259 (tag) tagging 7414579f2620fca6b75146c29ab2726fc4643ac9 (commit) replaces 2.3.6RC2 by stack on Wed Jul 28 22:11:07 2021 + - Log - Via create-release -BEGIN PGP SIGNATURE- iQIzBAABCgAdFiEEXzLoEtM2TIUEtz4m250xPaeHTykFAmEB1fsACgkQ250xPaeH Tym6kg//TC73iyUdIEY6WvDNIO86dNiSUxs52LYGmkFaVkHRJA5nsqZY7vj4rN0K 0H3uYyoxApTVD4pTY31eI8hpoOP0npY9kac2PF02eo3DT7+0VXL7mw3nJAFW/ODz a00B8AVKRpnCsbuqf99hF55FrbVFaIxhNx+L7AxisSk8yaFz8cIm1xl3OavT/aQx xtDJKK0PbOyHRGdTfLER0cgcaklJPFGJwQTiya+vFAbQ3YmtfeW98SwCM3j2TdnQ Bv2Sug9AOq4ygrjwNSGlTorE+wYWv2a3KtVNNgC450lHto+WCt7HnlgJ+IAp7pOi N2yyV4ODntZ2mMKhlChHxnN/8VtDsikap6KAPU5/7oYbC8vnEhprkRQ4qcNWkZoF E5fCrfTo/cIlVCGc9cD461/izxuBMynn2IgeqfmQxax+sRm5ZMSPODWPeC1tnpp5 X2rGlzpGPrwSCRRfd+2fC1nS+nUCq4UEaehj9dFsPlpsG01tRFepH1ggAlM+i65m H5zjBlwp9cu+Ix8aFtCFWFziL8FCaE+eOxlJoQFeRzmt2xfeTtL1zMV7JsTGURyD MN7JE3zV3IjPBM0GLvo6vuE3rLKafje9P70FRbL5jHLiI8iz+dLQsGKJuUkandtJ 4d8ZF0/vZc6CxNet9UWW8c9Leeo3/oh6pGlDKSuE8CtR+6ukJXM= =pCDz -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
[hbase] branch master updated (2e9ab3c -> de84c17)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hbase.git. from 2e9ab3c HBASE-26154: Adds exception metrics for QuotaExceededException and RpcThrottlingException (#3545) add de84c17 HBASE-26162 Release 2.3.6 No new revisions were added by this update. Summary of changes: src/site/xdoc/downloads.xml | 12 ++-- 1 file changed, 6 insertions(+), 6 deletions(-)
svn commit: r49139 - in /release/hbase: 2.3.5/ stable
Author: stack Date: Mon Aug 2 17:03:09 2021 New Revision: 49139 Log: Removed 2.3.5 and moved stable pointer to 2.3.6 Added: release/hbase/stable (with props) Removed: release/hbase/2.3.5/ Added: release/hbase/stable == --- release/hbase/stable (added) +++ release/hbase/stable Mon Aug 2 17:03:09 2021 @@ -0,0 +1 @@ +link 2.3.6 \ No newline at end of file Propchange: release/hbase/stable -- svn:special = *
svn commit: r49138 - /dev/hbase/2.3.6RC2/ /dev/hbase/2.3.6RC3/ /release/hbase/2.3.6/
Author: stack Date: Mon Aug 2 16:53:24 2021 New Revision: 49138 Log: Move 2.3.6RC3, the second RC, release as 2.3.6 (and delete the first RC, 2.3.6RC2) Added: release/hbase/2.3.6/ - copied from r49137, dev/hbase/2.3.6RC3/ Removed: dev/hbase/2.3.6RC2/ dev/hbase/2.3.6RC3/
svn commit: r49064 [4/4] - /dev/hbase/2.3.6RC3/
Added: dev/hbase/2.3.6RC3/api_compare_2.3.5_to_2.3.6RC3.html
==
--- dev/hbase/2.3.6RC3/api_compare_2.3.5_to_2.3.6RC3.html (added)
+++ dev/hbase/2.3.6RC3/api_compare_2.3.5_to_2.3.6RC3.html Thu Jul 29 00:25:42
2021
@@ -0,0 +1,571 @@
+
+
+http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd;>
+http://www.w3.org/1999/xhtml; xml:lang="en" lang="en">
+
+
+
+
+
+hbase: rel/2.3.5 to 2.3.6RC3 compatibility report
+
+body {
+font-family:Arial, sans-serif;
+background-color:White;
+color:Black;
+}
+hr {
+color:Black;
+background-color:Black;
+height:1px;
+border:0;
+}
+h1 {
+margin-bottom:0px;
+padding-bottom:0px;
+font-size:1.625em;
+}
+h2 {
+margin-bottom:0px;
+padding-bottom:0px;
+font-size:1.25em;
+white-space:nowrap;
+}
+div.symbols {
+color:#003E69;
+}
+div.symbols i {
+color:Brown;
+}
+span.section {
+font-weight:bold;
+cursor:pointer;
+color:#003E69;
+white-space:nowrap;
+margin-left:0.3125em;
+}
+span:hover.section {
+color:#336699;
+}
+span.sect_aff {
+cursor:pointer;
+padding-left:1.55em;
+font-size:0.875em;
+color:#cc3300;
+}
+span.ext {
+font-weight:normal;
+}
+span.jar {
+color:#cc3300;
+font-size:0.875em;
+font-weight:bold;
+}
+div.jar_list {
+padding-left:0.4em;
+font-size:0.94em;
+}
+span.pkg_t {
+color:#408080;
+font-size:0.875em;
+}
+span.pkg {
+color:#408080;
+font-size:0.875em;
+font-weight:bold;
+}
+span.cname {
+color:Green;
+font-size:0.875em;
+font-weight:bold;
+}
+span.iname_b {
+font-weight:bold;
+}
+span.iname_a {
+color:#33;
+font-weight:bold;
+font-size:0.94em;
+}
+span.sym_p {
+font-weight:normal;
+white-space:normal;
+}
+span.sym_pd {
+white-space:normal;
+}
+span.sym_p span, span.sym_pd span {
+white-space:nowrap;
+}
+span.attr {
+color:Black;
+font-weight:normal;
+}
+span.deprecated {
+color:Red;
+font-weight:bold;
+font-family:Monaco, monospace;
+}
+div.affect {
+padding-left:1em;
+padding-bottom:10px;
+font-size:0.87em;
+font-style:italic;
+line-height:0.9em;
+}
+div.affected {
+padding-left:2em;
+padding-top:10px;
+}
+table.ptable {
+border-collapse:collapse;
+border:1px outset black;
+margin-left:0.95em;
+margin-top:3px;
+margin-bottom:3px;
+width:56.25em;
+}
+table.ptable td {
+border:1px solid Gray;
+padding:3px;
+font-size:0.875em;
+text-align:left;
+vertical-align:top;
+max-width:28em;
+word-wrap:break-word;
+}
+table.ptable th {
+background-color:#ee;
+font-weight:bold;
+color:#33;
+font-family:Verdana, Arial;
+font-size:0.875em;
+border:1px solid Gray;
+text-align:center;
+vertical-align:top;
+white-space:nowrap;
+padding:3px;
+}
+table.summary {
+border-collapse:collapse;
+border:1px outset black;
+}
+table.summary th {
+background-color:#ee;
+font-weight:normal;
+text-align:left;
+font-size:0.94em;
+white-space:nowrap;
+border:1px inset Gray;
+padding:3px;
+}
+table.summary td {
+text-align:right;
+white-space:nowrap;
+border:1px inset Gray;
+padding:3px 5px 3px 10px;
+}
+span.mngl {
+padding-left:1em;
+font-size:0.875em;
+cursor:text;
+color:#44;
+font-weight:bold;
+}
+span.pleft {
+padding-left:2.5em;
+}
+span.color_p {
+font-style:italic;
+color:Brown;
+}
+span.param {
+font-style:italic;
+}
+span.focus_p {
+font-style:italic;
+background-color:#DCDCDC;
+}
+span.ttype {
+font-weight:normal;
+}
+span.nowrap {
+white-space:nowrap;
+}
+span.value {
+white-space:nowrap;
+font-weight:bold;
+}
+.passed {
+background-color:#CCFFCC;
+font-weight:normal;
+}
+.warning {
+background-color:#F4F4AF;
+font-weight:normal;
+}
+.failed {
+background-color:#FF;
+font-weight:normal;
+}
+.new {
+background-color:#C6DEFF;
+font-weight:normal;
+}
+
+.compatible {
+background-color:#CCFFCC;
+font-weight:normal;
+}
+.almost_compatible {
+background-color:#FFDAA3;
+font-weight:normal;
+}
+.incompatible {
+background-color:#FF;
+font-weight:normal;
+}
+.gray {
+background-color:#DCDCDC;
+font-weight:normal;
+}
+
+.top_ref {
+font-size:0.69em;
+}
+.footer {
+font-size:0.8125em;
+}
+.tabset {
+float:left;
+}
+a.tab {
+border:1px solid Black;
+float:left;
+margin:0px 5px -1px 0px;
+padding:3px 5px 3px 5px;
+position:relative;
+font-size:0.875em;
+background-color:#DDD;
+text-decoration:none;
+color:Black;
+}
+a.disabled:hover
+{
+color:Black;
+background:#EEE;
+}
+a.active:hover
+{
+color:Black;
+background:White;
+}
+a.active {
+border-bottom-color:White;
+background-color:White;
+}
+div.tab {
+border-top:1px solid
svn commit: r49064 [2/4] - /dev/hbase/2.3.6RC3/
it. | Minor | flakies, test | + + +### SUB-TASKS: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [HBASE-24734](https://issues.apache.org/jira/browse/HBASE-24734) | RegionInfo#containsRange should support check meta table | Major | HFile, MTTR | +| [HBASE-25739](https://issues.apache.org/jira/browse/HBASE-25739) | TableSkewCostFunction need to use aggregated deviation | Major | Balancer, master | +| [HBASE-25947](https://issues.apache.org/jira/browse/HBASE-25947) | Backport 'HBASE-25894 Improve the performance for region load and region count related cost functions' to branch-2.4 and branch-2.3 | Major | Balancer, Performance | +| [HBASE-25963](https://issues.apache.org/jira/browse/HBASE-25963) | HBaseCluster should be marked as IA.Public | Major | API | +| [HBASE-25941](https://issues.apache.org/jira/browse/HBASE-25941) | TestRESTServerSSL fails because of jdk bug | Major | test | +| [HBASE-25838](https://issues.apache.org/jira/browse/HBASE-25838) | Use double instead of Double in StochasticLoadBalancer | Major | Balancer, Performance | +| [HBASE-25840](https://issues.apache.org/jira/browse/HBASE-25840) | CatalogJanitor warns about skipping gc of regions during RIT, but does not actually skip | Minor | . | +| [HBASE-25775](https://issues.apache.org/jira/browse/HBASE-25775) | Use a special balancer to deal with maintenance mode | Major | Balancer | +| [HBASE-25199](https://issues.apache.org/jira/browse/HBASE-25199) | Remove HStore#getStoreHomedir | Minor | . | +| [HBASE-25696](https://issues.apache.org/jira/browse/HBASE-25696) | Need to initialize SLF4JBridgeHandler in jul-to-slf4j for redirecting jul to slf4j | Major | logging | +| [HBASE-25695](https://issues.apache.org/jira/browse/HBASE-25695) | Link to the filter on hbase:meta from user tables panel on master page | Major | UI | + + +### OTHER: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [HBASE-26015](https://issues.apache.org/jira/browse/HBASE-26015) | Should implement getRegionServers(boolean) method in AsyncAdmin | Major | Admin, Client | +| [HBASE-25755](https://issues.apache.org/jira/browse/HBASE-25755) | Exclude tomcat-embed-core from libthrift | Critical | dependencies, Thrift | +| [HBASE-25750](https://issues.apache.org/jira/browse/HBASE-25750) | Upgrade RpcControllerFactory and HBaseRpcController from Private to LimitedPrivate(COPROC,PHOENIX) | Major | Coprocessors, phoenix, rpc | +| [HBASE-24305](https://issues.apache.org/jira/browse/HBASE-24305) | Handle deprecations in ServerName | Minor | . | + + +## Release 2.3.5 - Unreleased (as of 2021-03-25) + + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [HBASE-25587](https://issues.apache.org/jira/browse/HBASE-25587) | [hbck2] Schedule SCP for all unknown servers | Major | hbase-operator-tools, hbck2 | +| [HBASE-25460](https://issues.apache.org/jira/browse/HBASE-25460) | Expose drainingServers as cluster metric | Major | metrics | +| [HBASE-25496](https://issues.apache.org/jira/browse/HBASE-25496) | add get\_namespace\_rsgroup command | Major | . | + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [HBASE-25621](https://issues.apache.org/jira/browse/HBASE-25621) | Balancer should check region plan source to avoid misplace region groups | Major | Balancer | +| [HBASE-25374](https://issues.apache.org/jira/browse/HBASE-25374) | Make REST Client connection and socket time out configurable | Minor | REST | +| [HBASE-25597](https://issues.apache.org/jira/browse/HBASE-25597) | Add row info in Exception when cell size exceeds maxCellSize | Minor | . | +| [HBASE-25635](https://issues.apache.org/jira/browse/HBASE-25635) | CandidateGenerator may miss some region balance actions | Major | Balancer | +| [HBASE-25566](https://issues.apache.org/jira/browse/HBASE-25566) | RoundRobinTableInputFormat | Major | mapreduce | +| [HBASE-25548](https://issues.apache.org/jira/browse/HBASE-25548) | Optionally allow snapshots to preserve cluster's max filesize config by setting it into table descriptor | Major | . | +| [HBASE-25582](https://issues.apache.org/jira/browse/HBASE-25582) | Support setting scan ReadType to be STREAM at cluster level | Major | . | +| [HBASE-23578](https://issues.apache.org/jira/browse/HBASE-23578) | [UI] Master UI shows long stack traces when table is broken | Minor | master, UI | +| [HBASE-25541](https://issues.apache.org/jira/browse/HBASE-25541) | In WALEntryStream, set the current path to null while dequeing the log | Major | . | +| [HBASE-25507](https://issues.apache.org/jira/browse/HBASE-25507) | Leak of ESTABLISHED sockets when compaction encountered "java.io.IOException: Invalid HFile block magic" | Major | Compaction | +| [HBASE-25528](https://issues.apache.org/jira/browse/HBASE-25528) | Dedicated merge dispatch threadpool on master | Mino
svn commit: r49064 [3/4] - /dev/hbase/2.3.6RC3/
Added: dev/hbase/2.3.6RC3/RELEASENOTES.md == --- dev/hbase/2.3.6RC3/RELEASENOTES.md (added) +++ dev/hbase/2.3.6RC3/RELEASENOTES.md Thu Jul 29 00:25:42 2021 @@ -0,0 +1,12647 @@ +# RELEASENOTES + + +# HBASE 2.3.6 Release Notes + +These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements. + + +--- + +* [HBASE-25165](https://issues.apache.org/jira/browse/HBASE-25165) | *Minor* | **Change 'State time' in UI so sorts** + +Start time on the Master UI is now displayed using ISO8601 format instead of java Date#toString(). + + +--- + +* [HBASE-26088](https://issues.apache.org/jira/browse/HBASE-26088) | *Critical* | **conn.getBufferedMutator(tableName) leaks thread executors and other problems** + +The API doc for Connection#getBufferedMutator(TableName) and Connection#getBufferedMutator(BufferedMutatorParams) mentioned that when user dont pass a ThreadPool to be used, we use the ThreadPool in the Connection. But in reality, we were creating new ThreadPool in such cases. + +We are keeping the behaviour of code as is but corrected the Javadoc and also a bug of not closing this new pool while Closing the BufferedMutator. + + +--- + +* [HBASE-22923](https://issues.apache.org/jira/browse/HBASE-22923) | *Major* | **hbase:meta is assigned to localhost when we downgrade the hbase version** + +Introduced new config: hbase.min.version.move.system.tables + +When the operator uses this configuration option, any version between +the current cluster version and the value of "hbase.min.version.move.system.tables" +does not trigger any auto-region movement. Auto-region movement here +refers to auto-migration of system table regions to newer server versions. +It is assumed that the configured range of versions does not require special +handling of moving system table regions to higher versioned RegionServer. +This auto-migration is done by AssignmentManager#checkIfShouldMoveSystemRegionAsync(). +Example: Let's assume the cluster is on version 1.4.0 and we have +set "hbase.min.version.move.system.tables" as "2.0.0". Now if we upgrade +one RegionServer on 1.4.0 cluster to 1.6.0 (\< 2.0.0), then AssignmentManager will +not move hbase:meta, hbase:namespace and other system table regions +to newly brought up RegionServer 1.6.0 as part of auto-migration. +However, if we upgrade one RegionServer on 1.4.0 cluster to 2.2.0 (\> 2.0.0), +then AssignmentManager will move all system table regions to newly brought +up RegionServer 2.2.0 as part of auto-migration done by +AssignmentManager#checkIfShouldMoveSystemRegionAsync(). + +Overall, assuming we have system RSGroup where we keep HBase system tables, if we use +config "hbase.min.version.move.system.tables" with value x.y.z then while upgrading cluster to +version greater than or equal to x.y.z, the first RegionServer that we upgrade must +belong to system RSGroup only. + + +--- + +* [HBASE-25902](https://issues.apache.org/jira/browse/HBASE-25902) | *Critical* | **Add missing CFs in meta during HBase 1 to 2.3+ Upgrade** + +While upgrading cluster from 1.x to 2.3+ versions, after the active master is done setting it's status as 'Initialized', it attempts to add 'table' and 'repl\_barrier' CFs in meta. Once CFs are added successfully, master is aborted with PleaseRestartMasterException because master has missed certain initialization events (e.g ClusterSchemaService is not initialized and tableStateManager fails to migrate table states from ZK to meta due to missing CFs). Subsequent active master initialization is expected to be smooth. +In the presence of multi masters, when one of them becomes active for the first time after upgrading to HBase 2.3+, it is aborted after fixing CFs in meta and one of the other backup masters will take over and become active soon. Hence, overall this is expected to be smooth upgrade if we have backup masters configured. If not, operator is expected to restart same master again manually. + + +--- + +* [HBASE-25877](https://issues.apache.org/jira/browse/HBASE-25877) | *Major* | **Add access check for compactionSwitch** + +Now calling RSRpcService.compactionSwitch, i.e, Admin.compactionSwitch at client side, requires ADMIN permission. +This is an incompatible change but it is also a bug, as we should not allow any users to disable compaction on a regionserver, so we apply this to all active branches. + + +--- + +* [HBASE-25984](https://issues.apache.org/jira/browse/HBASE-25984) | *Critical* | **FSHLog WAL lockup with sync future reuse [RS deadlock]** + +Fixes a WAL lockup issue due to premature reuse of the sync futures by the WAL consumers. The lockup causes the WAL system to hang resulting in blocked appends and syncs thus holding up the RPC handlers from progressing. Only workaround without this fix is to force abort the region server. + + +--- + +*
svn commit: r49064 [1/4] - /dev/hbase/2.3.6RC3/
Author: stack Date: Thu Jul 29 00:25:42 2021 New Revision: 49064 Log: Apache hbase 2.3.6RC3 Added: dev/hbase/2.3.6RC3/ dev/hbase/2.3.6RC3/CHANGES.md dev/hbase/2.3.6RC3/RELEASENOTES.md dev/hbase/2.3.6RC3/api_compare_2.3.5_to_2.3.6RC3.html dev/hbase/2.3.6RC3/hbase-2.3.6-bin.tar.gz (with props) dev/hbase/2.3.6RC3/hbase-2.3.6-bin.tar.gz.asc dev/hbase/2.3.6RC3/hbase-2.3.6-bin.tar.gz.sha512 dev/hbase/2.3.6RC3/hbase-2.3.6-client-bin.tar.gz (with props) dev/hbase/2.3.6RC3/hbase-2.3.6-client-bin.tar.gz.asc dev/hbase/2.3.6RC3/hbase-2.3.6-client-bin.tar.gz.sha512 dev/hbase/2.3.6RC3/hbase-2.3.6-src.tar.gz (with props) dev/hbase/2.3.6RC3/hbase-2.3.6-src.tar.gz.asc dev/hbase/2.3.6RC3/hbase-2.3.6-src.tar.gz.sha512
[hbase] 01/01: Preparing development version 2.3.7-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/hbase.git commit fd1a3fcf7b8e9d1fd49df7712721610dfe684365 Author: stack AuthorDate: Wed Jul 28 22:11:20 2021 + Preparing development version 2.3.7-SNAPSHOT Signed-off-by: stack --- hbase-annotations/pom.xml | 2 +- hbase-archetypes/hbase-archetype-builder/pom.xml | 2 +- hbase-archetypes/hbase-client-project/pom.xml | 2 +- hbase-archetypes/hbase-shaded-client-project/pom.xml | 2 +- hbase-archetypes/pom.xml | 2 +- hbase-assembly/pom.xml | 2 +- hbase-asyncfs/pom.xml | 2 +- hbase-build-configuration/pom.xml | 2 +- hbase-checkstyle/pom.xml | 4 ++-- hbase-client/pom.xml | 2 +- hbase-common/pom.xml | 2 +- hbase-endpoint/pom.xml | 2 +- hbase-examples/pom.xml | 2 +- hbase-external-blockcache/pom.xml | 2 +- hbase-hadoop-compat/pom.xml| 2 +- hbase-hadoop2-compat/pom.xml | 2 +- hbase-hbtop/pom.xml| 2 +- hbase-http/pom.xml | 2 +- hbase-it/pom.xml | 2 +- hbase-logging/pom.xml | 2 +- hbase-mapreduce/pom.xml| 2 +- hbase-metrics-api/pom.xml | 2 +- hbase-metrics/pom.xml | 2 +- hbase-procedure/pom.xml| 2 +- hbase-protocol-shaded/pom.xml | 2 +- hbase-protocol/pom.xml | 2 +- hbase-replication/pom.xml | 2 +- hbase-resource-bundle/pom.xml | 2 +- hbase-rest/pom.xml | 2 +- hbase-rsgroup/pom.xml | 2 +- hbase-server/pom.xml | 2 +- hbase-shaded/hbase-shaded-check-invariants/pom.xml | 2 +- hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml| 2 +- hbase-shaded/hbase-shaded-client/pom.xml | 2 +- hbase-shaded/hbase-shaded-mapreduce/pom.xml| 2 +- hbase-shaded/hbase-shaded-testing-util-tester/pom.xml | 2 +- hbase-shaded/hbase-shaded-testing-util/pom.xml | 2 +- hbase-shaded/hbase-shaded-with-hadoop-check-invariants/pom.xml | 2 +- hbase-shaded/pom.xml | 2 +- hbase-shell/pom.xml| 2 +- hbase-testing-util/pom.xml | 2 +- hbase-thrift/pom.xml | 2 +- hbase-zookeeper/pom.xml| 2 +- pom.xml| 2 +- 44 files changed, 45 insertions(+), 45 deletions(-) diff --git a/hbase-annotations/pom.xml b/hbase-annotations/pom.xml index 6ef7c28..11233a4 100644 --- a/hbase-annotations/pom.xml +++ b/hbase-annotations/pom.xml @@ -23,7 +23,7 @@ hbase org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. diff --git a/hbase-archetypes/hbase-archetype-builder/pom.xml b/hbase-archetypes/hbase-archetype-builder/pom.xml index e0b3bbc..2945594 100644 --- a/hbase-archetypes/hbase-archetype-builder/pom.xml +++ b/hbase-archetypes/hbase-archetype-builder/pom.xml @@ -25,7 +25,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. diff --git a/hbase-archetypes/hbase-client-project/pom.xml b/hbase-archetypes/hbase-client-project/pom.xml index b85a349..8bd11aa 100644 --- a/hbase-archetypes/hbase-client-project/pom.xml +++ b/hbase-archetypes/hbase-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. hbase-client-project diff --git a/hbase-archetypes/hbase-shaded-client-project/pom.xml b/hbase-archetypes/hbase-shaded-client-project/pom.xml index 9327d61..96e5215 100644 --- a/hbase-archetypes/hbase-shaded-client-project/pom.xml +++ b/hbase-archetypes/hbase-shaded-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. hbase-shaded-client-project diff --git a/hbase-archetypes/pom.xml b
[hbase] branch branch-2.3 updated (b84d580 -> fd1a3fc)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/hbase.git. from b84d580 Preparing development version 2.3.7-SNAPSHOT add 7414579 Preparing hbase release 2.3.6RC3; tagging and updates to CHANGES.md and RELEASENOTES.md new fd1a3fc Preparing development version 2.3.7-SNAPSHOT The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes:
[hbase] 01/01: Preparing hbase release 2.3.6RC3; tagging and updates to CHANGES.md and RELEASENOTES.md
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to annotated tag 2.3.6RC3 in repository https://gitbox.apache.org/repos/asf/hbase.git commit 7414579f2620fca6b75146c29ab2726fc4643ac9 Author: stack AuthorDate: Wed Jul 28 22:11:06 2021 + Preparing hbase release 2.3.6RC3; tagging and updates to CHANGES.md and RELEASENOTES.md Signed-off-by: stack --- hbase-annotations/pom.xml | 2 +- hbase-archetypes/hbase-archetype-builder/pom.xml | 2 +- hbase-archetypes/hbase-client-project/pom.xml | 2 +- hbase-archetypes/hbase-shaded-client-project/pom.xml | 2 +- hbase-archetypes/pom.xml | 2 +- hbase-assembly/pom.xml | 2 +- hbase-asyncfs/pom.xml | 2 +- hbase-build-configuration/pom.xml | 2 +- hbase-checkstyle/pom.xml | 4 ++-- hbase-client/pom.xml | 2 +- hbase-common/pom.xml | 2 +- hbase-endpoint/pom.xml | 2 +- hbase-examples/pom.xml | 2 +- hbase-external-blockcache/pom.xml | 2 +- hbase-hadoop-compat/pom.xml| 2 +- hbase-hadoop2-compat/pom.xml | 2 +- hbase-hbtop/pom.xml| 2 +- hbase-http/pom.xml | 2 +- hbase-it/pom.xml | 2 +- hbase-logging/pom.xml | 2 +- hbase-mapreduce/pom.xml| 2 +- hbase-metrics-api/pom.xml | 2 +- hbase-metrics/pom.xml | 2 +- hbase-procedure/pom.xml| 2 +- hbase-protocol-shaded/pom.xml | 2 +- hbase-protocol/pom.xml | 2 +- hbase-replication/pom.xml | 2 +- hbase-resource-bundle/pom.xml | 2 +- hbase-rest/pom.xml | 2 +- hbase-rsgroup/pom.xml | 2 +- hbase-server/pom.xml | 2 +- hbase-shaded/hbase-shaded-check-invariants/pom.xml | 2 +- hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml| 2 +- hbase-shaded/hbase-shaded-client/pom.xml | 2 +- hbase-shaded/hbase-shaded-mapreduce/pom.xml| 2 +- hbase-shaded/hbase-shaded-testing-util-tester/pom.xml | 2 +- hbase-shaded/hbase-shaded-testing-util/pom.xml | 2 +- hbase-shaded/hbase-shaded-with-hadoop-check-invariants/pom.xml | 2 +- hbase-shaded/pom.xml | 2 +- hbase-shell/pom.xml| 2 +- hbase-testing-util/pom.xml | 2 +- hbase-thrift/pom.xml | 2 +- hbase-zookeeper/pom.xml| 2 +- pom.xml| 2 +- 44 files changed, 45 insertions(+), 45 deletions(-) diff --git a/hbase-annotations/pom.xml b/hbase-annotations/pom.xml index 11233a4..6ef7c28 100644 --- a/hbase-annotations/pom.xml +++ b/hbase-annotations/pom.xml @@ -23,7 +23,7 @@ hbase org.apache.hbase -2.3.7-SNAPSHOT +2.3.6 .. diff --git a/hbase-archetypes/hbase-archetype-builder/pom.xml b/hbase-archetypes/hbase-archetype-builder/pom.xml index 2945594..e0b3bbc 100644 --- a/hbase-archetypes/hbase-archetype-builder/pom.xml +++ b/hbase-archetypes/hbase-archetype-builder/pom.xml @@ -25,7 +25,7 @@ hbase-archetypes org.apache.hbase -2.3.7-SNAPSHOT +2.3.6 .. diff --git a/hbase-archetypes/hbase-client-project/pom.xml b/hbase-archetypes/hbase-client-project/pom.xml index 8bd11aa..b85a349 100644 --- a/hbase-archetypes/hbase-client-project/pom.xml +++ b/hbase-archetypes/hbase-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.7-SNAPSHOT +2.3.6 .. hbase-client-project diff --git a/hbase-archetypes/hbase-shaded-client-project/pom.xml b/hbase-archetypes/hbase-shaded-client-project/pom.xml index 96e5215..9327d61 100644 --- a/hbase-archetypes/hbase-shaded-client-project/pom.xml +++ b/hbase-archetypes/hbase-shaded-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.7-SNAPSHOT +2.3.6 .. hbase-shaded-client
[hbase] annotated tag 2.3.6RC3 created (now acbf259)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to annotated tag 2.3.6RC3 in repository https://gitbox.apache.org/repos/asf/hbase.git. at acbf259 (tag) tagging 7414579f2620fca6b75146c29ab2726fc4643ac9 (commit) replaces 2.3.6RC2 by stack on Wed Jul 28 22:11:07 2021 + - Log - Via create-release -BEGIN PGP SIGNATURE- iQIzBAABCgAdFiEEXzLoEtM2TIUEtz4m250xPaeHTykFAmEB1fsACgkQ250xPaeH Tym6kg//TC73iyUdIEY6WvDNIO86dNiSUxs52LYGmkFaVkHRJA5nsqZY7vj4rN0K 0H3uYyoxApTVD4pTY31eI8hpoOP0npY9kac2PF02eo3DT7+0VXL7mw3nJAFW/ODz a00B8AVKRpnCsbuqf99hF55FrbVFaIxhNx+L7AxisSk8yaFz8cIm1xl3OavT/aQx xtDJKK0PbOyHRGdTfLER0cgcaklJPFGJwQTiya+vFAbQ3YmtfeW98SwCM3j2TdnQ Bv2Sug9AOq4ygrjwNSGlTorE+wYWv2a3KtVNNgC450lHto+WCt7HnlgJ+IAp7pOi N2yyV4ODntZ2mMKhlChHxnN/8VtDsikap6KAPU5/7oYbC8vnEhprkRQ4qcNWkZoF E5fCrfTo/cIlVCGc9cD461/izxuBMynn2IgeqfmQxax+sRm5ZMSPODWPeC1tnpp5 X2rGlzpGPrwSCRRfd+2fC1nS+nUCq4UEaehj9dFsPlpsG01tRFepH1ggAlM+i65m H5zjBlwp9cu+Ix8aFtCFWFziL8FCaE+eOxlJoQFeRzmt2xfeTtL1zMV7JsTGURyD MN7JE3zV3IjPBM0GLvo6vuE3rLKafje9P70FRbL5jHLiI8iz+dLQsGKJuUkandtJ 4d8ZF0/vZc6CxNet9UWW8c9Leeo3/oh6pGlDKSuE8CtR+6ukJXM= =pCDz -END PGP SIGNATURE- --- This annotated tag includes the following new commits: new 7414579 Preparing hbase release 2.3.6RC3; tagging and updates to CHANGES.md and RELEASENOTES.md The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[hbase] branch pom.xml created (now 82510a8)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch pom.xml in repository https://gitbox.apache.org/repos/asf/hbase.git. at 82510a8 None change This branch includes the following new commits: new 82510a8 None change The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[hbase] 01/01: None change
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch pom.xml in repository https://gitbox.apache.org/repos/asf/hbase.git commit 82510a8a172e6d1c1d61712faef8b2373fcb40d3 Author: stack AuthorDate: Wed Jul 28 14:52:02 2021 -0700 None change --- pom.xml | 1 - 1 file changed, 1 deletion(-) diff --git a/pom.xml b/pom.xml index 3d24d9d..aff47d4 100755 --- a/pom.xml +++ b/pom.xml @@ -19,7 +19,6 @@ * limitations under the License. */ - ON MVN COMPILE NOT WORKING If you wondering why 'mvn compile' does not work building HBase
[hbase] branch 2.3.6 created (now 332d9d1)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch 2.3.6 in repository https://gitbox.apache.org/repos/asf/hbase.git. at 332d9d1 HBASE-26146: Add support for HBASE_HBCK_OPTS (#3534) No new revisions were added by this update.
[hbase] branch branch-2.3 updated (ec3c449 -> b84d580)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/hbase.git. from ec3c449 Preparing development version 2.3.7-SNAPSHOT add de97319 Preparing hbase release 2.3.6RC3; tagging and updates to CHANGES.md and RELEASENOTES.md new b84d580 Preparing development version 2.3.7-SNAPSHOT The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes:
[hbase] 01/01: Preparing development version 2.3.7-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/hbase.git commit b84d58088483e3173ddac183538fecfb6e8d78d7 Author: stack AuthorDate: Wed Jul 28 16:45:05 2021 + Preparing development version 2.3.7-SNAPSHOT Signed-off-by: stack --- hbase-annotations/pom.xml | 2 +- hbase-archetypes/hbase-archetype-builder/pom.xml | 2 +- hbase-archetypes/hbase-client-project/pom.xml | 2 +- hbase-archetypes/hbase-shaded-client-project/pom.xml | 2 +- hbase-archetypes/pom.xml | 2 +- hbase-assembly/pom.xml | 2 +- hbase-asyncfs/pom.xml | 2 +- hbase-build-configuration/pom.xml | 2 +- hbase-checkstyle/pom.xml | 4 ++-- hbase-client/pom.xml | 2 +- hbase-common/pom.xml | 2 +- hbase-endpoint/pom.xml | 2 +- hbase-examples/pom.xml | 2 +- hbase-external-blockcache/pom.xml | 2 +- hbase-hadoop-compat/pom.xml| 2 +- hbase-hadoop2-compat/pom.xml | 2 +- hbase-hbtop/pom.xml| 2 +- hbase-http/pom.xml | 2 +- hbase-it/pom.xml | 2 +- hbase-logging/pom.xml | 2 +- hbase-mapreduce/pom.xml| 2 +- hbase-metrics-api/pom.xml | 2 +- hbase-metrics/pom.xml | 2 +- hbase-procedure/pom.xml| 2 +- hbase-protocol-shaded/pom.xml | 2 +- hbase-protocol/pom.xml | 2 +- hbase-replication/pom.xml | 2 +- hbase-resource-bundle/pom.xml | 2 +- hbase-rest/pom.xml | 2 +- hbase-rsgroup/pom.xml | 2 +- hbase-server/pom.xml | 2 +- hbase-shaded/hbase-shaded-check-invariants/pom.xml | 2 +- hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml| 2 +- hbase-shaded/hbase-shaded-client/pom.xml | 2 +- hbase-shaded/hbase-shaded-mapreduce/pom.xml| 2 +- hbase-shaded/hbase-shaded-testing-util-tester/pom.xml | 2 +- hbase-shaded/hbase-shaded-testing-util/pom.xml | 2 +- hbase-shaded/hbase-shaded-with-hadoop-check-invariants/pom.xml | 2 +- hbase-shaded/pom.xml | 2 +- hbase-shell/pom.xml| 2 +- hbase-testing-util/pom.xml | 2 +- hbase-thrift/pom.xml | 2 +- hbase-zookeeper/pom.xml| 2 +- pom.xml| 2 +- 44 files changed, 45 insertions(+), 45 deletions(-) diff --git a/hbase-annotations/pom.xml b/hbase-annotations/pom.xml index 6ef7c28..11233a4 100644 --- a/hbase-annotations/pom.xml +++ b/hbase-annotations/pom.xml @@ -23,7 +23,7 @@ hbase org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. diff --git a/hbase-archetypes/hbase-archetype-builder/pom.xml b/hbase-archetypes/hbase-archetype-builder/pom.xml index e0b3bbc..2945594 100644 --- a/hbase-archetypes/hbase-archetype-builder/pom.xml +++ b/hbase-archetypes/hbase-archetype-builder/pom.xml @@ -25,7 +25,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. diff --git a/hbase-archetypes/hbase-client-project/pom.xml b/hbase-archetypes/hbase-client-project/pom.xml index b85a349..8bd11aa 100644 --- a/hbase-archetypes/hbase-client-project/pom.xml +++ b/hbase-archetypes/hbase-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. hbase-client-project diff --git a/hbase-archetypes/hbase-shaded-client-project/pom.xml b/hbase-archetypes/hbase-shaded-client-project/pom.xml index 9327d61..96e5215 100644 --- a/hbase-archetypes/hbase-shaded-client-project/pom.xml +++ b/hbase-archetypes/hbase-shaded-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. hbase-shaded-client-project diff --git a/hbase-archetypes/pom.xml b
[hbase] annotated tag 2.3.6RC3 created (now c7cba99)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to annotated tag 2.3.6RC3 in repository https://gitbox.apache.org/repos/asf/hbase.git. at c7cba99 (tag) tagging de97319a2f08fad180f7af7565029f7b48ed0621 (commit) replaces 2.3.6RC2 by stack on Wed Jul 28 16:44:53 2021 + - Log - Via create-release -BEGIN PGP SIGNATURE- iQIzBAABCgAdFiEEXzLoEtM2TIUEtz4m250xPaeHTykFAmEBiYUACgkQ250xPaeH Tyl9/g//UbMwu+rbDxiJWMJNVxtqqQetKncoUXUce5lgAeFxx26ZB48lbeZDscP5 464rrUEKdWmlElX7DsKQFZXXMxm4Enyp4TQPRJ3DCZzOG4XyfEn2AaHXS/l/BA6U ZHkfiINtCO4EGlputBrEd/FRyreBOtUH5RM+eTRkq6OaG0ksFjRhQ08EmEjgxT+E U8/MlEl/AXL0sPGrg1KaHD+NJDKwhdZ9p9sn/N9YEMbxg8OQDLdu+cnJ6CPcWm9c KEkUa9YlsQLCyT1Ve3oIyog2q1IUxmbTljiVsQYiqbvRc6fcojaELxKQRQgnT7V7 V5Ir8nICX9Q5KBoXHIOdud8EvnuQpJkuczPlvOMEPe1gOSSQE+OF9dRlZqnPcaXJ zRuWojw975jlLlyAn/Zey/30zAPipzTT8zGeieKmht6DJpXWS0bikrxsgiMnbrjE q85j8KsbpKD9D8JpgR5iZCQn1AAHR5x3vo2AaTIM0KevKyH99ImK63yiWDGiPasn OKAGL3ebBbZ1CZPJXpuQDAatM3lxYgmldA5ARmXuXrMot8K1fXIDGwxPUNgOcrab G70Iy/uMKHuSNf6XzFE1q6jYy39ilh5905LjqRkhpwRzfKx7CBgX0COudkN7TlFw pdktohq9ZSUEpPHtGJdDe5T/ZmOc0/97BNDYBfc7EBey+PeE8CU= =KztA -END PGP SIGNATURE- --- This annotated tag includes the following new commits: new de97319 Preparing hbase release 2.3.6RC3; tagging and updates to CHANGES.md and RELEASENOTES.md The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[hbase] 01/01: Preparing hbase release 2.3.6RC3; tagging and updates to CHANGES.md and RELEASENOTES.md
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to annotated tag 2.3.6RC3 in repository https://gitbox.apache.org/repos/asf/hbase.git commit de97319a2f08fad180f7af7565029f7b48ed0621 Author: stack AuthorDate: Wed Jul 28 16:44:53 2021 + Preparing hbase release 2.3.6RC3; tagging and updates to CHANGES.md and RELEASENOTES.md Signed-off-by: stack --- hbase-annotations/pom.xml | 2 +- hbase-archetypes/hbase-archetype-builder/pom.xml | 2 +- hbase-archetypes/hbase-client-project/pom.xml | 2 +- hbase-archetypes/hbase-shaded-client-project/pom.xml | 2 +- hbase-archetypes/pom.xml | 2 +- hbase-assembly/pom.xml | 2 +- hbase-asyncfs/pom.xml | 2 +- hbase-build-configuration/pom.xml | 2 +- hbase-checkstyle/pom.xml | 4 ++-- hbase-client/pom.xml | 2 +- hbase-common/pom.xml | 2 +- hbase-endpoint/pom.xml | 2 +- hbase-examples/pom.xml | 2 +- hbase-external-blockcache/pom.xml | 2 +- hbase-hadoop-compat/pom.xml| 2 +- hbase-hadoop2-compat/pom.xml | 2 +- hbase-hbtop/pom.xml| 2 +- hbase-http/pom.xml | 2 +- hbase-it/pom.xml | 2 +- hbase-logging/pom.xml | 2 +- hbase-mapreduce/pom.xml| 2 +- hbase-metrics-api/pom.xml | 2 +- hbase-metrics/pom.xml | 2 +- hbase-procedure/pom.xml| 2 +- hbase-protocol-shaded/pom.xml | 2 +- hbase-protocol/pom.xml | 2 +- hbase-replication/pom.xml | 2 +- hbase-resource-bundle/pom.xml | 2 +- hbase-rest/pom.xml | 2 +- hbase-rsgroup/pom.xml | 2 +- hbase-server/pom.xml | 2 +- hbase-shaded/hbase-shaded-check-invariants/pom.xml | 2 +- hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml| 2 +- hbase-shaded/hbase-shaded-client/pom.xml | 2 +- hbase-shaded/hbase-shaded-mapreduce/pom.xml| 2 +- hbase-shaded/hbase-shaded-testing-util-tester/pom.xml | 2 +- hbase-shaded/hbase-shaded-testing-util/pom.xml | 2 +- hbase-shaded/hbase-shaded-with-hadoop-check-invariants/pom.xml | 2 +- hbase-shaded/pom.xml | 2 +- hbase-shell/pom.xml| 2 +- hbase-testing-util/pom.xml | 2 +- hbase-thrift/pom.xml | 2 +- hbase-zookeeper/pom.xml| 2 +- pom.xml| 2 +- 44 files changed, 45 insertions(+), 45 deletions(-) diff --git a/hbase-annotations/pom.xml b/hbase-annotations/pom.xml index 11233a4..6ef7c28 100644 --- a/hbase-annotations/pom.xml +++ b/hbase-annotations/pom.xml @@ -23,7 +23,7 @@ hbase org.apache.hbase -2.3.7-SNAPSHOT +2.3.6 .. diff --git a/hbase-archetypes/hbase-archetype-builder/pom.xml b/hbase-archetypes/hbase-archetype-builder/pom.xml index 2945594..e0b3bbc 100644 --- a/hbase-archetypes/hbase-archetype-builder/pom.xml +++ b/hbase-archetypes/hbase-archetype-builder/pom.xml @@ -25,7 +25,7 @@ hbase-archetypes org.apache.hbase -2.3.7-SNAPSHOT +2.3.6 .. diff --git a/hbase-archetypes/hbase-client-project/pom.xml b/hbase-archetypes/hbase-client-project/pom.xml index 8bd11aa..b85a349 100644 --- a/hbase-archetypes/hbase-client-project/pom.xml +++ b/hbase-archetypes/hbase-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.7-SNAPSHOT +2.3.6 .. hbase-client-project diff --git a/hbase-archetypes/hbase-shaded-client-project/pom.xml b/hbase-archetypes/hbase-shaded-client-project/pom.xml index 96e5215..9327d61 100644 --- a/hbase-archetypes/hbase-shaded-client-project/pom.xml +++ b/hbase-archetypes/hbase-shaded-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.7-SNAPSHOT +2.3.6 .. hbase-shaded-client
[hbase] branch branch-2.4 updated: HBASE-26146: Add support for HBASE_HBCK_OPTS (#3537)
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/hbase.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new f8ba9b3 HBASE-26146: Add support for HBASE_HBCK_OPTS (#3537) f8ba9b3 is described below commit f8ba9b3fe15fccef498d64f35e1d616ef27b6567 Author: Bryan Beaudreault AuthorDate: Wed Jul 28 01:06:51 2021 -0400 HBASE-26146: Add support for HBASE_HBCK_OPTS (#3537) Signed-off-by: stack --- bin/hbase | 21 +++-- 1 file changed, 15 insertions(+), 6 deletions(-) diff --git a/bin/hbase b/bin/hbase index 59c4871..6bf03f7 100755 --- a/bin/hbase +++ b/bin/hbase @@ -54,6 +54,8 @@ # HBASE_SHELL_OPTS Extra options passed to the hbase shell. #Empty by default. # +# HBASE_HBCK_OPTS Extra options passed to hbck. +#Defaults to HBASE_SERVER_JAAS_OPTS if specified, or HBASE_REGIONSERVER_OPTS. bin=`dirname "$0"` bin=`cd "$bin">/dev/null; pwd` @@ -423,12 +425,18 @@ else HBASE_OPTS="$HBASE_OPTS $CLIENT_GC_OPTS" fi -if [ "$AUTH_AS_SERVER" == "true" ] || [ "$COMMAND" = "hbck" ]; then - if [ -n "$HBASE_SERVER_JAAS_OPTS" ]; then - HBASE_OPTS="$HBASE_OPTS $HBASE_SERVER_JAAS_OPTS" - else - HBASE_OPTS="$HBASE_OPTS $HBASE_REGIONSERVER_OPTS" - fi +if [ -n "$HBASE_SERVER_JAAS_OPTS" ]; then + AUTH_AS_SERVER_OPTS="$HBASE_SERVER_JAAS_OPTS" +else + AUTH_AS_SERVER_OPTS="$HBASE_REGIONSERVER_OPTS" +fi + +if [ "$AUTH_AS_SERVER" == "true" ]; then + HBASE_OPTS="$HBASE_OPTS $AUTH_AS_SERVER_OPTS" +elif [ -z "$HBASE_HBCK_OPTS" ]; then + # The default for hbck should be to use auth-as-server args, for compatibility + # with HBASE-15145 + HBASE_HBCK_OPTS="$AUTH_AS_SERVER_OPTS" fi # check if the command needs jline @@ -545,6 +553,7 @@ elif [ "$COMMAND" = "hbck" ] ; then CLASS='org.apache.hadoop.hbase.util.HBaseFsck' ;; esac + HBASE_OPTS="$HBASE_OPTS $HBASE_HBCK_OPTS" elif [ "$COMMAND" = "wal" ] ; then CLASS='org.apache.hadoop.hbase.wal.WALPrettyPrinter' elif [ "$COMMAND" = "hfile" ] ; then
[hbase] branch branch-2.3 updated (b27ee46 -> ec3c449)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/hbase.git. from b27ee46 HBASE-26120 New replication gets stuck or data loss when multiwal groups more than 10 (#3528) add 072849a Preparing hbase release 2.3.6RC3; tagging and updates to CHANGES.md and RELEASENOTES.md new ec3c449 Preparing development version 2.3.7-SNAPSHOT The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: CHANGES.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
[hbase] 01/01: Preparing development version 2.3.7-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/hbase.git commit ec3c449e2f1387dbd29c8075c912dfd3a58229da Author: stack AuthorDate: Wed Jul 28 04:48:57 2021 + Preparing development version 2.3.7-SNAPSHOT Signed-off-by: stack --- hbase-annotations/pom.xml | 2 +- hbase-archetypes/hbase-archetype-builder/pom.xml | 2 +- hbase-archetypes/hbase-client-project/pom.xml | 2 +- hbase-archetypes/hbase-shaded-client-project/pom.xml | 2 +- hbase-archetypes/pom.xml | 2 +- hbase-assembly/pom.xml | 2 +- hbase-asyncfs/pom.xml | 2 +- hbase-build-configuration/pom.xml | 2 +- hbase-checkstyle/pom.xml | 4 ++-- hbase-client/pom.xml | 2 +- hbase-common/pom.xml | 2 +- hbase-endpoint/pom.xml | 2 +- hbase-examples/pom.xml | 2 +- hbase-external-blockcache/pom.xml | 2 +- hbase-hadoop-compat/pom.xml| 2 +- hbase-hadoop2-compat/pom.xml | 2 +- hbase-hbtop/pom.xml| 2 +- hbase-http/pom.xml | 2 +- hbase-it/pom.xml | 2 +- hbase-logging/pom.xml | 2 +- hbase-mapreduce/pom.xml| 2 +- hbase-metrics-api/pom.xml | 2 +- hbase-metrics/pom.xml | 2 +- hbase-procedure/pom.xml| 2 +- hbase-protocol-shaded/pom.xml | 2 +- hbase-protocol/pom.xml | 2 +- hbase-replication/pom.xml | 2 +- hbase-resource-bundle/pom.xml | 2 +- hbase-rest/pom.xml | 2 +- hbase-rsgroup/pom.xml | 2 +- hbase-server/pom.xml | 2 +- hbase-shaded/hbase-shaded-check-invariants/pom.xml | 2 +- hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml| 2 +- hbase-shaded/hbase-shaded-client/pom.xml | 2 +- hbase-shaded/hbase-shaded-mapreduce/pom.xml| 2 +- hbase-shaded/hbase-shaded-testing-util-tester/pom.xml | 2 +- hbase-shaded/hbase-shaded-testing-util/pom.xml | 2 +- hbase-shaded/hbase-shaded-with-hadoop-check-invariants/pom.xml | 2 +- hbase-shaded/pom.xml | 2 +- hbase-shell/pom.xml| 2 +- hbase-testing-util/pom.xml | 2 +- hbase-thrift/pom.xml | 2 +- hbase-zookeeper/pom.xml| 2 +- pom.xml| 2 +- 44 files changed, 45 insertions(+), 45 deletions(-) diff --git a/hbase-annotations/pom.xml b/hbase-annotations/pom.xml index 6ef7c28..11233a4 100644 --- a/hbase-annotations/pom.xml +++ b/hbase-annotations/pom.xml @@ -23,7 +23,7 @@ hbase org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. diff --git a/hbase-archetypes/hbase-archetype-builder/pom.xml b/hbase-archetypes/hbase-archetype-builder/pom.xml index e0b3bbc..2945594 100644 --- a/hbase-archetypes/hbase-archetype-builder/pom.xml +++ b/hbase-archetypes/hbase-archetype-builder/pom.xml @@ -25,7 +25,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. diff --git a/hbase-archetypes/hbase-client-project/pom.xml b/hbase-archetypes/hbase-client-project/pom.xml index b85a349..8bd11aa 100644 --- a/hbase-archetypes/hbase-client-project/pom.xml +++ b/hbase-archetypes/hbase-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. hbase-client-project diff --git a/hbase-archetypes/hbase-shaded-client-project/pom.xml b/hbase-archetypes/hbase-shaded-client-project/pom.xml index 9327d61..96e5215 100644 --- a/hbase-archetypes/hbase-shaded-client-project/pom.xml +++ b/hbase-archetypes/hbase-shaded-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. hbase-shaded-client-project diff --git a/hbase-archetypes/pom.xml b
[hbase] 01/01: Preparing hbase release 2.3.6RC3; tagging and updates to CHANGES.md and RELEASENOTES.md
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to annotated tag 2.3.6RC3 in repository https://gitbox.apache.org/repos/asf/hbase.git commit 072849a1e547367c6e7e89f38990025f0e5a31f2 Author: stack AuthorDate: Wed Jul 28 04:48:40 2021 + Preparing hbase release 2.3.6RC3; tagging and updates to CHANGES.md and RELEASENOTES.md Signed-off-by: stack --- CHANGES.md | 4 ++-- hbase-annotations/pom.xml | 2 +- hbase-archetypes/hbase-archetype-builder/pom.xml | 2 +- hbase-archetypes/hbase-client-project/pom.xml | 2 +- hbase-archetypes/hbase-shaded-client-project/pom.xml | 2 +- hbase-archetypes/pom.xml | 2 +- hbase-assembly/pom.xml | 2 +- hbase-asyncfs/pom.xml | 2 +- hbase-build-configuration/pom.xml | 2 +- hbase-checkstyle/pom.xml | 4 ++-- hbase-client/pom.xml | 2 +- hbase-common/pom.xml | 2 +- hbase-endpoint/pom.xml | 2 +- hbase-examples/pom.xml | 2 +- hbase-external-blockcache/pom.xml | 2 +- hbase-hadoop-compat/pom.xml| 2 +- hbase-hadoop2-compat/pom.xml | 2 +- hbase-hbtop/pom.xml| 2 +- hbase-http/pom.xml | 2 +- hbase-it/pom.xml | 2 +- hbase-logging/pom.xml | 2 +- hbase-mapreduce/pom.xml| 2 +- hbase-metrics-api/pom.xml | 2 +- hbase-metrics/pom.xml | 2 +- hbase-procedure/pom.xml| 2 +- hbase-protocol-shaded/pom.xml | 2 +- hbase-protocol/pom.xml | 2 +- hbase-replication/pom.xml | 2 +- hbase-resource-bundle/pom.xml | 2 +- hbase-rest/pom.xml | 2 +- hbase-rsgroup/pom.xml | 2 +- hbase-server/pom.xml | 2 +- hbase-shaded/hbase-shaded-check-invariants/pom.xml | 2 +- hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml| 2 +- hbase-shaded/hbase-shaded-client/pom.xml | 2 +- hbase-shaded/hbase-shaded-mapreduce/pom.xml| 2 +- hbase-shaded/hbase-shaded-testing-util-tester/pom.xml | 2 +- hbase-shaded/hbase-shaded-testing-util/pom.xml | 2 +- hbase-shaded/hbase-shaded-with-hadoop-check-invariants/pom.xml | 2 +- hbase-shaded/pom.xml | 2 +- hbase-shell/pom.xml| 2 +- hbase-testing-util/pom.xml | 2 +- hbase-thrift/pom.xml | 2 +- hbase-zookeeper/pom.xml| 2 +- pom.xml| 2 +- 45 files changed, 47 insertions(+), 47 deletions(-) diff --git a/CHANGES.md b/CHANGES.md index 2ac3526..3d2bdb9 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -20,7 +20,7 @@ # Be careful doing manual edits in this file. Do not change format # of release header or remove the below marker. This file is generated. # DO NOT REMOVE THIS MARKER; FOR INTERPOLATING CHANGES!--> -## Release 2.3.6 - Unreleased (as of 2021-07-26) +## Release 2.3.6 - Unreleased (as of 2021-07-28) @@ -54,6 +54,7 @@ | JIRA | Summary | Priority | Component | |: |: | :--- |: | +| [HBASE-26120](https://issues.apache.org/jira/browse/HBASE-26120) | New replication gets stuck or data loss when multiwal groups more than 10 | Critical | Replication | | [HBASE-25165](https://issues.apache.org/jira/browse/HBASE-25165) | Change 'State time' in UI so sorts | Minor | UI | | [HBASE-24984](https://issues.apache.org/jira/browse/HBASE-24984) | WAL corruption due to early DBBs re-use when Durability.ASYNC\_WAL is used with multi operation | Critical | rpc, wal | | [HBASE-26088](https://issues.apache.org/jira/browse/HBASE-26088) | conn.getBufferedMutator(tableName) leaks thread executors and other problems | Critical | Client | @@ -125,7 +126,6 @@ | [HBASE-25755](https://issues.apache.org/jira/browse/HBASE-25755) | Exclude tomcat-embed-core from libthrift | Criti
[hbase] annotated tag 2.3.6RC3 created (now 42434d8)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to annotated tag 2.3.6RC3 in repository https://gitbox.apache.org/repos/asf/hbase.git. at 42434d8 (tag) tagging 072849a1e547367c6e7e89f38990025f0e5a31f2 (commit) replaces 2.3.6RC2 by stack on Wed Jul 28 04:48:40 2021 + - Log - Via create-release -BEGIN PGP SIGNATURE- iQIzBAABCgAdFiEEXzLoEtM2TIUEtz4m250xPaeHTykFAmEA4agACgkQ250xPaeH TynCoA/+JrGrQSC4/vUghlOOXhdH+GDvrjDlx5ssESAcgNMNHBO+Vv1FxnjjsE1K LYDg0qdqjvIxeQDsh8KciLpI4BcT2JP64klP1855tk3mSgHVwGre9bPZBjPfYG8M e42va1xDx1SuEGFEL0TQJXVcqryWmAMco2/zt1LOfjzhkWQRZjUNNGrp2dcIBjSe 32d5XPPsM2Nt+JuR7nwUDJsZ1JtI9wm2XtQ9OeZ2tAucmzzMxVoh6ofPabnG6UAg beEhvOi85GU+NCLu5ld/Q1dIsA8Y4xO+nl1o8OYVC02tEpmtTI9DbJsTOrHv5kMl KaFfwunkumbhtAvxRqjUiCeYHwiK4lzlZTbRs4+rrJduzBqKtQNgre4kW+YIWtpE /peeCLbCisRHZJV1TtX0dXuh8tnmjwXGNbb2N00emji6M7Tqsm5C7fZVL1yJXDtP iMuuZWE05Wbp2JbrRNhVhh8awuSZk8GbT62IClss3GTsZTPB2kv1NiDNfDr8vfks s8SeXxSKSC/iKNk75Oi0PFMdNCpj/2fMbZmr0uK8xWqKxGeOsURpowjYjBabpjBp fF5dcrb8uMAoRoadGH5HAigC9daCJgT5dEktKdkGGW3+pKhxXsI4JZSl0SNr0iM6 7YBoUJth0btyy8W8VV3mgKuWP37tAUkQ8tNx0cvYss7vpu9DyZs= =EN1B -END PGP SIGNATURE- --- This annotated tag includes the following new commits: new 072849a Preparing hbase release 2.3.6RC3; tagging and updates to CHANGES.md and RELEASENOTES.md The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[hbase] branch master updated (02d263e -> 332d9d1)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hbase.git. from 02d263e HBASE-26118 The HStore.commitFile and HStore.moveFileIntoPlace almost have the same logic (#3525) add 332d9d1 HBASE-26146: Add support for HBASE_HBCK_OPTS (#3534) No new revisions were added by this update. Summary of changes: bin/hbase | 21 +++-- 1 file changed, 15 insertions(+), 6 deletions(-)
[hbase] branch branch-2 updated (dd22fec -> d470b25)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch branch-2 in repository https://gitbox.apache.org/repos/asf/hbase.git. from dd22fec HBASE-26120 New replication gets stuck or data loss when multiwal groups more than 10 (#3528) add d470b25 HBASE-26146: Add support for HBASE_HBCK_OPTS (#3534) No new revisions were added by this update. Summary of changes: bin/hbase | 21 +++-- 1 file changed, 15 insertions(+), 6 deletions(-)
svn commit: r49016 [3/4] - /dev/hbase/2.3.6RC2/
Added: dev/hbase/2.3.6RC2/RELEASENOTES.md == --- dev/hbase/2.3.6RC2/RELEASENOTES.md (added) +++ dev/hbase/2.3.6RC2/RELEASENOTES.md Tue Jul 27 03:15:15 2021 @@ -0,0 +1,12647 @@ +# RELEASENOTES + + +# HBASE 2.3.6 Release Notes + +These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements. + + +--- + +* [HBASE-25165](https://issues.apache.org/jira/browse/HBASE-25165) | *Minor* | **Change 'State time' in UI so sorts** + +Start time on the Master UI is now displayed using ISO8601 format instead of java Date#toString(). + + +--- + +* [HBASE-26088](https://issues.apache.org/jira/browse/HBASE-26088) | *Critical* | **conn.getBufferedMutator(tableName) leaks thread executors and other problems** + +The API doc for Connection#getBufferedMutator(TableName) and Connection#getBufferedMutator(BufferedMutatorParams) mentioned that when user dont pass a ThreadPool to be used, we use the ThreadPool in the Connection. But in reality, we were creating new ThreadPool in such cases. + +We are keeping the behaviour of code as is but corrected the Javadoc and also a bug of not closing this new pool while Closing the BufferedMutator. + + +--- + +* [HBASE-22923](https://issues.apache.org/jira/browse/HBASE-22923) | *Major* | **hbase:meta is assigned to localhost when we downgrade the hbase version** + +Introduced new config: hbase.min.version.move.system.tables + +When the operator uses this configuration option, any version between +the current cluster version and the value of "hbase.min.version.move.system.tables" +does not trigger any auto-region movement. Auto-region movement here +refers to auto-migration of system table regions to newer server versions. +It is assumed that the configured range of versions does not require special +handling of moving system table regions to higher versioned RegionServer. +This auto-migration is done by AssignmentManager#checkIfShouldMoveSystemRegionAsync(). +Example: Let's assume the cluster is on version 1.4.0 and we have +set "hbase.min.version.move.system.tables" as "2.0.0". Now if we upgrade +one RegionServer on 1.4.0 cluster to 1.6.0 (\< 2.0.0), then AssignmentManager will +not move hbase:meta, hbase:namespace and other system table regions +to newly brought up RegionServer 1.6.0 as part of auto-migration. +However, if we upgrade one RegionServer on 1.4.0 cluster to 2.2.0 (\> 2.0.0), +then AssignmentManager will move all system table regions to newly brought +up RegionServer 2.2.0 as part of auto-migration done by +AssignmentManager#checkIfShouldMoveSystemRegionAsync(). + +Overall, assuming we have system RSGroup where we keep HBase system tables, if we use +config "hbase.min.version.move.system.tables" with value x.y.z then while upgrading cluster to +version greater than or equal to x.y.z, the first RegionServer that we upgrade must +belong to system RSGroup only. + + +--- + +* [HBASE-25902](https://issues.apache.org/jira/browse/HBASE-25902) | *Critical* | **Add missing CFs in meta during HBase 1 to 2.3+ Upgrade** + +While upgrading cluster from 1.x to 2.3+ versions, after the active master is done setting it's status as 'Initialized', it attempts to add 'table' and 'repl\_barrier' CFs in meta. Once CFs are added successfully, master is aborted with PleaseRestartMasterException because master has missed certain initialization events (e.g ClusterSchemaService is not initialized and tableStateManager fails to migrate table states from ZK to meta due to missing CFs). Subsequent active master initialization is expected to be smooth. +In the presence of multi masters, when one of them becomes active for the first time after upgrading to HBase 2.3+, it is aborted after fixing CFs in meta and one of the other backup masters will take over and become active soon. Hence, overall this is expected to be smooth upgrade if we have backup masters configured. If not, operator is expected to restart same master again manually. + + +--- + +* [HBASE-25877](https://issues.apache.org/jira/browse/HBASE-25877) | *Major* | **Add access check for compactionSwitch** + +Now calling RSRpcService.compactionSwitch, i.e, Admin.compactionSwitch at client side, requires ADMIN permission. +This is an incompatible change but it is also a bug, as we should not allow any users to disable compaction on a regionserver, so we apply this to all active branches. + + +--- + +* [HBASE-25984](https://issues.apache.org/jira/browse/HBASE-25984) | *Critical* | **FSHLog WAL lockup with sync future reuse [RS deadlock]** + +Fixes a WAL lockup issue due to premature reuse of the sync futures by the WAL consumers. The lockup causes the WAL system to hang resulting in blocked appends and syncs thus holding up the RPC handlers from progressing. Only workaround without this fix is to force abort the region server. + + +--- + +*
svn commit: r49016 [4/4] - /dev/hbase/2.3.6RC2/
Added: dev/hbase/2.3.6RC2/api_compare_2.3.5_to_2.3.6RC2.html
==
--- dev/hbase/2.3.6RC2/api_compare_2.3.5_to_2.3.6RC2.html (added)
+++ dev/hbase/2.3.6RC2/api_compare_2.3.5_to_2.3.6RC2.html Tue Jul 27 03:15:15
2021
@@ -0,0 +1,571 @@
+
+
+http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd;>
+http://www.w3.org/1999/xhtml; xml:lang="en" lang="en">
+
+
+
+
+
+hbase: rel/2.3.5 to 2.3.6RC2 compatibility report
+
+body {
+font-family:Arial, sans-serif;
+background-color:White;
+color:Black;
+}
+hr {
+color:Black;
+background-color:Black;
+height:1px;
+border:0;
+}
+h1 {
+margin-bottom:0px;
+padding-bottom:0px;
+font-size:1.625em;
+}
+h2 {
+margin-bottom:0px;
+padding-bottom:0px;
+font-size:1.25em;
+white-space:nowrap;
+}
+div.symbols {
+color:#003E69;
+}
+div.symbols i {
+color:Brown;
+}
+span.section {
+font-weight:bold;
+cursor:pointer;
+color:#003E69;
+white-space:nowrap;
+margin-left:0.3125em;
+}
+span:hover.section {
+color:#336699;
+}
+span.sect_aff {
+cursor:pointer;
+padding-left:1.55em;
+font-size:0.875em;
+color:#cc3300;
+}
+span.ext {
+font-weight:normal;
+}
+span.jar {
+color:#cc3300;
+font-size:0.875em;
+font-weight:bold;
+}
+div.jar_list {
+padding-left:0.4em;
+font-size:0.94em;
+}
+span.pkg_t {
+color:#408080;
+font-size:0.875em;
+}
+span.pkg {
+color:#408080;
+font-size:0.875em;
+font-weight:bold;
+}
+span.cname {
+color:Green;
+font-size:0.875em;
+font-weight:bold;
+}
+span.iname_b {
+font-weight:bold;
+}
+span.iname_a {
+color:#33;
+font-weight:bold;
+font-size:0.94em;
+}
+span.sym_p {
+font-weight:normal;
+white-space:normal;
+}
+span.sym_pd {
+white-space:normal;
+}
+span.sym_p span, span.sym_pd span {
+white-space:nowrap;
+}
+span.attr {
+color:Black;
+font-weight:normal;
+}
+span.deprecated {
+color:Red;
+font-weight:bold;
+font-family:Monaco, monospace;
+}
+div.affect {
+padding-left:1em;
+padding-bottom:10px;
+font-size:0.87em;
+font-style:italic;
+line-height:0.9em;
+}
+div.affected {
+padding-left:2em;
+padding-top:10px;
+}
+table.ptable {
+border-collapse:collapse;
+border:1px outset black;
+margin-left:0.95em;
+margin-top:3px;
+margin-bottom:3px;
+width:56.25em;
+}
+table.ptable td {
+border:1px solid Gray;
+padding:3px;
+font-size:0.875em;
+text-align:left;
+vertical-align:top;
+max-width:28em;
+word-wrap:break-word;
+}
+table.ptable th {
+background-color:#ee;
+font-weight:bold;
+color:#33;
+font-family:Verdana, Arial;
+font-size:0.875em;
+border:1px solid Gray;
+text-align:center;
+vertical-align:top;
+white-space:nowrap;
+padding:3px;
+}
+table.summary {
+border-collapse:collapse;
+border:1px outset black;
+}
+table.summary th {
+background-color:#ee;
+font-weight:normal;
+text-align:left;
+font-size:0.94em;
+white-space:nowrap;
+border:1px inset Gray;
+padding:3px;
+}
+table.summary td {
+text-align:right;
+white-space:nowrap;
+border:1px inset Gray;
+padding:3px 5px 3px 10px;
+}
+span.mngl {
+padding-left:1em;
+font-size:0.875em;
+cursor:text;
+color:#44;
+font-weight:bold;
+}
+span.pleft {
+padding-left:2.5em;
+}
+span.color_p {
+font-style:italic;
+color:Brown;
+}
+span.param {
+font-style:italic;
+}
+span.focus_p {
+font-style:italic;
+background-color:#DCDCDC;
+}
+span.ttype {
+font-weight:normal;
+}
+span.nowrap {
+white-space:nowrap;
+}
+span.value {
+white-space:nowrap;
+font-weight:bold;
+}
+.passed {
+background-color:#CCFFCC;
+font-weight:normal;
+}
+.warning {
+background-color:#F4F4AF;
+font-weight:normal;
+}
+.failed {
+background-color:#FF;
+font-weight:normal;
+}
+.new {
+background-color:#C6DEFF;
+font-weight:normal;
+}
+
+.compatible {
+background-color:#CCFFCC;
+font-weight:normal;
+}
+.almost_compatible {
+background-color:#FFDAA3;
+font-weight:normal;
+}
+.incompatible {
+background-color:#FF;
+font-weight:normal;
+}
+.gray {
+background-color:#DCDCDC;
+font-weight:normal;
+}
+
+.top_ref {
+font-size:0.69em;
+}
+.footer {
+font-size:0.8125em;
+}
+.tabset {
+float:left;
+}
+a.tab {
+border:1px solid Black;
+float:left;
+margin:0px 5px -1px 0px;
+padding:3px 5px 3px 5px;
+position:relative;
+font-size:0.875em;
+background-color:#DDD;
+text-decoration:none;
+color:Black;
+}
+a.disabled:hover
+{
+color:Black;
+background:#EEE;
+}
+a.active:hover
+{
+color:Black;
+background:White;
+}
+a.active {
+border-bottom-color:White;
+background-color:White;
+}
+div.tab {
+border-top:1px solid
svn commit: r49016 [2/4] - /dev/hbase/2.3.6RC2/
/browse/HBASE-24734) | RegionInfo#containsRange should support check meta table | Major | HFile, MTTR | +| [HBASE-25739](https://issues.apache.org/jira/browse/HBASE-25739) | TableSkewCostFunction need to use aggregated deviation | Major | Balancer, master | +| [HBASE-25947](https://issues.apache.org/jira/browse/HBASE-25947) | Backport 'HBASE-25894 Improve the performance for region load and region count related cost functions' to branch-2.4 and branch-2.3 | Major | Balancer, Performance | +| [HBASE-25963](https://issues.apache.org/jira/browse/HBASE-25963) | HBaseCluster should be marked as IA.Public | Major | API | +| [HBASE-25941](https://issues.apache.org/jira/browse/HBASE-25941) | TestRESTServerSSL fails because of jdk bug | Major | test | +| [HBASE-25838](https://issues.apache.org/jira/browse/HBASE-25838) | Use double instead of Double in StochasticLoadBalancer | Major | Balancer, Performance | +| [HBASE-25840](https://issues.apache.org/jira/browse/HBASE-25840) | CatalogJanitor warns about skipping gc of regions during RIT, but does not actually skip | Minor | . | +| [HBASE-25775](https://issues.apache.org/jira/browse/HBASE-25775) | Use a special balancer to deal with maintenance mode | Major | Balancer | +| [HBASE-25199](https://issues.apache.org/jira/browse/HBASE-25199) | Remove HStore#getStoreHomedir | Minor | . | +| [HBASE-25696](https://issues.apache.org/jira/browse/HBASE-25696) | Need to initialize SLF4JBridgeHandler in jul-to-slf4j for redirecting jul to slf4j | Major | logging | +| [HBASE-25695](https://issues.apache.org/jira/browse/HBASE-25695) | Link to the filter on hbase:meta from user tables panel on master page | Major | UI | + + +### OTHER: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [HBASE-26015](https://issues.apache.org/jira/browse/HBASE-26015) | Should implement getRegionServers(boolean) method in AsyncAdmin | Major | Admin, Client | +| [HBASE-25755](https://issues.apache.org/jira/browse/HBASE-25755) | Exclude tomcat-embed-core from libthrift | Critical | dependencies, Thrift | +| [HBASE-25750](https://issues.apache.org/jira/browse/HBASE-25750) | Upgrade RpcControllerFactory and HBaseRpcController from Private to LimitedPrivate(COPROC,PHOENIX) | Major | Coprocessors, phoenix, rpc | +| [HBASE-24305](https://issues.apache.org/jira/browse/HBASE-24305) | Handle deprecations in ServerName | Minor | . | +| [HBASE-24492](https://issues.apache.org/jira/browse/HBASE-24492) | ProtobufLogReader.readNext does not need looping | Minor | Replication, wal | + + +## Release 2.3.5 - Unreleased (as of 2021-03-25) + + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [HBASE-25587](https://issues.apache.org/jira/browse/HBASE-25587) | [hbck2] Schedule SCP for all unknown servers | Major | hbase-operator-tools, hbck2 | +| [HBASE-25460](https://issues.apache.org/jira/browse/HBASE-25460) | Expose drainingServers as cluster metric | Major | metrics | +| [HBASE-25496](https://issues.apache.org/jira/browse/HBASE-25496) | add get\_namespace\_rsgroup command | Major | . | + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [HBASE-25621](https://issues.apache.org/jira/browse/HBASE-25621) | Balancer should check region plan source to avoid misplace region groups | Major | Balancer | +| [HBASE-25374](https://issues.apache.org/jira/browse/HBASE-25374) | Make REST Client connection and socket time out configurable | Minor | REST | +| [HBASE-25597](https://issues.apache.org/jira/browse/HBASE-25597) | Add row info in Exception when cell size exceeds maxCellSize | Minor | . | +| [HBASE-25635](https://issues.apache.org/jira/browse/HBASE-25635) | CandidateGenerator may miss some region balance actions | Major | Balancer | +| [HBASE-25566](https://issues.apache.org/jira/browse/HBASE-25566) | RoundRobinTableInputFormat | Major | mapreduce | +| [HBASE-25548](https://issues.apache.org/jira/browse/HBASE-25548) | Optionally allow snapshots to preserve cluster's max filesize config by setting it into table descriptor | Major | . | +| [HBASE-25582](https://issues.apache.org/jira/browse/HBASE-25582) | Support setting scan ReadType to be STREAM at cluster level | Major | . | +| [HBASE-23578](https://issues.apache.org/jira/browse/HBASE-23578) | [UI] Master UI shows long stack traces when table is broken | Minor | master, UI | +| [HBASE-25541](https://issues.apache.org/jira/browse/HBASE-25541) | In WALEntryStream, set the current path to null while dequeing the log | Major | . | +| [HBASE-25507](https://issues.apache.org/jira/browse/HBASE-25507) | Leak of ESTABLISHED sockets when compaction encountered "java.io.IOException: Invalid HFile block magic" | Major | Compaction | +| [HBASE-25528](https://issues.apache.org/jira/browse/HBASE-25528) | Dedicated merge dispatch threadpool on master | Minor | master | +| [HBASE-25
svn commit: r49016 [1/4] - /dev/hbase/2.3.6RC2/
Author: stack Date: Tue Jul 27 03:15:15 2021 New Revision: 49016 Log: Apache hbase 2.3.6RC2 Added: dev/hbase/2.3.6RC2/ dev/hbase/2.3.6RC2/CHANGES.md dev/hbase/2.3.6RC2/RELEASENOTES.md dev/hbase/2.3.6RC2/api_compare_2.3.5_to_2.3.6RC2.html dev/hbase/2.3.6RC2/hbase-2.3.6-bin.tar.gz (with props) dev/hbase/2.3.6RC2/hbase-2.3.6-bin.tar.gz.asc dev/hbase/2.3.6RC2/hbase-2.3.6-bin.tar.gz.sha512 dev/hbase/2.3.6RC2/hbase-2.3.6-client-bin.tar.gz (with props) dev/hbase/2.3.6RC2/hbase-2.3.6-client-bin.tar.gz.asc dev/hbase/2.3.6RC2/hbase-2.3.6-client-bin.tar.gz.sha512 dev/hbase/2.3.6RC2/hbase-2.3.6-src.tar.gz (with props) dev/hbase/2.3.6RC2/hbase-2.3.6-src.tar.gz.asc dev/hbase/2.3.6RC2/hbase-2.3.6-src.tar.gz.sha512
[hbase] 01/01: Preparing development version 2.3.7-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/hbase.git commit 1968a66eaefd937c3a43a5e0197b3642c8669631 Author: stack AuthorDate: Mon Jul 26 19:29:33 2021 + Preparing development version 2.3.7-SNAPSHOT Signed-off-by: stack --- hbase-annotations/pom.xml | 2 +- hbase-archetypes/hbase-archetype-builder/pom.xml | 2 +- hbase-archetypes/hbase-client-project/pom.xml | 2 +- hbase-archetypes/hbase-shaded-client-project/pom.xml | 2 +- hbase-archetypes/pom.xml | 2 +- hbase-assembly/pom.xml | 2 +- hbase-asyncfs/pom.xml | 2 +- hbase-build-configuration/pom.xml | 2 +- hbase-checkstyle/pom.xml | 4 ++-- hbase-client/pom.xml | 2 +- hbase-common/pom.xml | 2 +- hbase-endpoint/pom.xml | 2 +- hbase-examples/pom.xml | 2 +- hbase-external-blockcache/pom.xml | 2 +- hbase-hadoop-compat/pom.xml| 2 +- hbase-hadoop2-compat/pom.xml | 2 +- hbase-hbtop/pom.xml| 2 +- hbase-http/pom.xml | 2 +- hbase-it/pom.xml | 2 +- hbase-logging/pom.xml | 2 +- hbase-mapreduce/pom.xml| 2 +- hbase-metrics-api/pom.xml | 2 +- hbase-metrics/pom.xml | 2 +- hbase-procedure/pom.xml| 2 +- hbase-protocol-shaded/pom.xml | 2 +- hbase-protocol/pom.xml | 2 +- hbase-replication/pom.xml | 2 +- hbase-resource-bundle/pom.xml | 2 +- hbase-rest/pom.xml | 2 +- hbase-rsgroup/pom.xml | 2 +- hbase-server/pom.xml | 2 +- hbase-shaded/hbase-shaded-check-invariants/pom.xml | 2 +- hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml| 2 +- hbase-shaded/hbase-shaded-client/pom.xml | 2 +- hbase-shaded/hbase-shaded-mapreduce/pom.xml| 2 +- hbase-shaded/hbase-shaded-testing-util-tester/pom.xml | 2 +- hbase-shaded/hbase-shaded-testing-util/pom.xml | 2 +- hbase-shaded/hbase-shaded-with-hadoop-check-invariants/pom.xml | 2 +- hbase-shaded/pom.xml | 2 +- hbase-shell/pom.xml| 2 +- hbase-testing-util/pom.xml | 2 +- hbase-thrift/pom.xml | 2 +- hbase-zookeeper/pom.xml| 2 +- pom.xml| 2 +- 44 files changed, 45 insertions(+), 45 deletions(-) diff --git a/hbase-annotations/pom.xml b/hbase-annotations/pom.xml index 6ef7c28..11233a4 100644 --- a/hbase-annotations/pom.xml +++ b/hbase-annotations/pom.xml @@ -23,7 +23,7 @@ hbase org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. diff --git a/hbase-archetypes/hbase-archetype-builder/pom.xml b/hbase-archetypes/hbase-archetype-builder/pom.xml index e0b3bbc..2945594 100644 --- a/hbase-archetypes/hbase-archetype-builder/pom.xml +++ b/hbase-archetypes/hbase-archetype-builder/pom.xml @@ -25,7 +25,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. diff --git a/hbase-archetypes/hbase-client-project/pom.xml b/hbase-archetypes/hbase-client-project/pom.xml index b85a349..8bd11aa 100644 --- a/hbase-archetypes/hbase-client-project/pom.xml +++ b/hbase-archetypes/hbase-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. hbase-client-project diff --git a/hbase-archetypes/hbase-shaded-client-project/pom.xml b/hbase-archetypes/hbase-shaded-client-project/pom.xml index 9327d61..96e5215 100644 --- a/hbase-archetypes/hbase-shaded-client-project/pom.xml +++ b/hbase-archetypes/hbase-shaded-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. hbase-shaded-client-project diff --git a/hbase-archetypes/pom.xml b
[hbase] branch branch-2.3 updated (86320d6 -> 1968a66)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/hbase.git. from 86320d6 Revert "HBASE-26001 When turn on access control, the cell level TTL of Increment and Append operations is invalid (#3403)" add 79d57a4 Preparing hbase release 2.3.6RC2; tagging and updates to CHANGES.md and RELEASENOTES.md new 1968a66 Preparing development version 2.3.7-SNAPSHOT The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: CHANGES.md | 4 ++-- RELEASENOTES.md | 7 +++ 2 files changed, 9 insertions(+), 2 deletions(-)
[hbase] 01/01: Preparing hbase release 2.3.6RC2; tagging and updates to CHANGES.md and RELEASENOTES.md
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to annotated tag 2.3.6RC2 in repository https://gitbox.apache.org/repos/asf/hbase.git commit 79d57a453ac840873ca15fc151b6f9f342b467b9 Author: stack AuthorDate: Mon Jul 26 19:28:56 2021 + Preparing hbase release 2.3.6RC2; tagging and updates to CHANGES.md and RELEASENOTES.md Signed-off-by: stack --- CHANGES.md | 4 ++-- RELEASENOTES.md| 7 +++ hbase-annotations/pom.xml | 2 +- hbase-archetypes/hbase-archetype-builder/pom.xml | 2 +- hbase-archetypes/hbase-client-project/pom.xml | 2 +- hbase-archetypes/hbase-shaded-client-project/pom.xml | 2 +- hbase-archetypes/pom.xml | 2 +- hbase-assembly/pom.xml | 2 +- hbase-asyncfs/pom.xml | 2 +- hbase-build-configuration/pom.xml | 2 +- hbase-checkstyle/pom.xml | 4 ++-- hbase-client/pom.xml | 2 +- hbase-common/pom.xml | 2 +- hbase-endpoint/pom.xml | 2 +- hbase-examples/pom.xml | 2 +- hbase-external-blockcache/pom.xml | 2 +- hbase-hadoop-compat/pom.xml| 2 +- hbase-hadoop2-compat/pom.xml | 2 +- hbase-hbtop/pom.xml| 2 +- hbase-http/pom.xml | 2 +- hbase-it/pom.xml | 2 +- hbase-logging/pom.xml | 2 +- hbase-mapreduce/pom.xml| 2 +- hbase-metrics-api/pom.xml | 2 +- hbase-metrics/pom.xml | 2 +- hbase-procedure/pom.xml| 2 +- hbase-protocol-shaded/pom.xml | 2 +- hbase-protocol/pom.xml | 2 +- hbase-replication/pom.xml | 2 +- hbase-resource-bundle/pom.xml | 2 +- hbase-rest/pom.xml | 2 +- hbase-rsgroup/pom.xml | 2 +- hbase-server/pom.xml | 2 +- hbase-shaded/hbase-shaded-check-invariants/pom.xml | 2 +- hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml| 2 +- hbase-shaded/hbase-shaded-client/pom.xml | 2 +- hbase-shaded/hbase-shaded-mapreduce/pom.xml| 2 +- hbase-shaded/hbase-shaded-testing-util-tester/pom.xml | 2 +- hbase-shaded/hbase-shaded-testing-util/pom.xml | 2 +- hbase-shaded/hbase-shaded-with-hadoop-check-invariants/pom.xml | 2 +- hbase-shaded/pom.xml | 2 +- hbase-shell/pom.xml| 2 +- hbase-testing-util/pom.xml | 2 +- hbase-thrift/pom.xml | 2 +- hbase-zookeeper/pom.xml| 2 +- pom.xml| 2 +- 46 files changed, 54 insertions(+), 47 deletions(-) diff --git a/CHANGES.md b/CHANGES.md index a3b36b7..2ac3526 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -20,7 +20,7 @@ # Be careful doing manual edits in this file. Do not change format # of release header or remove the below marker. This file is generated. # DO NOT REMOVE THIS MARKER; FOR INTERPOLATING CHANGES!--> -## Release 2.3.6 - Unreleased (as of 2021-07-23) +## Release 2.3.6 - Unreleased (as of 2021-07-26) @@ -54,6 +54,7 @@ | JIRA | Summary | Priority | Component | |: |: | :--- |: | +| [HBASE-25165](https://issues.apache.org/jira/browse/HBASE-25165) | Change 'State time' in UI so sorts | Minor | UI | | [HBASE-24984](https://issues.apache.org/jira/browse/HBASE-24984) | WAL corruption due to early DBBs re-use when Durability.ASYNC\_WAL is used with multi operation | Critical | rpc, wal | | [HBASE-26088](https://issues.apache.org/jira/browse/HBASE-26088) | conn.getBufferedMutator(tableName) leaks thread executors and other problems | Critical | Client | | [HBASE-25973](https://issues.apache.org/jira/browse/HBASE-25973) | Balancer should explain progress in a better way in log | Major | Balancer | @@ -70,7 +71,6 @@ | [HBASE-26013](https://issues.apache.org/jira/browse/HBASE-26013) |
[hbase] annotated tag 2.3.6RC2 created (now 0f29947)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to annotated tag 2.3.6RC2 in repository https://gitbox.apache.org/repos/asf/hbase.git. at 0f29947 (tag) tagging 79d57a453ac840873ca15fc151b6f9f342b467b9 (commit) replaces 2.3.6RC0 by stack on Mon Jul 26 19:28:56 2021 + - Log - Via create-release -BEGIN PGP SIGNATURE- iQIzBAABCgAdFiEEXzLoEtM2TIUEtz4m250xPaeHTykFAmD/DPkACgkQ250xPaeH TynFqg//SALMB6G5M3/iWd2aZlEZAUaIFx/DATMYtlYKYoffMaLFylCRN18n7D3k CIzsKEuGrAgGvEKhgaEuNpfme8EarDnaLSRlsILsAvRrN/nG/WobZTg8u3+GS8JI 963ZCyoA+mwQrMOlXhImxknCJUyM4VTfofsMa9yF6Gzf/vycnuWfivqTplYVaewu P3jPCLNd5vraivPa4poV83HVTJ3qy3w8zbNjuGw89Uu5sTB9m2u6YPjCM96OqptN Jr9eaN1e4PhOYd62u+wiodgE75AcN0eClhSbXQhWls/je83SYM8O3Sw9ti155Aut 5Kn3U/IA7J2Q8U+xeQMWHwYNuewAZLDndPltH33SVGU2tR6K9YFzqw3VAzAxRcrb ROP6QKw1234fxP+A3dzDtxYhJKSTchWfr4hFtxjwNv8s9z3plhXVZvr/xL4NtVgw +Tm6pMFtdx79El0Sas4rW/cNTDXSq2xA0LvBg0tyDJpEOfmle1DsOR+r3rAA/23t 5MjAIQJ26ymG7TB/ce9YHFLmckkRXPgN0s+1u2qqfrNftSy0l5WK0fGwlaACr7X8 pIOamAaBZErr5DNT2bLDDBYZsZWDJG+EsBiKvBr1LRfUHUsg8qxltqiKz2x0GuWX tKp2ETxq2w0/xn6xmCYy7WNtj6MhAKUJR5hSupN+ozErsakV+TY= =r53i -END PGP SIGNATURE- --- This annotated tag includes the following new commits: new 79d57a4 Preparing hbase release 2.3.6RC2; tagging and updates to CHANGES.md and RELEASENOTES.md The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[hbase] branch branch-2.3 updated: Revert "HBASE-26001 When turn on access control, the cell level TTL of Increment and Append operations is invalid (#3403)"
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.3 by this push:
new 86320d6 Revert "HBASE-26001 When turn on access control, the cell
level TTL of Increment and Append operations is invalid (#3403)"
86320d6 is described below
commit 86320d6b0498a5679f25ea9717adae8453d4b50b
Author: stack
AuthorDate: Mon Jul 26 10:57:20 2021 -0700
Revert "HBASE-26001 When turn on access control, the cell level TTL of
Increment and Append operations is invalid (#3403)"
This reverts commit 864ac503a008dbcf6b8c9ec246bbf2f7b913c39d.
---
.../hbase/security/access/AccessController.java| 45 +--
.../TestPostIncrementAndAppendBeforeWAL.java | 139 +
2 files changed, 37 insertions(+), 147 deletions(-)
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
index a643d74..6b7a532 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
@@ -135,6 +135,7 @@ import org.apache.yetus.audience.InterfaceAudience;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
+import org.apache.hbase.thirdparty.com.google.common.collect.ArrayListMultimap;
import org.apache.hbase.thirdparty.com.google.common.collect.ImmutableSet;
import org.apache.hbase.thirdparty.com.google.common.collect.ListMultimap;
import org.apache.hbase.thirdparty.com.google.common.collect.Lists;
@@ -1784,7 +1785,7 @@ public class AccessController implements
MasterCoprocessor, RegionCoprocessor,
List> cellPairs) throws IOException {
// If the HFile version is insufficient to persist tags, we won't have any
// work to do here
-if (!cellFeaturesEnabled || mutation.getACL() == null) {
+if (!cellFeaturesEnabled) {
return cellPairs;
}
return cellPairs.stream().map(pair -> new Pair<>(pair.getFirst(),
@@ -1798,7 +1799,7 @@ public class AccessController implements
MasterCoprocessor, RegionCoprocessor,
List> cellPairs) throws IOException {
// If the HFile version is insufficient to persist tags, we won't have any
// work to do here
-if (!cellFeaturesEnabled || mutation.getACL() == null) {
+if (!cellFeaturesEnabled) {
return cellPairs;
}
return cellPairs.stream().map(pair -> new Pair<>(pair.getFirst(),
@@ -1807,28 +1808,50 @@ public class AccessController implements
MasterCoprocessor, RegionCoprocessor,
}
private Cell createNewCellWithTags(Mutation mutation, Cell oldCell, Cell
newCell) {
-// As Increment and Append operations have already copied the tags of
oldCell to the newCell,
-// there is no need to rewrite them again. Just extract non-acl tags of
newCell if we need to
-// add a new acl tag for the cell. Actually, oldCell is useless here.
+// Collect any ACLs from the old cell
List tags = Lists.newArrayList();
-if (newCell != null) {
- Iterator tagIterator = PrivateCellUtil.tagsIterator(newCell);
+List aclTags = Lists.newArrayList();
+ListMultimap perms = ArrayListMultimap.create();
+if (oldCell != null) {
+ Iterator tagIterator = PrivateCellUtil.tagsIterator(oldCell);
while (tagIterator.hasNext()) {
Tag tag = tagIterator.next();
if (tag.getType() != PermissionStorage.ACL_TAG_TYPE) {
// Not an ACL tag, just carry it through
if (LOG.isTraceEnabled()) {
-LOG.trace("Carrying forward tag from " + newCell + ": type " +
tag.getType()
+LOG.trace("Carrying forward tag from " + oldCell + ": type " +
tag.getType()
+ " length " + tag.getValueLength());
}
tags.add(tag);
+} else {
+ aclTags.add(tag);
+}
+ }
+}
+
+// Do we have an ACL on the operation?
+byte[] aclBytes = mutation.getACL();
+if (aclBytes != null) {
+ // Yes, use it
+ tags.add(new ArrayBackedTag(PermissionStorage.ACL_TAG_TYPE, aclBytes));
+} else {
+ // No, use what we carried forward
+ if (perms != null) {
+// TODO: If we collected ACLs from more than one tag we may have a
+// List of size > 1, this can be collapsed into a single
+// Permission
+if (LOG.isTraceEnabled()) {
+ LOG.trace("Carrying forward ACLs from " + oldCell + ": " + perms);
}
+tags.addAll(aclTags);
}
}
-// We have checked the ACL tag of mutation is not null.
-// So that the tags could not be empty.
-tags.add(ne
[hbase] branch branch-2.3 updated (976205f -> 3114911)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/hbase.git. from 976205f HBASE-25165 Change 'State time' in UI so sorts add 5000405 Preparing hbase release 2.3.6RC1; tagging and updates to CHANGES.md and RELEASENOTES.md new 3114911 Preparing development version 2.3.7-SNAPSHOT The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: CHANGES.md | 4 ++-- RELEASENOTES.md | 7 +++ 2 files changed, 9 insertions(+), 2 deletions(-)
[hbase] 01/01: Preparing development version 2.3.7-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/hbase.git commit 3114911bde3fdc51b5b6bda0d0bff90fe2f96cea Author: stack AuthorDate: Mon Jul 26 18:50:25 2021 + Preparing development version 2.3.7-SNAPSHOT Signed-off-by: stack --- hbase-annotations/pom.xml | 2 +- hbase-archetypes/hbase-archetype-builder/pom.xml | 2 +- hbase-archetypes/hbase-client-project/pom.xml | 2 +- hbase-archetypes/hbase-shaded-client-project/pom.xml | 2 +- hbase-archetypes/pom.xml | 2 +- hbase-assembly/pom.xml | 2 +- hbase-asyncfs/pom.xml | 2 +- hbase-build-configuration/pom.xml | 2 +- hbase-checkstyle/pom.xml | 4 ++-- hbase-client/pom.xml | 2 +- hbase-common/pom.xml | 2 +- hbase-endpoint/pom.xml | 2 +- hbase-examples/pom.xml | 2 +- hbase-external-blockcache/pom.xml | 2 +- hbase-hadoop-compat/pom.xml| 2 +- hbase-hadoop2-compat/pom.xml | 2 +- hbase-hbtop/pom.xml| 2 +- hbase-http/pom.xml | 2 +- hbase-it/pom.xml | 2 +- hbase-logging/pom.xml | 2 +- hbase-mapreduce/pom.xml| 2 +- hbase-metrics-api/pom.xml | 2 +- hbase-metrics/pom.xml | 2 +- hbase-procedure/pom.xml| 2 +- hbase-protocol-shaded/pom.xml | 2 +- hbase-protocol/pom.xml | 2 +- hbase-replication/pom.xml | 2 +- hbase-resource-bundle/pom.xml | 2 +- hbase-rest/pom.xml | 2 +- hbase-rsgroup/pom.xml | 2 +- hbase-server/pom.xml | 2 +- hbase-shaded/hbase-shaded-check-invariants/pom.xml | 2 +- hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml| 2 +- hbase-shaded/hbase-shaded-client/pom.xml | 2 +- hbase-shaded/hbase-shaded-mapreduce/pom.xml| 2 +- hbase-shaded/hbase-shaded-testing-util-tester/pom.xml | 2 +- hbase-shaded/hbase-shaded-testing-util/pom.xml | 2 +- hbase-shaded/hbase-shaded-with-hadoop-check-invariants/pom.xml | 2 +- hbase-shaded/pom.xml | 2 +- hbase-shell/pom.xml| 2 +- hbase-testing-util/pom.xml | 2 +- hbase-thrift/pom.xml | 2 +- hbase-zookeeper/pom.xml| 2 +- pom.xml| 2 +- 44 files changed, 45 insertions(+), 45 deletions(-) diff --git a/hbase-annotations/pom.xml b/hbase-annotations/pom.xml index 6ef7c28..11233a4 100644 --- a/hbase-annotations/pom.xml +++ b/hbase-annotations/pom.xml @@ -23,7 +23,7 @@ hbase org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. diff --git a/hbase-archetypes/hbase-archetype-builder/pom.xml b/hbase-archetypes/hbase-archetype-builder/pom.xml index e0b3bbc..2945594 100644 --- a/hbase-archetypes/hbase-archetype-builder/pom.xml +++ b/hbase-archetypes/hbase-archetype-builder/pom.xml @@ -25,7 +25,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. diff --git a/hbase-archetypes/hbase-client-project/pom.xml b/hbase-archetypes/hbase-client-project/pom.xml index b85a349..8bd11aa 100644 --- a/hbase-archetypes/hbase-client-project/pom.xml +++ b/hbase-archetypes/hbase-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. hbase-client-project diff --git a/hbase-archetypes/hbase-shaded-client-project/pom.xml b/hbase-archetypes/hbase-shaded-client-project/pom.xml index 9327d61..96e5215 100644 --- a/hbase-archetypes/hbase-shaded-client-project/pom.xml +++ b/hbase-archetypes/hbase-shaded-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. hbase-shaded-client-project diff --git a/hbase-archetypes/pom.xml b
[hbase] annotated tag 2.3.6RC1 created (now f23862d)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to annotated tag 2.3.6RC1 in repository https://gitbox.apache.org/repos/asf/hbase.git. at f23862d (tag) tagging 5000405d63d80e87b432848cd762aae335bbd8e6 (commit) replaces 2.3.6RC0 by stack on Mon Jul 26 18:49:58 2021 + - Log - Via create-release -BEGIN PGP SIGNATURE- iQIzBAABCgAdFiEEXzLoEtM2TIUEtz4m250xPaeHTykFAmD/A9YACgkQ250xPaeH TylsQQ//URXAwT7kHZyliZ5GkosA83H02z8ZQvS8Vpux505HsEG9FRV8jJx0l7pw oACsg4k18gNIX3Jp8SvnqJvvxiIbFauycnsPlu+FdunkPOXIFoG8lEAacMBmyd03 swQfGCK4zJs2Ohf6vHRhanxnxuGPVC0Fwum068r3KQLrjdvfetqXnT0ZUJAnF0xF K2AjWrtRVjS8WRzWKkAcGlqhbdSXyypRKkgJHFM1/2E8XNO+x+H8c+I9HTdHHmkM nNd26Pnddmewg+dGawr5gshq7VqC3HFicO7AuyWy6wMR90PRGO/7IIfkHBex2tfF 6+LQVyVC5wrhXxyhHysvsSTG1rOYQqfDbXGp3uly70xIrjgC0QwxRbpgLdeqRUf0 kLbVSQlMCiV9ZNvcMToyxHBPJwea3unLVd6vpmHqpjwPOsO1BGbElf1Jcq8DrTq0 Oc/qOmrjVXNn8k0tHfBz84ONFc0wqr14Blt70rhPpyvqnpOuaLngrvzHokLXoolA 8O1nShnSU1DXy2vxgOpqsRhzCzfOJIbeBbkOzwLAkbIxz9IIwwQWYzfOsc0JcdrJ 3OewZDRGIlIuyfgkare8/h5B58drWEHEU0kGSE0gmNSuu04Ve7em12iOvg13+kzU oy3nlKafwm1z9/zUwkEh/N8AOsVnBLcQnI8SoBOAZYDzQEu6zVc= =8NI/ -END PGP SIGNATURE- --- This annotated tag includes the following new commits: new 5000405 Preparing hbase release 2.3.6RC1; tagging and updates to CHANGES.md and RELEASENOTES.md The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[hbase] 01/01: Preparing hbase release 2.3.6RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to annotated tag 2.3.6RC1 in repository https://gitbox.apache.org/repos/asf/hbase.git commit 5000405d63d80e87b432848cd762aae335bbd8e6 Author: stack AuthorDate: Mon Jul 26 18:49:57 2021 + Preparing hbase release 2.3.6RC1; tagging and updates to CHANGES.md and RELEASENOTES.md Signed-off-by: stack --- CHANGES.md | 4 ++-- RELEASENOTES.md| 7 +++ hbase-annotations/pom.xml | 2 +- hbase-archetypes/hbase-archetype-builder/pom.xml | 2 +- hbase-archetypes/hbase-client-project/pom.xml | 2 +- hbase-archetypes/hbase-shaded-client-project/pom.xml | 2 +- hbase-archetypes/pom.xml | 2 +- hbase-assembly/pom.xml | 2 +- hbase-asyncfs/pom.xml | 2 +- hbase-build-configuration/pom.xml | 2 +- hbase-checkstyle/pom.xml | 4 ++-- hbase-client/pom.xml | 2 +- hbase-common/pom.xml | 2 +- hbase-endpoint/pom.xml | 2 +- hbase-examples/pom.xml | 2 +- hbase-external-blockcache/pom.xml | 2 +- hbase-hadoop-compat/pom.xml| 2 +- hbase-hadoop2-compat/pom.xml | 2 +- hbase-hbtop/pom.xml| 2 +- hbase-http/pom.xml | 2 +- hbase-it/pom.xml | 2 +- hbase-logging/pom.xml | 2 +- hbase-mapreduce/pom.xml| 2 +- hbase-metrics-api/pom.xml | 2 +- hbase-metrics/pom.xml | 2 +- hbase-procedure/pom.xml| 2 +- hbase-protocol-shaded/pom.xml | 2 +- hbase-protocol/pom.xml | 2 +- hbase-replication/pom.xml | 2 +- hbase-resource-bundle/pom.xml | 2 +- hbase-rest/pom.xml | 2 +- hbase-rsgroup/pom.xml | 2 +- hbase-server/pom.xml | 2 +- hbase-shaded/hbase-shaded-check-invariants/pom.xml | 2 +- hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml| 2 +- hbase-shaded/hbase-shaded-client/pom.xml | 2 +- hbase-shaded/hbase-shaded-mapreduce/pom.xml| 2 +- hbase-shaded/hbase-shaded-testing-util-tester/pom.xml | 2 +- hbase-shaded/hbase-shaded-testing-util/pom.xml | 2 +- hbase-shaded/hbase-shaded-with-hadoop-check-invariants/pom.xml | 2 +- hbase-shaded/pom.xml | 2 +- hbase-shell/pom.xml| 2 +- hbase-testing-util/pom.xml | 2 +- hbase-thrift/pom.xml | 2 +- hbase-zookeeper/pom.xml| 2 +- pom.xml| 2 +- 46 files changed, 54 insertions(+), 47 deletions(-) diff --git a/CHANGES.md b/CHANGES.md index a3b36b7..2ac3526 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -20,7 +20,7 @@ # Be careful doing manual edits in this file. Do not change format # of release header or remove the below marker. This file is generated. # DO NOT REMOVE THIS MARKER; FOR INTERPOLATING CHANGES!--> -## Release 2.3.6 - Unreleased (as of 2021-07-23) +## Release 2.3.6 - Unreleased (as of 2021-07-26) @@ -54,6 +54,7 @@ | JIRA | Summary | Priority | Component | |: |: | :--- |: | +| [HBASE-25165](https://issues.apache.org/jira/browse/HBASE-25165) | Change 'State time' in UI so sorts | Minor | UI | | [HBASE-24984](https://issues.apache.org/jira/browse/HBASE-24984) | WAL corruption due to early DBBs re-use when Durability.ASYNC\_WAL is used with multi operation | Critical | rpc, wal | | [HBASE-26088](https://issues.apache.org/jira/browse/HBASE-26088) | conn.getBufferedMutator(tableName) leaks thread executors and other problems | Critical | Client | | [HBASE-25973](https://issues.apache.org/jira/browse/HBASE-25973) | Balancer should explain progress in a better way in log | Major | Balancer | @@ -70,7 +71,6 @@ | [HBASE-26013](https://issues.apache.org/jira/browse/HBASE-26013) |
[hbase] branch branch-2.3 updated: HBASE-25165 Change 'State time' in UI so sorts
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.3 by this push:
new 976205f HBASE-25165 Change 'State time' in UI so sorts
976205f is described below
commit 976205fba05197d224a0b23aab88ad34dbdfaae9
Author: stack
AuthorDate: Wed Oct 7 16:29:25 2020 -0700
HBASE-25165 Change 'State time' in UI so sorts
Display startcode in iso8601.
---
.../org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon
index a3067ee..5878361 100644
---
a/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon
+++
b/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/RegionServerListTmpl.jamon
@@ -121,7 +121,7 @@ Arrays.sort(serverNames);
<& serverNameLink; serverName=serverName; &>
-<% new Date(startcode) %>
+<% java.time.Instant.ofEpochMilli(startcode) %>
<% TraditionalBinaryPrefix.long2String(lastContact, "s", 1) %>
<% version %>
<% String.format("%,.0f", requestsPerSecond) %>
[hbase] 01/01: Preparing development version 2.3.7-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/hbase.git commit 74d94694be3822de245d9568de3006a880c3d9c9 Author: stack AuthorDate: Fri Jul 23 18:23:43 2021 + Preparing development version 2.3.7-SNAPSHOT Signed-off-by: stack --- hbase-annotations/pom.xml | 2 +- hbase-archetypes/hbase-archetype-builder/pom.xml | 2 +- hbase-archetypes/hbase-client-project/pom.xml | 2 +- hbase-archetypes/hbase-shaded-client-project/pom.xml | 2 +- hbase-archetypes/pom.xml | 2 +- hbase-assembly/pom.xml | 2 +- hbase-asyncfs/pom.xml | 2 +- hbase-build-configuration/pom.xml | 2 +- hbase-checkstyle/pom.xml | 4 ++-- hbase-client/pom.xml | 2 +- hbase-common/pom.xml | 2 +- hbase-endpoint/pom.xml | 2 +- hbase-examples/pom.xml | 2 +- hbase-external-blockcache/pom.xml | 2 +- hbase-hadoop-compat/pom.xml| 2 +- hbase-hadoop2-compat/pom.xml | 2 +- hbase-hbtop/pom.xml| 2 +- hbase-http/pom.xml | 2 +- hbase-it/pom.xml | 2 +- hbase-logging/pom.xml | 2 +- hbase-mapreduce/pom.xml| 2 +- hbase-metrics-api/pom.xml | 2 +- hbase-metrics/pom.xml | 2 +- hbase-procedure/pom.xml| 2 +- hbase-protocol-shaded/pom.xml | 2 +- hbase-protocol/pom.xml | 2 +- hbase-replication/pom.xml | 2 +- hbase-resource-bundle/pom.xml | 2 +- hbase-rest/pom.xml | 2 +- hbase-rsgroup/pom.xml | 2 +- hbase-server/pom.xml | 2 +- hbase-shaded/hbase-shaded-check-invariants/pom.xml | 2 +- hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml| 2 +- hbase-shaded/hbase-shaded-client/pom.xml | 2 +- hbase-shaded/hbase-shaded-mapreduce/pom.xml| 2 +- hbase-shaded/hbase-shaded-testing-util-tester/pom.xml | 2 +- hbase-shaded/hbase-shaded-testing-util/pom.xml | 2 +- hbase-shaded/hbase-shaded-with-hadoop-check-invariants/pom.xml | 2 +- hbase-shaded/pom.xml | 2 +- hbase-shell/pom.xml| 2 +- hbase-testing-util/pom.xml | 2 +- hbase-thrift/pom.xml | 2 +- hbase-zookeeper/pom.xml| 2 +- pom.xml| 2 +- 44 files changed, 45 insertions(+), 45 deletions(-) diff --git a/hbase-annotations/pom.xml b/hbase-annotations/pom.xml index 6ef7c28..11233a4 100644 --- a/hbase-annotations/pom.xml +++ b/hbase-annotations/pom.xml @@ -23,7 +23,7 @@ hbase org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. diff --git a/hbase-archetypes/hbase-archetype-builder/pom.xml b/hbase-archetypes/hbase-archetype-builder/pom.xml index e0b3bbc..2945594 100644 --- a/hbase-archetypes/hbase-archetype-builder/pom.xml +++ b/hbase-archetypes/hbase-archetype-builder/pom.xml @@ -25,7 +25,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. diff --git a/hbase-archetypes/hbase-client-project/pom.xml b/hbase-archetypes/hbase-client-project/pom.xml index b85a349..8bd11aa 100644 --- a/hbase-archetypes/hbase-client-project/pom.xml +++ b/hbase-archetypes/hbase-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. hbase-client-project diff --git a/hbase-archetypes/hbase-shaded-client-project/pom.xml b/hbase-archetypes/hbase-shaded-client-project/pom.xml index 9327d61..96e5215 100644 --- a/hbase-archetypes/hbase-shaded-client-project/pom.xml +++ b/hbase-archetypes/hbase-shaded-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.3.6 +2.3.7-SNAPSHOT .. hbase-shaded-client-project diff --git a/hbase-archetypes/pom.xml b
[hbase] branch branch-2.3 updated (1832418 -> 74d9469)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/hbase.git. from 1832418 Revert "HBASE-25792 Filter out o.a.hadoop.thirdparty building shaded jars" add 34c4803 Preparing hbase release 2.3.6RC0; tagging and updates to CHANGES.md and RELEASENOTES.md new 74d9469 Preparing development version 2.3.7-SNAPSHOT The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: CHANGES.md | 108 ++ RELEASENOTES.md| 123 + hbase-annotations/pom.xml | 2 +- hbase-archetypes/hbase-archetype-builder/pom.xml | 2 +- hbase-archetypes/hbase-client-project/pom.xml | 2 +- .../hbase-shaded-client-project/pom.xml| 2 +- hbase-archetypes/pom.xml | 2 +- hbase-assembly/pom.xml | 2 +- hbase-asyncfs/pom.xml | 2 +- hbase-build-configuration/pom.xml | 2 +- hbase-checkstyle/pom.xml | 4 +- hbase-client/pom.xml | 2 +- hbase-common/pom.xml | 2 +- hbase-endpoint/pom.xml | 2 +- hbase-examples/pom.xml | 2 +- hbase-external-blockcache/pom.xml | 2 +- hbase-hadoop-compat/pom.xml| 2 +- hbase-hadoop2-compat/pom.xml | 2 +- hbase-hbtop/pom.xml| 2 +- hbase-http/pom.xml | 2 +- hbase-it/pom.xml | 2 +- hbase-logging/pom.xml | 2 +- hbase-mapreduce/pom.xml| 2 +- hbase-metrics-api/pom.xml | 2 +- hbase-metrics/pom.xml | 2 +- hbase-procedure/pom.xml| 2 +- hbase-protocol-shaded/pom.xml | 2 +- hbase-protocol/pom.xml | 2 +- hbase-replication/pom.xml | 2 +- hbase-resource-bundle/pom.xml | 2 +- hbase-rest/pom.xml | 2 +- hbase-rsgroup/pom.xml | 2 +- hbase-server/pom.xml | 2 +- hbase-shaded/hbase-shaded-check-invariants/pom.xml | 2 +- .../hbase-shaded-client-byo-hadoop/pom.xml | 2 +- hbase-shaded/hbase-shaded-client/pom.xml | 2 +- hbase-shaded/hbase-shaded-mapreduce/pom.xml| 2 +- .../hbase-shaded-testing-util-tester/pom.xml | 2 +- hbase-shaded/hbase-shaded-testing-util/pom.xml | 2 +- .../pom.xml| 2 +- hbase-shaded/pom.xml | 2 +- hbase-shell/pom.xml| 2 +- hbase-testing-util/pom.xml | 2 +- hbase-thrift/pom.xml | 2 +- hbase-zookeeper/pom.xml| 2 +- pom.xml| 2 +- 46 files changed, 276 insertions(+), 45 deletions(-)
[hbase] 01/01: Preparing hbase release 2.3.6RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to annotated tag 2.3.6RC0 in repository https://gitbox.apache.org/repos/asf/hbase.git commit 34c4803db42a1094f1db275670a8ea96ed6bf51e Author: stack AuthorDate: Fri Jul 23 18:23:17 2021 + Preparing hbase release 2.3.6RC0; tagging and updates to CHANGES.md and RELEASENOTES.md Signed-off-by: stack --- CHANGES.md | 108 ++ RELEASENOTES.md| 123 + hbase-annotations/pom.xml | 2 +- hbase-archetypes/hbase-archetype-builder/pom.xml | 2 +- hbase-archetypes/hbase-client-project/pom.xml | 2 +- .../hbase-shaded-client-project/pom.xml| 2 +- hbase-archetypes/pom.xml | 2 +- hbase-assembly/pom.xml | 2 +- hbase-asyncfs/pom.xml | 2 +- hbase-build-configuration/pom.xml | 2 +- hbase-checkstyle/pom.xml | 4 +- hbase-client/pom.xml | 2 +- hbase-common/pom.xml | 2 +- hbase-endpoint/pom.xml | 2 +- hbase-examples/pom.xml | 2 +- hbase-external-blockcache/pom.xml | 2 +- hbase-hadoop-compat/pom.xml| 2 +- hbase-hadoop2-compat/pom.xml | 2 +- hbase-hbtop/pom.xml| 2 +- hbase-http/pom.xml | 2 +- hbase-it/pom.xml | 2 +- hbase-logging/pom.xml | 2 +- hbase-mapreduce/pom.xml| 2 +- hbase-metrics-api/pom.xml | 2 +- hbase-metrics/pom.xml | 2 +- hbase-procedure/pom.xml| 2 +- hbase-protocol-shaded/pom.xml | 2 +- hbase-protocol/pom.xml | 2 +- hbase-replication/pom.xml | 2 +- hbase-resource-bundle/pom.xml | 2 +- hbase-rest/pom.xml | 2 +- hbase-rsgroup/pom.xml | 2 +- hbase-server/pom.xml | 2 +- hbase-shaded/hbase-shaded-check-invariants/pom.xml | 2 +- .../hbase-shaded-client-byo-hadoop/pom.xml | 2 +- hbase-shaded/hbase-shaded-client/pom.xml | 2 +- hbase-shaded/hbase-shaded-mapreduce/pom.xml| 2 +- .../hbase-shaded-testing-util-tester/pom.xml | 2 +- hbase-shaded/hbase-shaded-testing-util/pom.xml | 2 +- .../pom.xml| 2 +- hbase-shaded/pom.xml | 2 +- hbase-shell/pom.xml| 2 +- hbase-testing-util/pom.xml | 2 +- hbase-thrift/pom.xml | 2 +- hbase-zookeeper/pom.xml| 2 +- pom.xml| 2 +- 46 files changed, 276 insertions(+), 45 deletions(-) diff --git a/CHANGES.md b/CHANGES.md index b3e53d4..a3b36b7 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -20,6 +20,114 @@ # Be careful doing manual edits in this file. Do not change format # of release header or remove the below marker. This file is generated. # DO NOT REMOVE THIS MARKER; FOR INTERPOLATING CHANGES!--> +## Release 2.3.6 - Unreleased (as of 2021-07-23) + + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [HBASE-26108](https://issues.apache.org/jira/browse/HBASE-26108) | add option to disable scanMetrics in TableSnapshotInputFormat | Major | . | +| [HBASE-26025](https://issues.apache.org/jira/browse/HBASE-26025) | Add a flag to mark if the IOError can be solved by retry in thrift IOError | Major | Thrift | +| [HBASE-26012](https://issues.apache.org/jira/browse/HBASE-26012) | Improve logging and dequeue logic in DelayQueue | Minor | . | +| [HBASE-25937](https://issues.apache.org/jira/browse/HBASE-25937) | Clarify UnknownRegionException | Minor | Client | +| [HBASE-25998](https://issues.apache.org/jira/browse/HBASE-25998) | Revisit synchronization in SyncFuture | Major | Performance, regionserver, wal | +| [HBASE-26000](https://issues.apache.org/jira/browse/HBASE-26000) | Optimize the display of ZK dump in the master web UI | Minor | . | +| [HBASE-25995](https://issues.apache.org/jira/browse/HBASE-25995) | Change the method name for DoubleArrayCost.setCosts | Major | Balancer | +| [HBASE-25993](https://issues.apache.org/jira/browse/HBASE-25993) | Make excluded SSL cipher suites configurable for all Web UIs | Major | . | +| [HBASE-25987](https://issues.apache.org/jira/browse/HB
[hbase] annotated tag 2.3.6RC0 created (now fe18974)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to annotated tag 2.3.6RC0 in repository https://gitbox.apache.org/repos/asf/hbase.git. at fe18974 (tag) tagging 34c4803db42a1094f1db275670a8ea96ed6bf51e (commit) replaces rel/2.3.5 by stack on Fri Jul 23 18:23:18 2021 + - Log - Via create-release -BEGIN PGP SIGNATURE- iQIzBAABCgAdFiEEXzLoEtM2TIUEtz4m250xPaeHTykFAmD7CRYACgkQ250xPaeH TynHKA//Xo+WvRByKB8NOJjHFVxSjz/jK12kCIp/zP5LGUTjPGkJt2B+HNueNTCK znWLdZYRxYLY79pa962pyzV02X6p323T/0JzmyrGJBpgNfJ/HbuGck06ZvVxt2gW oc/NE62SyjbEEASgMnHTxzZc46Kz5pqHC2zOAhB+sf+ynSJ7tzEAY+2EBNvMgCGK Nx7SsNk8+PDeVSrlL4kRABGdfMJtGxz8PCOyqxa2cRLW09NFDQtu8NngF7YvaCky qDG0l0yR1F10lorW3pdUCTjVPfTgoiiweU9sfawtyQk07F9wWHoW6hYK/U9SaVSu DUug2IrBMQ+th1Rs+d5BvkifGCJbb2WEjPM1UEcekek+gPESH0bnnOQ7mzSN50XM v8zV0xsjzHWWuaSkxBmwQ5thsLLfaN2YRMVG+Lgfbx4PMwypy+T/XCKGVi/PH/lI GgmQuxyklxh2MXqiqCIjzSqX+jMym5hN57VYK2e4b2OX6689pMH2Y/Xr/MOdzMF8 bmZ76Jtz8A9zp7JXbPK493ZohIcamVuhUfGPGpMOvOFfZlqZN7/88IHYHMSU5btI 5vNfp+SmfqKH7X2V8m7UZOYVUCu3726VgKcmboT/wQ+b/+ZPeWjX9GhjaxrmYozN WZat5sHaZazBdkoWHalu0cKjYet1TeY6krcbsXzD17kS5C9Gflg= =nQwP -END PGP SIGNATURE- --- This annotated tag includes the following new commits: new 34c4803 Preparing hbase release 2.3.6RC0; tagging and updates to CHANGES.md and RELEASENOTES.md The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[hbase] branch branch-2.3 updated: Revert "HBASE-25792 Filter out o.a.hadoop.thirdparty building shaded jars"
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/hbase.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new 1832418 Revert "HBASE-25792 Filter out o.a.hadoop.thirdparty building shaded jars" 1832418 is described below commit 1832418ca7b78739c8443a4a1f3de587e847a41a Author: stack AuthorDate: Thu Jul 22 22:25:36 2021 -0700 Revert "HBASE-25792 Filter out o.a.hadoop.thirdparty building shaded jars" This reverts commit 59a67c6dfbae00bbf9c7994224b66406260e8f50. --- hbase-shaded/pom.xml | 7 --- 1 file changed, 7 deletions(-) diff --git a/hbase-shaded/pom.xml b/hbase-shaded/pom.xml index 27e6d3c..615bdb2 100644 --- a/hbase-shaded/pom.xml +++ b/hbase-shaded/pom.xml @@ -541,13 +541,6 @@ keytab.txt - - -*:* - - org/apache/hadoop/thirdparty/**/* - -
[hbase] branch branch-2 updated: Revert "HBASE-26027 The calling of HTable.batch blocked at AsyncRequestFuture… (#3419)"
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2 by this push:
new 2c7b185 Revert "HBASE-26027 The calling of HTable.batch blocked at
AsyncRequestFuture… (#3419)"
2c7b185 is described below
commit 2c7b185431579134d2dcbec5846faddea3518a42
Author: stack
AuthorDate: Thu Jul 22 21:06:27 2021 -0700
Revert "HBASE-26027 The calling of HTable.batch blocked at
AsyncRequestFuture… (#3419)"
This reverts commit 1d6eb77ef8e813ce1050afe6d71954462ab0c28a.
---
.../org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java | 10 +-
1 file changed, 1 insertion(+), 9 deletions(-)
diff --git
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java
index e982fa2..d2486cc 100644
---
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java
+++
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java
@@ -1140,15 +1140,7 @@ class AsyncRequestFutureImpl implements
AsyncRequestFuture {
@Override
public void waitUntilDone() throws InterruptedIOException {
try {
- if (this.operationTimeout > 0) {
-// the worker thread maybe over by some exception without decrement
the actionsInProgress,
-// then the guarantee of operationTimeout will be broken, so we should
set cutoff to avoid
-// stuck here forever
-long cutoff = (EnvironmentEdgeManager.currentTime() +
this.operationTimeout) * 1000L;
-waitUntilDone(cutoff);
- } else {
-waitUntilDone(Long.MAX_VALUE);
- }
+ waitUntilDone(Long.MAX_VALUE);
} catch (InterruptedException iex) {
throw new InterruptedIOException(iex.getMessage());
} finally {
[hbase] branch branch-2.3 updated: Revert "HBASE-26027 The calling of HTable.batch blocked at AsyncRequestFuture… (#3419)"
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.3 by this push:
new bde8bfb Revert "HBASE-26027 The calling of HTable.batch blocked at
AsyncRequestFuture… (#3419)"
bde8bfb is described below
commit bde8bfbf9eb23839e7e5f24760473bd1bd168967
Author: stack
AuthorDate: Thu Jul 22 21:02:02 2021 -0700
Revert "HBASE-26027 The calling of HTable.batch blocked at
AsyncRequestFuture… (#3419)"
This reverts commit 9c7d9fa229ea97c288fc1f6843bb05a7a4df4b87.
---
.../org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java | 10 +-
1 file changed, 1 insertion(+), 9 deletions(-)
diff --git
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java
index c26ebdc..e46a50e 100644
---
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java
+++
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java
@@ -1148,15 +1148,7 @@ class AsyncRequestFutureImpl implements
AsyncRequestFuture {
@Override
public void waitUntilDone() throws InterruptedIOException {
try {
- if (this.operationTimeout > 0) {
-// the worker thread maybe over by some exception without decrement
the actionsInProgress,
-// then the guarantee of operationTimeout will be broken, so we should
set cutoff to avoid
-// stuck here forever
-long cutoff = (EnvironmentEdgeManager.currentTime() +
this.operationTimeout) * 1000L;
-waitUntilDone(cutoff);
- } else {
-waitUntilDone(Long.MAX_VALUE);
- }
+ waitUntilDone(Long.MAX_VALUE);
} catch (InterruptedException iex) {
throw new InterruptedIOException(iex.getMessage());
} finally {
[hbase] branch branch-2.3 updated: HBASE-25973 Balancer should explain progress in a better way in log -… (#3484)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.3 by this push:
new 7e7b730 HBASE-25973 Balancer should explain progress in a better way
in log -… (#3484)
7e7b730 is described below
commit 7e7b73024279676b42be059001b2115776e07576
Author: clarax
AuthorDate: Fri Jul 16 15:23:09 2021 -0700
HBASE-25973 Balancer should explain progress in a better way in log -…
(#3484)
Signed-off-by: stack
---
.../org/apache/hadoop/hbase/master/HMaster.java| 2 +
.../hbase/master/balancer/BaseLoadBalancer.java| 2 +
.../master/balancer/StochasticLoadBalancer.java| 115 ++---
.../TestStochasticLoadBalancerBalanceCluster.java | 2 +-
4 files changed, 84 insertions(+), 37 deletions(-)
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
index 85265ff..228e45c 100644
--- a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
+++ b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
@@ -1966,6 +1966,8 @@ public class HMaster extends HRegionServer implements
MasterServices {
}
}
}
+LOG.info("Balancer is going into sleep until next period in {}ms",
getConfiguration()
+ .getInt(HConstants.HBASE_BALANCER_PERIOD,
HConstants.DEFAULT_HBASE_BALANCER_PERIOD));
return successRegionPlans;
}
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
index ee5e907..9a05a33 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
@@ -75,6 +75,8 @@ import org.slf4j.LoggerFactory;
*
*/
@InterfaceAudience.Private
+@edu.umd.cs.findbugs.annotations.SuppressWarnings(value="IS2_INCONSISTENT_SYNC",
+ justification="Complaint is about isByTable not being synchronized; we don't
modify often")
public abstract class BaseLoadBalancer implements LoadBalancer {
protected static final int MIN_SERVER_BALANCE = 2;
private volatile boolean stopped = false;
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
index a7ccc41..6b86374 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
@@ -145,7 +145,8 @@ public class StochasticLoadBalancer extends
BaseLoadBalancer {
private List candidateGenerators;
private List costFunctions; // FindBugs: Wants this protected;
IS2_INCONSISTENT_SYNC
-
+ // To save currently configed sum of multiplier. Defaulted at 1 for cases
that carry high cost
+ private float sumMultiplier = 1.0f;
// to save and report costs to JMX
private double curOverallCost = 0d;
private double[] tempFunctionCosts;
@@ -197,7 +198,6 @@ public class StochasticLoadBalancer extends
BaseLoadBalancer {
}
regionReplicaHostCostFunction = new RegionReplicaHostCostFunction(conf);
regionReplicaRackCostFunction = new RegionReplicaRackCostFunction(conf);
-
costFunctions = new ArrayList<>();
addCostFunction(new RegionCountSkewCostFunction(conf));
addCostFunction(new PrimaryRegionCountSkewCostFunction(conf));
@@ -311,46 +311,61 @@ public class StochasticLoadBalancer extends
BaseLoadBalancer {
protected boolean needsBalance(TableName tableName, Cluster cluster) {
ClusterLoadState cs = new ClusterLoadState(cluster.clusterState);
if (cs.getNumServers() < MIN_SERVER_BALANCE) {
- if (LOG.isDebugEnabled()) {
-LOG.debug("Not running balancer because only " + cs.getNumServers()
-+ " active regionserver(s)");
- }
+ LOG.info("Not running balancer because only " + cs.getNumServers() +
+" active regionserver(s)");
return false;
}
if (areSomeRegionReplicasColocated(cluster)) {
+ LOG.info("Running balancer because at least one server hosts replicas of
the same region.");
return true;
}
if (idleRegionServerExist(cluster)){
+ LOG.info("Running balancer because cluster has idle server(s).");
return true;
}
+sumMultiplier = 0.0f;
double total = 0.0;
-float sumMultiplier = 0.0f;
for (CostFunction c : costFunctions) {
float multiplier = c.getMultiplier();
- if (multiplier
[hbase] branch branch-2.4 updated: HBASE-25973 Balancer should explain progress in a better way in log - backport branch-2 (#3485)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 6ab6d6f HBASE-25973 Balancer should explain progress in a better way
in log - backport branch-2 (#3485)
6ab6d6f is described below
commit 6ab6d6f2316daa7a547dbb7c09a6d0c8ce581c2d
Author: clarax
AuthorDate: Fri Jul 16 15:20:14 2021 -0700
HBASE-25973 Balancer should explain progress in a better way in log -
backport branch-2 (#3485)
Signed-off-by: stack
---
.../org/apache/hadoop/hbase/master/HMaster.java| 2 +
.../hbase/master/balancer/BaseLoadBalancer.java| 2 +
.../master/balancer/StochasticLoadBalancer.java| 145 +++--
3 files changed, 80 insertions(+), 69 deletions(-)
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
index 9086ad3..6d0d1ca 100644
--- a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
+++ b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
@@ -1858,6 +1858,8 @@ public class HMaster extends HRegionServer implements
MasterServices {
}
}
}
+LOG.info("Balancer is going into sleep until next period in {}ms",
getConfiguration()
+ .getInt(HConstants.HBASE_BALANCER_PERIOD,
HConstants.DEFAULT_HBASE_BALANCER_PERIOD));
return successRegionPlans;
}
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
index 96902b7..2e55b9b 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
@@ -74,6 +74,8 @@ import
org.apache.hbase.thirdparty.com.google.common.collect.Sets;
*
*/
@InterfaceAudience.Private
+@edu.umd.cs.findbugs.annotations.SuppressWarnings(value="IS2_INCONSISTENT_SYNC",
+ justification="Complaint is about isByTable not being synchronized; we don't
modify often")
public abstract class BaseLoadBalancer implements LoadBalancer {
public static final String BALANCER_DECISION_BUFFER_ENABLED =
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
index 20037c4..da51175 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
@@ -149,7 +149,8 @@ public class StochasticLoadBalancer extends
BaseLoadBalancer {
private List candidateGenerators;
private List costFunctions; // FindBugs: Wants this protected;
IS2_INCONSISTENT_SYNC
-
+ // To save currently configed sum of multiplier. Defaulted at 1 for cases
that carry high cost
+ private float sumMultiplier = 1.0f;
// to save and report costs to JMX
private double curOverallCost = 0d;
private double[] tempFunctionCosts;
@@ -206,7 +207,6 @@ public class StochasticLoadBalancer extends
BaseLoadBalancer {
}
regionReplicaHostCostFunction = new RegionReplicaHostCostFunction(conf);
regionReplicaRackCostFunction = new RegionReplicaRackCostFunction(conf);
-
costFunctions = new ArrayList<>();
addCostFunction(new RegionCountSkewCostFunction(conf));
addCostFunction(new PrimaryRegionCountSkewCostFunction(conf));
@@ -327,63 +327,65 @@ public class StochasticLoadBalancer extends
BaseLoadBalancer {
protected boolean needsBalance(TableName tableName, Cluster cluster) {
ClusterLoadState cs = new ClusterLoadState(cluster.clusterState);
if (cs.getNumServers() < MIN_SERVER_BALANCE) {
- if (LOG.isDebugEnabled()) {
-LOG.debug("Not running balancer because only " + cs.getNumServers()
-+ " active regionserver(s)");
- }
- if (this.isBalancerRejectionRecording) {
-sendRejectionReasonToRingBuffer("The number of RegionServers " +
- cs.getNumServers() + " < MIN_SERVER_BALANCE(" + MIN_SERVER_BALANCE +
")", null);
- }
+ LOG.info("Not running balancer because only " + cs.getNumServers() +
+" active regionserver(s)");
+ sendRejectionReasonToRingBuffer("The number of RegionServers " +
cs.getNumServers() +
+" < MIN_SERVER_BALANCE(" + MIN_SERVER_BALANCE + ")", null);
return false;
}
if (areSomeRegionReplicasColocated(cluster)) {
+ LOG.info("Running balancer because at least one
[hbase] branch branch-2.3 updated: HBASE-25739 TableSkewCostFunction need to use aggregated deviation - … (#3482)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.3 by this push:
new 8789fb2 HBASE-25739 TableSkewCostFunction need to use aggregated
deviation - … (#3482)
8789fb2 is described below
commit 8789fb2a322bd705db7b63978ef920ab9add8129
Author: clarax
AuthorDate: Fri Jul 16 10:54:23 2021 -0700
HBASE-25739 TableSkewCostFunction need to use aggregated deviation - …
(#3482)
Signed-off-by: Duo Zhang
Signed-off-by: stack
Reviewed-by: Nick Dimiduk
---
.../hbase/master/balancer/BaseLoadBalancer.java| 58
.../hbase/master/balancer/DoubleArrayCost.java | 53 +++---
.../master/balancer/StochasticLoadBalancer.java| 62 +++---
.../hbase/master/balancer/BalancerTestBase.java| 1 -
.../master/balancer/TestBaseLoadBalancer.java | 4 +-
.../TestStochasticLoadBalancerBalanceCluster.java | 5 +-
...estStochasticLoadBalancerHeterogeneousCost.java | 1 -
.../TestStochasticLoadBalancerLargeCluster.java| 3 ++
8 files changed, 108 insertions(+), 79 deletions(-)
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
index b9585b5..ee5e907 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
@@ -157,8 +157,12 @@ public abstract class BaseLoadBalancer implements
LoadBalancer {
int[] regionIndexToServerIndex;//regionIndex -> serverIndex
int[] initialRegionIndexToServerIndex;//regionIndex -> serverIndex
(initial cluster state)
int[] regionIndexToTableIndex; //regionIndex -> tableIndex
-int[][] numRegionsPerServerPerTable; //serverIndex -> tableIndex -> #
regions
-int[] numMaxRegionsPerTable; //tableIndex -> max number of regions
in a single RS
+int[][] numRegionsPerServerPerTable; // serverIndex -> tableIndex -> #
regions
+int[] numRegionsPerTable; // tableIndex -> region count
+double[] meanRegionsPerTable; // mean region count per table
+double[] regionSkewByTable; // skew on RS per by table
+double[] minRegionSkewByTable; // min skew on RS per by table
+double[] maxRegionSkewByTable; // max skew on RS per by table
int[] regionIndexToPrimaryIndex; //regionIndex -> regionIndex of the
primary
boolean hasRegionReplicas = false; //whether there is regions with
replicas
@@ -365,7 +369,9 @@ public abstract class BaseLoadBalancer implements
LoadBalancer {
}
numTables = tables.size();
+ LOG.debug("Number of tables={}", numTables);
numRegionsPerServerPerTable = new int[numServers][numTables];
+ numRegionsPerTable = new int[numTables];
for (int i = 0; i < numServers; i++) {
for (int j = 0; j < numTables; j++) {
@@ -376,15 +382,26 @@ public abstract class BaseLoadBalancer implements
LoadBalancer {
for (int i=0; i < regionIndexToServerIndex.length; i++) {
if (regionIndexToServerIndex[i] >= 0) {
numRegionsPerServerPerTable[regionIndexToServerIndex[i]][regionIndexToTableIndex[i]]++;
+ numRegionsPerTable[regionIndexToTableIndex[i]]++;
}
}
- numMaxRegionsPerTable = new int[numTables];
+ // Avoid repeated computation for planning
+ meanRegionsPerTable = new double[numTables];
+ regionSkewByTable = new double[numTables];
+ maxRegionSkewByTable = new double[numTables];
+ minRegionSkewByTable = new double[numTables];
+
+ for (int i = 0; i < numTables; i++) {
+meanRegionsPerTable[i] = Double.valueOf(numRegionsPerTable[i]) /
numServers;
+minRegionSkewByTable[i] +=
DoubleArrayCost.getMinSkew(numRegionsPerTable[i], numServers);
+maxRegionSkewByTable[i] +=
DoubleArrayCost.getMaxSkew(numRegionsPerTable[i], numServers);
+ }
+
for (int[] aNumRegionsPerServerPerTable : numRegionsPerServerPerTable) {
-for (tableIndex = 0; tableIndex < aNumRegionsPerServerPerTable.length;
tableIndex++) {
- if (aNumRegionsPerServerPerTable[tableIndex] >
numMaxRegionsPerTable[tableIndex]) {
-numMaxRegionsPerTable[tableIndex] =
aNumRegionsPerServerPerTable[tableIndex];
- }
+for (int tableIdx = 0; tableIdx < aNumRegionsPerServerPerTable.length;
tableIdx++) {
+ regionSkewByTable[tableIdx] +=
+Math.abs(aNumRegionsPerServerPerTable[tableIdx] -
meanRegionsPerTable[tableIdx]);
}
}
@@ -824,22 +841,13 @@ public abstract class BaseLoadBalancer implements
[hbase] branch branch-2.4 updated: HBASE-25739 TableSkewCostFunction need to use aggregated deviation - … (#3481)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new dd2ae36 HBASE-25739 TableSkewCostFunction need to use aggregated
deviation - … (#3481)
dd2ae36 is described below
commit dd2ae3605d2aa4740e0b18366ba11245b51a1093
Author: clarax
AuthorDate: Fri Jul 16 10:53:41 2021 -0700
HBASE-25739 TableSkewCostFunction need to use aggregated deviation - …
(#3481)
Signed-off-by: Duo Zhang
Signed-off-by: stack
Reviewed-by: Nick Dimiduk
---
.../hbase/master/balancer/BaseLoadBalancer.java| 58
.../hbase/master/balancer/DoubleArrayCost.java | 53 +++---
.../master/balancer/StochasticLoadBalancer.java| 62 +++---
.../hbase/master/balancer/BalancerTestBase.java| 1 -
.../master/balancer/TestBaseLoadBalancer.java | 4 +-
.../TestStochasticLoadBalancerBalanceCluster.java | 4 +-
...estStochasticLoadBalancerHeterogeneousCost.java | 1 -
.../TestStochasticLoadBalancerLargeCluster.java| 3 ++
...asticLoadBalancerRegionReplicaLargeCluster.java | 1 +
9 files changed, 109 insertions(+), 78 deletions(-)
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
index 56c894e..96902b7 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
@@ -165,8 +165,12 @@ public abstract class BaseLoadBalancer implements
LoadBalancer {
int[] regionIndexToServerIndex;//regionIndex -> serverIndex
int[] initialRegionIndexToServerIndex;//regionIndex -> serverIndex
(initial cluster state)
int[] regionIndexToTableIndex; //regionIndex -> tableIndex
-int[][] numRegionsPerServerPerTable; //serverIndex -> tableIndex -> #
regions
-int[] numMaxRegionsPerTable; //tableIndex -> max number of regions
in a single RS
+int[][] numRegionsPerServerPerTable; // serverIndex -> tableIndex -> #
regions
+int[] numRegionsPerTable; // tableIndex -> region count
+double[] meanRegionsPerTable; // mean region count per table
+double[] regionSkewByTable; // skew on RS per by table
+double[] minRegionSkewByTable; // min skew on RS per by table
+double[] maxRegionSkewByTable; // max skew on RS per by table
int[] regionIndexToPrimaryIndex; //regionIndex -> regionIndex of the
primary
boolean hasRegionReplicas = false; //whether there is regions with
replicas
@@ -373,7 +377,9 @@ public abstract class BaseLoadBalancer implements
LoadBalancer {
}
numTables = tables.size();
+ LOG.debug("Number of tables={}", numTables);
numRegionsPerServerPerTable = new int[numServers][numTables];
+ numRegionsPerTable = new int[numTables];
for (int i = 0; i < numServers; i++) {
for (int j = 0; j < numTables; j++) {
@@ -384,15 +390,26 @@ public abstract class BaseLoadBalancer implements
LoadBalancer {
for (int i=0; i < regionIndexToServerIndex.length; i++) {
if (regionIndexToServerIndex[i] >= 0) {
numRegionsPerServerPerTable[regionIndexToServerIndex[i]][regionIndexToTableIndex[i]]++;
+ numRegionsPerTable[regionIndexToTableIndex[i]]++;
}
}
- numMaxRegionsPerTable = new int[numTables];
+ // Avoid repeated computation for planning
+ meanRegionsPerTable = new double[numTables];
+ regionSkewByTable = new double[numTables];
+ maxRegionSkewByTable = new double[numTables];
+ minRegionSkewByTable = new double[numTables];
+
+ for (int i = 0; i < numTables; i++) {
+meanRegionsPerTable[i] = Double.valueOf(numRegionsPerTable[i]) /
numServers;
+minRegionSkewByTable[i] +=
DoubleArrayCost.getMinSkew(numRegionsPerTable[i], numServers);
+maxRegionSkewByTable[i] +=
DoubleArrayCost.getMaxSkew(numRegionsPerTable[i], numServers);
+ }
+
for (int[] aNumRegionsPerServerPerTable : numRegionsPerServerPerTable) {
-for (tableIndex = 0; tableIndex < aNumRegionsPerServerPerTable.length;
tableIndex++) {
- if (aNumRegionsPerServerPerTable[tableIndex] >
numMaxRegionsPerTable[tableIndex]) {
-numMaxRegionsPerTable[tableIndex] =
aNumRegionsPerServerPerTable[tableIndex];
- }
+for (int tableIdx = 0; tableIdx < aNumRegionsPerServerPerTable.length;
tableIdx++) {
+ regionSkewByTable[tableIdx] +=
+Math.abs(aNumRegionsPerServerPerTable[tableIdx] -
meanRegionsPerTable[tableIdx]);
}
}
@@ -832
[hbase] branch branch-2 updated: HBASE-25739 TableSkewCostFunction need to use aggregated deviation - backport (#3475)
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch branch-2 in repository https://gitbox.apache.org/repos/asf/hbase.git The following commit(s) were added to refs/heads/branch-2 by this push: new 287cf20 HBASE-25739 TableSkewCostFunction need to use aggregated deviation - backport (#3475) 287cf20 is described below commit 287cf207ff6bc040b52d63783b09ee7b84bf9ea8 Author: clarax AuthorDate: Thu Jul 15 14:15:23 2021 -0700 HBASE-25739 TableSkewCostFunction need to use aggregated deviation - backport (#3475) Signed-off-by: Duo Zhang Signed-off-by: stack Reviewed-by: Nick Dimiduk
[hbase] branch branch-2 updated: HBASE-25739 TableSkewCostFunction need to use aggregated deviation - backport
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2 by this push:
new dfc9ac8 HBASE-25739 TableSkewCostFunction need to use aggregated
deviation - backport
dfc9ac8 is described below
commit dfc9ac8ffb83b914af27f0e6096bc46d9d87b95f
Author: Clara Xiong
AuthorDate: Mon Jul 12 15:45:11 2021 -0700
HBASE-25739 TableSkewCostFunction need to use aggregated deviation -
backport
Signed-off-by: Duo Zhang
Signed-off-by: stack
Reviewed-by: Nick Dimiduk
---
.../master/balancer/BalancerClusterState.java | 57 ++
.../hadoop/hbase/master/balancer/CostFunction.java | 9 ++--
.../hbase/master/balancer/DoubleArrayCost.java | 51 +++
.../master/balancer/StochasticLoadBalancer.java| 5 +-
.../master/balancer/TableSkewCostFunction.java | 15 +++---
.../hbase/master/balancer/BalancerTestBase.java| 2 +-
.../master/balancer/TestBaseLoadBalancer.java | 4 +-
.../TestStochasticLoadBalancerBalanceCluster.java | 3 +-
...estStochasticLoadBalancerHeterogeneousCost.java | 1 -
.../TestStochasticLoadBalancerLargeCluster.java| 3 ++
10 files changed, 91 insertions(+), 59 deletions(-)
diff --git
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BalancerClusterState.java
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BalancerClusterState.java
index 7fa92cb..0032002 100644
---
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BalancerClusterState.java
+++
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BalancerClusterState.java
@@ -81,6 +81,11 @@ class BalancerClusterState {
int[] initialRegionIndexToServerIndex; // regionIndex -> serverIndex
(initial cluster state)
int[] regionIndexToTableIndex; // regionIndex -> tableIndex
int[][] numRegionsPerServerPerTable; // serverIndex -> tableIndex -> #
regions
+ int[] numRegionsPerTable; // tableIndex -> region count
+ double[] meanRegionsPerTable; // mean region count per table
+ double[] regionSkewByTable; // skew on RS per by table
+ double[] minRegionSkewByTable; // min skew on RS per by table
+ double[] maxRegionSkewByTable; // max skew on RS per by table
int[] numMaxRegionsPerTable; // tableIndex -> max number of regions in a
single RS
int[] regionIndexToPrimaryIndex; // regionIndex -> regionIndex of the primary
boolean hasRegionReplicas = false; // whether there is regions with replicas
@@ -290,7 +295,9 @@ class BalancerClusterState {
}
numTables = tables.size();
+LOG.debug("Number of tables={}", numTables);
numRegionsPerServerPerTable = new int[numServers][numTables];
+numRegionsPerTable = new int[numTables];
for (int i = 0; i < numServers; i++) {
for (int j = 0; j < numTables; j++) {
@@ -301,15 +308,26 @@ class BalancerClusterState {
for (int i = 0; i < regionIndexToServerIndex.length; i++) {
if (regionIndexToServerIndex[i] >= 0) {
numRegionsPerServerPerTable[regionIndexToServerIndex[i]][regionIndexToTableIndex[i]]++;
+numRegionsPerTable[regionIndexToTableIndex[i]]++;
}
}
-numMaxRegionsPerTable = new int[numTables];
+// Avoid repeated computation for planning
+meanRegionsPerTable = new double[numTables];
+regionSkewByTable = new double[numTables];
+maxRegionSkewByTable = new double[numTables];
+minRegionSkewByTable = new double[numTables];
+
+for (int i = 0; i < numTables; i++) {
+ meanRegionsPerTable[i] = Double.valueOf(numRegionsPerTable[i]) /
numServers;
+ minRegionSkewByTable[i] +=
DoubleArrayCost.getMinSkew(numRegionsPerTable[i], numServers);
+ maxRegionSkewByTable[i] +=
DoubleArrayCost.getMaxSkew(numRegionsPerTable[i], numServers);
+}
+
for (int[] aNumRegionsPerServerPerTable : numRegionsPerServerPerTable) {
- for (tableIndex = 0; tableIndex < aNumRegionsPerServerPerTable.length;
tableIndex++) {
-if (aNumRegionsPerServerPerTable[tableIndex] >
numMaxRegionsPerTable[tableIndex]) {
- numMaxRegionsPerTable[tableIndex] =
aNumRegionsPerServerPerTable[tableIndex];
-}
+ for (int tableIdx = 0; tableIdx < aNumRegionsPerServerPerTable.length;
tableIdx++) {
+regionSkewByTable[tableIdx] +=
+ Math.abs(aNumRegionsPerServerPerTable[tableIdx] -
meanRegionsPerTable[tableIdx]);
}
}
@@ -671,22 +689,13 @@ class BalancerClusterState {
int tableIndex = regionIndexToTableIndex[region];
if (oldServer >= 0) {
numRegionsPerServerPerTable[oldServer][tableIndex]--;
+ // update regionSkewPerTable for the move from old server
+ regionSkewByTable[tableIndex] += getSkewChangeFor(oldServer, tableIndex,
-1);
[hbase] branch master updated (875b63c -> 1e763d5)
This is an automated email from the ASF dual-hosted git repository. stack pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hbase.git. from 875b63c add zhaobaiqiang to the developer list add 1e763d5 HBASE-25973 Balancer should explain progress in a better way in log (#3356) No new revisions were added by this update. Summary of changes: .../master/balancer/StochasticLoadBalancer.java| 97 -- .../org/apache/hadoop/hbase/master/HMaster.java| 2 + 2 files changed, 54 insertions(+), 45 deletions(-)
[hbase] branch branch-2.4 updated: HBASE-25989 FanOutOneBlockAsyncDFSOutput using shaded protobuf in hdfs 3.3+ (#3368)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new a7d10e5 HBASE-25989 FanOutOneBlockAsyncDFSOutput using shaded
protobuf in hdfs 3.3+ (#3368)
a7d10e5 is described below
commit a7d10e550f5ac3b8a43e22b2c4a5706fddbe34c3
Author: Michael Stack
AuthorDate: Sat Jun 12 07:27:34 2021 -0700
HBASE-25989 FanOutOneBlockAsyncDFSOutput using shaded protobuf in hdfs 3.3+
(#3368)
Signed-off-by: Wei-Chiu Chuang
Signed-off-by: Duo Zhang
---
.../main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/hbase-asyncfs/src/main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java
b/hbase-asyncfs/src/main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java
index 98b4e6f..d6e68f3 100644
---
a/hbase-asyncfs/src/main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java
+++
b/hbase-asyncfs/src/main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java
@@ -123,7 +123,7 @@ public class ProtobufDecoder extends
MessageToMessageDecoder {
try {
protobufMessageLiteClass =
Class.forName("org.apache.hadoop.thirdparty.protobuf.MessageLite");
protobufMessageLiteBuilderClass = Class.forName(
-"org.apache.hadoop.thirdparty.protobuf.MessageLite.Builder");
+"org.apache.hadoop.thirdparty.protobuf.MessageLite$Builder");
LOG.debug("Hadoop 3.3 and above shades protobuf.");
} catch (ClassNotFoundException e) {
LOG.debug("Hadoop 3.2 and below use unshaded protobuf.", e);
[hbase] branch branch-2 updated: HBASE-25989 FanOutOneBlockAsyncDFSOutput using shaded protobuf in hdfs 3.3+ (#3368)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2 by this push:
new ef9149b HBASE-25989 FanOutOneBlockAsyncDFSOutput using shaded
protobuf in hdfs 3.3+ (#3368)
ef9149b is described below
commit ef9149bf78a88730795923d29bf63b006c4f5c4d
Author: Michael Stack
AuthorDate: Sat Jun 12 07:27:34 2021 -0700
HBASE-25989 FanOutOneBlockAsyncDFSOutput using shaded protobuf in hdfs 3.3+
(#3368)
Signed-off-by: Wei-Chiu Chuang
Signed-off-by: Duo Zhang
---
.../main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/hbase-asyncfs/src/main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java
b/hbase-asyncfs/src/main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java
index 98b4e6f..d6e68f3 100644
---
a/hbase-asyncfs/src/main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java
+++
b/hbase-asyncfs/src/main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java
@@ -123,7 +123,7 @@ public class ProtobufDecoder extends
MessageToMessageDecoder {
try {
protobufMessageLiteClass =
Class.forName("org.apache.hadoop.thirdparty.protobuf.MessageLite");
protobufMessageLiteBuilderClass = Class.forName(
-"org.apache.hadoop.thirdparty.protobuf.MessageLite.Builder");
+"org.apache.hadoop.thirdparty.protobuf.MessageLite$Builder");
LOG.debug("Hadoop 3.3 and above shades protobuf.");
} catch (ClassNotFoundException e) {
LOG.debug("Hadoop 3.2 and below use unshaded protobuf.", e);
[hbase] branch master updated: HBASE-25989 FanOutOneBlockAsyncDFSOutput using shaded protobuf in hdfs 3.3+ (#3368)
This is an automated email from the ASF dual-hosted git repository.
stack pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/master by this push:
new ba6995e HBASE-25989 FanOutOneBlockAsyncDFSOutput using shaded
protobuf in hdfs 3.3+ (#3368)
ba6995e is described below
commit ba6995e083929776526b359f6278a534078faca2
Author: Michael Stack
AuthorDate: Sat Jun 12 07:27:34 2021 -0700
HBASE-25989 FanOutOneBlockAsyncDFSOutput using shaded protobuf in hdfs 3.3+
(#3368)
Signed-off-by: Wei-Chiu Chuang
Signed-off-by: Duo Zhang
---
.../main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/hbase-asyncfs/src/main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java
b/hbase-asyncfs/src/main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java
index 98b4e6f..d6e68f3 100644
---
a/hbase-asyncfs/src/main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java
+++
b/hbase-asyncfs/src/main/java/org/apache/hadoop/hbase/io/asyncfs/ProtobufDecoder.java
@@ -123,7 +123,7 @@ public class ProtobufDecoder extends
MessageToMessageDecoder {
try {
protobufMessageLiteClass =
Class.forName("org.apache.hadoop.thirdparty.protobuf.MessageLite");
protobufMessageLiteBuilderClass = Class.forName(
-"org.apache.hadoop.thirdparty.protobuf.MessageLite.Builder");
+"org.apache.hadoop.thirdparty.protobuf.MessageLite$Builder");
LOG.debug("Hadoop 3.3 and above shades protobuf.");
} catch (ClassNotFoundException e) {
LOG.debug("Hadoop 3.2 and below use unshaded protobuf.", e);
[hbase] branch master updated: HBASE-25969 Purge netty-all transitive includes (#3353) (#3365)
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hbase.git The following commit(s) were added to refs/heads/master by this push: new 1654dcf HBASE-25969 Purge netty-all transitive includes (#3353) (#3365) 1654dcf is described below commit 1654dcfbfbb1a1a1e2ebc662240244e9b7627254 Author: Michael Stack AuthorDate: Tue Jun 8 21:33:15 2021 -0700 HBASE-25969 Purge netty-all transitive includes (#3353) (#3365) Signed-off-by: Pankaj Kumar Signed-off-by: Xiaolin Ha --- pom.xml | 39 +++ 1 file changed, 39 insertions(+) diff --git a/pom.xml b/pom.xml index cff4136..8894eea 100755 --- a/pom.xml +++ b/pom.xml @@ -2273,6 +2273,10 @@ netty +io.netty +netty-all + + org.slf4j slf4j-log4j12 @@ -2844,6 +2848,10 @@ io.netty netty + + io.netty + netty-all + javax.servlet servlet-api @@ -2927,6 +2935,10 @@ io.netty netty + + io.netty + netty-all + javax.servlet servlet-api @@ -2952,6 +2964,10 @@ io.netty netty + + io.netty + netty-all + javax.servlet servlet-api @@ -3136,6 +3152,13 @@ io.netty netty + com.google.code.findbugs jsr305 @@ -3160,6 +3183,14 @@ log4j log4j + +io.netty +netty + + +io.netty +netty-all + @@ -3194,6 +3225,10 @@ log4j log4j + + io.netty + netty-all + @@ -3246,6 +3281,10 @@ netty + io.netty + netty-all + + com.google.code.findbugs jsr305
[hbase] branch branch-2 updated: HBASE-25969 Purge netty-all transitive includes (#3353)
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch branch-2 in repository https://gitbox.apache.org/repos/asf/hbase.git The following commit(s) were added to refs/heads/branch-2 by this push: new 3d6e73d HBASE-25969 Purge netty-all transitive includes (#3353) 3d6e73d is described below commit 3d6e73d4e32df1ae1541bd9aa4b2858f11a1772c Author: Michael Stack AuthorDate: Tue Jun 8 07:33:25 2021 -0700 HBASE-25969 Purge netty-all transitive includes (#3353) Signed-off-by: Pankaj Kumar Signed-off-by: Xiaolin Ha --- pom.xml | 72 + 1 file changed, 72 insertions(+) diff --git a/pom.xml b/pom.xml index be78522..87e3b47 100755 --- a/pom.xml +++ b/pom.xml @@ -2009,6 +2009,10 @@ netty +io.netty +netty-all + + org.slf4j slf4j-log4j12 @@ -2631,6 +2635,10 @@ netty +io.netty +netty-all + + javax.servlet servlet-api @@ -2662,6 +2670,10 @@ netty +io.netty +netty-all + + javax.servlet servlet-api @@ -2683,6 +2695,10 @@ netty +io.netty +netty-all + + javax.servlet servlet-api @@ -2710,6 +2726,10 @@ netty +io.netty +netty-all + + stax stax-api @@ -2751,6 +2771,10 @@ netty +io.netty +netty-all + + stax stax-api @@ -2829,6 +2853,10 @@ netty +io.netty +netty-all + + com.google.code.findbugs jsr305 @@ -2869,6 +2897,10 @@ org.codehaus.jackson jackson-xc + +io.netty +netty + @@ -2926,6 +2958,10 @@ netty +io.netty +netty-all + + com.google.code.findbugs jsr305 @@ -3006,6 +3042,10 @@ io.netty netty + + io.netty + netty-all + javax.servlet servlet-api @@ -3049,6 +3089,11 @@ io.netty netty + + + io.netty + netty-all + javax.servlet servlet-api @@ -3078,6 +3123,10 @@ io.netty netty + + io.netty + netty-all + javax.servlet servlet-api @@ -3141,6 +3190,14 @@ log4j log4j + +io.netty +netty + + +io.netty +netty-all + @@ -3190,6 +3247,10 @@ log4j log4j + + io.netty + netty-all + @@ -3267,6 +3328,10 @@ netty + io.netty + netty-all + + com.google.code.findbugs jsr305 @@ -3367,6 +3432,13 @@ io.netty netty + com.google.code.findbugs jsr305
[hbase] branch branch-2.4 updated: HBASE-25969 Purge netty-all transitive includes (#3353)
This is an automated email from the ASF dual-hosted git repository. stack pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/hbase.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 39a577f HBASE-25969 Purge netty-all transitive includes (#3353) 39a577f is described below commit 39a577fbbf88bf8012218797389f1211fcdfe775 Author: Michael Stack AuthorDate: Tue Jun 8 07:33:25 2021 -0700 HBASE-25969 Purge netty-all transitive includes (#3353) Signed-off-by: Pankaj Kumar Signed-off-by: Xiaolin Ha --- pom.xml | 72 + 1 file changed, 72 insertions(+) diff --git a/pom.xml b/pom.xml index 8d67e83..93198bc 100755 --- a/pom.xml +++ b/pom.xml @@ -2007,6 +2007,10 @@ netty +io.netty +netty-all + + org.slf4j slf4j-log4j12 @@ -2629,6 +2633,10 @@ netty +io.netty +netty-all + + javax.servlet servlet-api @@ -2660,6 +2668,10 @@ netty +io.netty +netty-all + + javax.servlet servlet-api @@ -2681,6 +2693,10 @@ netty +io.netty +netty-all + + javax.servlet servlet-api @@ -2708,6 +2724,10 @@ netty +io.netty +netty-all + + stax stax-api @@ -2749,6 +2769,10 @@ netty +io.netty +netty-all + + stax stax-api @@ -2827,6 +2851,10 @@ netty +io.netty +netty-all + + com.google.code.findbugs jsr305 @@ -2867,6 +2895,10 @@ org.codehaus.jackson jackson-xc + +io.netty +netty + @@ -2924,6 +2956,10 @@ netty +io.netty +netty-all + + com.google.code.findbugs jsr305 @@ -3004,6 +3040,10 @@ io.netty netty + + io.netty + netty-all + javax.servlet servlet-api @@ -3047,6 +3087,11 @@ io.netty netty + + + io.netty + netty-all + javax.servlet servlet-api @@ -3076,6 +3121,10 @@ io.netty netty + + io.netty + netty-all + javax.servlet servlet-api @@ -3139,6 +3188,14 @@ log4j log4j + +io.netty +netty + + +io.netty +netty-all + @@ -3188,6 +3245,10 @@ log4j log4j + + io.netty + netty-all + @@ -3265,6 +3326,10 @@ netty + io.netty + netty-all + + com.google.code.findbugs jsr305 @@ -3365,6 +3430,13 @@ io.netty netty + com.google.code.findbugs jsr305
