This is an automated email from the ASF dual-hosted git repository.
zghao pushed a commit to branch branch-2.2
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.2 by this push:
new f93aaf7 HBASE-22850 Generate CHANGES.md and RELEASENOTES.md for 2.2.1
(addendum for 2.2.1RC1) (#576)
f93aaf7 is described below
commit f93aaf770cce81caacbf22174dfee2860dbb4810
Author: Guanghao Zhang <[email protected]>
AuthorDate: Wed Sep 4 10:54:14 2019 +0800
HBASE-22850 Generate CHANGES.md and RELEASENOTES.md for 2.2.1 (addendum for
2.2.1RC1) (#576)
Signed-off-by: Duo Zhang <[email protected]>
---
CHANGES.md | 54 +++++++++++++++++++++++++++++++++++++++++++++++++++++-
RELEASENOTES.md | 51 ++++++++++++++++++++++++++++++++++++++++++++++++++-
2 files changed, 103 insertions(+), 2 deletions(-)
diff --git a/CHANGES.md b/CHANGES.md
index cb672ac..4032d74 100644
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -20,7 +20,7 @@
# Be careful doing manual edits in this file. Do not change format
# of release header or remove the below marker. This file is generated.
# DO NOT REMOVE THIS MARKER; FOR INTERPOLATING CHANGES!-->
-## Release 2.2.1 - Unreleased (as of 2019-08-14)
+## Release 2.2.1 - Unreleased (as of 2019-09-04)
### INCOMPATIBLE CHANGES:
@@ -40,6 +40,19 @@
| JIRA | Summary | Priority | Component |
|:---- |:---- | :--- |:---- |
+| [HBASE-22724](https://issues.apache.org/jira/browse/HBASE-22724) | Add a
emoji on the vote table for pre commit result on github | Major | build, test |
+| [HBASE-22954](https://issues.apache.org/jira/browse/HBASE-22954) | Whitelist
net.java.dev.jna which got pulled in through Hadoop 3.3.0 | Minor | community,
hadoop3 |
+| [HBASE-22905](https://issues.apache.org/jira/browse/HBASE-22905) | Avoid
temp ByteBuffer allocation in BlockingRpcConnection#writeRequest | Major | . |
+| [HBASE-22962](https://issues.apache.org/jira/browse/HBASE-22962) | Fix typo
in javadoc description | Minor | documentation |
+| [HBASE-22933](https://issues.apache.org/jira/browse/HBASE-22933) | Do not
need to kick reassign for rs group change any more | Major | rsgroup |
+| [HBASE-22872](https://issues.apache.org/jira/browse/HBASE-22872) | Don't
create normalization plan unnecesarily when split and merge both are disabled |
Minor | . |
+| [HBASE-20509](https://issues.apache.org/jira/browse/HBASE-20509) | Put List
in HashSet directly without using addAll function to improve performance |
Trivial | Performance |
+| [HBASE-21996](https://issues.apache.org/jira/browse/HBASE-21996) | Set
locale for javadoc | Major | documentation |
+| [HBASE-22464](https://issues.apache.org/jira/browse/HBASE-22464) |
Improvements to hbase-vote script | Trivial | scripts |
+| [HBASE-22810](https://issues.apache.org/jira/browse/HBASE-22810) |
Initialize an separate ThreadPoolExecutor for taking/restoring snapshot |
Major | . |
+| [HBASE-22844](https://issues.apache.org/jira/browse/HBASE-22844) | Fix
Checkstyle issues in client snapshot exceptions | Minor | Client |
+| [HBASE-22871](https://issues.apache.org/jira/browse/HBASE-22871) | Move the
DirScanPool out and do not use static field | Major | master |
+| [HBASE-22841](https://issues.apache.org/jira/browse/HBASE-22841) |
TimeRange's factory functions do not support ranges, only \`allTime\` and
\`at\` | Major | Client |
| [HBASE-22828](https://issues.apache.org/jira/browse/HBASE-22828) | Log a
region close journal | Minor | . |
| [HBASE-22812](https://issues.apache.org/jira/browse/HBASE-22812) |
InterfaceAudience annotation in CatalogJanitor uses fully-qualified name |
Minor | . |
| [HBASE-22800](https://issues.apache.org/jira/browse/HBASE-22800) | Add
mapreduce dependencies to hbase-shaded-testing-util | Major | . |
@@ -82,6 +95,28 @@
| JIRA | Summary | Priority | Component |
|:---- |:---- | :--- |:---- |
+| [HBASE-22970](https://issues.apache.org/jira/browse/HBASE-22970) | split
parents show as overlaps in the HBCK Report | Major | . |
+| [HBASE-22961](https://issues.apache.org/jira/browse/HBASE-22961) | Deprecate
hbck1 in core | Major | hbck |
+| [HBASE-22896](https://issues.apache.org/jira/browse/HBASE-22896) |
TestHRegion.testFlushMarkersWALFail is flaky | Minor | . |
+| [HBASE-22943](https://issues.apache.org/jira/browse/HBASE-22943) | Various
procedures should not cache log trace level | Minor | proc-v2 |
+| [HBASE-22881](https://issues.apache.org/jira/browse/HBASE-22881) | Fix
non-daemon threads in hbase server implementation | Major | master |
+| [HBASE-22893](https://issues.apache.org/jira/browse/HBASE-22893) | Change
the comment in HBaseClassTestRule to reflect change in default test timeouts |
Trivial | . |
+| [HBASE-22928](https://issues.apache.org/jira/browse/HBASE-22928) |
ScanMetrics counter update may not happen in case of exception in
TableRecordReaderImpl | Minor | mapreduce |
+| [HBASE-22941](https://issues.apache.org/jira/browse/HBASE-22941) |
MetaTableAccessor.getMergeRegions() returns parent regions in random order |
Major | . |
+| [HBASE-22935](https://issues.apache.org/jira/browse/HBASE-22935) |
TaskMonitor warns MonitoredRPCHandler task may be stuck when it recently
started | Minor | logging |
+| [HBASE-22857](https://issues.apache.org/jira/browse/HBASE-22857) | Fix the
failed ut TestHRegion and TestHRegionWithInMemoryFlush | Major | . |
+| [HBASE-22922](https://issues.apache.org/jira/browse/HBASE-22922) | Only the
two first regions are locked in MergeTableRegionsProcedure | Major | . |
+| [HBASE-22852](https://issues.apache.org/jira/browse/HBASE-22852) | hbase
nightlies leaking gpg-agents | Minor | build |
+| [HBASE-22867](https://issues.apache.org/jira/browse/HBASE-22867) | The
ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster
with thousands table | Critical | master |
+| [HBASE-22904](https://issues.apache.org/jira/browse/HBASE-22904) | NPE
occurs when RS send space quota usage report during HMaster init | Minor | . |
+| [HBASE-22806](https://issues.apache.org/jira/browse/HBASE-22806) | Deleted
CF are not cleared if memstore contain entries | Major | API |
+| [HBASE-22601](https://issues.apache.org/jira/browse/HBASE-22601) |
Misconfigured addition of peers leads to cluster shutdown. | Major | . |
+| [HBASE-22863](https://issues.apache.org/jira/browse/HBASE-22863) | Avoid
Jackson versions and dependencies with known CVEs | Major | dependencies |
+| [HBASE-22879](https://issues.apache.org/jira/browse/HBASE-22879) |
user\_permission command failed to show global permission | Major | . |
+| [HBASE-22882](https://issues.apache.org/jira/browse/HBASE-22882) |
TestFlushSnapshotFromClient#testConcurrentSnapshottingAttempts is flakey (was
written flakey) | Major | test |
+| [HBASE-22870](https://issues.apache.org/jira/browse/HBASE-22870) |
reflection fails to access a private nested class | Major | master |
+| [HBASE-22860](https://issues.apache.org/jira/browse/HBASE-22860) | Master's
webui returns NPE/HTTP 500 under maintenance mode | Major | master, UI |
+| [HBASE-22856](https://issues.apache.org/jira/browse/HBASE-22856) |
HBASE-Find-Flaky-Tests fails with pip error | Major | build, test |
| [HBASE-22632](https://issues.apache.org/jira/browse/HBASE-22632) |
SplitTableRegionProcedure and MergeTableRegionsProcedure should skip store
files for unknown column families | Major | proc-v2 |
| [HBASE-22838](https://issues.apache.org/jira/browse/HBASE-22838) |
assembly:single failure: user id or group id 'xxxxx' is too big | Major |
build |
| [HBASE-22417](https://issues.apache.org/jira/browse/HBASE-22417) |
DeleteTableProcedure.deleteFromMeta method should remove table from Master's
table descriptors cache | Major | . |
@@ -131,6 +166,9 @@
| JIRA | Summary | Priority | Component |
|:---- |:---- | :--- |:---- |
+| [HBASE-22886](https://issues.apache.org/jira/browse/HBASE-22886) | Code
Coverage Improvement: Create Unit Tests for ConnectionId | Trivial | test |
+| [HBASE-22766](https://issues.apache.org/jira/browse/HBASE-22766) | Code
Coverage Improvement: Create Unit Tests for ResultStatsUtil | Trivial | test |
+| [HBASE-22894](https://issues.apache.org/jira/browse/HBASE-22894) | Move
testOpenRegionFailedMemoryLeak to dedicated class | Major | test |
| [HBASE-22725](https://issues.apache.org/jira/browse/HBASE-22725) | Remove
all remaining javadoc warnings | Trivial | test |
| [HBASE-22615](https://issues.apache.org/jira/browse/HBASE-22615) | Make
TestChoreService more robust to timing | Minor | test |
@@ -139,6 +177,12 @@
| JIRA | Summary | Priority | Component |
|:---- |:---- | :--- |:---- |
+| [HBASE-22851](https://issues.apache.org/jira/browse/HBASE-22851) | Preparing
HBase release 2.2.1RC0: set version to 2.2.1 in branch-2.2 | Major | . |
+| [HBASE-22878](https://issues.apache.org/jira/browse/HBASE-22878) | Show
table throttle quotas in table jsp | Major | . |
+| [HBASE-22946](https://issues.apache.org/jira/browse/HBASE-22946) | Fix
TableNotFound when grant/revoke if AccessController is not loaded | Major | . |
+| [HBASE-22945](https://issues.apache.org/jira/browse/HBASE-22945) | Show
quota infos in master UI | Major | master, UI |
+| [HBASE-22858](https://issues.apache.org/jira/browse/HBASE-22858) | Add HBCK
Report to master's header.jsp | Minor | master |
+| [HBASE-22891](https://issues.apache.org/jira/browse/HBASE-22891) | Use
HBaseQA in HBase-PreCommit-GitHub-PR job | Major | build, scripts |
| [HBASE-22771](https://issues.apache.org/jira/browse/HBASE-22771) | [HBCK2]
fixMeta method and server-side support | Major | hbck2 |
| [HBASE-22845](https://issues.apache.org/jira/browse/HBASE-22845) | Revert
MetaTableAccessor#makePutFromTableState access to public | Blocker | . |
| [HBASE-22777](https://issues.apache.org/jira/browse/HBASE-22777) | Add a
multi-region merge (for fixing overlaps, etc.) | Major | hbck2, proc-v2 |
@@ -163,6 +207,13 @@
| JIRA | Summary | Priority | Component |
|:---- |:---- | :--- |:---- |
+| [HBASE-22833](https://issues.apache.org/jira/browse/HBASE-22833) |
MultiRowRangeFilter should provide a method for creating a filter which is
functionally equivalent to multiple prefix filters | Minor | Client |
+| [HBASE-22895](https://issues.apache.org/jira/browse/HBASE-22895) | Fix the
flakey TestSpaceQuotas | Major | Quotas, test |
+| [HBASE-22914](https://issues.apache.org/jira/browse/HBASE-22914) | Backport
HBASE-20662 to branch-2.2 | Major | . |
+| [HBASE-22910](https://issues.apache.org/jira/browse/HBASE-22910) | Enable
TestMultiVersionConcurrencyControl | Major | test |
+| [HBASE-22913](https://issues.apache.org/jira/browse/HBASE-22913) | Use
Hadoop label for nightly builds | Major | build |
+| [HBASE-22911](https://issues.apache.org/jira/browse/HBASE-22911) | fewer
concurrent github PR builds | Critical | build |
+| [HBASE-21400](https://issues.apache.org/jira/browse/HBASE-21400) | correct
spelling error of 'initilize' in comment | Trivial | documentation |
| [HBASE-22382](https://issues.apache.org/jira/browse/HBASE-22382) | Refactor
tests in TestFromClientSide | Major | test |
| [HBASE-21606](https://issues.apache.org/jira/browse/HBASE-21606) | Document
use of the meta table load metrics added in HBASE-19722 | Critical |
documentation, meta, metrics, Operability |
| [HBASE-19230](https://issues.apache.org/jira/browse/HBASE-19230) | Write up
fixVersion policy from dev discussion in refguide | Major | documentation |
@@ -170,6 +221,7 @@
| [HBASE-22560](https://issues.apache.org/jira/browse/HBASE-22560) | Upgrade
to Jetty 9.3.latest and Jackson 2.9.latest | Major | dependencies |
+
## Release 2.2.0 - Unreleased (as of 2019-06-11)
### INCOMPATIBLE CHANGES:
diff --git a/RELEASENOTES.md b/RELEASENOTES.md
index 7791173..f617056 100644
--- a/RELEASENOTES.md
+++ b/RELEASENOTES.md
@@ -27,9 +27,58 @@ These release notes cover new developer and user-facing
incompatibilities, impor
---
+* [HBASE-22867](https://issues.apache.org/jira/browse/HBASE-22867) |
*Critical* | **The ForkJoinPool in CleanerChore will spawn thousands of threads
in our cluster with thousands table**
+
+Replace the ForkJoinPool in CleanerChore by ThreadPoolExecutor which can limit
the spawn thread size and avoid the master GC frequently. The replacement is
an internal implementation in CleanerChore, so no config key change, the
upstream users can just upgrade the hbase master without any other change.
+
+
+---
+
+* [HBASE-22810](https://issues.apache.org/jira/browse/HBASE-22810) | *Major* |
**Initialize an separate ThreadPoolExecutor for taking/restoring snapshot**
+
+Introduced a new config key for the snapshot taking/restoring operations at
master side: hbase.master.executor.snapshot.threads, its default value is 3.
means we can have 3 snapshot operations running at the same time.
+
+
+---
+
+* [HBASE-22863](https://issues.apache.org/jira/browse/HBASE-22863) | *Major* |
**Avoid Jackson versions and dependencies with known CVEs**
+
+1. Stopped exposing vulnerable Jackson1 dependencies so that downstreamers
would not pull it in from HBase.
+2. However, since Hadoop requires some Jackson1 dependencies, put vulnerable
Jackson mapper at test scope in some HBase modules and hence, HBase tarball
created by hbase-assembly contains Jackson1 mapper jar in lib. Still, downsteam
applications can't pull in Jackson1 from HBase.
+
+
+---
+
+* [HBASE-22841](https://issues.apache.org/jira/browse/HBASE-22841) | *Major* |
**TimeRange's factory functions do not support ranges, only \`allTime\` and
\`at\`**
+
+Add serveral API in TimeRange class for avoiding using the deprecated
TimeRange constructor:
+\* TimeRange#from: Represents the time interval [minStamp, Long.MAX\_VALUE)
+\* TimeRange#until: Represents the time interval [0, maxStamp)
+\* TimeRange#between: Represents the time interval [minStamp, maxStamp)
+
+
+---
+
+* [HBASE-22833](https://issues.apache.org/jira/browse/HBASE-22833) | *Minor* |
**MultiRowRangeFilter should provide a method for creating a filter which is
functionally equivalent to multiple prefix filters**
+
+Provide a public method in MultiRowRangeFilter class to speed the requirement
of filtering with multiple row prefixes, it will expand the row prefixes as
multiple rowkey ranges by MultiRowRangeFilter, it's more efficient.
+{code}
+public MultiRowRangeFilter(byte[][] rowKeyPrefixes);
+{code}
+
+
+---
+
+* [HBASE-22856](https://issues.apache.org/jira/browse/HBASE-22856) | *Major* |
**HBASE-Find-Flaky-Tests fails with pip error**
+
+Update the base docker image to ubuntu 18.04 for the find flaky tests jenkins
job.
+
+
+---
+
* [HBASE-22771](https://issues.apache.org/jira/browse/HBASE-22771) | *Major* |
**[HBCK2] fixMeta method and server-side support**
-Adds a fixMeta method to hbck Service. Fixes holes in hbase:meta. Follow-up to
fix overlaps.
+Adds a fixMeta method to hbck Service. Fixes holes in hbase:meta. Follow-up to
fix overlaps. See HBASE-22567 also.
Follow-on is adding a client-side to hbase-operator-tools that can exploit
this new addition (HBASE-22825)