Repository: hbase Updated Branches: refs/heads/branch-2.0 790e880e0 -> 909782156
HBASE-21566 Release notes and changes for 2.0.4RC0 and 2.1.1RC0 Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/90978215 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/90978215 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/90978215 Branch: refs/heads/branch-2.0 Commit: 9097821560f630dff0fb9df4b0c589ad2acb8016 Parents: 790e880 Author: stack <st...@apache.org> Authored: Thu Dec 6 21:49:17 2018 -0800 Committer: stack <st...@apache.org> Committed: Thu Dec 6 21:49:17 2018 -0800 ---------------------------------------------------------------------- CHANGES.md | 40 ++++++++++++++++++++++++++++++++++++++- RELEASENOTES.md | 53 +++++++++++++++++++++++++++++++++++++++++++++++++++- 2 files changed, 91 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/hbase/blob/90978215/CHANGES.md ---------------------------------------------------------------------- diff --git a/CHANGES.md b/CHANGES.md index 7d9607d..df80826 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -41,7 +41,45 @@ may have to bulk import old-style CHANGES.txt on to the end in a code comment to preserve continuity of the CHANGELOG. --> -## Release 2.0.3 - Unreleased (as of 2018-11-19) +## Release 2.0.4 - Unreleased (as of 2018-12-07) + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | +|:---- |:---- | :--- |:---- | +| [HBASE-21413](https://issues.apache.org/jira/browse/HBASE-21413) | Empty meta log doesn't get split when restart whole cluster | Major | . | +| [HBASE-21146](https://issues.apache.org/jira/browse/HBASE-21146) | (2.0) Add ability for HBase Canary to ignore a configurable number of ZooKeeper down nodes | Minor | canary, Zookeeper | + + +### BUG FIXES: + +| JIRA | Summary | Priority | Component | +|:---- |:---- | :--- |:---- | +| [HBASE-21559](https://issues.apache.org/jira/browse/HBASE-21559) | The RestoreSnapshotFromClientTestBase related UT are flaky | Major | . | +| [HBASE-21551](https://issues.apache.org/jira/browse/HBASE-21551) | Memory leak when use scan with STREAM at server side | Blocker | regionserver | +| [HBASE-21544](https://issues.apache.org/jira/browse/HBASE-21544) | Backport HBASE-20734 Colocate recovered edits directory with hbase.wal.dir | Major | wal | +| [HBASE-21518](https://issues.apache.org/jira/browse/HBASE-21518) | TestMasterFailoverWithProcedures is flaky | Major | . | +| [HBASE-21504](https://issues.apache.org/jira/browse/HBASE-21504) | If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived. | Critical | Compaction | +| [HBASE-21492](https://issues.apache.org/jira/browse/HBASE-21492) | CellCodec Written To WAL Before It's Verified | Critical | wal | +| [HBASE-21507](https://issues.apache.org/jira/browse/HBASE-21507) | Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method | Major | regionserver | + + +### SUB-TASKS: + +| JIRA | Summary | Priority | Component | +|:---- |:---- | :--- |:---- | +| [HBASE-21557](https://issues.apache.org/jira/browse/HBASE-21557) | Set version to 2.0.4 on branch-2.0 so can cut an RC | Major | release | + + +### OTHER: + +| JIRA | Summary | Priority | Component | +|:---- |:---- | :--- |:---- | +| [HBASE-21495](https://issues.apache.org/jira/browse/HBASE-21495) | Create 2.0.3 Release | Major | . | +| [HBASE-21517](https://issues.apache.org/jira/browse/HBASE-21517) | Move the getTableRegionForRow method from HMaster to TestMaster | Major | test | + + +## Release 2.0.3 - Released 2018-12-02 ### INCOMPATIBLE CHANGES: http://git-wip-us.apache.org/repos/asf/hbase/blob/90978215/RELEASENOTES.md ---------------------------------------------------------------------- diff --git a/RELEASENOTES.md b/RELEASENOTES.md index 0809957..1514864 100644 --- a/RELEASENOTES.md +++ b/RELEASENOTES.md @@ -1,4 +1,4 @@ -# HBASE 2.0.3 Release Notes +# HBASE 2.0.4 Release Notes <!--- # Licensed to the Apache Software Foundation (ASF) under one @@ -42,6 +42,57 @@ may have to bulk import old-style CHANGES.txt on to the end in a code comment to preserve continuity of the CHANGELOG. --> +These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements. + + +--- + +* [HBASE-21551](https://issues.apache.org/jira/browse/HBASE-21551) | *Blocker* | **Memory leak when use scan with STREAM at server side** + +<!-- markdown --> +### Summary +HBase clusters will experience Region Server failures due to out of memory errors due to a leak given any of the following: + +* User initiates Scan operations set to use the STREAM reading type +* User initiates Scan operations set to use the default reading type that read more than 4 * the block size of column families involved in the scan (e.g. by default 4*64KiB) +* Compactions run + +### Root cause + +When there are long running scans the Region Server process attempts to optimize access by using a different API geared towards sequential access. Due to an error in HBASE-20704 for HBase 2.0+ the Region Server fails to release related resources when those scans finish. That same optimization path is always used for the HBase internal file compaction process. + +### Workaround + +Impact for this error can be minimized by setting the config value âhbase.storescanner.pread.max.bytesâ to MAX_INT to avoid the optimization for default user scans. Clients should also be checked to ensure they do not pass the STREAM read type to the Scan API. This will have a severe impact on performance for long scans. + +Compactions always use this sequential optimized reading mechanism so downstream users will need to periodically restart Region Server roles after compactions have happened. + + +--- + +* [HBASE-21146](https://issues.apache.org/jira/browse/HBASE-21146) | *Minor* | **(2.0) Add ability for HBase Canary to ignore a configurable number of ZooKeeper down nodes** + +Adds -permittedZookeeperFailures \<N\> + +Makes it so Canary will keep running reporting on downed zk ensemble members rather than exit. + + +--- + +* [HBASE-21557](https://issues.apache.org/jira/browse/HBASE-21557) | *Major* | **Set version to 2.0.4 on branch-2.0 so can cut an RC** + +Set project version to 2.0.4 from 2.0.4-SNAPSHOT + + +--- + +* [HBASE-21544](https://issues.apache.org/jira/browse/HBASE-21544) | *Major* | **Backport HBASE-20734 Colocate recovered edits directory with hbase.wal.dir** + +This change moves the recovered.edits files which are created by the WALSplitter from the default filesystem into the WAL filesystem. This better enables the separate filesystem for WAL and HFile deployment model, by avoiding a check which requires that the HFile filesystem provides the hflush capability. + + + +# HBASE 2.0.3 Release Notes These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements.