This is an automated email from the ASF dual-hosted git repository.
mmiller pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/accumulo-website.git
The following commit(s) were added to refs/heads/main by this push:
new 66477b5 Release notes updates (#295)
66477b5 is described below
commit 66477b5a135be31ebc2e3e41198cc9e48e0dd72b
Author: Mike Miller <mmil...@apache.org>
AuthorDate: Thu Oct 21 14:51:36 2021 -0400
Release notes updates (#295)
* Expand some sections with more detail
* Add LTM to header
* Add informative sections at the beginning with TODOs
* Add TODOs for sections that need more info
* Add bullet to notable changes
---
_posts/release/2020-01-19-accumulo-2.1.0.md | 73 ++++++++++++++++++++++++----
images/release/active-compactions-table.png | Bin 0 -> 26834 bytes
2 files changed, 63 insertions(+), 10 deletions(-)
diff --git a/_posts/release/2020-01-19-accumulo-2.1.0.md
b/_posts/release/2020-01-19-accumulo-2.1.0.md
index 6517d99..62ece86 100644
--- a/_posts/release/2020-01-19-accumulo-2.1.0.md
+++ b/_posts/release/2020-01-19-accumulo-2.1.0.md
@@ -1,11 +1,28 @@
---
title: Apache Accumulo 2.1.0
sortableversion: '02.01.00'
+LTM: true
draft: true
---
** DRAFT RELEASE NOTES **
+## About
+
+TODO high level description of the release
+
+TODO summarize contributions
+
+According to the [Long Term Maintenance (LTM)][LTM] strategy, the intent is to
+maintain the X.X release line with critical bug and security fixes until one
+year after the next LTM version is released.
+
+TODO Version Upgrade guidance
+
+## Minimum Requirements
+
+TODO describe requirements
+
## Binary Incompatibility
This release is known to be incompatible with prior versions of the client
@@ -14,9 +31,9 @@ be able to communicate with a 2.1.0 or later installation of
Accumulo, nor will
the 2.1.0 or later version of the client libraries communicate with a 2.0.1 or
earlier installation.
-## Notable Changes
+## Major Changes
-### Compaction Changes
+### Overhaul of Table Compactions
Significant changes were made to how Accumulo compacts files in this release.
See
{% dlink administration/compaction %} for details, below are some highlights.
@@ -169,11 +186,32 @@ metrics to supported Micrometer sinks. {% ghi 1134 %}
### New SPI Package
-New SPI Package {% ghi 1900 %} {% ghi 1905 %} {% ghi 1880 %} {% ghi 1891 %} {%
ghi 1426 %}
+TODO describe New SPI Package {% ghi 1900 %} {% ghi 1905 %} {% ghi 1880 %} {%
ghi 1891 %} {% ghi 1426 %}
### New listtablets shell command.
-New command for debugging tablets called listtablets {% ghi 1317 %} {% ghi
1821 %}
+A new command was created for debugging called listtablets, that shows
detailed tablet information
+on a single line. This command aggregates data about a tablet such as status,
location, size,
+number of entries and HDFS directory name. It even shows the start and end
rows of tablets,
+displaying them in the same sorted order they are stored in the metadata. See
example command output below.
+{% ghi 1317 %} {% ghi 1821 %}
+
+```
+root@uno> listtablets -t test_ingest -h
+2021-01-04T15:12:47,663 [Shell.audit] INFO : root@uno> listtablets -t
test_ingest -h
+NUM TABLET_DIR FILES WALS ENTRIES SIZE STATUS LOCATION
ID START (Exclusive) END
+TABLE: test_ingest
+1 t-0000007 1 0 60 552 HOSTED
CURRENT:ip-10-113-12-25:9997 2 -INF row_0000000005
+2 t-0000006 1 0 500 2.71K HOSTED
CURRENT:ip-10-113-12-25:9997 2 row_0000000005 row_0000000055
+3 t-0000008 1 0 5.00K 24.74K HOSTED
CURRENT:ip-10-113-12-25:9997 2 row_0000000055 row_0000000555
+4 default_tablet 1 0 4.44K 22.01K HOSTED
CURRENT:ip-10-113-12-25:9997 2 row_0000000555 +INF
+root@uno> listtablets -t accumulo.metadata
+2021-01-04T15:13:21,750 [Shell.audit] INFO : root@uno> listtablets -t
accumulo.metadata
+NUM TABLET_DIR FILES WALS ENTRIES SIZE STATUS LOCATION
ID START (Exclusive) END
+TABLE: accumulo.metadata
+1 table_info 2 0 7 524 HOSTED
CURRENT:ip-10-113-12-25:9997 !0 -INF ~
+2 default_tablet 0 0 0 0 HOSTED
CURRENT:ip-10-113-12-25:9997 !0 ~ +INF
+```
### New option for cloning offline
@@ -181,7 +219,10 @@ Added option to leave cloned tables offline {% ghi 1474 %}
{% ghi 1475 %}
### New max tablets option in bulk import
-Created max tablets property in new bulk import {% ghi 1614 %}
+The property `table.bulk.max.tablets` was created in new bulk import
technique. This property acts as a cluster performance
+failsafe to prevent a single ingested file from being distributed across too
much of a cluster. The value is enforced
+by the new bulk import technique and is the maximum number of tablets allowed
for one bulk import file. When this property
+is set, an error will be thrown when the value is exceeded during a bulk
import. {% ghi 1614 %}
### New ability for user to define context classloaders
@@ -202,16 +243,26 @@ TODO clarify what was done for this. {% ghi 1787 %} {%
ghi 1788 %} {% ghi 1798 %
### Various Performance improvements when deleting tables
-Make delete table operations cancel user compactions {% ghi 2030 %} {% ghi
2169 %}.
-Prevent compactions from starting when delete table is called {% ghi 2182 %}
{% ghi 2240 %}.
-Added check to not flush when table is being deleted {% ghi 1887 %}.
-Make the UnloadTabletHandler log before waiting for deletes to finish {% ghi
1881 %}.
-Stop user flush if table is being deleted {% ghi 1931 %}
+* Make delete table operations cancel user compactions {% ghi 2030 %} {% ghi
2169 %}.
+* Prevent compactions from starting when delete table is called {% ghi 2182 %}
{% ghi 2240 %}.
+* Added check to not flush when table is being deleted {% ghi 1887 %}.
+* Added log message before waiting for deletes to finish {% ghi 1881 %}.
+* Added code to stop user flush if table is being deleted {% ghi 1931 %}
### New jshell entry point
Created new "jshell" convenience entry point {% ghi 1870 %} {% ghi 1910 %}
+### New Monitor Compactions page & performance improvements
+
+A page was added to the Monitor that lists the active compactions and the
longest running
+active compaction. As an optimization, the page will only fetch data if a user
loads the
+page and will only do so a maximum of once a minute. The same optimization was
added for the Active Scans page,
+along with the addition of a "Fetched" column indicating when the data was
retrieved. {% ghi 2283 %} {% ghi 2294 %}
+
+
+
+
### Other notable changes
* {% ghi 1309 %} Prevent cloning metadata table
@@ -241,6 +292,7 @@ Created new "jshell" convenience entry point {% ghi 1870 %}
{% ghi 1910 %}
* {% ghi 1848 %} Update column name in the monitor UI
* {% ghi 2039 %} {% ghi 2045 %} Add bulk import option to ignore empty dirs
* {% ghi 2064 %} Add option to disable encryption to AESCryptoService
+* {% ghi 2117 %} Make sorted recovery write to RFiles
## Upgrading
@@ -250,6 +302,7 @@ View the [Upgrading Accumulo documentation][upgrade] for
guidance.
[All tickets related to 2.1.0.][project]
+[LTM]: {{ site.baseurl }}/contributor/versioning#LTM
[upgrade]: /docs/2.x/administration/upgrading
[project]: https://github.com/apache/accumulo/projects/3
[ext_comp_blog]:
https://accumulo.apache.org/blog/2021/07/08/external-compactions.html
diff --git a/images/release/active-compactions-table.png
b/images/release/active-compactions-table.png
new file mode 100644
index 0000000..d2c9925
Binary files /dev/null and b/images/release/active-compactions-table.png differ
