This is an automated email from the ASF dual-hosted git repository. ddanielr pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/accumulo-website.git
The following commit(s) were added to refs/heads/main by this push: new 469ce588f Minor updates to 2.1.3 release notes (#436) 469ce588f is described below commit 469ce588f931c5bf9ec4e63e7462b0bcc73f8c8d Author: Dave Marion <dlmar...@apache.org> AuthorDate: Thu Aug 1 11:22:13 2024 -0400 Minor updates to 2.1.3 release notes (#436) * Minor updates to 2.1.3 release notes * Update _posts/release/2024-07-10-accumulo-2.1.3.md Co-authored-by: Dom G. <domgargu...@apache.org> --------- Co-authored-by: Dom G. <domgargu...@apache.org> --- _posts/release/2024-07-10-accumulo-2.1.3.md | 29 +++++++++++++++++++---------- 1 file changed, 19 insertions(+), 10 deletions(-) diff --git a/_posts/release/2024-07-10-accumulo-2.1.3.md b/_posts/release/2024-07-10-accumulo-2.1.3.md index f20aecd28..cf934d7f1 100644 --- a/_posts/release/2024-07-10-accumulo-2.1.3.md +++ b/_posts/release/2024-07-10-accumulo-2.1.3.md @@ -24,7 +24,7 @@ Improvements that affect performance: of unique names, larger batch sizes can reduce ZooKeeper contention because more file names can be reserved with a single ZooKeeper call. * {% ghi 3733 %} Avoid creating server side threads when failed writes are cancelled. In versions 2.1.2 - and earlier, the thrift close call creates a new thread to cancel the thrift session. With 2.1.3, an + and earlier, the thrift close call creates a new thread to cancel the thrift session. With 2.1.3, a new thrift method is available to test if a session is reserved and deletes it if it is not reserved without creating an additional thread. If the new method is not available it falls back to the previous close method to preserve interoperability between 2.x versions. @@ -33,14 +33,16 @@ Improvements that affect performance: subsequent GC Runs. * {% ghi 3756 %} Added new RPC named cancelUpdate that reduces the amount of threads waiting to close failed batch write sessions. -* {% ghi 4682 %} Changed the ScanServer ref format to sort by UUID to increase performance -* {% ghi 4536 %} Created ScanServerSelector that tries to use scan servers on the same host to leverage +* {% ghi 4682 %} Changed the ScanServer file reference format in the metadata table to sort by UUID to increase performance. +* {% ghi 4536 %} Created alternate ScanServerSelector implementation that tries to use scan servers on the same host to leverage shared off-heap-cache usage. * {% ghi 4544 %} Made scan servers refresh cached list of tablet files before expiration. Added new property {% plink sserver.cache.metadata.refresh.percent %} to control when refresh happens. * {% ghi 3813 %} Made compactors use cached address for compaction coordinator when getting next compaction job. This lowers load on zookeeper when running many compactors. * {% ghi 3706 %} Avoid unnescessary copying of hadoop config that was causing Accumulo GC slowdown. +* {% ghi 4709 %} Modified Manager balancer code such that the root, metadata, and user tables will be balanced + separately, and in that order. For example, balancing for user tables will not occur while the metadata table is unbalanced. ### Notable Bug Fixes @@ -58,7 +60,7 @@ Improvements that affect performance: * {% ghi 3744 %} Fixed bug regarding improperly created GCRun logger name. * {% ghi 3737 %} Adds a custom Transport Factory to set transport message and frame size to avoid infinite loops as described in {% ghi 3731 %}. -* {% ghi 3750 %} Fixed issue when deleting a compaction thread pool would leave tablets in a bad state. +* {% ghi 3750 %} Fixed issue when deleting a compaction thread pool that would leave tablets in a bad state. * {% ghi 4117 %} Fixed a bug in compaction properties where the replacement `maxOpen` property was being ignored in favor of the deprecated `open.max` property. * {% ghi 4681 %} Stopped listing all compactors in each compactor to reduce load on Zookeeper. @@ -68,17 +70,18 @@ Improvements that affect performance: `compactor.message.size.max`,`compaction.coordinator.message.size.max`. * {% ghi 3966 %} Changed the default value of the the property {% plink table.majc.compaction.strategy %} to empty string to fix a compatibility bug with old and new compaction plugins. -* {% ghi 4554 %} Fixed a race condtion that could cause duplicate compactions to run. While harmless in +* {% ghi 4554 %} Fixed a race condition that could cause duplicate compactions to run. While harmless in terms of data, the duplicate compactions could waste significant compute resources. -* {% ghi 4127 %} Updated new compaction plugins to honor {% plink table.file.max %} property. Implemented +* {% ghi 4127 %} Updated new compaction plugins to honor {% plink table.file.max %} property. Implemented a much more efficient algorithm than old compaction plugins had for this property. -* {% ghi 4485 %} Interrupt compactions on tablet unload. This prevents long running compactions from blocking +* {% ghi 4485 %} Interrupt compactions on tablet unload. This prevents long running compactions from blocking tablet migration. * {% ghi 3512 %} Fixed issue with improperly cleaned up scans preventing metadata tablet unload. * {% ghi 4456 %} Setting empty property value no longer deletes property * {% ghi 4000 %} Fixed bug that could cause bulk import to lose files when errors happened in the tablet server. * {% ghi 4462 %} Fixed bug that prevented listing Fate operations in some situations. * {% ghi 4573 %} Modified CredentialProviderToken to no longer store password in serialized form. +* {% ghi 4684 %} Fixed an issue that was causing table creation to get progressively slower when creating a lot of tables. ### Improvements that help with administration: @@ -90,7 +93,7 @@ Improvements that affect performance: * {% ghi 3745 %} Adds prefix to gc deletion log messages. This makes it easier to isolate the deletion actions of the garbage collector for analysis. * {% ghi 3724 %} Adds logging of transactions when metadata and in-memory differences are detected. -* {% ghi 3725 %} Changed the gc batch size from bytes to memory percentage value. Modified default value of +* {% ghi 3725 %} Changed the gc batch size from bytes to memory percentage value. Modified default value of property {% plink gc.candidate.batch.size %}. * {% ghi 3684 %} Consolidated y/n prompts in the shell. Users can now exit out of multi-table delete operations without accepting prompts for each one. @@ -101,15 +104,21 @@ Improvements that affect performance: to be used at the same time. Updated documentation on the property {% plink general.micrometer.factory %} * {% ghi 4622 %} Added compactor busy and server idle metrics {% ghi 4740 %} to allow for proper scale-in operations. Added property {% plink general.metrics.process.idle %} to configure idle time for metrics. -* {% ghi 3927 %} Added a new JSON property type that validates the value is json. Updated the properties +* {% ghi 3927 %} Added a new JSON property type that validates the value is json. Updated the properties {% plink monitor.resources.external %} and {% plink tserver.compaction.major.service.meta.planner.opts.executors %} to use this new type. * {% ghi 4223 %} Added properties {% plink compactor.wait.time.job.min %} and {% plink compactor.wait.time.job.max %} to control the min and max times compactors use when polling for work. -* {% ghi 3998 %} Added instance name tag to metrics. This is useful for the case when metrics from multiple Accumulo instances +* {% ghi 3998 %} Added instance name tag to metrics. This is useful for the case when metrics from multiple Accumulo instances are flowing into a single metrics system. * {% ghi 4763 %} Improved the accumulo-cluster script and cluster.yaml file for the use case of starting and stopping specific groups of compactors and scan servers. * {% ghi 4487 %} Scan server properties can now be set in the shell. +* {% ghi 4768 %} Modified thread pool names so that the user will be able to easily find their location in the source code + when looking at thread pool metrics. This change affects the thread names in the output of a jstack on the process. +* {% ghi 4470 %} Added new metrics to indicate how many migrations are remaining. +* {% ghi 4558 %} Added a log message in the Manager when it has been waiting over 15 minutes for a tablet to unload. +* {% ghi 4495 %} Added `accumulo admin serviceStatus` command to quickly get system process status from the command line. + ## Upgrading