keith-turner closed pull request #78: update 1.9.0 release notes URL: https://github.com/apache/accumulo-website/pull/78
This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull request (from a fork), the diff is supplied below (as it won't show otherwise due to GitHub magic): diff --git a/_posts/release/2018-03-06-accumulo-1.9.0.md b/_posts/release/2018-03-06-accumulo-1.9.0.md index f9343ee8..88aef9e2 100644 --- a/_posts/release/2018-03-06-accumulo-1.9.0.md +++ b/_posts/release/2018-03-06-accumulo-1.9.0.md @@ -22,15 +22,56 @@ Below are resources for this release: In [ACCUMULO-4611], public API in ClientConfiguration using commons config types was deprecated to better support Hadoop 3 in the future. New methods were added to replace these methods which cause -this release to be a 1.9.0 release. +this release to be a 1.9.0 release. These changes allow removal of commons config from Accumulo's +API in 2.0.0. If using ClientConfiguration, then switching from existing constructors to the new +static methods [create()], [fromFile()], or [fromMap()] will ensure your code works in 2.0.0. ### Performance Improvements -Several peformance improvements were added in [#379], [ACCUMULO-4778], [ACCUMULO-4779] and -[ACCUMULO-4781]. +Accumulo was profiled while running lots of concurrent small scans. During this excercise these +performance bugs were found and fixed: [#378], [ACCUMULO-4778], [ACCUMULO-4779], [ACCUMULO-4781], +[ACCUMULO-4782], [ACCUMULO-4788], [ACCUMULO-4789], [ACCUMULO-4790], [ACCUMULO-4797], +[ACCUMULO-4798], [ACCUMULO-4799], [ACCUMULO-4800], [ACCUMULO-4801], [ACCUMULO-4805], and [ACCUMULO-4809] + +Below are other significant performance improvements in 1.9.0 : + +* [ACCUMULO-4636] - System iterator performance improvements +* [ACCUMULO-4657] - Avoided expensive BulkImport logging +* [ACCUMULO-4667] - Avoided unnecessary recomputation in LocalityGroupIterator +* [#410] - Fixed inefficient auths check + +### Fixed upgrade process to set version on all volumes + +During upgrades, only one volume in a multiple HDFS volume was updated with the correct version. This would cause all tablet servers +to complain and ultimately fail. [ACCUMULO-4686] fixes this by setting the version on all volumes. + +### Updated Accumulo to work with new releases of Guava + +In [ACCUMULO-4702], dependencies on Beta-annotated Guava classes and methods were removed. While Accumulo still +includes Guava 14 in its tarball, it will work with newer versions of Guava in client code. It has been tested to work +with Guava 23. + +### Updated RFile to prevent very large blocks + +RFiles now use windowed statistics ([ACCUMULO-4669]) to prevent very large blocks. In 1.8.0 a bug was introduced that +caused RFile data block sizes to grow very large in the case where key sizes slowly increased. This could lead +to degraded query performance or out of memory exceptions on tablet servers. + +### Allow iterators to yield + +In [ACCUMULO-4643] added capability for an iterator to yield control in a seek or next call prior +to finding a key/value. Yielding avoids starvation of other scans when +iterators take a long time to return a key/value. To use this feature, +implement YieldingKeyValueIterator. ## Other Notable Changes +* [#403] - Enabled more metrics reporting +* [ACCUMULO-4528] - Add import/export table info to docs +* [ACCUMULO-4655] - Added a Response Time column to the monitor +* [ACCUMULO-4693] - Add process name to metrics +* [ACCUMULO-4721] - Document rfile-info in the user manual + ## Upgrading View the [Upgrading Accumulo documentation][upgrade] for guidance. @@ -42,8 +83,6 @@ View the [Upgrading Accumulo documentation][upgrade] for guidance. * [#379] - Misc performance improvements * [#393] - Add TableOfflineException to TableOps.addSplits * [#401] - Fix ChaoticBalancerIT -* [#403] - Enabled more metrics reporting -* [#410] - Fixed inefficient auths check * [#416] - POM updates for formatting * [#417] - Make TLSv1.2 the default * [ACCUMULO-1972] - Fixed Range constructor @@ -57,7 +96,6 @@ View the [Upgrading Accumulo documentation][upgrade] for guidance. * [ACCUMULO-4432] - Ensure ITs are categorized * [ACCUMULO-4482] - Mention snappy compression in docs * [ACCUMULO-4506] - Add a timeout to a replication RPC call -* [ACCUMULO-4528] - Add import/export table info to docs * [ACCUMULO-4546] - Create default log message for table error * [ACCUMULO-4555] - Removes parsing of version string in Version class * [ACCUMULO-4576] - Suppress warnings from deprecations @@ -71,21 +109,16 @@ View the [Upgrading Accumulo documentation][upgrade] for guidance. * [ACCUMULO-4627] - Add corrupt WAL recovery instructions to user manual * [ACCUMULO-4633] - Added check to prevent division by zero * [ACCUMULO-4634] - Appropriately implement the mocked out methods of MockIteratorEnvironment per the interface specifications. -* [ACCUMULO-4636] - System iterator improvements * [ACCUMULO-4639] - Relocate NullTserver test class * [ACCUMULO-4640] - Accumulo shell is expecting instance.volumes in client.conf instead of accumulo-site.xml -* [ACCUMULO-4643] - Allow iterators to yield * [ACCUMULO-4648] - Update voting text in build.sh script * [ACCUMULO-4654] - Continue balancing even with pending migrations -* [ACCUMULO-4655] - Added a Response Time column to the monitor * [ACCUMULO-4656] - Add option to PrintInfo for displaying Index information -* [ACCUMULO-4657] - BulkImport Performance Bottleneck * [ACCUMULO-4658] - Cache call to ZooKeeper to get table id map for the duration of the method * [ACCUMULO-4660] - Sanitize incoming values from HTTP parameters * [ACCUMULO-4662] - Fix ambiguous table reference * [ACCUMULO-4665] - Use UGI with real Kerberos credentials * [ACCUMULO-4666] - Improve KerberosToken sanity-checks and related doc -* [ACCUMULO-4667] - Inefficient LocalityGroupIterator * [ACCUMULO-4669] - Use windowed statistics in RFile * [ACCUMULO-4676] - Use HTTPOnly flags in monitor * [ACCUMULO-4682] - Enforce import ordering @@ -93,12 +126,10 @@ View the [Upgrading Accumulo documentation][upgrade] for guidance. * [ACCUMULO-4685] - Fix minor warnings and bug in FileRefTest * [ACCUMULO-4686] - Fix upgrade process to set version in all volumes * [ACCUMULO-4687] - Clean up some static-analysis warnings -* [ACCUMULO-4693] - Add process name to metrics * [ACCUMULO-4699] - Fixed queued work key in replication * [ACCUMULO-4702] - Code fixes to work with Guava 23 * [ACCUMULO-4713] - Correct handling min and max timestamps * [ACCUMULO-4716] - Don't cache blks over max array size -* [ACCUMULO-4721] - Document rfile-info in the user manual * [ACCUMULO-4741] - Remove minified files in Monitor * [ACCUMULO-4744] - Fixed RFile API scanner bug * [ACCUMULO-4751] - Set createdTime for status records @@ -135,10 +166,13 @@ View the [Upgrading Accumulo documentation][upgrade] for guidance. [GitHub]: https://github.com/apache/accumulo/issues?q=label%3Av1.9.0+is%3Aclosed [JIRA]: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12312121&version=12339245 -[upgrade]: https://accumulo.apache.org/docs/2.0/administration/upgrading -[user_manual]: https://accumulo.apache.org/1.9/accumulo_user_manual.html -[javadoc]: https://accumulo.apache.org/1.9/apidocs/ -[examples]: https://accumulo.apache.org/1.9/examples/ +[upgrade]: {{ site.baseurl }}/docs/2.0/administration/upgrading +[user_manual]: {{ site.baseurl }}/1.9/accumulo_user_manual.html +[javadoc]: {{ site.baseurl }}/1.9/apidocs/ +[examples]: {{ site.baseurl }}/1.9/examples/ +[create()]: {{ site.baseurl }}/1.9/apidocs/org/apache/accumulo/core/client/ClientConfiguration.html#create-- +[fromFile()]: {{ site.baseurl }}/1.9/apidocs/org/apache/accumulo/core/client/ClientConfiguration.html#fromFile-java.io.File- +[fromMap()]: {{ site.baseurl }}/1.9/apidocs/org/apache/accumulo/core/client/ClientConfiguration.html#fromMap-java.util.Map- [#379]: https://github.com/apache/accumulo/issues/379 [#393]: https://github.com/apache/accumulo/issues/393 [#401]: https://github.com/apache/accumulo/issues/401 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
