Updates for 1.12 release
Project: http://git-wip-us.apache.org/repos/asf/drill/repo Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/aada3ab4 Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/aada3ab4 Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/aada3ab4 Branch: refs/heads/gh-pages Commit: aada3ab4d70eb6483b16df5e371d775984194a98 Parents: d79e234 Author: Bridget Bevens <bbev...@maprtech.com> Authored: Fri Dec 15 22:24:20 2017 -0800 Committer: Bridget Bevens <bbev...@maprtech.com> Committed: Fri Dec 15 22:24:20 2017 -0800 ---------------------------------------------------------------------- _data/version.json | 10 +- _docs/getting-started/010-drill-introduction.md | 24 +- .../047-installing-drill-on-the-cluster.md | 8 +- ...20-installing-drill-on-linux-and-mac-os-x.md | 8 +- .../040-installing-drill-on-windows.md | 4 +- _docs/rn/001-1.11.0-rn.md | 297 ----------- _docs/rn/001-1.12.0-rn.md | 430 ++++++++++++++++ _docs/rn/002-1.10.0-rn.md | 290 ----------- _docs/rn/003-1.9.0-rn.md | 180 ------- _docs/rn/004-1.8.0-rn.md | 173 ------- _docs/rn/005-1.7.0-rn.md | 159 ------ _docs/rn/006-1.6.0-rn.md | 126 ----- _docs/rn/007-1.5.0-rn.md | 162 ------ _docs/rn/008-1.4.0-rn.md | 105 ---- _docs/rn/009-1.3.0-rn.md | 159 ------ _docs/rn/010-1.11.0-rn.md | 297 +++++++++++ _docs/rn/010-1.2.0-rn.md | 509 ------------------- _docs/rn/011-1.10.0-rn.md | 290 +++++++++++ _docs/rn/012-1.9.0-rn.md | 180 +++++++ _docs/rn/013-1.8.0-rn.md | 173 +++++++ _docs/rn/014-1.7.0-rn.md | 159 ++++++ _docs/rn/015-1.6.0-rn.md | 126 +++++ _docs/rn/016-1.5.0-rn.md | 162 ++++++ _docs/rn/017-1.4.0-rn.md | 105 ++++ _docs/rn/018-1.3.0-rn.md | 159 ++++++ _docs/rn/019-1.2.0-rn.md | 509 +++++++++++++++++++ _docs/tutorials/020-drill-in-10-minutes.md | 10 +- .../050-analyzing-highly-dynamic-datasets.md | 4 +- blog/_posts/2017-12-15-drill-1.12-released.md | 64 +++ 29 files changed, 2699 insertions(+), 2183 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/_data/version.json ---------------------------------------------------------------------- diff --git a/_data/version.json b/_data/version.json index dee77c9..7342da9 100644 --- a/_data/version.json +++ b/_data/version.json @@ -1,7 +1,7 @@ { - "display_version": "1.11", - "full_version": "1.11.0", - "release_date": "July 31, 2017", - "blog_post":"/blog/2017/07/31/drill-1.11-released", - "release_notes": "https://drill.apache.org/docs/apache-drill-1-11-0-release-notes/" + "display_version": "1.12", + "full_version": "1.12.0", + "release_date": "December 15, 2017", + "blog_post":"/blog/2017/12/15/drill-1.12-released", + "release_notes": "https://drill.apache.org/docs/apache-drill-1-12-0-release-notes/" } http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/_docs/getting-started/010-drill-introduction.md ---------------------------------------------------------------------- diff --git a/_docs/getting-started/010-drill-introduction.md b/_docs/getting-started/010-drill-introduction.md index b59b07a..e249017 100644 --- a/_docs/getting-started/010-drill-introduction.md +++ b/_docs/getting-started/010-drill-introduction.md @@ -1,6 +1,6 @@ --- title: "Drill Introduction" -date: 2017-07-31 04:43:33 UTC +date: 2017-12-16 06:24:22 UTC parent: "Getting Started" --- Drill is an Apache open-source SQL query engine for Big Data exploration. @@ -10,6 +10,28 @@ applications, while still providing the familiarity and ecosystem of ANSI SQL, the industry-standard query language. Drill provides plug-and-play integration with existing Apache Hive and Apache HBase deployments. +## What's New in Apache Drill 1.12 + +Drill 1.12 provides the following new features and improvements: + +- Kafka and OpenTSDB storage plugins (DRILL-4779, DRILL-5337) +- SSL/TLS support (DRILL-5431) +- Network encryption support (DRILL-5682) +- Queue-based memory assignment for buffering operators (DRILL-5716) +- A collection of networking functions that facilitate network analysis using Drill (DRILL-5834) +- Support for the libpam4j PAM authenticator (DRILL-5820) +- Filter pushdown for Parquet can handle files with multiple rowgroups (DRILL-5795) +- UTF-8 is enabled in the query string by default (DRILL-5772) +- IF NOT EXISTS support for CREATE TABLE and CREATE VIEWS (DRILL-5952) +- Geometry functions, `ST_AsGeoJSON` and `ST_AsJSON`, that return GeoJSON and JSON representations (DRILL-5962, DRILL-5960) +- JMX metrics for failed and canceled queries (DRILL-5909) +- Syntax highlighting and error checking for storage plugin configurations (DRILL-5981) +- System options improvements, including a new internal system options table (DRILL-5723) +- Ability to prevent users from accessing a path outside the current workspace (DRILL-5964) +- Ability to put the server in quiescent mode for a graceful shutdown (DRILL-4286) +- The Drill Web Console lists the completion of successfully completed queries as "successful" (DRILL-5923) + + ## What's New in Apache Drill 1.11 Drill 1.11 provides the following new features and improvements: http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/_docs/install/047-installing-drill-on-the-cluster.md ---------------------------------------------------------------------- diff --git a/_docs/install/047-installing-drill-on-the-cluster.md b/_docs/install/047-installing-drill-on-the-cluster.md index 73c49b8..21ab2f0 100644 --- a/_docs/install/047-installing-drill-on-the-cluster.md +++ b/_docs/install/047-installing-drill-on-the-cluster.md @@ -1,13 +1,13 @@ --- title: "Installing Drill on the Cluster" -date: 2017-07-31 04:43:41 UTC +date: 2017-12-16 06:24:22 UTC parent: "Installing Drill in Distributed Mode" --- You install Drill on nodes in the cluster, configure a cluster ID, and add Zookeeper information, as described in the following steps: - 1. Download the latest version of Apache Drill [here](http://apache.mirrors.hoobly.com/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz) or from the [Apache Drill mirror site](http://www.apache.org/dyn/closer.cgi/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz) with the command appropriate for your system: - * `wget http://apache.mirrors.hoobly.com/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz` - * `curl -o apache-drill-1.11.0.tar.gz http://apache.mirrors.hoobly.com/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz` + 1. Download the latest version of Apache Drill [here](http://apache.mirrors.hoobly.com/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz) or from the [Apache Drill mirror site](http://www.apache.org/dyn/closer.cgi/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz) with the command appropriate for your system: + * `wget http://apache.mirrors.hoobly.com/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz` + * `curl -o apache-drill-1.12.0.tar.gz http://apache.mirrors.hoobly.com/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz` 2. Extract the tarball to the directory of your choice, such as `/opt`: `tar -xzvf apache-drill-<version>.tar.gz` 3. In `drill-override.conf,` use the Drill `cluster ID`, and provide ZooKeeper host names and port numbers to configure a connection to your ZooKeeper quorum. http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/_docs/install/installing-drill-in-embedded-mode/020-installing-drill-on-linux-and-mac-os-x.md ---------------------------------------------------------------------- diff --git a/_docs/install/installing-drill-in-embedded-mode/020-installing-drill-on-linux-and-mac-os-x.md b/_docs/install/installing-drill-in-embedded-mode/020-installing-drill-on-linux-and-mac-os-x.md index c5a7412..4342ef6 100644 --- a/_docs/install/installing-drill-in-embedded-mode/020-installing-drill-on-linux-and-mac-os-x.md +++ b/_docs/install/installing-drill-in-embedded-mode/020-installing-drill-on-linux-and-mac-os-x.md @@ -1,6 +1,6 @@ --- title: "Installing Drill on Linux and Mac OS X" -date: 2017-07-31 04:43:45 UTC +date: 2017-12-16 06:24:23 UTC parent: "Installing Drill in Embedded Mode" --- First, check that you [meet the prerequisites]({{site.baseurl}}/docs/embedded-mode-prerequisites), and then install Apache Drill on Linux or Mac OS X: @@ -8,9 +8,9 @@ First, check that you [meet the prerequisites]({{site.baseurl}}/docs/embedded-mo Complete the following steps to install Drill: 1. In a terminal window, change to the directory where you want to install Drill. -2. Download the latest version of Apache Drill [here](http://apache.mirrors.hoobly.com/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz) or from the [Apache Drill mirror site](http://www.apache.org/dyn/closer.cgi/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz) with the command appropriate for your system: - * `wget http://apache.mirrors.hoobly.com/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz` - * `curl -o apache-drill-1.11.0.tar.gz http://www.apache.org/dyn/closer.cgi/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz` +2. Download the latest version of Apache Drill [here](http://apache.mirrors.hoobly.com/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz) or from the [Apache Drill mirror site](http://www.apache.org/dyn/closer.cgi/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz) with the command appropriate for your system: + * `wget http://apache.mirrors.hoobly.com/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz` + * `curl -o apache-drill-1.12.0.tar.gz http://www.apache.org/dyn/closer.cgi/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz` 3. Copy the downloaded file to the directory where you want to install Drill. 4. Extract the contents of the Drill `.tar.gz` file. Use sudo only if necessary: `tar -xvzf <.tar.gz file name>` http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/_docs/install/installing-drill-in-embedded-mode/040-installing-drill-on-windows.md ---------------------------------------------------------------------- diff --git a/_docs/install/installing-drill-in-embedded-mode/040-installing-drill-on-windows.md b/_docs/install/installing-drill-in-embedded-mode/040-installing-drill-on-windows.md index 5c814c9..08e519c 100644 --- a/_docs/install/installing-drill-in-embedded-mode/040-installing-drill-on-windows.md +++ b/_docs/install/installing-drill-in-embedded-mode/040-installing-drill-on-windows.md @@ -1,11 +1,11 @@ --- title: "Installing Drill on Windows" -date: 2017-07-31 04:43:51 UTC +date: 2017-12-16 06:24:23 UTC parent: "Installing Drill in Embedded Mode" --- First, check that you [meet the prerequisites]({{site.baseurl}}/docs/embedded-mode-prerequisites), including setting the JAVA_HOME environment variable, and then install Drill. Currently, Drill supports 64-bit Windows only. Complete the following steps to install Drill: -1. Download the latest version of Apache Drill [here](http://apache.mirrors.hoobly.com/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz). +1. Download the latest version of Apache Drill [here](http://apache.mirrors.hoobly.com/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz). 2. Move the downloaded file to the directory where you want to install Drill. 3. Unzip the GZ file using a third-party tool. If the tool you use does not unzip the underlying TAR file as well as the GZ file, perform a second unzip to extract the Drill software. The extraction process creates the installation directory containing the Drill software. http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/_docs/rn/001-1.11.0-rn.md ---------------------------------------------------------------------- diff --git a/_docs/rn/001-1.11.0-rn.md b/_docs/rn/001-1.11.0-rn.md deleted file mode 100644 index 378cb47..0000000 --- a/_docs/rn/001-1.11.0-rn.md +++ /dev/null @@ -1,297 +0,0 @@ ---- -title: "Apache Drill 1.11.0 Release Notes" -parent: "Release Notes" ---- - -**Release date:** July 31, 2017 - -Today, we're happy to announce the availability of Drill 1.11.0. You can download it [here](https://drill.apache.org/download/). - -## New Features and Improvements -This release of Drill provides the following new features and improvements: - -- Cryptography-related functions. (DRILL-5634) -- Spill to disk for the hash aggregate operator. (DRILL-5457) -- Format plugin support for PCAP files. (DRILL-5432) -- Ability to change the HDFS block Size for Parquet files. (DRILL-5379) -- Ability to store query profiles in memory. (DRILL-5481) -- Configurable CTAS directory and file permissions option. (DRILL-5391) -- Support for network encryption. (DRILL-4335) -- Relative paths stored in the metadata file. (DRILL-3867) -- Support for ANSI_QUOTES. (DRILL-3510) - - -The following sections list additional bug fixes and improvements: - -<h2> Sub-task -</h2> -<ul> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3250'>DRILL-3250</a>] - Drill fails to compare multi-byte characters from hive table -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4301'>DRILL-4301</a>] - OOM : Unable to allocate sv2 for 1000 records, and not enough batchGroups to spill. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5008'>DRILL-5008</a>] - Refactor, document and simplify ExternalSortBatch -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5011'>DRILL-5011</a>] - External Sort Batch memory use depends on record width -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5014'>DRILL-5014</a>] - ExternalSortBatch cache size, spill count differs from config setting -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5019'>DRILL-5019</a>] - ExternalSortBatch spills all batches to disk even if even one spills -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5020'>DRILL-5020</a>] - ExternalSortBatch has inconsistent notions of the memory limit -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5022'>DRILL-5022</a>] - ExternalSortBatch sets two different limits for "copier" memory -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5023'>DRILL-5023</a>] - ExternalSortBatch does not spill fully, throws off spill calculations -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5025'>DRILL-5025</a>] - ExternalSortBatch provides weak control over spill file size -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5026'>DRILL-5026</a>] - ExternalSortBatch uses two memory allocators; one will do -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5027'>DRILL-5027</a>] - ExternalSortBatch is inefficient: rewrites data unnecessarily -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5055'>DRILL-5055</a>] - External Sort does not delete spill file if error occurs during close -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5062'>DRILL-5062</a>] - External sort refers to the deprecated HDFS fs.default.name param -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5066'>DRILL-5066</a>] - External sort attempts to retry sv2 memory alloc, even if can never succeed -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5210'>DRILL-5210</a>] - External Sort BatchGroup leaks memory if an OOM occurs during read -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5285'>DRILL-5285</a>] - Provide detailed, accurate estimate of size consumed by a record batch -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5312'>DRILL-5312</a>] - "Record batch sizer" does not include overhead for variable-sized vectors -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5319'>DRILL-5319</a>] - Refactor FragmentContext and OptionManager for unit testing -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5320'>DRILL-5320</a>] - Refactor OptionManager for unit testing -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5321'>DRILL-5321</a>] - Refactor FragmentContext for unit testing -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5322'>DRILL-5322</a>] - Provide an OperatorFixture for sub-operator unit testing setup -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5323'>DRILL-5323</a>] - Provide test tools to create, populate and compare row sets -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5324'>DRILL-5324</a>] - Provide simplified column reader/writer for use in tests -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5331'>DRILL-5331</a>] - NPE in FunctionImplementationRegistry.findDrillFunction() if dynamic UDFs disabled -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5342'>DRILL-5342</a>] - Refactor "managed" external sort for unit tests -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5567'>DRILL-5567</a>] - Review changes for DRILL 5514 -</li> -</ul> - -<h2> Bug -</h2> -<ul> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3867'>DRILL-3867</a>] - Store relative paths in metadata file -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4039'>DRILL-4039</a>] - Query fails when non-ascii characters are used in string literals -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4347'>DRILL-4347</a>] - Planning time for query64 from TPCDS test suite has increased 10 times compared to 1.4 release -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4511'>DRILL-4511</a>] - refresh over empty folder results in error, we need a better error message -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4678'>DRILL-4678</a>] - Tune metadata by generating a dispatcher at runtime -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4720'>DRILL-4720</a>] - MINDIR() and IMINDIR() functions return no results with metadata cache -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4722'>DRILL-4722</a>] - Fix EqualityVisitor for interval day expressions with millis -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4755'>DRILL-4755</a>] - StringIndexOutOfBoundsException seen with CONVERT_FROM function -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4903'>DRILL-4903</a>] - Implicit columns are shown when Jdbc plugin is enabled -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4970'>DRILL-4970</a>] - Wrong results when casting double to bigint or int -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4971'>DRILL-4971</a>] - Query encounters system error, when there aren't eval subexpressions of any function in boolean and/or expressions -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5005'>DRILL-5005</a>] - Potential issues with external sort info in query profile -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5083'>DRILL-5083</a>] - RecordIterator can sometimes restart a query on close -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5130'>DRILL-5130</a>] - UNION ALL difference in results -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5140'>DRILL-5140</a>] - Fix CompileException in run-time generated code when record batch has large number of fields. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5160'>DRILL-5160</a>] - Memory leak in Parquet async reader when Snappy fails -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5164'>DRILL-5164</a>] - Equi-join query results in CompileException when inputs have large number of columns -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5165'>DRILL-5165</a>] - wrong results - LIMIT ALL and OFFSET clause in same query -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5213'>DRILL-5213</a>] - Prepared statement for actual query is missing the query text -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5226'>DRILL-5226</a>] - External Sort encountered an error while spilling to disk -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5229'>DRILL-5229</a>] - Upgrade kudu client to org.apache.kudu:kudu-client:1.2.0 -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5234'>DRILL-5234</a>] - External sort's spilling functionality does not work when the spilled columns contains a map type column -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5284'>DRILL-5284</a>] - Roll-up of final fixes for managed sort -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5297'>DRILL-5297</a>] - Print the plan text when plan pattern check fails in unit tests -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5311'>DRILL-5311</a>] - C++ connector connect doesn't check handshake result for timeout -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5316'>DRILL-5316</a>] - C++ Client Crashes When drillbitsVector.count is 0 after zoo_get_children completed with ZOK -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5330'>DRILL-5330</a>] - NPE in FunctionImplementationRegistry.functionReplacement() -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5344'>DRILL-5344</a>] - External sort priority queue copier fails with an empty batch -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5349'>DRILL-5349</a>] - TestParquetWriter unit tests fail with synchronous parquet reader -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5359'>DRILL-5359</a>] - ClassCastException when push down filter on the output of flatten into parquet scan -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5368'>DRILL-5368</a>] - Memory leak in C++ server metadata handler -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5369'>DRILL-5369</a>] - Missing initialization for ServerMetaContext -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5373'>DRILL-5373</a>] - Drill JDBC error in the process of connection via SQuirrel: java.lang.NoClassDefFoundError: javax/validation/constraints/NotNull -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5375'>DRILL-5375</a>] - Nested loop join: return correct result for left join -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5378'>DRILL-5378</a>] - Put more information into SchemaChangeException when HashJoin hit SchemaChangeException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5385'>DRILL-5385</a>] - Vector serializer fails to read saved SV2 -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5387'>DRILL-5387</a>] - TestBitBitKerberos and TestUserBitKerberos cause sporadic unit test failures -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5395'>DRILL-5395</a>] - Query on MapR-DB table fails with NPE due to an issue with assignment logic -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5397'>DRILL-5397</a>] - Random Error : Unable to get holder type for minor type [LATE] and mode [OPTIONAL] -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5399'>DRILL-5399</a>] - Fix race condition in DrillComplexWriterFuncHolder -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5409'>DRILL-5409</a>] - Update MapR version to 5.2.1-mapr -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5413'>DRILL-5413</a>] - DrillConnectionImpl.isReadOnly() throws NullPointerException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5419'>DRILL-5419</a>] - Calculate return string length for literals & some string functions -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5420'>DRILL-5420</a>] - all cores at 100% of all servers -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5424'>DRILL-5424</a>] - Fix IOBE for reverse function -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5428'>DRILL-5428</a>] - submit_plan fails after Drill 1.8 script revisions -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5429'>DRILL-5429</a>] - Improve query performance for MapR DB JSON Tables -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5450'>DRILL-5450</a>] - Fix initcap function to convert upper case characters correctly -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5496'>DRILL-5496</a>] - Must restart drillbits whenever a secure Hive metastore is restarted -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5498'>DRILL-5498</a>] - CSV text reader does not handle duplicate header names -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5523'>DRILL-5523</a>] - Revert if condition in UnionAllRecordBatch changed in DRILL-5419 -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5533'>DRILL-5533</a>] - Fix flag assignment in FunctionInitializer.checkInit() method -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5537'>DRILL-5537</a>] - Display columns alias for queries with sum() when RDBMS storage plugin is enabled -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5538'>DRILL-5538</a>] - Create TopProject with validatedNodeType after PHYSICAL phase -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5541'>DRILL-5541</a>] - C++ Client Crashes During Simple "Man in the Middle" Attack Test with Exploitable Write AV -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5544'>DRILL-5544</a>] - Out of heap running CTAS against text delimited -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5560'>DRILL-5560</a>] - Create configuration file for distribution specific configuration -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5577'>DRILL-5577</a>] - Column alias are ignored when Storage Plugin is enabled -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5587'>DRILL-5587</a>] - Validate Parquet blockSize and pageSize configured with SYSTEM/SESSION option -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5589'>DRILL-5589</a>] - JDBC client crashes after successful authentication if trace logging is enabled. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5590'>DRILL-5590</a>] - Drill return IndexOutOfBoundsException when a (Text) file > 4096 rows -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5599'>DRILL-5599</a>] - Notify StatusHandlerListener that batch sending has failed even if channel is still open -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5616'>DRILL-5616</a>] - Hash Agg Spill: OOM while reading irregular varchar data -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5659'>DRILL-5659</a>] - C++ Client (master) behavior is unstable resulting incorrect result or exception in API calls -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5665'>DRILL-5665</a>] - planner.force_2phase.aggr Set to TRUE for HashAgg may cause wrong results for VARIANCE and STD_DEV -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5668'>DRILL-5668</a>] - C++ connector crash when query error message is too long -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5669'>DRILL-5669</a>] - Multiple TPCH queries failed due to OOM -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5678'>DRILL-5678</a>] - Undefined behavior due to un-initialized values in ServerMetaContext -</li> -</ul> - -<h2> Improvement -</h2> -<ul> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2974'>DRILL-2974</a>] - Make OutOfMemoryException an unchecked exception and remove OutOfMemoryRuntimeException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3510'>DRILL-3510</a>] - Add ANSI_QUOTES option so that Drill's SQL Parser will recognize ANSI_SQL identifiers -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5056'>DRILL-5056</a>] - UserException does not write full message to log -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5080'>DRILL-5080</a>] - Create a memory-managed version of the External Sort operator -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5163'>DRILL-5163</a>] - External sort on Mac creates a separate child process per spill via HDFS FS -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5315'>DRILL-5315</a>] - Small Comment Typo in drillClient.hpp -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5318'>DRILL-5318</a>] - Create a sub-operator test framework -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5325'>DRILL-5325</a>] - Implement sub-operator unit tests for managed external sort -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5351'>DRILL-5351</a>] - Excessive bounds checking in the Parquet reader -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5352'>DRILL-5352</a>] - Extend test framework profile parser printer for multi-fragment queries -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5355'>DRILL-5355</a>] - Misc. code cleanup -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5356'>DRILL-5356</a>] - Refactor Parquet Record Reader -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5379'>DRILL-5379</a>] - Set Hdfs Block Size based on Parquet Block Size -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5391'>DRILL-5391</a>] - CTAS: make folder and file permission configurable -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5394'>DRILL-5394</a>] - Optimize query planning for MapR-DB tables by caching row counts -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5415'>DRILL-5415</a>] - Improve Fixture Builder to configure client properties and keep collection type properties for server -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5423'>DRILL-5423</a>] - Refactor ScanBatch to allow unit testing record readers -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5457'>DRILL-5457</a>] - Support Spill to Disk for the Hash Aggregate Operator -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5481'>DRILL-5481</a>] - Allow Drill to persist profiles in-memory only with a max capacity -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5485'>DRILL-5485</a>] - Remove WebServer dependency on DrillClient -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5504'>DRILL-5504</a>] - Vector validator to diagnose offset vector issues -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5512'>DRILL-5512</a>] - Standardize error handling in ScanBatch -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5514'>DRILL-5514</a>] - Enhance VectorContainer to merge two row sets -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5516'>DRILL-5516</a>] - Limit memory usage for Hbase reader -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5517'>DRILL-5517</a>] - Provide size-aware set operations in value vectors -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5518'>DRILL-5518</a>] - Roll-up of a number of test framework enhancements -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5545'>DRILL-5545</a>] - Add findbugs to build -</li> -</ul> - -<h2> New Feature -</h2> -<ul> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-291'>DRILL-291</a>] - Add SASL support for Drill -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4335'>DRILL-4335</a>] - Apache Drill should support network encryption - SASL encryption between Drill Client to Drillbit -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5432'>DRILL-5432</a>] - Added pcap-format support -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5634'>DRILL-5634</a>] - Add Crypto and Hash Functions -</li> -</ul> - http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/_docs/rn/001-1.12.0-rn.md ---------------------------------------------------------------------- diff --git a/_docs/rn/001-1.12.0-rn.md b/_docs/rn/001-1.12.0-rn.md new file mode 100644 index 0000000..3c8fe4e --- /dev/null +++ b/_docs/rn/001-1.12.0-rn.md @@ -0,0 +1,430 @@ +--- +title: "Apache Drill 1.12.0 Release Notes" +parent: "Release Notes" +--- + +**Release date:** December 15, 2017 + +Today, we're happy to announce the availability of Drill 1.12.0. You can download it [here](https://drill.apache.org/download/). + +## New Features and Improvements +This release of Drill provides the following new features and improvements: + +- Kafka and OpenTSDB storage plugins (DRILL-4779, DRILL-5337) +- SSL/TLS support (DRILL-5431) +- Network encryption support (DRILL-5682) +- Queue-based memory assignment for buffering operators (DRILL-5716) +- A collection of networking functions that facilitate network analysis using Drill (DRILL-5834) +- Support for the libpam4j PAM authenticator (DRILL-5820) +- Filter pushdown for Parquet can handle files with multiple rowgroups (DRILL-5795) +- UTF-8 is enabled in the query string by default (DRILL-5772) +- IF NOT EXISTS support for CREATE TABLE and CREATE VIEWS (DRILL-5952) +- Geometry functions, `ST_AsGeoJSON` and `ST_AsJSON`, that return GeoJSON and JSON representations (DRILL-5962, DRILL-5960) +- JMX metrics for failed and canceled queries (DRILL-5909) +- Syntax highlighting and error checking for storage plugin configurations (DRILL-5981) +- System options improvements, including a new internal system options table (DRILL-5723) +- Ability to prevent users from accessing a path outside the current workspace (DRILL-5964) +- Ability to put the server in quiescent mode for a graceful shutdown (DRILL-4286) +- The Drill Web Console lists the completion of successfully completed queries as "successful" (DRILL-5923) + + + +The following sections list additional bug fixes and improvements: + +<h2> Sub-task +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5253'>DRILL-5253</a>] - External sort fails with OOM error (Fails to allocate sv2) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5801'>DRILL-5801</a>] - Label the Gantt chart that indicates the lifespan details of the various minor fragments +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5802'>DRILL-5802</a>] - Provide a sortable table for tables within a query profile +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5803'>DRILL-5803</a>] - Show the hostname for each minor fragment in operator table +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5867'>DRILL-5867</a>] - List profiles in pages rather than a long verbose listing +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5881'>DRILL-5881</a>] - Java Client: [Threat Modeling] Drillbit may be spoofed by an attacker and this may lead to data being written to the attacker's target instead of Drillbit +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5882'>DRILL-5882</a>] - C++ Client: [Threat Modeling] Drillbit may be spoofed by an attacker and this may lead to data being written to the attacker's target instead of Drillbit +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-6031'>DRILL-6031</a>] - Document support for dots in field names +</li> +</ul> + +<h2> Bug +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1051'>DRILL-1051</a>] - Casting timestamp as date gives wrong result for dates earlier than 1883 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1499'>DRILL-1499</a>] - Different column order could appear in the result set for a schema-less select * query, even there are no changing schemas. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3241'>DRILL-3241</a>] - Query with window function runs out of direct memory and does not report back to client that it did +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3407'>DRILL-3407</a>] - CTAS Auto Partition : The plan for count(*) should show the list of files scanned +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3449'>DRILL-3449</a>] - When Foreman node dies, the FragmentExecutor still tries to send status updates to Foreman +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3827'>DRILL-3827</a>] - Empty metadata file causes queries on the table to fail +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3829'>DRILL-3829</a>] - Metadata Caching : Drill should ignore a corrupted cache file +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4139'>DRILL-4139</a>] - Fix parquet partition pruning for BIT, INTERVAL and DECIMAL types +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4255'>DRILL-4255</a>] - SELECT DISTINCT query over JSON data returns UNSUPPORTED OPERATION +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4640'>DRILL-4640</a>] - Unable to submit physical plan from Web UI on Windows +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4686'>DRILL-4686</a>] - Aggregation query over HBase table results in IllegalStateException: Failure while reading vector +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4734'>DRILL-4734</a>] - Query against HBase table on a 5 node cluster fails with SchemaChangeException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4735'>DRILL-4735</a>] - Count(dir0) on parquet returns 0 result +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5002'>DRILL-5002</a>] - Using hive's date functions on top of date column gives wrong results for local time-zone +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5146'>DRILL-5146</a>] - Unnecessary spilling to disk by sort when we only have 5000 rows with one column +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5166'>DRILL-5166</a>] - Select with options returns NPE +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5185'>DRILL-5185</a>] - Union all not passing type info when the output contains 0 rows +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5268'>DRILL-5268</a>] - SYSTEM ERROR: UnsupportedOperationException: Unable to get size for minor type [MAP] and mode [REQUIRED] +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5269'>DRILL-5269</a>] - SYSTEM ERROR: JsonMappingException: No suitable constructor found for type [simple type, class org.apache.drill.exec.store.direct.DirectSubScan] +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5327'>DRILL-5327</a>] - Hash aggregate can return empty batch which can cause schema change exception +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5339'>DRILL-5339</a>] - Web UI: flaws in query profile display on error +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5341'>DRILL-5341</a>] - Web UI: remove duplicating link to documentation in Options page +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5346'>DRILL-5346</a>] - Web UI: remove link on user in query profile list +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5357'>DRILL-5357</a>] - Partition pruning information not available in query plan for COUNT aggregate query +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5416'>DRILL-5416</a>] - Vectors read from disk report incorrect memory sizes +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5442'>DRILL-5442</a>] - Managed Sort: IndexOutOfBounds with a join over an inlist +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5443'>DRILL-5443</a>] - Managed External Sort fails with OOM while spilling to disk +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5445'>DRILL-5445</a>] - Assertion Error in Managed External Sort when dealing with repeated maps +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5447'>DRILL-5447</a>] - Managed External Sort : Unable to allocate sv2 vector +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5464'>DRILL-5464</a>] - Fix JSON reader when it deals with empty file +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5465'>DRILL-5465</a>] - Managed external sort results in an OOM +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5478'>DRILL-5478</a>] - Spill file size parameter is not honored by the managed external sort +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5480'>DRILL-5480</a>] - Empty batch returning from HBase may cause SchemaChangeException even when data does not have different schema +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5507'>DRILL-5507</a>] - Millions of "Failure finding Drillbit running on host" info messages in foreman logs +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5513'>DRILL-5513</a>] - Managed External Sort : OOM error during the merge phase +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5519'>DRILL-5519</a>] - Sort fails to spill and results in an OOM +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5525'>DRILL-5525</a>] - Inconsistent, unhelpful semantics for batch, field schema comparison +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5546'>DRILL-5546</a>] - Schema change problems caused by empty batch +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5547'>DRILL-5547</a>] - Drill config options and session options do not work as intended +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5564'>DRILL-5564</a>] - IllegalStateException: allocator[op:21:1:5:HashJoinPOP]: buffer space (16674816) + prealloc space (0) + child space (0) != allocated (16740352) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5582'>DRILL-5582</a>] - [Threat Modeling] Drillbit may be spoofed by an attacker and this may lead to data being written to the attacker's target instead of Drillbit +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5594'>DRILL-5594</a>] - Excessive buffer reallocations during merge phase of external sort +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5597'>DRILL-5597</a>] - Incorrect "bits" vector allocation in nullable vectors allocateNew() +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5602'>DRILL-5602</a>] - Repeated List Vector fails to initialize the offset vector +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5617'>DRILL-5617</a>] - Spill file name collisions when spill file is on a shared file system +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5645'>DRILL-5645</a>] - negation of expression causes null pointer exception +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5660'>DRILL-5660</a>] - Drill 1.10 queries fail due to Parquet Metadata "corruption" from DRILL-3867 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5663'>DRILL-5663</a>] - Drillbit fails to start when only keystore path is provided without keystore password. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5675'>DRILL-5675</a>] - Drill C++ Client Date Time Literals Support Metadata Mapping is Incorrect +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5686'>DRILL-5686</a>] - Warning for sasl.max_wrapped_size contain incorrect syntax +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5687'>DRILL-5687</a>] - Disable TestMergeJoinWithSchemaChanges#testMissingAndNewColumns +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5694'>DRILL-5694</a>] - hash agg spill to disk, second phase OOM +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5698'>DRILL-5698</a>] - Drill should start in embedded mode using java 1.8.0_144 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5699'>DRILL-5699</a>] - Drill Web UI Page Source Has Links To External Sites +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5701'>DRILL-5701</a>] - drill.connections.rpc.<user/control/data>.<encrypted/unencrypted> metric not behaving correctly +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5702'>DRILL-5702</a>] - Jdbc Driver Class not found +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5710'>DRILL-5710</a>] - drill-config.sh incorrectly exits with Java 1.7 or later is required to run Apache Drill +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5714'>DRILL-5714</a>] - Fix NPE when mapr-db plugin is used in table function +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5715'>DRILL-5715</a>] - Performance of refactored HashAgg operator regressed +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5717'>DRILL-5717</a>] - change some date time unit cases with specific timezone or Local +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5721'>DRILL-5721</a>] - Query with only root fragment and no non-root fragment hangs when Drillbit to Drillbit Control Connection has network issues +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5725'>DRILL-5725</a>] - Update Jackson version to 2.7.8 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5727'>DRILL-5727</a>] - Update release profile to generate SHA-512 checksum. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5729'>DRILL-5729</a>] - Fix Travis Checks +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5737'>DRILL-5737</a>] - Hash Agg uses more than the allocated memory under certain low memory conditions +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5740'>DRILL-5740</a>] - hash agg fail to read spill file +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5743'>DRILL-5743</a>] - Using order by clause in a select * query on hbase table returns only the row_key and order by field(s) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5744'>DRILL-5744</a>] - External sort fails with OOM error +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5745'>DRILL-5745</a>] - Invalid "location" information in Drill web server +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5746'>DRILL-5746</a>] - Pcap PR manually edited Protobuf files, values lost on next build +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5749'>DRILL-5749</a>] - Foreman and Netty threads occure deadlock +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5751'>DRILL-5751</a>] - Fix unit tests to use local file system even if it is not set by default +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5753'>DRILL-5753</a>] - Managed External Sort: One or more nodes ran out of memory while executing the query. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5755'>DRILL-5755</a>] - TOP_N_SORT operator does not free memory while running +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5757'>DRILL-5757</a>] - CONVERT_TO_JSON function is failed while using non-existence field as a parameter. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5761'>DRILL-5761</a>] - Disable Lilith ClassicMultiplexSocketAppender by default +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5763'>DRILL-5763</a>] - Fix NPE during MapRDBSubScan deserialization +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5765'>DRILL-5765</a>] - Json query profile is not shown on Web UI +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5766'>DRILL-5766</a>] - Stored XSS in APACHE DRILL +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5771'>DRILL-5771</a>] - Fix serDe errors for format plugins +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5775'>DRILL-5775</a>] - Select * query on a maprdb binary table fails +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5790'>DRILL-5790</a>] - PCAP format explicitly opens local file +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5792'>DRILL-5792</a>] - CONVERT_FROM_JSON on an empty file throws runtime exception +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5804'>DRILL-5804</a>] - External Sort times out, may be infinite loop +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5811'>DRILL-5811</a>] - Large number of "Failure finding Drillbit" messages when using MFS +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5812'>DRILL-5812</a>] - Restore the minor fragment Gantt chart Canvas +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5816'>DRILL-5816</a>] - Hash function produces skewed results on String values with same leading prefix +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5819'>DRILL-5819</a>] - Default value of security.admin.user_groups and security.admin.users is "true" +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5822'>DRILL-5822</a>] - The query with "SELECT *" with "ORDER BY" clause and `planner.slice_target`=1 doesn't preserve column order +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5824'>DRILL-5824</a>] - 1st phase Hash Aggregate allocates more memory than the limit +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5830'>DRILL-5830</a>] - Resolve regressions to MapR DB from DRILL-5546 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5838'>DRILL-5838</a>] - Fix MaprDB filter pushdown for the case of nested field (reg. of DRILL-4264) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5839'>DRILL-5839</a>] - Handle Empty Batches in Merge Receiver +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5840'>DRILL-5840</a>] - A query that includes sort completes, and then loses Drill connection. Drill becomes unresponsive, and cannot restart because it cannot communicate with Zookeeper +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5845'>DRILL-5845</a>] - Columns returned by select with "ORDER BY" and "LIMIT" clauses are not in correct order. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5849'>DRILL-5849</a>] - Add freemarker lib to dependencyManagement to ensure proper version is used when resolving dependency version conflicts +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5853'>DRILL-5853</a>] - Sort removal based on NULL direction +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5854'>DRILL-5854</a>] - IllegalStateException when empty batch is received. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5857'>DRILL-5857</a>] - Fix NumberFormatException in Hive unit tests +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5859'>DRILL-5859</a>] - Time for query queuing timeout not display correctly in WebUI +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5863'>DRILL-5863</a>] - Sortable table incorrectly sorts minor fragments and time elements lexically instead of sorting by implicit value +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5864'>DRILL-5864</a>] - Selecting a non-existing field from a MapR-DB JSON table fails with NPE +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5872'>DRILL-5872</a>] - Deserialization of profile JSON fails due to totalCost being reported as "NaN" +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5874'>DRILL-5874</a>] - NPE in AnonWebUserConnection.cleanupSession() +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5878'>DRILL-5878</a>] - TableNotFound exception is being reported for a wrong storage plugin. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5887'>DRILL-5887</a>] - Display process user/ groups in Drill UI +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5888'>DRILL-5888</a>] - jdbc-all-jar unit tests broken because of dependency on hadoop.security +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5890'>DRILL-5890</a>] - Tests Leak Many Open File Descriptors +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5895'>DRILL-5895</a>] - Fix unit tests for mongo storage plugin +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5896'>DRILL-5896</a>] - Handle vector creation in HbaseRecordReader to avoid NullableInt vectors later +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5898'>DRILL-5898</a>] - Query returns columns in the wrong order +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5906'>DRILL-5906</a>] - java.lang.NullPointerException while quering Hive ORC tables on MapR cluster. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5923'>DRILL-5923</a>] - State of a successfully completed query shown as "COMPLETED" +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5941'>DRILL-5941</a>] - Skip header / footer logic works incorrectly for Hive tables when file has several input splits +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5972'>DRILL-5972</a>] - Slow performance for query on INFORMATION_SCHEMA.TABLE +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5979'>DRILL-5979</a>] - unnable to access temporary table from drill web interface +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5986'>DRILL-5986</a>] - Update jackson-databind version to 2.7.9.1 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5987'>DRILL-5987</a>] - Two versions of javassist on the classpath +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-6006'>DRILL-6006</a>] - Label current is missing on Web UI since the same drillbits with different status are considered to be different +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-6007'>DRILL-6007</a>] - web ui index page is refreshed at high pace +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-6017'>DRILL-6017</a>] - Fix for SHUTDOWN button being visible for non Admin users +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-6019'>DRILL-6019</a>] - Only admin should be able to access shutdown resources +</li> +<li>Order by doesn't sort columns when window function is involved in the query</li> +<li>MIN MAX DIR tests fail and return incorrect results</li> +<li>header.line.count does not work for Hive table with data file size > chunk size</li> +<li>lang.NoClassDefFoundError exception not handled in org.apache.drill.exec.rpc.security.ClientAuthenticatorProvider</li> +<li>Investigate jackson-databind vulnerabilities CVE-2017-15095 & CVE-2017-7525</li> +<li>Null Pointer Exception with query using table function</li> +<li>Fix XSS vulnerabilities in Drill</li> +<li>Some queries in concurrent execution get stuck in STARTING phase</li> +<li>hashagg.num_partitions cannot be set by "alter session" or "alter system"</li> +<li>Query with 2-way JOIN fails with "Hash join does not support schema changes"</li> +<li>RowKeyJoin is generated instead of IndexScan for queries with derived table/ table functions</li> +<li>ConvertCountToDirectScan rule enhancements</li> +<li>Drill wrong old date-time values displaying</li> +<li>Warning message "Exception while trying to prune partition" when query on view</li> +<li>Drill not able to read MapR-DB when FQDN is longer than 64 characters</li> +<li>Pam authentication with Centrify doesn't work by JPam restriction</li> +<li>Hash aggregate does not support schema changes</li> +<li>Simple query with only one join condition failed with "Hash join does not support schema changes"</li> +<li>UnsupportedOperationException: Unable to get holder type for minor type [LATE] and mode [OPTIONAL].</li> +<li>Query on TPC-H SF100 dataset fails with "Hash join does not support schema changes" [MapR-DB JSON Tables]</li> +</ul> + +<h2> Improvement +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1691'>DRILL-1691</a>] - ConvertCountToDirectScan rule should be applicable for 2 or more COUNT aggregates +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4264'>DRILL-4264</a>] - Allow field names to include dots +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5089'>DRILL-5089</a>] - Skip initializing all enabled storage plugins for every query +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5106'>DRILL-5106</a>] - Refactor SkipRecordsInspector to exclude check for predefined file formats +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5259'>DRILL-5259</a>] - Allow listing a user-defined number of profiles +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5338'>DRILL-5338</a>] - Web UI: add better visual indication for PLANNING, QUEUED, EXECUTION in Query Profile that they are part of total time duration +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5704'>DRILL-5704</a>] - Improve error message on client side when queries fail with "Failed to create schema tree." when Impersonation is enabled and logins are anonymous +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5709'>DRILL-5709</a>] - Provide a value vector method to convert a vector to nullable +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5716'>DRILL-5716</a>] - Queue-based memory assignment for buffering operators +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5726'>DRILL-5726</a>] - Support Impersonation without authentication for REST API +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5795'>DRILL-5795</a>] - Filter pushdown for parquet handles multi rowgroup file +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5808'>DRILL-5808</a>] - Reduce memory allocator strictness for "managed" operators +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5815'>DRILL-5815</a>] - Provide option to set query memory as percent of total +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5832'>DRILL-5832</a>] - Migrate OperatorFixture to use SystemOptionManager rather than mock +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5834'>DRILL-5834</a>] - Add Networking Functions +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5842'>DRILL-5842</a>] - Refactor and simplify the fragment, operator contexts for testing +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5862'>DRILL-5862</a>] - Update project parent pom xml to the latest ASF version +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5893'>DRILL-5893</a>] - Maven forkCount property is too aggressive causing builds to fail on some machines. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5899'>DRILL-5899</a>] - Simple pattern matchers can work with DrillBuf directly +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5909'>DRILL-5909</a>] - need new JMX metrics for (FAILED and CANCELED) queries +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5910'>DRILL-5910</a>] - Logging exception when custom AuthenticatorFactory not found +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5921'>DRILL-5921</a>] - Counters metrics should be listed in table +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5943'>DRILL-5943</a>] - Avoid the strong check introduced by DRILL-5582 for PLAIN mechanism +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5952'>DRILL-5952</a>] - Implement "CREATE TABLE IF NOT EXISTS" +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5960'>DRILL-5960</a>] - Add function STAsGeoJSON to extend GIS support +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5962'>DRILL-5962</a>] - Add function STAsJSON to extend GIS support +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5964'>DRILL-5964</a>] - Do not allow queries to access paths outside the current workspace root +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5980'>DRILL-5980</a>] - Make queryType param for REST API case insensitive +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5981'>DRILL-5981</a>] - Add Syntax Highlighting and Error Checking to Storage Plugin Config Page +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5989'>DRILL-5989</a>] - Run Smoke Tests On Travis +</li> +</ul> + +<h2> New Feature +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4286'>DRILL-4286</a>] - Have an ability to put server in quiescent mode of operation +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4779'>DRILL-4779</a>] - Kafka storage plugin support +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5337'>DRILL-5337</a>] - OpenTSDB storage plugin +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5431'>DRILL-5431</a>] - Support SSL +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5682'>DRILL-5682</a>] - Apache Drill should support network encryption +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5723'>DRILL-5723</a>] - Support System/Session Internal Options And Additional Option System Fixes +</li> +</ul> + +<h2> Task +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5601'>DRILL-5601</a>] - Rollup of External Sort memory management fixes +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5685'>DRILL-5685</a>] - Provide a way to set common environment variable between sqlline and Drillbit differently. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5758'>DRILL-5758</a>] - Rollup of external sort fixes to issues found by QA +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5772'>DRILL-5772</a>] - Enable UTF-8 support in query string by default +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5781'>DRILL-5781</a>] - Fix unit test failures to use tests config even if default config is available +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5820'>DRILL-5820</a>] - Add support for libpam4j Pam Authenticator +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5911'>DRILL-5911</a>] - Upgrade esri-geometry-api version to 2.0.0 to avoid dependency on org.json library +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5917'>DRILL-5917</a>] - Ban org.json:json library in Drill +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-6000'>DRILL-6000</a>] - Graceful Shutdown Unit Tests Should Not Be Run On Travis +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-6011'>DRILL-6011</a>] - Update log info message in DrillClient +</li> +</ul> + \ No newline at end of file http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/_docs/rn/002-1.10.0-rn.md ---------------------------------------------------------------------- diff --git a/_docs/rn/002-1.10.0-rn.md b/_docs/rn/002-1.10.0-rn.md deleted file mode 100644 index 0f83cf3..0000000 --- a/_docs/rn/002-1.10.0-rn.md +++ /dev/null @@ -1,290 +0,0 @@ ---- -title: "Apache Drill 1.10.0 Release Notes" -parent: "Release Notes" ---- - -**Release date:** March 15, 2017 - -Today, we're happy to announce the availability of Drill 1.10.0. You can download it [here](https://drill.apache.org/download/). - -## New Features and Improvements -This release of Drill provides the following new features and improvements: - -- Support for the CREATE TEMPORARY TABLE AS (CTTAS) command. -- A JDBC connection option that improves fault tolerance when connecting directly to a Drill node from a client. -- The Web Console displays the Drill version and additional query profile statistics. -- Drill implicitly interprets the INT96 timestamp data type in Parquet files. -- Support for Kerberos authentication between the client and drillbit. - -The following sections list additional bug fixes and improvements: - -<h2> Sub-task -</h2> -<ul> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4272'>DRILL-4272</a>] - When sort runs out of memory and query fails, resources are seemingly not freed -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4301'>DRILL-4301</a>] - OOM : Unable to allocate sv2 for 1000 records, and not enough batchGroups to spill. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4730'>DRILL-4730</a>] - Update JDBC DatabaseMetaData implementation to use new Metadata APIs -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5008'>DRILL-5008</a>] - Refactor, document and simplify ExternalSortBatch -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5011'>DRILL-5011</a>] - External Sort Batch memory use depends on record width -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5014'>DRILL-5014</a>] - ExternalSortBatch cache size, spill count differs from config setting -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5017'>DRILL-5017</a>] - Config param drill.exec.sort.external.batch.size is not used -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5019'>DRILL-5019</a>] - ExternalSortBatch spills all batches to disk even if even one spills -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5020'>DRILL-5020</a>] - ExternalSortBatch has inconsistent notions of the memory limit -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5022'>DRILL-5022</a>] - ExternalSortBatch sets two different limits for "copier" memory -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5023'>DRILL-5023</a>] - ExternalSortBatch does not spill fully, throws off spill calculations -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5025'>DRILL-5025</a>] - ExternalSortBatch provides weak control over spill file size -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5026'>DRILL-5026</a>] - ExternalSortBatch uses two memory allocators; one will do -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5027'>DRILL-5027</a>] - ExternalSortBatch is inefficient: rewrites data unnecessarily -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5055'>DRILL-5055</a>] - External Sort does not delete spill file if error occurs during close -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5062'>DRILL-5062</a>] - External sort refers to the deprecated HDFS fs.default.name param -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5066'>DRILL-5066</a>] - External sort attempts to retry sv2 memory alloc, even if can never succeed -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5210'>DRILL-5210</a>] - External Sort BatchGroup leaks memory if an OOM occurs during read -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5262'>DRILL-5262</a>] - NPE in managed external sort while spilling to disk -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5264'>DRILL-5264</a>] - Managed External Sort fails with OOM -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5267'>DRILL-5267</a>] - Managed external sort spills too often with Parquet data -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5285'>DRILL-5285</a>] - Provide detailed, accurate estimate of size consumed by a record batch -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5294'>DRILL-5294</a>] - Managed External Sort throws an OOM during the merge and spill phase -</li> -</ul> - -<h2> Bug -</h2> -<ul> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1808'>DRILL-1808</a>] - Large compilation unit tests fails due to high memory allocation -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2293'>DRILL-2293</a>] - CTAS does not clean up when it fails -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3562'>DRILL-3562</a>] - Query fails when using flatten on JSON data where some documents have an empty array -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4578'>DRILL-4578</a>] - "children" missing from results of full scan over JSON data -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4764'>DRILL-4764</a>] - Parquet file with INT_16, etc. logical types not supported by simple SELECT -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4812'>DRILL-4812</a>] - Wildcard queries fail on Windows -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4850'>DRILL-4850</a>] - TPCDS Query 33 failed in the second and 3rd runs, but succeeded in the 1st run -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4872'>DRILL-4872</a>] - NPE from CTAS partitioned by a projected casted null -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4919'>DRILL-4919</a>] - Fix select count(1) / count(*) on csv with header -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4938'>DRILL-4938</a>] - Report UserException when constant expression reduction fails -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4963'>DRILL-4963</a>] - Issues when overloading Drill native functions with dynamic UDFs -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4982'>DRILL-4982</a>] - Hive Queries degrade when queries switch between different formats -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4994'>DRILL-4994</a>] - Prepared statement stopped working between 1.8.0 client and < 1.8.0 server -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4995'>DRILL-4995</a>] - Allow lazy init when dynamic UDF support is disabled -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4996'>DRILL-4996</a>] - Parquet Date auto-correction is not working in auto-partitioned parquet files generated by drill-1.6 -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5005'>DRILL-5005</a>] - Potential issues with external sort info in query profile -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5015'>DRILL-5015</a>] - As per documentation, when issuing a list of drillbits in the connection string, we always attempt to connect only to the first one -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5032'>DRILL-5032</a>] - Drill query on hive parquet table failed with OutOfMemoryError: Java heap space -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5034'>DRILL-5034</a>] - Select timestamp from hive generated parquet always return in UTC -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5039'>DRILL-5039</a>] - NPE - CTAS PARTITION BY (<char-type-column>) -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5040'>DRILL-5040</a>] - Interrupted CTAS should not succeed & should not create physical file on disk -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5044'>DRILL-5044</a>] - Fix retry logic to handle VersionMismatchException by not deleting jars in remote UDFs area -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5048'>DRILL-5048</a>] - Fix type mismatch error in case statement with null timestamp -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5050'>DRILL-5050</a>] - C++ client library has symbol resolution issues when loaded by a process that already uses boost::asio -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5051'>DRILL-5051</a>] - DRILL-5051: Fix incorrect result returned in nest query with offset specified -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5070'>DRILL-5070</a>] - Code gen: create methods in fixed order to allow test verification -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5081'>DRILL-5081</a>] - Excessive info level logging introduced in DRILL-4203 -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5086'>DRILL-5086</a>] - ClassCastException when filter pushdown is used with a bigint or float column and metadata caching. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5088'>DRILL-5088</a>] - Error when reading DBRef column -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5091'>DRILL-5091</a>] - JDBC unit test fail on Java 8 -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5094'>DRILL-5094</a>] - Assure Comparator to be transitive -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5097'>DRILL-5097</a>] - Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from works -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5104'>DRILL-5104</a>] - Foreman sets external sort memory allocation even for a physical plan -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5112'>DRILL-5112</a>] - Unit tests derived from PopUnitTestBase fail in IDE due to config errors -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5113'>DRILL-5113</a>] - Upgrade Maven RAT plugin to avoid annoying XML errors -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5117'>DRILL-5117</a>] - Compile error when query a json file with 1000+columns -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5119'>DRILL-5119</a>] - Update MapR version to 5.2.0.40963-mapr -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5121'>DRILL-5121</a>] - A memory leak is observed when exact case is not specified for a column in a filter condition -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5127'>DRILL-5127</a>] - Revert the fix for DRILL-4831 -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5157'>DRILL-5157</a>] - Multiple Snappy versions on class path; causes unit test failures -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5159'>DRILL-5159</a>] - ProjectMergeRule in Drill should operate on RelNodes with same convention trait. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5164'>DRILL-5164</a>] - Equi-join query results in CompileException when inputs have large number of columns -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5167'>DRILL-5167</a>] - C++ connector does not set escape string for metadata search pattern -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5190'>DRILL-5190</a>] - Display planning and queued time for a query in its profile page -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5196'>DRILL-5196</a>] - Could not run a single MongoDB unit test case through command line or IDE -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5207'>DRILL-5207</a>] - Improve Parquet scan pipelining -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5208'>DRILL-5208</a>] - Finding path to java executable should be deterministic -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5218'>DRILL-5218</a>] - Support Disabling Heartbeats in C++ Client -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5224'>DRILL-5224</a>] - CTTAS: fix errors connected with system path delimiters (Windows) -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5230'>DRILL-5230</a>] - Translation of millisecond duration into hours is incorrect -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5238'>DRILL-5238</a>] - CTTAS: unable to resolve temporary table if workspace is indicated without schema -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5242'>DRILL-5242</a>] - The UI breaks when trying to render profiles having unknown metrics -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5243'>DRILL-5243</a>] - Fix TestContextFunctions.sessionIdUDFWithinSameSession unit test -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5252'>DRILL-5252</a>] - A condition returns always true -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5263'>DRILL-5263</a>] - Prevent left NLJoin with non scalar subqueries -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5266'>DRILL-5266</a>] - Parquet Reader produces "low density" record batches - bits vs. bytes -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5273'>DRILL-5273</a>] - CompliantTextReader exhausts 4 GB memory when reading 5000 small files -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5274'>DRILL-5274</a>] - Exception thrown in Drillbit shutdown in UDF cleanup code -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5275'>DRILL-5275</a>] - Sort spill serialization is slow due to repeated buffer allocations -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5284'>DRILL-5284</a>] - Roll-up of final fixes for managed sort -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5287'>DRILL-5287</a>] - Provide option to skip updates of ephemeral state changes in Zookeeper -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5293'>DRILL-5293</a>] - Poor performance of Hash Table due to same hash value as distribution below -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5304'>DRILL-5304</a>] - Queries fail intermittently when there is skew in data distribution -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5313'>DRILL-5313</a>] - C++ client build failure on linux -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5326'>DRILL-5326</a>] - Unit tests failures related to the SERVER_METADTA -</li> -</ul> - -<h2> Improvement -</h2> -<ul> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4217'>DRILL-4217</a>] - Query parquet file treat INT_16 & INT_8 as INT32 -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4280'>DRILL-4280</a>] - Kerberos Authentication -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4373'>DRILL-4373</a>] - Drill and Hive have incompatible timestamp representations in parquet -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4604'>DRILL-4604</a>] - Generate warning on Web UI if drillbits version mismatch is detected -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4864'>DRILL-4864</a>] - Add ANSI format for date/time functions -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4956'>DRILL-4956</a>] - Temporary tables support -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4980'>DRILL-4980</a>] - Upgrading of the approach of parquet date correctness status detection -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4987'>DRILL-4987</a>] - Use ImpersonationUtil in RemoteFunctionRegistry -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5043'>DRILL-5043</a>] - Function that returns a unique id per session/connection similar to MySQL's CONNECTION_ID() -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5052'>DRILL-5052</a>] - Option to debug generated Java code using an IDE -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5056'>DRILL-5056</a>] - UserException does not write full message to log -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5065'>DRILL-5065</a>] - Optimize count(*) queries on MapR-DB JSON Tables -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5080'>DRILL-5080</a>] - Create a memory-managed version of the External Sort operator -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5085'>DRILL-5085</a>] - Add / update description for dynamic UDFs directories in drill-env.sh and drill-module.conf -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5098'>DRILL-5098</a>] - Improving fault tolerance for connection between client and foreman node. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5108'>DRILL-5108</a>] - Reduce output from Maven git-commit-id-plugin -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5116'>DRILL-5116</a>] - Enable generated code debugging in each Drill operator -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5123'>DRILL-5123</a>] - Write query profile after sending final response to client to improve latency -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5126'>DRILL-5126</a>] - Provide simplified, unified "cluster fixture" for tests -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5172'>DRILL-5172</a>] - Display elapsed time for queries in the UI -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5195'>DRILL-5195</a>] - Publish Operator and MajorFragment Stats in Profile page -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5215'>DRILL-5215</a>] - CTTAS: disallow temp tables in view expansion logic -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5221'>DRILL-5221</a>] - cancel message is delayed until queryid or data is received -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5254'>DRILL-5254</a>] - Enhance default reduction factors in optimizer -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5255'>DRILL-5255</a>] - Unit tests fail due to CTTAS temporary name space checks -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5257'>DRILL-5257</a>] - Provide option to save query profiles sync, async or not at all -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5258'>DRILL-5258</a>] - Allow "extended" mock tables access from SQL queries -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5259'>DRILL-5259</a>] - Allow listing a user-defined number of profiles -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5260'>DRILL-5260</a>] - Refinements to new "Cluster Fixture" test framework -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5290'>DRILL-5290</a>] - Provide an option to build operator table once for built-in static functions and reuse it across queries. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5301'>DRILL-5301</a>] - Add server metadata API -</li> -</ul> - -<h2> New Feature -</h2> -<ul> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4935'>DRILL-4935</a>] - Allow drillbits to advertise a configurable host address to Zookeeper -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4979'>DRILL-4979</a>] - Make dataport configurable -</li> -</ul> - -<h2> Task -</h2> -<ul> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5354'>DRILL-5354</a>] - Create CTTAS Documentaion -</li> -</ul> - - \ No newline at end of file