http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/_docs/rn/010-1.11.0-rn.md ---------------------------------------------------------------------- diff --git a/_docs/rn/010-1.11.0-rn.md b/_docs/rn/010-1.11.0-rn.md new file mode 100644 index 0000000..378cb47 --- /dev/null +++ b/_docs/rn/010-1.11.0-rn.md @@ -0,0 +1,297 @@ +--- +title: "Apache Drill 1.11.0 Release Notes" +parent: "Release Notes" +--- + +**Release date:** July 31, 2017 + +Today, we're happy to announce the availability of Drill 1.11.0. You can download it [here](https://drill.apache.org/download/). + +## New Features and Improvements +This release of Drill provides the following new features and improvements: + +- Cryptography-related functions. (DRILL-5634) +- Spill to disk for the hash aggregate operator. (DRILL-5457) +- Format plugin support for PCAP files. (DRILL-5432) +- Ability to change the HDFS block Size for Parquet files. (DRILL-5379) +- Ability to store query profiles in memory. (DRILL-5481) +- Configurable CTAS directory and file permissions option. (DRILL-5391) +- Support for network encryption. (DRILL-4335) +- Relative paths stored in the metadata file. (DRILL-3867) +- Support for ANSI_QUOTES. (DRILL-3510) + + +The following sections list additional bug fixes and improvements: + +<h2> Sub-task +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3250'>DRILL-3250</a>] - Drill fails to compare multi-byte characters from hive table +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4301'>DRILL-4301</a>] - OOM : Unable to allocate sv2 for 1000 records, and not enough batchGroups to spill. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5008'>DRILL-5008</a>] - Refactor, document and simplify ExternalSortBatch +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5011'>DRILL-5011</a>] - External Sort Batch memory use depends on record width +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5014'>DRILL-5014</a>] - ExternalSortBatch cache size, spill count differs from config setting +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5019'>DRILL-5019</a>] - ExternalSortBatch spills all batches to disk even if even one spills +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5020'>DRILL-5020</a>] - ExternalSortBatch has inconsistent notions of the memory limit +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5022'>DRILL-5022</a>] - ExternalSortBatch sets two different limits for "copier" memory +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5023'>DRILL-5023</a>] - ExternalSortBatch does not spill fully, throws off spill calculations +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5025'>DRILL-5025</a>] - ExternalSortBatch provides weak control over spill file size +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5026'>DRILL-5026</a>] - ExternalSortBatch uses two memory allocators; one will do +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5027'>DRILL-5027</a>] - ExternalSortBatch is inefficient: rewrites data unnecessarily +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5055'>DRILL-5055</a>] - External Sort does not delete spill file if error occurs during close +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5062'>DRILL-5062</a>] - External sort refers to the deprecated HDFS fs.default.name param +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5066'>DRILL-5066</a>] - External sort attempts to retry sv2 memory alloc, even if can never succeed +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5210'>DRILL-5210</a>] - External Sort BatchGroup leaks memory if an OOM occurs during read +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5285'>DRILL-5285</a>] - Provide detailed, accurate estimate of size consumed by a record batch +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5312'>DRILL-5312</a>] - "Record batch sizer" does not include overhead for variable-sized vectors +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5319'>DRILL-5319</a>] - Refactor FragmentContext and OptionManager for unit testing +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5320'>DRILL-5320</a>] - Refactor OptionManager for unit testing +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5321'>DRILL-5321</a>] - Refactor FragmentContext for unit testing +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5322'>DRILL-5322</a>] - Provide an OperatorFixture for sub-operator unit testing setup +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5323'>DRILL-5323</a>] - Provide test tools to create, populate and compare row sets +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5324'>DRILL-5324</a>] - Provide simplified column reader/writer for use in tests +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5331'>DRILL-5331</a>] - NPE in FunctionImplementationRegistry.findDrillFunction() if dynamic UDFs disabled +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5342'>DRILL-5342</a>] - Refactor "managed" external sort for unit tests +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5567'>DRILL-5567</a>] - Review changes for DRILL 5514 +</li> +</ul> + +<h2> Bug +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3867'>DRILL-3867</a>] - Store relative paths in metadata file +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4039'>DRILL-4039</a>] - Query fails when non-ascii characters are used in string literals +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4347'>DRILL-4347</a>] - Planning time for query64 from TPCDS test suite has increased 10 times compared to 1.4 release +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4511'>DRILL-4511</a>] - refresh over empty folder results in error, we need a better error message +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4678'>DRILL-4678</a>] - Tune metadata by generating a dispatcher at runtime +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4720'>DRILL-4720</a>] - MINDIR() and IMINDIR() functions return no results with metadata cache +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4722'>DRILL-4722</a>] - Fix EqualityVisitor for interval day expressions with millis +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4755'>DRILL-4755</a>] - StringIndexOutOfBoundsException seen with CONVERT_FROM function +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4903'>DRILL-4903</a>] - Implicit columns are shown when Jdbc plugin is enabled +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4970'>DRILL-4970</a>] - Wrong results when casting double to bigint or int +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4971'>DRILL-4971</a>] - Query encounters system error, when there aren't eval subexpressions of any function in boolean and/or expressions +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5005'>DRILL-5005</a>] - Potential issues with external sort info in query profile +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5083'>DRILL-5083</a>] - RecordIterator can sometimes restart a query on close +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5130'>DRILL-5130</a>] - UNION ALL difference in results +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5140'>DRILL-5140</a>] - Fix CompileException in run-time generated code when record batch has large number of fields. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5160'>DRILL-5160</a>] - Memory leak in Parquet async reader when Snappy fails +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5164'>DRILL-5164</a>] - Equi-join query results in CompileException when inputs have large number of columns +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5165'>DRILL-5165</a>] - wrong results - LIMIT ALL and OFFSET clause in same query +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5213'>DRILL-5213</a>] - Prepared statement for actual query is missing the query text +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5226'>DRILL-5226</a>] - External Sort encountered an error while spilling to disk +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5229'>DRILL-5229</a>] - Upgrade kudu client to org.apache.kudu:kudu-client:1.2.0 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5234'>DRILL-5234</a>] - External sort's spilling functionality does not work when the spilled columns contains a map type column +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5284'>DRILL-5284</a>] - Roll-up of final fixes for managed sort +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5297'>DRILL-5297</a>] - Print the plan text when plan pattern check fails in unit tests +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5311'>DRILL-5311</a>] - C++ connector connect doesn't check handshake result for timeout +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5316'>DRILL-5316</a>] - C++ Client Crashes When drillbitsVector.count is 0 after zoo_get_children completed with ZOK +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5330'>DRILL-5330</a>] - NPE in FunctionImplementationRegistry.functionReplacement() +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5344'>DRILL-5344</a>] - External sort priority queue copier fails with an empty batch +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5349'>DRILL-5349</a>] - TestParquetWriter unit tests fail with synchronous parquet reader +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5359'>DRILL-5359</a>] - ClassCastException when push down filter on the output of flatten into parquet scan +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5368'>DRILL-5368</a>] - Memory leak in C++ server metadata handler +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5369'>DRILL-5369</a>] - Missing initialization for ServerMetaContext +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5373'>DRILL-5373</a>] - Drill JDBC error in the process of connection via SQuirrel: java.lang.NoClassDefFoundError: javax/validation/constraints/NotNull +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5375'>DRILL-5375</a>] - Nested loop join: return correct result for left join +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5378'>DRILL-5378</a>] - Put more information into SchemaChangeException when HashJoin hit SchemaChangeException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5385'>DRILL-5385</a>] - Vector serializer fails to read saved SV2 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5387'>DRILL-5387</a>] - TestBitBitKerberos and TestUserBitKerberos cause sporadic unit test failures +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5395'>DRILL-5395</a>] - Query on MapR-DB table fails with NPE due to an issue with assignment logic +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5397'>DRILL-5397</a>] - Random Error : Unable to get holder type for minor type [LATE] and mode [OPTIONAL] +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5399'>DRILL-5399</a>] - Fix race condition in DrillComplexWriterFuncHolder +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5409'>DRILL-5409</a>] - Update MapR version to 5.2.1-mapr +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5413'>DRILL-5413</a>] - DrillConnectionImpl.isReadOnly() throws NullPointerException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5419'>DRILL-5419</a>] - Calculate return string length for literals & some string functions +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5420'>DRILL-5420</a>] - all cores at 100% of all servers +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5424'>DRILL-5424</a>] - Fix IOBE for reverse function +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5428'>DRILL-5428</a>] - submit_plan fails after Drill 1.8 script revisions +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5429'>DRILL-5429</a>] - Improve query performance for MapR DB JSON Tables +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5450'>DRILL-5450</a>] - Fix initcap function to convert upper case characters correctly +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5496'>DRILL-5496</a>] - Must restart drillbits whenever a secure Hive metastore is restarted +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5498'>DRILL-5498</a>] - CSV text reader does not handle duplicate header names +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5523'>DRILL-5523</a>] - Revert if condition in UnionAllRecordBatch changed in DRILL-5419 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5533'>DRILL-5533</a>] - Fix flag assignment in FunctionInitializer.checkInit() method +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5537'>DRILL-5537</a>] - Display columns alias for queries with sum() when RDBMS storage plugin is enabled +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5538'>DRILL-5538</a>] - Create TopProject with validatedNodeType after PHYSICAL phase +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5541'>DRILL-5541</a>] - C++ Client Crashes During Simple "Man in the Middle" Attack Test with Exploitable Write AV +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5544'>DRILL-5544</a>] - Out of heap running CTAS against text delimited +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5560'>DRILL-5560</a>] - Create configuration file for distribution specific configuration +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5577'>DRILL-5577</a>] - Column alias are ignored when Storage Plugin is enabled +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5587'>DRILL-5587</a>] - Validate Parquet blockSize and pageSize configured with SYSTEM/SESSION option +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5589'>DRILL-5589</a>] - JDBC client crashes after successful authentication if trace logging is enabled. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5590'>DRILL-5590</a>] - Drill return IndexOutOfBoundsException when a (Text) file > 4096 rows +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5599'>DRILL-5599</a>] - Notify StatusHandlerListener that batch sending has failed even if channel is still open +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5616'>DRILL-5616</a>] - Hash Agg Spill: OOM while reading irregular varchar data +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5659'>DRILL-5659</a>] - C++ Client (master) behavior is unstable resulting incorrect result or exception in API calls +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5665'>DRILL-5665</a>] - planner.force_2phase.aggr Set to TRUE for HashAgg may cause wrong results for VARIANCE and STD_DEV +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5668'>DRILL-5668</a>] - C++ connector crash when query error message is too long +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5669'>DRILL-5669</a>] - Multiple TPCH queries failed due to OOM +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5678'>DRILL-5678</a>] - Undefined behavior due to un-initialized values in ServerMetaContext +</li> +</ul> + +<h2> Improvement +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2974'>DRILL-2974</a>] - Make OutOfMemoryException an unchecked exception and remove OutOfMemoryRuntimeException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3510'>DRILL-3510</a>] - Add ANSI_QUOTES option so that Drill's SQL Parser will recognize ANSI_SQL identifiers +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5056'>DRILL-5056</a>] - UserException does not write full message to log +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5080'>DRILL-5080</a>] - Create a memory-managed version of the External Sort operator +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5163'>DRILL-5163</a>] - External sort on Mac creates a separate child process per spill via HDFS FS +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5315'>DRILL-5315</a>] - Small Comment Typo in drillClient.hpp +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5318'>DRILL-5318</a>] - Create a sub-operator test framework +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5325'>DRILL-5325</a>] - Implement sub-operator unit tests for managed external sort +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5351'>DRILL-5351</a>] - Excessive bounds checking in the Parquet reader +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5352'>DRILL-5352</a>] - Extend test framework profile parser printer for multi-fragment queries +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5355'>DRILL-5355</a>] - Misc. code cleanup +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5356'>DRILL-5356</a>] - Refactor Parquet Record Reader +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5379'>DRILL-5379</a>] - Set Hdfs Block Size based on Parquet Block Size +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5391'>DRILL-5391</a>] - CTAS: make folder and file permission configurable +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5394'>DRILL-5394</a>] - Optimize query planning for MapR-DB tables by caching row counts +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5415'>DRILL-5415</a>] - Improve Fixture Builder to configure client properties and keep collection type properties for server +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5423'>DRILL-5423</a>] - Refactor ScanBatch to allow unit testing record readers +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5457'>DRILL-5457</a>] - Support Spill to Disk for the Hash Aggregate Operator +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5481'>DRILL-5481</a>] - Allow Drill to persist profiles in-memory only with a max capacity +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5485'>DRILL-5485</a>] - Remove WebServer dependency on DrillClient +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5504'>DRILL-5504</a>] - Vector validator to diagnose offset vector issues +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5512'>DRILL-5512</a>] - Standardize error handling in ScanBatch +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5514'>DRILL-5514</a>] - Enhance VectorContainer to merge two row sets +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5516'>DRILL-5516</a>] - Limit memory usage for Hbase reader +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5517'>DRILL-5517</a>] - Provide size-aware set operations in value vectors +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5518'>DRILL-5518</a>] - Roll-up of a number of test framework enhancements +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5545'>DRILL-5545</a>] - Add findbugs to build +</li> +</ul> + +<h2> New Feature +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-291'>DRILL-291</a>] - Add SASL support for Drill +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4335'>DRILL-4335</a>] - Apache Drill should support network encryption - SASL encryption between Drill Client to Drillbit +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5432'>DRILL-5432</a>] - Added pcap-format support +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5634'>DRILL-5634</a>] - Add Crypto and Hash Functions +</li> +</ul> +
http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/_docs/rn/010-1.2.0-rn.md ---------------------------------------------------------------------- diff --git a/_docs/rn/010-1.2.0-rn.md b/_docs/rn/010-1.2.0-rn.md deleted file mode 100644 index 572db45..0000000 --- a/_docs/rn/010-1.2.0-rn.md +++ /dev/null @@ -1,509 +0,0 @@ ---- -title: "Apache Drill 1.2.0 Release Notes" -parent: "Release Notes" ---- - -**Release date:** October 16, 2015 - -Today we're happy to announce the availability of Drill 1.2.0, providing more than 150 bug fixes and a number of new features. These release notes include links to the following Jira issues: - -* [Enhancements and bug fixes]({{site.baseurl}}/docs/apache-drill-1-2-0-release-notes/#enhancements-and-bug-fixes) -* [Important unresolved issues]({{site.baseurl}}/docs/apache-drill-1-2-0-release-notes/#important-unresolved-issues) - -## Noteworthy New Features in Drill 1.2.0 - -This release of Drill introduces a number of enhancements, including the following ones: - -* Support for JDBC data sources, such as MySQL, through a [new JDBC Storage plugin]({{site.baseurl}}/docs/rdbms-storage-plugin/#example:-working-with-mysql) -* Improvements in the Drill JDBC driver including inclusion of -[Javadocs]({{site.baseurl}}/api/1.2/jdbc/) and better application dependency compatibility -* Enhancements to Avro file formats - * [Support for complex data types](https://issues.apache.org/jira/browse/DRILL-3565), such as UNION and MAP - * [Optimized Avro file processing](https://issues.apache.org/jira/browse/DRILL-3720) (block-wise) -* Partition pruning improvements -* A number of new [SQL window functions]({{site.baseurl}}/docs/sql-window-functions) - * NTILE - * LAG and LEAD - * FIRST_VALUE and LAST_VALUE -* [HTTPS support]({{site.baseurl}}/docs/configuring-web-console-and-rest-api-security/) for Web Console operations -* Performance improvements for [querying HBase]({{site.baseurl}}/docs/querying-hbase/#querying-big-endian-encoded-data), which includes leveraging [ordered byte encoding]({{site.baseurl}}/docs/querying-hbase/#leveraging-hbase-ordered-byte-encoding) -* [Optimized reads]({{site.baseurl}}/docs/querying-hive/#optimizing-reads-of-parquet-backed-tables) of Parquet-backed, Hive tables -* Read support for the [Parquet INT96 type]({{site.baseurl}}/docs/parquet-format/#about-int96-support) and a new TIMESTAMP_IMPALA type used with the [CONVERT_FROM]({{site.baseurl}}/docs/supported-data-types/#data-types-for-convert_to-and-convert_from-functions) function decodes a timestamp from Hive or Impala. -* [Parquet metadata caching]({{site.baseurl}}/docs/optimizing-parquet-metadata-reading/) to improve query performance on a large number of files -* [DROP TABLE]({{site.baseurl}}/docs/drop-table/) command -* Improved correlated subqueries -* Union Distinct -* Improved LIMIT processing - -## Enhancements and Bug Fixes - -<h2> Sub-task -</h2> -<ul> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3364'>DRILL-3364</a>] - Prune scan range if the filter is on the leading field with byte comparable encoding -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3553'>DRILL-3553</a>] - add support for LEAD and LAG window functions -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3608'>DRILL-3608</a>] - add support for FIRST_VALUE and LAST_VALUE -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3616'>DRILL-3616</a>] - Memory leak in a cleanup code after canceling queries with window functions spilling to disk -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3619'>DRILL-3619</a>] - Add support for NTILE window function -</li> -</ul> - -<h2> Bug -</h2> -<ul> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-343'>DRILL-343</a>] - Document update required to describe sqlline usage for Windows -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1395'>DRILL-1395</a>] - UNION ALL query fails "while setting up Foreman" -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1457'>DRILL-1457</a>] - Limit operator optimization : push limit operator past exchange operator -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1651'>DRILL-1651</a>] - Allow Filter to push past Project with ITEM operator -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1773'>DRILL-1773</a>] - Issues when using JAVA code through Drill JDBC driver -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1795'>DRILL-1795</a>] - TPCH SF1000 Queries fail with DecoderException: java.lang.NullPointerException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1816'>DRILL-1816</a>] - Scan Error with JSON on large no of records with Complex Types -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1831'>DRILL-1831</a>] - LIKE operator not working with SQL [charlist] Wildcard -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1929'>DRILL-1929</a>] - After canceling query in sqlline subsequent query in same session hangs -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1938'>DRILL-1938</a>] - Fix error message when reserved words are used in query. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1976'>DRILL-1976</a>] - Possible Memory Leak in drill jdbc client when dealing with wide columns (5000 chars long) -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2050'>DRILL-2050</a>] - Accountor closed with outstanding buffer -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2053'>DRILL-2053</a>] - Column names are case sensitive if column is coming from WITH clause -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2095'>DRILL-2095</a>] - Order by on a repeated index inside a sub query results in an NPE -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2098'>DRILL-2098</a>] - correct startup on windows -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2166'>DRILL-2166</a>] - left join with complex type throw ClassTransformationException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2190'>DRILL-2190</a>] - Failure to order by function if DISTINCT clause is present -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2274'>DRILL-2274</a>] - Unable to allocate sv2 buffer after repeated attempts : JOIN, Order by used in query -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2304'>DRILL-2304</a>] - Case sensitivity - system and session options are case sensitive -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2312'>DRILL-2312</a>] - JDBC driver returning incorrect data after extended usage -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2313'>DRILL-2313</a>] - Query fails when one of the operands is a DATE literal without an explicit cast -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2318'>DRILL-2318</a>] - Query fails when an ORDER BY clause is used with WITH-CLAUSE -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2361'>DRILL-2361</a>] - Column aliases cannot include dots -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2398'>DRILL-2398</a>] - IS NOT DISTINCT FROM predicate returns incorrect result when used as a join filter -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2418'>DRILL-2418</a>] - Memory leak during execution if comparison function is not found -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2445'>DRILL-2445</a>] - JDBC : Connection.rollback method currently throws UnsuportedOperationException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2451'>DRILL-2451</a>] - JDBC : Connection.commit throws an UnsupportedOperationException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2459'>DRILL-2459</a>] - INFO._SCHEMA's CHARACTER_MAXIMUM_LENGTH is -1 for type CHAR -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2482'>DRILL-2482</a>] - JDBC : calling getObject when the actual column type is 'NVARCHAR' results in NoClassDefFoundError -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2519'>DRILL-2519</a>] - INFORMATION_SCHEMA.COLUMNS is missing <interval_qualifier> info -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2522'>DRILL-2522</a>] - Implement INFORMATION_SCHEMA.* enough for relevant tools [bug] -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2530'>DRILL-2530</a>] - getColumns() doesn't return right COLUMN_SIZE for INTERVAL types -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2588'>DRILL-2588</a>] - Profile UI: "First Start" field contains incorrect data -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2625'>DRILL-2625</a>] - org.apache.drill.common.StackTrace should follow standard stacktrace format -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2643'>DRILL-2643</a>] - HashAggBatch/HashAggTemplate call incoming.cleanup() twice resulting in warnings -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2644'>DRILL-2644</a>] - Data Types page should list and describe all data types -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2649'>DRILL-2649</a>] - Math and Trig page seems to refer to types that are not Drill SQL types -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2650'>DRILL-2650</a>] - Cancelled queries json profile shows query end time occurs before fragments end time -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2688'>DRILL-2688</a>] - Use of ORDER BY on right side of Union All results in SqlValidatorException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2721'>DRILL-2721</a>] - Identify, fix _existing_ INFO._SCHEMA columns in conflict with SQL spec. by 1.0 -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2722'>DRILL-2722</a>] - Query profile data not being sent/received (and web UI not updated) -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2724'>DRILL-2724</a>] - Implicit cast test fails in Union All query (reports type mismatch) -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2727'>DRILL-2727</a>] - CTAS select * from CSV file results in Exception -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2737'>DRILL-2737</a>] - Sqlline throws Runtime exception when JDBC ResultSet throws a SQLException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2745'>DRILL-2745</a>] - Query returns IOB Exception when JSON data with empty arrays is input to flatten function -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2760'>DRILL-2760</a>] - Quoted strings from CSV file appear in query output in different forms -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2777'>DRILL-2777</a>] - CTAS, order by and flatten of repeated list result in ExpandConversionRule error -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2800'>DRILL-2800</a>] - Performance regression introduced with commit: a6df26a (Patch for DRILL-2512) -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2802'>DRILL-2802</a>] - Projecting dir[n] by itself results in projecting of all columns -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2815'>DRILL-2815</a>] - Some PathScanner logging, misc. cleanup. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2837'>DRILL-2837</a>] - Resolve what Statement.cancel() really should do -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2843'>DRILL-2843</a>] - Reading empty CSV file fails with error (rather than yielding zero rows) -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2851'>DRILL-2851</a>] - Memory LEAK - FLATTEN function fails when input array has 99,999 integer type elements -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2852'>DRILL-2852</a>] - CASTing the column 'dir0' in view causes partition pruning to fail -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2862'>DRILL-2862</a>] - Convert_to/Convert_From throw assertion when an incorrect encoding type is specified -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2864'>DRILL-2864</a>] - Unable to cast string literal with the valid value in ISO 8601 format to interval -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2867'>DRILL-2867</a>] - Session level parameter drill.exec.testing.controls appears to be set even though it was not -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2890'>DRILL-2890</a>] - C++ Client: Update query submitter usage to clarify using authentication -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2924'>DRILL-2924</a>] - IOBException when querying a table which has 1 file and a subfolder with 1 file -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2935'>DRILL-2935</a>] - Casting varchar to varbinary fails -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2937'>DRILL-2937</a>] - Result for integer values from json files contains "$numberLong" in front of value -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2949'>DRILL-2949</a>] - TPC-DS queries 1 and 30 fail with CannotPlanException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3030'>DRILL-3030</a>] - Foreman hangs trying to cancel non-root fragments -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3045'>DRILL-3045</a>] - Drill is not partition pruning due to internal off-heap memory limit for planning phase -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3056'>DRILL-3056</a>] - Numeric literal in an IN list is casted to decimal even when decimal type is disabled -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3076'>DRILL-3076</a>] - USING clause should not be supported in drill -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3095'>DRILL-3095</a>] - Memory Leak : Failure while closing accountor. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3096'>DRILL-3096</a>] - "State change requested from ... --> ... for " blank after "for" -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3122'>DRILL-3122</a>] - Changing a session option to default value results in status as changed -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3133'>DRILL-3133</a>] - MergingRecordBatch can leak memory if query is canceled before batches in rawBatches were loaded -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3141'>DRILL-3141</a>] - sqlline throws an exception when query is cancelled -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3151'>DRILL-3151</a>] - ResultSetMetaData not as specified by JDBC (null/dummy value, not ""/etc.) -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3153'>DRILL-3153</a>] - DatabaseMetaData.getIdentifierQuoteString() returns (standard) double-quote, not Drill's back quote -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3156'>DRILL-3156</a>] - Calcite tracing is broken in Drill -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3160'>DRILL-3160</a>] - Make JDBC Javadoc documentation available to users -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3163'>DRILL-3163</a>] - Fix hang/ leak issue exposed by TestDrillbitResilience#foreman_runTryEnd -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3189'>DRILL-3189</a>] - Disable ALLOW PARTIAL/DISALLOW PARTIAL in window function grammar -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3243'>DRILL-3243</a>] - Need a better error message - Use of alias in window function definition -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3257'>DRILL-3257</a>] - TPCDS query 74 results in a StackOverflowError on Scale Factor 1 -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3271'>DRILL-3271</a>] - Hive : Tpch 01.q fails with a verification issue for SF100 dataset -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3284'>DRILL-3284</a>] - Document incompatibility between drill's to_date and hive's unix_timestamp -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3287'>DRILL-3287</a>] - Changing session level parameter back to the default value does not change it's status back to DEFAULT -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3292'>DRILL-3292</a>] - SUM(constant) OVER(...) returns wrong results -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3297'>DRILL-3297</a>] - Using rank, dense_rank, percent_rank, cume_dist, row_number window functions without OVER clause results in cryptic schema change error -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3312'>DRILL-3312</a>] - PageReader.allocatePageData() calls BufferAllocator.buffer(int) but doesn't check if the result is null -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3322'>DRILL-3322</a>] - Something broken in or around RPC timeout setup? -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3347'>DRILL-3347</a>] - Resolve: ResultSet.getObject(...) for VARCHAR returns ...hadoop.io.Text, not String -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3348'>DRILL-3348</a>] - NPE when two different window functions are used in projection list and order by clauses -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3360'>DRILL-3360</a>] - Window function defined within another window function -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3382'>DRILL-3382</a>] - CTAS with order by clause fails with IOOB exception -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3393'>DRILL-3393</a>] - Quotes not being recognized in tab delimited (tsv) files -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3412'>DRILL-3412</a>] - Projections are not getting push down below Window operator -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3441'>DRILL-3441</a>] - CompliantTextRecordReader#isStarQuery loops indefinitely -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3445'>DRILL-3445</a>] - BufferAllocator.buffer() implementations should throw an OutOfMemoryRuntimeException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3448'>DRILL-3448</a>] - typo in QueryManager.DrillbitStatusListener will cause the Foreman to hang if a Drillbit dies -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3455'>DRILL-3455</a>] - If a drillbit, that contains fragments for the current query, dies the QueryManager will fail the query even if those fragments already finished successfully -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3463'>DRILL-3463</a>] - Unit test of project pushdown in TestUnionAll should put more precisely plan attribute in plan verification. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3464'>DRILL-3464</a>] - Index out of bounds exception while performing concat() -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3476'>DRILL-3476</a>] - Filter on nested element gives wrong results -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3479'>DRILL-3479</a>] - Sqlline from drill v1.1.0 displays version as 1.0.0 -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3483'>DRILL-3483</a>] - Clarify CommonConstants' constants. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3484'>DRILL-3484</a>] - Error using functions with no parameters when `drill.exec.functions.cast_empty_string_to_null` is set to true -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3497'>DRILL-3497</a>] - Throw UserException#validationError for errors when modifying options -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3500'>DRILL-3500</a>] - Provide additional information while registering storage plugin optimizer rules -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3502'>DRILL-3502</a>] - JDBC driver can cause conflicts -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3503'>DRILL-3503</a>] - Make PruneScanRule have a pluggable partitioning mechanism -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3509'>DRILL-3509</a>] - Empty JSON files trigger exception when used in a union -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3537'>DRILL-3537</a>] - Empty Json file can potentially result into wrong results -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3542'>DRILL-3542</a>] - Rebase Drill on Calcite 1.4.0 release -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3550'>DRILL-3550</a>] - Incorrect results reading complex data with schema change -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3551'>DRILL-3551</a>] - CTAS from complex Json source with schema change is not written (and hence not read back ) correctly -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3554'>DRILL-3554</a>] - Union over TIME and TIMESTAMP values throws SchemaChangeException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3555'>DRILL-3555</a>] - Changing defaults for planner.memory.max_query_memory_per_node causes queries with window function to fail -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3557'>DRILL-3557</a>] - Reading empty CSV file fails with SYSTEM ERROR -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3566'>DRILL-3566</a>] - Calling Connection.prepareStatement throws a ClassCastException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3573'>DRILL-3573</a>] - Enable TPC-H query 17 in unit tests -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3574'>DRILL-3574</a>] - Empty Over Clause should trigger Union-Exchange to be added below -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3579'>DRILL-3579</a>] - Drill on Hive query fails if partition table has __HIVE_DEFAULT_PARTITION__ -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3580'>DRILL-3580</a>] - wrong plan for window function queries containing function(col1 + colb) -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3583'>DRILL-3583</a>] - SUM on varchar column produces incorrect error -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3595'>DRILL-3595</a>] - Wrong results returned by query that uses LEAD window function -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3596'>DRILL-3596</a>] - Allow only (<expression>) or (<expression>, 1) for LEAD and LAG window functions as input parameters -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3599'>DRILL-3599</a>] - Wrong results returned by LEAD(col-name, -1) -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3601'>DRILL-3601</a>] - LEAD function used without OVER clause should not plan -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3604'>DRILL-3604</a>] - LEAD(<varchar-column>) returns IOB Exception -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3605'>DRILL-3605</a>] - Wrong results - Lead(char-column) -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3606'>DRILL-3606</a>] - Wrong results - Lead(char-column) without PARTITION BY clause -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3617'>DRILL-3617</a>] - Apply "shading" to JDBC-all Jar file to avoid version conflicts -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3621'>DRILL-3621</a>] - Wrong results when Drill on Hbase query contains rowkey "or" or "IN" -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3622'>DRILL-3622</a>] - With user authentication enabled, only admin users should be able to change system options -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3635'>DRILL-3635</a>] - IllegalArgumentException - not a Parquet file (too small) -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3638'>DRILL-3638</a>] - Incorrect results LEAD(<float-type-column>) -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3642'>DRILL-3642</a>] - External Sort will leak memory if query is cancelled while it's spilling to disk -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3643'>DRILL-3643</a>] - NTILE(0) returns RuntimeException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3645'>DRILL-3645</a>] - typo in drill documentation -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3648'>DRILL-3648</a>] - NTILE function returns incorrect results -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3649'>DRILL-3649</a>] - LEAD , LAG , NTILE , FIRST_VALUE , LAST_VALUE report RuntimeException for missing OVER clause -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3653'>DRILL-3653</a>] - Assert in a query with both avg aggregate and avg window aggregate functions -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3654'>DRILL-3654</a>] - FIRST_VALUE(<char-column>/<varchar-column>) returns IOB Exception -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3657'>DRILL-3657</a>] - Wrong result with SUM(1) window function when multiple partitions are present -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3658'>DRILL-3658</a>] - Missing org.apache.hadoop in the JDBC jar -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3663'>DRILL-3663</a>] - Drill View aliases being lost via âorder byâ -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3667'>DRILL-3667</a>] - Random Assertion Error while planning -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3668'>DRILL-3668</a>] - Incorrect results FIRST_VALUE function -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3673'>DRILL-3673</a>] - Memory leak in parquet writer on CTAS -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3677'>DRILL-3677</a>] - Wrong result with LEAD window function when used in multiple windows in the same query -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3679'>DRILL-3679</a>] - IOB Exception : when window functions used in outer and inner query -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3680'>DRILL-3680</a>] - window function query returns Incorrect results -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3684'>DRILL-3684</a>] - CTAS : Memory Leak when using CTAS with tpch sf100 -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3685'>DRILL-3685</a>] - Failure to execute query with NTILE and ROW_NUMBER window functions with different window definitions -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3689'>DRILL-3689</a>] - incorrect results : aggregate AVG returns wrong results over results returned by LEAD function. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3690'>DRILL-3690</a>] - Partitioning pruning produces wrong results when there are nested expressions in the filter -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3691'>DRILL-3691</a>] - CTAS Memory Leak : IllegalStateException -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3700'>DRILL-3700</a>] - Exception in a query with multiple fist_value window functions with different partitions -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3702'>DRILL-3702</a>] - PartitionPruning hit ClassCastException in Interpreter when the pruning filter expression is of non-nullable type. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3707'>DRILL-3707</a>] - Fix for DRILL-3616 can cause a NullPointerException in ExternalSort cleanup -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3711'>DRILL-3711</a>] - Windows unit test failure on 1.2 snapshot -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3716'>DRILL-3716</a>] - Drill should push filter past aggregate in order to improve query performance. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3718'>DRILL-3718</a>] - quotes in .tsv trigger exception -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3719'>DRILL-3719</a>] - Adding negative sign in front of EXTRACT triggers Assertion Error -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3732'>DRILL-3732</a>] - Drill leaks memory if external sort hits out of disk space exception -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3735'>DRILL-3735</a>] - Directory pruning is not happening when number of files is larger than 64k -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3736'>DRILL-3736</a>] - Documentation for partition is misleading/wrong syntax -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3737'>DRILL-3737</a>] - CTAS from empty text file fails with NPE -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3746'>DRILL-3746</a>] - Hive query fails if the table contains external partitions -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3757'>DRILL-3757</a>] - Link to IntelliJ IDEA settings jar on the contributors guidelines page is broken. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3758'>DRILL-3758</a>] - InvalidRecordException while selecting from a table with multiple parquet file -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3767'>DRILL-3767</a>] - SchemaPath.getCompoundPath(String...strings) reverses it's input array -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3773'>DRILL-3773</a>] - Mongo RecordReader projection pushdown doesn't work past first level paths -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3778'>DRILL-3778</a>] - Add rest of DRILL-3160 (making JDBC Javadoc available) -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3779'>DRILL-3779</a>] - NPE during mergeAndSpill operation of external sort -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3781'>DRILL-3781</a>] - Using CURRENT_DATE in a group by throws a column not found error for hive tables and csv files -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3783'>DRILL-3783</a>] - Incorrect results : COUNT(<column-name>) over results returned by UNION ALL -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3784'>DRILL-3784</a>] - simple Jdbc program fails with NoClassDefFoundError -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3788'>DRILL-3788</a>] - Directory based partition pruning not taking effect with metadata caching -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3809'>DRILL-3809</a>] - PrelFinalizable.SHUTTLE causes ArrayIndexOutOfBoundsException when multiple queries are run concurrently -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3811'>DRILL-3811</a>] - AtomicRemainder incorrectly accounts for transferred allocations -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3817'>DRILL-3817</a>] - Refresh metadata does not work when used with sub schema -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3819'>DRILL-3819</a>] - Remove redundant filter for files start with "." -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3884'>DRILL-3884</a>] - Hive native scan has lower parallelization leading to performance degradation -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3892'>DRILL-3892</a>] - Metadata cache not being leveraged when partition pruning is taking place -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3901'>DRILL-3901</a>] - Performance regression with doing Explain of COUNT(*) over 100K files -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3917'>DRILL-3917</a>] - IllegalArgumentException when running query after creating metadata cache -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3918'>DRILL-3918</a>] - Avoid extra loading of the metadata cache file -</li> -</ul> - -<h2> Improvement -</h2> -<ul> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1666'>DRILL-1666</a>] - Provide Test cases for Mongo Storage plugin -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2332'>DRILL-2332</a>] - Drill should be consistent with Implicit casting rules across data formats -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2424'>DRILL-2424</a>] - Ignore hidden files in directory path -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2699'>DRILL-2699</a>] - Collect all cleanup errors before reporting a failure to the client -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2748'>DRILL-2748</a>] - Filter is not pushed down into subquery with the group by -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2908'>DRILL-2908</a>] - Support reading the Parquet int 96 type -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3121'>DRILL-3121</a>] - Hive partition pruning is not happening -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3209'>DRILL-3209</a>] - [Umbrella] Plan reads of Hive tables as native Drill reads when a native reader for the underlying table format exists -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3295'>DRILL-3295</a>] - UNION (distinct type) is supported now -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3341'>DRILL-3341</a>] - Move OperatorWrapper list and FragmentWrapper list creation to ProfileWrapper ctor -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3354'>DRILL-3354</a>] - TestBuilder can check if the number of result batches equals some expected value -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3450'>DRILL-3450</a>] - Rename NonRootStatusReporter to FragmentStatusReporter -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3467'>DRILL-3467</a>] - Restrict 'show databases' based on underlying permissions. -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3536'>DRILL-3536</a>] - Add support for LEAD, LAG, NTILE, FIRST_VALUE and LAST_VALUE window functions -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3545'>DRILL-3545</a>] - Need documentation on BINARY_STRING and STRING_BINARY functions -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3565'>DRILL-3565</a>] - Add support for Avro UNION type -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3589'>DRILL-3589</a>] - JDBC driver maven artifact includes a lot of unnecessary dependencies -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3652'>DRILL-3652</a>] - Need to document order of operations with window functions and flatten -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3720'>DRILL-3720</a>] - Avro Record Reader should process Avro files by per block basis -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3888'>DRILL-3888</a>] - Build test jars for all Drill Modules -</li> -</ul> - -<h2> New Feature -</h2> -<ul> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2743'>DRILL-2743</a>] - Parquet file metadata caching -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3180'>DRILL-3180</a>] - Apache Drill JDBC storage plugin to query rdbms systems such as MySQL and Netezza from Apache Drill -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3470'>DRILL-3470</a>] - Add support for multiple partition by clauses for window functions in the same query -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3492'>DRILL-3492</a>] - Add support for encoding of Drill data types into byte ordered format -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3725'>DRILL-3725</a>] - Add HTTPS support for Drill web interface -</li> -</ul> - -<h2> Task -</h2> -<ul> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2693'>DRILL-2693</a>] - doc programmatically submit queries to Drill -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3683'>DRILL-3683</a>] - [Unit Test] Add expected plan for tests in TestWindowFunctions suite -</li> -<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3799'>DRILL-3799</a>] - Create Simple HBase Tutorial -</li> -</ul> - -## Important Unresolved Issues - -* The Drill error message about JSON syntax that appears when Drill cannot find the JDBC driver during configuration of the JDBC storage plugin is misleading. To configure the JDBC plugin, you must put the JDBC driver in the `<drill_installation_directory>/jars/3rdparty` directory. [DRILL-3985](https://issues.apache.org/jira/browse/DRILL-3958) -* The MySQL TEXT type is not supported. The popular classicmodels database uses the TEXT type, and therefore cannot be used as is until this issue is resolved. [DRILL-3956](https://issues.apache.org/jira/browse/DRILL-3956) - - - - - - - http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/_docs/rn/011-1.10.0-rn.md ---------------------------------------------------------------------- diff --git a/_docs/rn/011-1.10.0-rn.md b/_docs/rn/011-1.10.0-rn.md new file mode 100644 index 0000000..0f83cf3 --- /dev/null +++ b/_docs/rn/011-1.10.0-rn.md @@ -0,0 +1,290 @@ +--- +title: "Apache Drill 1.10.0 Release Notes" +parent: "Release Notes" +--- + +**Release date:** March 15, 2017 + +Today, we're happy to announce the availability of Drill 1.10.0. You can download it [here](https://drill.apache.org/download/). + +## New Features and Improvements +This release of Drill provides the following new features and improvements: + +- Support for the CREATE TEMPORARY TABLE AS (CTTAS) command. +- A JDBC connection option that improves fault tolerance when connecting directly to a Drill node from a client. +- The Web Console displays the Drill version and additional query profile statistics. +- Drill implicitly interprets the INT96 timestamp data type in Parquet files. +- Support for Kerberos authentication between the client and drillbit. + +The following sections list additional bug fixes and improvements: + +<h2> Sub-task +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4272'>DRILL-4272</a>] - When sort runs out of memory and query fails, resources are seemingly not freed +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4301'>DRILL-4301</a>] - OOM : Unable to allocate sv2 for 1000 records, and not enough batchGroups to spill. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4730'>DRILL-4730</a>] - Update JDBC DatabaseMetaData implementation to use new Metadata APIs +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5008'>DRILL-5008</a>] - Refactor, document and simplify ExternalSortBatch +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5011'>DRILL-5011</a>] - External Sort Batch memory use depends on record width +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5014'>DRILL-5014</a>] - ExternalSortBatch cache size, spill count differs from config setting +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5017'>DRILL-5017</a>] - Config param drill.exec.sort.external.batch.size is not used +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5019'>DRILL-5019</a>] - ExternalSortBatch spills all batches to disk even if even one spills +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5020'>DRILL-5020</a>] - ExternalSortBatch has inconsistent notions of the memory limit +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5022'>DRILL-5022</a>] - ExternalSortBatch sets two different limits for "copier" memory +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5023'>DRILL-5023</a>] - ExternalSortBatch does not spill fully, throws off spill calculations +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5025'>DRILL-5025</a>] - ExternalSortBatch provides weak control over spill file size +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5026'>DRILL-5026</a>] - ExternalSortBatch uses two memory allocators; one will do +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5027'>DRILL-5027</a>] - ExternalSortBatch is inefficient: rewrites data unnecessarily +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5055'>DRILL-5055</a>] - External Sort does not delete spill file if error occurs during close +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5062'>DRILL-5062</a>] - External sort refers to the deprecated HDFS fs.default.name param +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5066'>DRILL-5066</a>] - External sort attempts to retry sv2 memory alloc, even if can never succeed +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5210'>DRILL-5210</a>] - External Sort BatchGroup leaks memory if an OOM occurs during read +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5262'>DRILL-5262</a>] - NPE in managed external sort while spilling to disk +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5264'>DRILL-5264</a>] - Managed External Sort fails with OOM +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5267'>DRILL-5267</a>] - Managed external sort spills too often with Parquet data +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5285'>DRILL-5285</a>] - Provide detailed, accurate estimate of size consumed by a record batch +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5294'>DRILL-5294</a>] - Managed External Sort throws an OOM during the merge and spill phase +</li> +</ul> + +<h2> Bug +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1808'>DRILL-1808</a>] - Large compilation unit tests fails due to high memory allocation +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2293'>DRILL-2293</a>] - CTAS does not clean up when it fails +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3562'>DRILL-3562</a>] - Query fails when using flatten on JSON data where some documents have an empty array +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4578'>DRILL-4578</a>] - "children" missing from results of full scan over JSON data +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4764'>DRILL-4764</a>] - Parquet file with INT_16, etc. logical types not supported by simple SELECT +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4812'>DRILL-4812</a>] - Wildcard queries fail on Windows +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4850'>DRILL-4850</a>] - TPCDS Query 33 failed in the second and 3rd runs, but succeeded in the 1st run +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4872'>DRILL-4872</a>] - NPE from CTAS partitioned by a projected casted null +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4919'>DRILL-4919</a>] - Fix select count(1) / count(*) on csv with header +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4938'>DRILL-4938</a>] - Report UserException when constant expression reduction fails +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4963'>DRILL-4963</a>] - Issues when overloading Drill native functions with dynamic UDFs +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4982'>DRILL-4982</a>] - Hive Queries degrade when queries switch between different formats +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4994'>DRILL-4994</a>] - Prepared statement stopped working between 1.8.0 client and < 1.8.0 server +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4995'>DRILL-4995</a>] - Allow lazy init when dynamic UDF support is disabled +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4996'>DRILL-4996</a>] - Parquet Date auto-correction is not working in auto-partitioned parquet files generated by drill-1.6 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5005'>DRILL-5005</a>] - Potential issues with external sort info in query profile +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5015'>DRILL-5015</a>] - As per documentation, when issuing a list of drillbits in the connection string, we always attempt to connect only to the first one +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5032'>DRILL-5032</a>] - Drill query on hive parquet table failed with OutOfMemoryError: Java heap space +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5034'>DRILL-5034</a>] - Select timestamp from hive generated parquet always return in UTC +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5039'>DRILL-5039</a>] - NPE - CTAS PARTITION BY (<char-type-column>) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5040'>DRILL-5040</a>] - Interrupted CTAS should not succeed & should not create physical file on disk +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5044'>DRILL-5044</a>] - Fix retry logic to handle VersionMismatchException by not deleting jars in remote UDFs area +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5048'>DRILL-5048</a>] - Fix type mismatch error in case statement with null timestamp +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5050'>DRILL-5050</a>] - C++ client library has symbol resolution issues when loaded by a process that already uses boost::asio +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5051'>DRILL-5051</a>] - DRILL-5051: Fix incorrect result returned in nest query with offset specified +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5070'>DRILL-5070</a>] - Code gen: create methods in fixed order to allow test verification +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5081'>DRILL-5081</a>] - Excessive info level logging introduced in DRILL-4203 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5086'>DRILL-5086</a>] - ClassCastException when filter pushdown is used with a bigint or float column and metadata caching. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5088'>DRILL-5088</a>] - Error when reading DBRef column +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5091'>DRILL-5091</a>] - JDBC unit test fail on Java 8 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5094'>DRILL-5094</a>] - Assure Comparator to be transitive +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5097'>DRILL-5097</a>] - Using store.parquet.reader.int96_as_timestamp gives IOOB whereas convert_from works +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5104'>DRILL-5104</a>] - Foreman sets external sort memory allocation even for a physical plan +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5112'>DRILL-5112</a>] - Unit tests derived from PopUnitTestBase fail in IDE due to config errors +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5113'>DRILL-5113</a>] - Upgrade Maven RAT plugin to avoid annoying XML errors +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5117'>DRILL-5117</a>] - Compile error when query a json file with 1000+columns +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5119'>DRILL-5119</a>] - Update MapR version to 5.2.0.40963-mapr +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5121'>DRILL-5121</a>] - A memory leak is observed when exact case is not specified for a column in a filter condition +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5127'>DRILL-5127</a>] - Revert the fix for DRILL-4831 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5157'>DRILL-5157</a>] - Multiple Snappy versions on class path; causes unit test failures +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5159'>DRILL-5159</a>] - ProjectMergeRule in Drill should operate on RelNodes with same convention trait. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5164'>DRILL-5164</a>] - Equi-join query results in CompileException when inputs have large number of columns +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5167'>DRILL-5167</a>] - C++ connector does not set escape string for metadata search pattern +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5190'>DRILL-5190</a>] - Display planning and queued time for a query in its profile page +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5196'>DRILL-5196</a>] - Could not run a single MongoDB unit test case through command line or IDE +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5207'>DRILL-5207</a>] - Improve Parquet scan pipelining +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5208'>DRILL-5208</a>] - Finding path to java executable should be deterministic +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5218'>DRILL-5218</a>] - Support Disabling Heartbeats in C++ Client +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5224'>DRILL-5224</a>] - CTTAS: fix errors connected with system path delimiters (Windows) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5230'>DRILL-5230</a>] - Translation of millisecond duration into hours is incorrect +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5238'>DRILL-5238</a>] - CTTAS: unable to resolve temporary table if workspace is indicated without schema +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5242'>DRILL-5242</a>] - The UI breaks when trying to render profiles having unknown metrics +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5243'>DRILL-5243</a>] - Fix TestContextFunctions.sessionIdUDFWithinSameSession unit test +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5252'>DRILL-5252</a>] - A condition returns always true +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5263'>DRILL-5263</a>] - Prevent left NLJoin with non scalar subqueries +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5266'>DRILL-5266</a>] - Parquet Reader produces "low density" record batches - bits vs. bytes +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5273'>DRILL-5273</a>] - CompliantTextReader exhausts 4 GB memory when reading 5000 small files +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5274'>DRILL-5274</a>] - Exception thrown in Drillbit shutdown in UDF cleanup code +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5275'>DRILL-5275</a>] - Sort spill serialization is slow due to repeated buffer allocations +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5284'>DRILL-5284</a>] - Roll-up of final fixes for managed sort +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5287'>DRILL-5287</a>] - Provide option to skip updates of ephemeral state changes in Zookeeper +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5293'>DRILL-5293</a>] - Poor performance of Hash Table due to same hash value as distribution below +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5304'>DRILL-5304</a>] - Queries fail intermittently when there is skew in data distribution +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5313'>DRILL-5313</a>] - C++ client build failure on linux +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5326'>DRILL-5326</a>] - Unit tests failures related to the SERVER_METADTA +</li> +</ul> + +<h2> Improvement +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4217'>DRILL-4217</a>] - Query parquet file treat INT_16 & INT_8 as INT32 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4280'>DRILL-4280</a>] - Kerberos Authentication +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4373'>DRILL-4373</a>] - Drill and Hive have incompatible timestamp representations in parquet +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4604'>DRILL-4604</a>] - Generate warning on Web UI if drillbits version mismatch is detected +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4864'>DRILL-4864</a>] - Add ANSI format for date/time functions +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4956'>DRILL-4956</a>] - Temporary tables support +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4980'>DRILL-4980</a>] - Upgrading of the approach of parquet date correctness status detection +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4987'>DRILL-4987</a>] - Use ImpersonationUtil in RemoteFunctionRegistry +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5043'>DRILL-5043</a>] - Function that returns a unique id per session/connection similar to MySQL's CONNECTION_ID() +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5052'>DRILL-5052</a>] - Option to debug generated Java code using an IDE +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5056'>DRILL-5056</a>] - UserException does not write full message to log +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5065'>DRILL-5065</a>] - Optimize count(*) queries on MapR-DB JSON Tables +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5080'>DRILL-5080</a>] - Create a memory-managed version of the External Sort operator +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5085'>DRILL-5085</a>] - Add / update description for dynamic UDFs directories in drill-env.sh and drill-module.conf +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5098'>DRILL-5098</a>] - Improving fault tolerance for connection between client and foreman node. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5108'>DRILL-5108</a>] - Reduce output from Maven git-commit-id-plugin +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5116'>DRILL-5116</a>] - Enable generated code debugging in each Drill operator +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5123'>DRILL-5123</a>] - Write query profile after sending final response to client to improve latency +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5126'>DRILL-5126</a>] - Provide simplified, unified "cluster fixture" for tests +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5172'>DRILL-5172</a>] - Display elapsed time for queries in the UI +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5195'>DRILL-5195</a>] - Publish Operator and MajorFragment Stats in Profile page +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5215'>DRILL-5215</a>] - CTTAS: disallow temp tables in view expansion logic +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5221'>DRILL-5221</a>] - cancel message is delayed until queryid or data is received +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5254'>DRILL-5254</a>] - Enhance default reduction factors in optimizer +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5255'>DRILL-5255</a>] - Unit tests fail due to CTTAS temporary name space checks +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5257'>DRILL-5257</a>] - Provide option to save query profiles sync, async or not at all +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5258'>DRILL-5258</a>] - Allow "extended" mock tables access from SQL queries +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5259'>DRILL-5259</a>] - Allow listing a user-defined number of profiles +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5260'>DRILL-5260</a>] - Refinements to new "Cluster Fixture" test framework +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5290'>DRILL-5290</a>] - Provide an option to build operator table once for built-in static functions and reuse it across queries. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5301'>DRILL-5301</a>] - Add server metadata API +</li> +</ul> + +<h2> New Feature +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4935'>DRILL-4935</a>] - Allow drillbits to advertise a configurable host address to Zookeeper +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-4979'>DRILL-4979</a>] - Make dataport configurable +</li> +</ul> + +<h2> Task +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-5354'>DRILL-5354</a>] - Create CTTAS Documentaion +</li> +</ul> + + \ No newline at end of file
