Repository: drill Updated Branches: refs/heads/gh-pages d79e23427 -> aada3ab4d
http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/_docs/rn/019-1.2.0-rn.md ---------------------------------------------------------------------- diff --git a/_docs/rn/019-1.2.0-rn.md b/_docs/rn/019-1.2.0-rn.md new file mode 100644 index 0000000..572db45 --- /dev/null +++ b/_docs/rn/019-1.2.0-rn.md @@ -0,0 +1,509 @@ +--- +title: "Apache Drill 1.2.0 Release Notes" +parent: "Release Notes" +--- + +**Release date:** October 16, 2015 + +Today we're happy to announce the availability of Drill 1.2.0, providing more than 150 bug fixes and a number of new features. These release notes include links to the following Jira issues: + +* [Enhancements and bug fixes]({{site.baseurl}}/docs/apache-drill-1-2-0-release-notes/#enhancements-and-bug-fixes) +* [Important unresolved issues]({{site.baseurl}}/docs/apache-drill-1-2-0-release-notes/#important-unresolved-issues) + +## Noteworthy New Features in Drill 1.2.0 + +This release of Drill introduces a number of enhancements, including the following ones: + +* Support for JDBC data sources, such as MySQL, through a [new JDBC Storage plugin]({{site.baseurl}}/docs/rdbms-storage-plugin/#example:-working-with-mysql) +* Improvements in the Drill JDBC driver including inclusion of +[Javadocs]({{site.baseurl}}/api/1.2/jdbc/) and better application dependency compatibility +* Enhancements to Avro file formats + * [Support for complex data types](https://issues.apache.org/jira/browse/DRILL-3565), such as UNION and MAP + * [Optimized Avro file processing](https://issues.apache.org/jira/browse/DRILL-3720) (block-wise) +* Partition pruning improvements +* A number of new [SQL window functions]({{site.baseurl}}/docs/sql-window-functions) + * NTILE + * LAG and LEAD + * FIRST_VALUE and LAST_VALUE +* [HTTPS support]({{site.baseurl}}/docs/configuring-web-console-and-rest-api-security/) for Web Console operations +* Performance improvements for [querying HBase]({{site.baseurl}}/docs/querying-hbase/#querying-big-endian-encoded-data), which includes leveraging [ordered byte encoding]({{site.baseurl}}/docs/querying-hbase/#leveraging-hbase-ordered-byte-encoding) +* [Optimized reads]({{site.baseurl}}/docs/querying-hive/#optimizing-reads-of-parquet-backed-tables) of Parquet-backed, Hive tables +* Read support for the [Parquet INT96 type]({{site.baseurl}}/docs/parquet-format/#about-int96-support) and a new TIMESTAMP_IMPALA type used with the [CONVERT_FROM]({{site.baseurl}}/docs/supported-data-types/#data-types-for-convert_to-and-convert_from-functions) function decodes a timestamp from Hive or Impala. +* [Parquet metadata caching]({{site.baseurl}}/docs/optimizing-parquet-metadata-reading/) to improve query performance on a large number of files +* [DROP TABLE]({{site.baseurl}}/docs/drop-table/) command +* Improved correlated subqueries +* Union Distinct +* Improved LIMIT processing + +## Enhancements and Bug Fixes + +<h2> Sub-task +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3364'>DRILL-3364</a>] - Prune scan range if the filter is on the leading field with byte comparable encoding +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3553'>DRILL-3553</a>] - add support for LEAD and LAG window functions +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3608'>DRILL-3608</a>] - add support for FIRST_VALUE and LAST_VALUE +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3616'>DRILL-3616</a>] - Memory leak in a cleanup code after canceling queries with window functions spilling to disk +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3619'>DRILL-3619</a>] - Add support for NTILE window function +</li> +</ul> + +<h2> Bug +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-343'>DRILL-343</a>] - Document update required to describe sqlline usage for Windows +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1395'>DRILL-1395</a>] - UNION ALL query fails "while setting up Foreman" +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1457'>DRILL-1457</a>] - Limit operator optimization : push limit operator past exchange operator +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1651'>DRILL-1651</a>] - Allow Filter to push past Project with ITEM operator +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1773'>DRILL-1773</a>] - Issues when using JAVA code through Drill JDBC driver +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1795'>DRILL-1795</a>] - TPCH SF1000 Queries fail with DecoderException: java.lang.NullPointerException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1816'>DRILL-1816</a>] - Scan Error with JSON on large no of records with Complex Types +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1831'>DRILL-1831</a>] - LIKE operator not working with SQL [charlist] Wildcard +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1929'>DRILL-1929</a>] - After canceling query in sqlline subsequent query in same session hangs +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1938'>DRILL-1938</a>] - Fix error message when reserved words are used in query. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1976'>DRILL-1976</a>] - Possible Memory Leak in drill jdbc client when dealing with wide columns (5000 chars long) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2050'>DRILL-2050</a>] - Accountor closed with outstanding buffer +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2053'>DRILL-2053</a>] - Column names are case sensitive if column is coming from WITH clause +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2095'>DRILL-2095</a>] - Order by on a repeated index inside a sub query results in an NPE +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2098'>DRILL-2098</a>] - correct startup on windows +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2166'>DRILL-2166</a>] - left join with complex type throw ClassTransformationException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2190'>DRILL-2190</a>] - Failure to order by function if DISTINCT clause is present +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2274'>DRILL-2274</a>] - Unable to allocate sv2 buffer after repeated attempts : JOIN, Order by used in query +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2304'>DRILL-2304</a>] - Case sensitivity - system and session options are case sensitive +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2312'>DRILL-2312</a>] - JDBC driver returning incorrect data after extended usage +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2313'>DRILL-2313</a>] - Query fails when one of the operands is a DATE literal without an explicit cast +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2318'>DRILL-2318</a>] - Query fails when an ORDER BY clause is used with WITH-CLAUSE +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2361'>DRILL-2361</a>] - Column aliases cannot include dots +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2398'>DRILL-2398</a>] - IS NOT DISTINCT FROM predicate returns incorrect result when used as a join filter +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2418'>DRILL-2418</a>] - Memory leak during execution if comparison function is not found +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2445'>DRILL-2445</a>] - JDBC : Connection.rollback method currently throws UnsuportedOperationException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2451'>DRILL-2451</a>] - JDBC : Connection.commit throws an UnsupportedOperationException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2459'>DRILL-2459</a>] - INFO._SCHEMA's CHARACTER_MAXIMUM_LENGTH is -1 for type CHAR +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2482'>DRILL-2482</a>] - JDBC : calling getObject when the actual column type is 'NVARCHAR' results in NoClassDefFoundError +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2519'>DRILL-2519</a>] - INFORMATION_SCHEMA.COLUMNS is missing <interval_qualifier> info +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2522'>DRILL-2522</a>] - Implement INFORMATION_SCHEMA.* enough for relevant tools [bug] +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2530'>DRILL-2530</a>] - getColumns() doesn't return right COLUMN_SIZE for INTERVAL types +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2588'>DRILL-2588</a>] - Profile UI: "First Start" field contains incorrect data +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2625'>DRILL-2625</a>] - org.apache.drill.common.StackTrace should follow standard stacktrace format +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2643'>DRILL-2643</a>] - HashAggBatch/HashAggTemplate call incoming.cleanup() twice resulting in warnings +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2644'>DRILL-2644</a>] - Data Types page should list and describe all data types +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2649'>DRILL-2649</a>] - Math and Trig page seems to refer to types that are not Drill SQL types +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2650'>DRILL-2650</a>] - Cancelled queries json profile shows query end time occurs before fragments end time +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2688'>DRILL-2688</a>] - Use of ORDER BY on right side of Union All results in SqlValidatorException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2721'>DRILL-2721</a>] - Identify, fix _existing_ INFO._SCHEMA columns in conflict with SQL spec. by 1.0 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2722'>DRILL-2722</a>] - Query profile data not being sent/received (and web UI not updated) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2724'>DRILL-2724</a>] - Implicit cast test fails in Union All query (reports type mismatch) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2727'>DRILL-2727</a>] - CTAS select * from CSV file results in Exception +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2737'>DRILL-2737</a>] - Sqlline throws Runtime exception when JDBC ResultSet throws a SQLException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2745'>DRILL-2745</a>] - Query returns IOB Exception when JSON data with empty arrays is input to flatten function +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2760'>DRILL-2760</a>] - Quoted strings from CSV file appear in query output in different forms +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2777'>DRILL-2777</a>] - CTAS, order by and flatten of repeated list result in ExpandConversionRule error +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2800'>DRILL-2800</a>] - Performance regression introduced with commit: a6df26a (Patch for DRILL-2512) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2802'>DRILL-2802</a>] - Projecting dir[n] by itself results in projecting of all columns +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2815'>DRILL-2815</a>] - Some PathScanner logging, misc. cleanup. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2837'>DRILL-2837</a>] - Resolve what Statement.cancel() really should do +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2843'>DRILL-2843</a>] - Reading empty CSV file fails with error (rather than yielding zero rows) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2851'>DRILL-2851</a>] - Memory LEAK - FLATTEN function fails when input array has 99,999 integer type elements +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2852'>DRILL-2852</a>] - CASTing the column 'dir0' in view causes partition pruning to fail +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2862'>DRILL-2862</a>] - Convert_to/Convert_From throw assertion when an incorrect encoding type is specified +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2864'>DRILL-2864</a>] - Unable to cast string literal with the valid value in ISO 8601 format to interval +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2867'>DRILL-2867</a>] - Session level parameter drill.exec.testing.controls appears to be set even though it was not +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2890'>DRILL-2890</a>] - C++ Client: Update query submitter usage to clarify using authentication +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2924'>DRILL-2924</a>] - IOBException when querying a table which has 1 file and a subfolder with 1 file +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2935'>DRILL-2935</a>] - Casting varchar to varbinary fails +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2937'>DRILL-2937</a>] - Result for integer values from json files contains "$numberLong" in front of value +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2949'>DRILL-2949</a>] - TPC-DS queries 1 and 30 fail with CannotPlanException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3030'>DRILL-3030</a>] - Foreman hangs trying to cancel non-root fragments +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3045'>DRILL-3045</a>] - Drill is not partition pruning due to internal off-heap memory limit for planning phase +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3056'>DRILL-3056</a>] - Numeric literal in an IN list is casted to decimal even when decimal type is disabled +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3076'>DRILL-3076</a>] - USING clause should not be supported in drill +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3095'>DRILL-3095</a>] - Memory Leak : Failure while closing accountor. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3096'>DRILL-3096</a>] - "State change requested from ... --> ... for " blank after "for" +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3122'>DRILL-3122</a>] - Changing a session option to default value results in status as changed +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3133'>DRILL-3133</a>] - MergingRecordBatch can leak memory if query is canceled before batches in rawBatches were loaded +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3141'>DRILL-3141</a>] - sqlline throws an exception when query is cancelled +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3151'>DRILL-3151</a>] - ResultSetMetaData not as specified by JDBC (null/dummy value, not ""/etc.) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3153'>DRILL-3153</a>] - DatabaseMetaData.getIdentifierQuoteString() returns (standard) double-quote, not Drill's back quote +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3156'>DRILL-3156</a>] - Calcite tracing is broken in Drill +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3160'>DRILL-3160</a>] - Make JDBC Javadoc documentation available to users +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3163'>DRILL-3163</a>] - Fix hang/ leak issue exposed by TestDrillbitResilience#foreman_runTryEnd +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3189'>DRILL-3189</a>] - Disable ALLOW PARTIAL/DISALLOW PARTIAL in window function grammar +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3243'>DRILL-3243</a>] - Need a better error message - Use of alias in window function definition +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3257'>DRILL-3257</a>] - TPCDS query 74 results in a StackOverflowError on Scale Factor 1 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3271'>DRILL-3271</a>] - Hive : Tpch 01.q fails with a verification issue for SF100 dataset +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3284'>DRILL-3284</a>] - Document incompatibility between drill's to_date and hive's unix_timestamp +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3287'>DRILL-3287</a>] - Changing session level parameter back to the default value does not change it's status back to DEFAULT +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3292'>DRILL-3292</a>] - SUM(constant) OVER(...) returns wrong results +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3297'>DRILL-3297</a>] - Using rank, dense_rank, percent_rank, cume_dist, row_number window functions without OVER clause results in cryptic schema change error +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3312'>DRILL-3312</a>] - PageReader.allocatePageData() calls BufferAllocator.buffer(int) but doesn't check if the result is null +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3322'>DRILL-3322</a>] - Something broken in or around RPC timeout setup? +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3347'>DRILL-3347</a>] - Resolve: ResultSet.getObject(...) for VARCHAR returns ...hadoop.io.Text, not String +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3348'>DRILL-3348</a>] - NPE when two different window functions are used in projection list and order by clauses +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3360'>DRILL-3360</a>] - Window function defined within another window function +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3382'>DRILL-3382</a>] - CTAS with order by clause fails with IOOB exception +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3393'>DRILL-3393</a>] - Quotes not being recognized in tab delimited (tsv) files +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3412'>DRILL-3412</a>] - Projections are not getting push down below Window operator +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3441'>DRILL-3441</a>] - CompliantTextRecordReader#isStarQuery loops indefinitely +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3445'>DRILL-3445</a>] - BufferAllocator.buffer() implementations should throw an OutOfMemoryRuntimeException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3448'>DRILL-3448</a>] - typo in QueryManager.DrillbitStatusListener will cause the Foreman to hang if a Drillbit dies +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3455'>DRILL-3455</a>] - If a drillbit, that contains fragments for the current query, dies the QueryManager will fail the query even if those fragments already finished successfully +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3463'>DRILL-3463</a>] - Unit test of project pushdown in TestUnionAll should put more precisely plan attribute in plan verification. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3464'>DRILL-3464</a>] - Index out of bounds exception while performing concat() +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3476'>DRILL-3476</a>] - Filter on nested element gives wrong results +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3479'>DRILL-3479</a>] - Sqlline from drill v1.1.0 displays version as 1.0.0 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3483'>DRILL-3483</a>] - Clarify CommonConstants' constants. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3484'>DRILL-3484</a>] - Error using functions with no parameters when `drill.exec.functions.cast_empty_string_to_null` is set to true +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3497'>DRILL-3497</a>] - Throw UserException#validationError for errors when modifying options +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3500'>DRILL-3500</a>] - Provide additional information while registering storage plugin optimizer rules +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3502'>DRILL-3502</a>] - JDBC driver can cause conflicts +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3503'>DRILL-3503</a>] - Make PruneScanRule have a pluggable partitioning mechanism +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3509'>DRILL-3509</a>] - Empty JSON files trigger exception when used in a union +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3537'>DRILL-3537</a>] - Empty Json file can potentially result into wrong results +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3542'>DRILL-3542</a>] - Rebase Drill on Calcite 1.4.0 release +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3550'>DRILL-3550</a>] - Incorrect results reading complex data with schema change +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3551'>DRILL-3551</a>] - CTAS from complex Json source with schema change is not written (and hence not read back ) correctly +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3554'>DRILL-3554</a>] - Union over TIME and TIMESTAMP values throws SchemaChangeException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3555'>DRILL-3555</a>] - Changing defaults for planner.memory.max_query_memory_per_node causes queries with window function to fail +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3557'>DRILL-3557</a>] - Reading empty CSV file fails with SYSTEM ERROR +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3566'>DRILL-3566</a>] - Calling Connection.prepareStatement throws a ClassCastException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3573'>DRILL-3573</a>] - Enable TPC-H query 17 in unit tests +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3574'>DRILL-3574</a>] - Empty Over Clause should trigger Union-Exchange to be added below +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3579'>DRILL-3579</a>] - Drill on Hive query fails if partition table has __HIVE_DEFAULT_PARTITION__ +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3580'>DRILL-3580</a>] - wrong plan for window function queries containing function(col1 + colb) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3583'>DRILL-3583</a>] - SUM on varchar column produces incorrect error +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3595'>DRILL-3595</a>] - Wrong results returned by query that uses LEAD window function +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3596'>DRILL-3596</a>] - Allow only (<expression>) or (<expression>, 1) for LEAD and LAG window functions as input parameters +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3599'>DRILL-3599</a>] - Wrong results returned by LEAD(col-name, -1) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3601'>DRILL-3601</a>] - LEAD function used without OVER clause should not plan +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3604'>DRILL-3604</a>] - LEAD(<varchar-column>) returns IOB Exception +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3605'>DRILL-3605</a>] - Wrong results - Lead(char-column) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3606'>DRILL-3606</a>] - Wrong results - Lead(char-column) without PARTITION BY clause +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3617'>DRILL-3617</a>] - Apply "shading" to JDBC-all Jar file to avoid version conflicts +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3621'>DRILL-3621</a>] - Wrong results when Drill on Hbase query contains rowkey "or" or "IN" +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3622'>DRILL-3622</a>] - With user authentication enabled, only admin users should be able to change system options +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3635'>DRILL-3635</a>] - IllegalArgumentException - not a Parquet file (too small) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3638'>DRILL-3638</a>] - Incorrect results LEAD(<float-type-column>) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3642'>DRILL-3642</a>] - External Sort will leak memory if query is cancelled while it's spilling to disk +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3643'>DRILL-3643</a>] - NTILE(0) returns RuntimeException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3645'>DRILL-3645</a>] - typo in drill documentation +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3648'>DRILL-3648</a>] - NTILE function returns incorrect results +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3649'>DRILL-3649</a>] - LEAD , LAG , NTILE , FIRST_VALUE , LAST_VALUE report RuntimeException for missing OVER clause +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3653'>DRILL-3653</a>] - Assert in a query with both avg aggregate and avg window aggregate functions +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3654'>DRILL-3654</a>] - FIRST_VALUE(<char-column>/<varchar-column>) returns IOB Exception +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3657'>DRILL-3657</a>] - Wrong result with SUM(1) window function when multiple partitions are present +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3658'>DRILL-3658</a>] - Missing org.apache.hadoop in the JDBC jar +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3663'>DRILL-3663</a>] - Drill View aliases being lost via âorder byâ +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3667'>DRILL-3667</a>] - Random Assertion Error while planning +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3668'>DRILL-3668</a>] - Incorrect results FIRST_VALUE function +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3673'>DRILL-3673</a>] - Memory leak in parquet writer on CTAS +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3677'>DRILL-3677</a>] - Wrong result with LEAD window function when used in multiple windows in the same query +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3679'>DRILL-3679</a>] - IOB Exception : when window functions used in outer and inner query +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3680'>DRILL-3680</a>] - window function query returns Incorrect results +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3684'>DRILL-3684</a>] - CTAS : Memory Leak when using CTAS with tpch sf100 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3685'>DRILL-3685</a>] - Failure to execute query with NTILE and ROW_NUMBER window functions with different window definitions +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3689'>DRILL-3689</a>] - incorrect results : aggregate AVG returns wrong results over results returned by LEAD function. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3690'>DRILL-3690</a>] - Partitioning pruning produces wrong results when there are nested expressions in the filter +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3691'>DRILL-3691</a>] - CTAS Memory Leak : IllegalStateException +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3700'>DRILL-3700</a>] - Exception in a query with multiple fist_value window functions with different partitions +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3702'>DRILL-3702</a>] - PartitionPruning hit ClassCastException in Interpreter when the pruning filter expression is of non-nullable type. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3707'>DRILL-3707</a>] - Fix for DRILL-3616 can cause a NullPointerException in ExternalSort cleanup +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3711'>DRILL-3711</a>] - Windows unit test failure on 1.2 snapshot +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3716'>DRILL-3716</a>] - Drill should push filter past aggregate in order to improve query performance. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3718'>DRILL-3718</a>] - quotes in .tsv trigger exception +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3719'>DRILL-3719</a>] - Adding negative sign in front of EXTRACT triggers Assertion Error +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3732'>DRILL-3732</a>] - Drill leaks memory if external sort hits out of disk space exception +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3735'>DRILL-3735</a>] - Directory pruning is not happening when number of files is larger than 64k +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3736'>DRILL-3736</a>] - Documentation for partition is misleading/wrong syntax +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3737'>DRILL-3737</a>] - CTAS from empty text file fails with NPE +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3746'>DRILL-3746</a>] - Hive query fails if the table contains external partitions +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3757'>DRILL-3757</a>] - Link to IntelliJ IDEA settings jar on the contributors guidelines page is broken. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3758'>DRILL-3758</a>] - InvalidRecordException while selecting from a table with multiple parquet file +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3767'>DRILL-3767</a>] - SchemaPath.getCompoundPath(String...strings) reverses it's input array +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3773'>DRILL-3773</a>] - Mongo RecordReader projection pushdown doesn't work past first level paths +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3778'>DRILL-3778</a>] - Add rest of DRILL-3160 (making JDBC Javadoc available) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3779'>DRILL-3779</a>] - NPE during mergeAndSpill operation of external sort +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3781'>DRILL-3781</a>] - Using CURRENT_DATE in a group by throws a column not found error for hive tables and csv files +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3783'>DRILL-3783</a>] - Incorrect results : COUNT(<column-name>) over results returned by UNION ALL +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3784'>DRILL-3784</a>] - simple Jdbc program fails with NoClassDefFoundError +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3788'>DRILL-3788</a>] - Directory based partition pruning not taking effect with metadata caching +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3809'>DRILL-3809</a>] - PrelFinalizable.SHUTTLE causes ArrayIndexOutOfBoundsException when multiple queries are run concurrently +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3811'>DRILL-3811</a>] - AtomicRemainder incorrectly accounts for transferred allocations +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3817'>DRILL-3817</a>] - Refresh metadata does not work when used with sub schema +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3819'>DRILL-3819</a>] - Remove redundant filter for files start with "." +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3884'>DRILL-3884</a>] - Hive native scan has lower parallelization leading to performance degradation +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3892'>DRILL-3892</a>] - Metadata cache not being leveraged when partition pruning is taking place +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3901'>DRILL-3901</a>] - Performance regression with doing Explain of COUNT(*) over 100K files +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3917'>DRILL-3917</a>] - IllegalArgumentException when running query after creating metadata cache +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3918'>DRILL-3918</a>] - Avoid extra loading of the metadata cache file +</li> +</ul> + +<h2> Improvement +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-1666'>DRILL-1666</a>] - Provide Test cases for Mongo Storage plugin +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2332'>DRILL-2332</a>] - Drill should be consistent with Implicit casting rules across data formats +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2424'>DRILL-2424</a>] - Ignore hidden files in directory path +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2699'>DRILL-2699</a>] - Collect all cleanup errors before reporting a failure to the client +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2748'>DRILL-2748</a>] - Filter is not pushed down into subquery with the group by +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2908'>DRILL-2908</a>] - Support reading the Parquet int 96 type +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3121'>DRILL-3121</a>] - Hive partition pruning is not happening +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3209'>DRILL-3209</a>] - [Umbrella] Plan reads of Hive tables as native Drill reads when a native reader for the underlying table format exists +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3295'>DRILL-3295</a>] - UNION (distinct type) is supported now +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3341'>DRILL-3341</a>] - Move OperatorWrapper list and FragmentWrapper list creation to ProfileWrapper ctor +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3354'>DRILL-3354</a>] - TestBuilder can check if the number of result batches equals some expected value +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3450'>DRILL-3450</a>] - Rename NonRootStatusReporter to FragmentStatusReporter +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3467'>DRILL-3467</a>] - Restrict 'show databases' based on underlying permissions. +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3536'>DRILL-3536</a>] - Add support for LEAD, LAG, NTILE, FIRST_VALUE and LAST_VALUE window functions +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3545'>DRILL-3545</a>] - Need documentation on BINARY_STRING and STRING_BINARY functions +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3565'>DRILL-3565</a>] - Add support for Avro UNION type +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3589'>DRILL-3589</a>] - JDBC driver maven artifact includes a lot of unnecessary dependencies +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3652'>DRILL-3652</a>] - Need to document order of operations with window functions and flatten +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3720'>DRILL-3720</a>] - Avro Record Reader should process Avro files by per block basis +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3888'>DRILL-3888</a>] - Build test jars for all Drill Modules +</li> +</ul> + +<h2> New Feature +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2743'>DRILL-2743</a>] - Parquet file metadata caching +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3180'>DRILL-3180</a>] - Apache Drill JDBC storage plugin to query rdbms systems such as MySQL and Netezza from Apache Drill +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3470'>DRILL-3470</a>] - Add support for multiple partition by clauses for window functions in the same query +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3492'>DRILL-3492</a>] - Add support for encoding of Drill data types into byte ordered format +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3725'>DRILL-3725</a>] - Add HTTPS support for Drill web interface +</li> +</ul> + +<h2> Task +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-2693'>DRILL-2693</a>] - doc programmatically submit queries to Drill +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3683'>DRILL-3683</a>] - [Unit Test] Add expected plan for tests in TestWindowFunctions suite +</li> +<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3799'>DRILL-3799</a>] - Create Simple HBase Tutorial +</li> +</ul> + +## Important Unresolved Issues + +* The Drill error message about JSON syntax that appears when Drill cannot find the JDBC driver during configuration of the JDBC storage plugin is misleading. To configure the JDBC plugin, you must put the JDBC driver in the `<drill_installation_directory>/jars/3rdparty` directory. [DRILL-3985](https://issues.apache.org/jira/browse/DRILL-3958) +* The MySQL TEXT type is not supported. The popular classicmodels database uses the TEXT type, and therefore cannot be used as is until this issue is resolved. [DRILL-3956](https://issues.apache.org/jira/browse/DRILL-3956) + + + + + + + http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/_docs/tutorials/020-drill-in-10-minutes.md ---------------------------------------------------------------------- diff --git a/_docs/tutorials/020-drill-in-10-minutes.md b/_docs/tutorials/020-drill-in-10-minutes.md index bf924ef..b3c252e 100644 --- a/_docs/tutorials/020-drill-in-10-minutes.md +++ b/_docs/tutorials/020-drill-in-10-minutes.md @@ -1,6 +1,6 @@ --- title: "Drill in 10 Minutes" -date: 2017-07-31 04:43:58 UTC +date: 2017-12-16 06:24:23 UTC parent: "Tutorials" description: Get started with Drill in 10 minutes or less. --- @@ -45,9 +45,9 @@ The output looks something like this: Complete the following steps to install Drill: 1. In a terminal window, change to the directory where you want to install Drill. -2. Download the latest version of Apache Drill [here](http://apache.mirrors.hoobly.com/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz) or from the [Apache Drill mirror site](http://www.apache.org/dyn/closer.cgi/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz) with the command appropriate for your system: - * `wget http://apache.mirrors.hoobly.com/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz` - * `curl -o apache-drill-1.11.0.tar.gz http://apache.mirrors.hoobly.com/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz` +2. Download the latest version of Apache Drill [here](http://apache.mirrors.hoobly.com/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz) or from the [Apache Drill mirror site](http://www.apache.org/dyn/closer.cgi/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz) with the command appropriate for your system: + * `wget http://apache.mirrors.hoobly.com/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz` + * `curl -o apache-drill-1.12.0.tar.gz http://apache.mirrors.hoobly.com/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz` 3. Copy the downloaded file to the directory where you want to install Drill. 4. Extract the contents of the Drill .tar.gz file. Use `sudo` if necessary: `tar -xvzf <.tar.gz file name>` @@ -75,7 +75,7 @@ Start Drill in embedded mode using the `drill-embedded` command: You can install Drill on Windows. First, set the JAVA_HOME environment variable, and then install Drill. Complete the following steps to install Drill: -1. Download the latest version of Apache Drill [here](http://apache.mirrors.hoobly.com/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz) or from the [Apache Drill mirror site](http://www.apache.org/dyn/closer.cgi/drill/drill-1.11.0/apache-drill-1.11.0.tar.gz). +1. Download the latest version of Apache Drill [here](http://apache.mirrors.hoobly.com/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz) or from the [Apache Drill mirror site](http://www.apache.org/dyn/closer.cgi/drill/drill-1.12.0/apache-drill-1.12.0.tar.gz). 2. Move the `apache-drill-<version>.tar.gz` file to a directory where you want to install Drill. 3. Unzip the `TAR.GZ` file using a third-party tool. If the tool you use does not unzip the TAR file as well as the `TAR.GZ` file, unzip the `apache-drill-<version>.tar` to extract the Drill software. The extraction process creates the installation directory named apache-drill-<version> containing the Drill software. http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/_docs/tutorials/050-analyzing-highly-dynamic-datasets.md ---------------------------------------------------------------------- diff --git a/_docs/tutorials/050-analyzing-highly-dynamic-datasets.md b/_docs/tutorials/050-analyzing-highly-dynamic-datasets.md index 5db7c4d..5e7b7e2 100644 --- a/_docs/tutorials/050-analyzing-highly-dynamic-datasets.md +++ b/_docs/tutorials/050-analyzing-highly-dynamic-datasets.md @@ -1,6 +1,6 @@ --- title: "Analyzing Highly Dynamic Datasets" -date: 2017-03-15 21:28:39 UTC +date: 2017-12-16 06:24:23 UTC parent: "Tutorials" --- @@ -33,7 +33,7 @@ The element names that you see in the `checkin_info` are unknown upfront and can Step 1: First download Drill, if you have not yet done so, onto your machine http://drill.apache.org/download/ - tar -xvf apache-drill-1.10.0.tar + tar -xvf apache-drill-1.12.0.tar Install Drill locally on your desktop (embedded mode). You donât need Hadoop. http://git-wip-us.apache.org/repos/asf/drill/blob/aada3ab4/blog/_posts/2017-12-15-drill-1.12-released.md ---------------------------------------------------------------------- diff --git a/blog/_posts/2017-12-15-drill-1.12-released.md b/blog/_posts/2017-12-15-drill-1.12-released.md new file mode 100644 index 0000000..81db1b4 --- /dev/null +++ b/blog/_posts/2017-12-15-drill-1.12-released.md @@ -0,0 +1,64 @@ +--- +layout: post +title: "Drill 1.12 Released" +code: drill-1.12-released +excerpt: Apache Drill 1.12's highlights are: Kafka and OpenTSDB storage plugins, SSL and network encryption support, queue-based memory assignment for buffering operators, networking functions, and the ability to prevent users from accessing paths outside the root of a workspace. +authors: ["bbevens"] +--- + +Today, we're happy to announce the availability of Drill 1.12.0. You can download it [here](https://drill.apache.org/download/). + +The release provides the following bug fixes and improvements: + +## Kafka and OpenTSDB Storage Plugins (DRILL-4779, DRILL-5337) +You can configure Kafka and OpenTSDB as Drill data sources. + +- For Kafka storage plugin information, see the [README](https://github.com/apache/drill/blob/master/contrib/storage-kafka/README.md) file. +- For OpenTSDB storage plugin information, see the [README](https://github.com/apache/drill/blob/master/contrib/storage-opentsdb/README.md) file. Configure the OpenTSDB storage plugin in the Storage tab of the Drill Web Console, as shown: + + { + "storage": { + openTSDB: { + type: "openTSDB", + connection: "http://localhost:10000";, + enabled: false + } + } + } + +## Queue-Based Memory Assignment for Buffering Operators (Throttling) (DRILL-5716) +Throttling limits the number of concurrent queries that run to prevent queries from failing with out-of-memory errors. When you enable throttling, you configure the number of concurrent queries that can run and the resource requirements for each query. Drill calculates the amount of memory to assign per query per node. See [Throttling]({{site.baseurl}}/docs/throttling/) for more information. + + + +## Networking Functions +Drill supports the following networking functions to facilitate network analysis using Drill: + +- `inet_aton(<ip>)`: Converts an IPv4 address into an integer +- `inet_ntoa( <int>)`: Converts an integer IP into dotted decimal notation +- `in_network( <ip>,<cidr> )`: Returns true if the IP address is in the given CIDR block +- `address_count( <cidr> )`: Returns the number of IPs in a given CIDR block +- `broadcast_address( <cidr> )`: Returns the broadcast address for a given CIDR block +- `netmask(<cidr> )`: Returns the netmask for a given CIDR block +- `low_address(<cidr>)`: Returns the first address in a given CIDR block +- `high_address(<cidr>)`: Returns the last address in a given CIDR block +- `url_encode( <url> )`: Returns a URL encoded string +- `url_decode( <url> )`: Decodes ``a URL encoded string +- `is_valid_IP(<ip>)`: Returns true if the IP is a valid IP address +- `is_private_ip(<ip>)`: Returns true if the IP is a private IPv4 address +- `is_valid_IPv4(<ip>)`: Returns true if the IP is a valid IPv4 address +- `is_valid_IPv6(<ip>)`: Returns true if the IP is a valid IPv6 address + +## SSL Support +Drill supports SSL to encrypt data passed between the Drill client and Drillbit. SSL also provides one-way authentication through which the Drill client verifies the identity of the Drillbit. The SASL feature in Drill provides authentication and an option to encrypt data, however the encryption feature is not available when using Plain authentication. If you need to use Plain authentication (certain BI tools only use Plain authentication), you can enable SSL to encrypt data. You can have both SASL and SSL enabled when using Plain authentication only. For any other scenario, using SSL and SASL encryption together is strongly discouraged. The Drill server requires an SSL certificate. The certificate can be self-signed or signed by a CA (Certificate Authority). SSL is not supported for communication between Drillbits. + +## Network Encryption Support +Drill 1.10 provided authentication support through Plain and Kerberos authentication mechanisms to authenticate the Drill client to Drillbit and Drillbit to Drillbit communication channels. Drill 1.11 extends that support to include encryption. Drill uses the Kerberos mechanism over the SASL framework to encrypt the communication channels. + + +## Access to Paths Outside the Current Workspace (DRILL-5964) +A new parameter, allowAccessOutsideWorkspace, in the dfs storage plugin configuration prevents users from accessing paths outside the root of a workspace. The default value for the parameter is false. Set the parameter to true to allow users access outside of a workspace. If existing storage plugin configurations do not specify the parameter, users cannot access paths outside the configured workspaces. + + +You can find a complete list of JIRAs resolved in the 1.12.0 release [here](https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12341087&styleName=Html&projectId=12313820&Create=Create&atl_token=A5KQ-2QAV-T4JA-FDED%7Cd194b12b906cd370f36d15e8af60a94592b89038%7Clin). +
