Repository: drill Updated Branches: refs/heads/gh-pages 83baaab6f -> f883ad51f
update docs for NaN infinity type support and bounds checking behavior change Project: http://git-wip-us.apache.org/repos/asf/drill/repo Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/f883ad51 Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/f883ad51 Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/f883ad51 Branch: refs/heads/gh-pages Commit: f883ad51f8401285c709bbeb7066f95e96299b64 Parents: 83baaab Author: Bridget Bevens <[email protected]> Authored: Mon Jan 29 21:08:10 2018 -0800 Committer: Bridget Bevens <[email protected]> Committed: Mon Jan 29 21:08:10 2018 -0800 ---------------------------------------------------------------------- .../020-configuring-drill-memory.md | 20 +++++++++++++++++--- .../050-json-data-model.md | 14 +++++++++++--- 2 files changed, 28 insertions(+), 6 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/drill/blob/f883ad51/_docs/configure-drill/020-configuring-drill-memory.md ---------------------------------------------------------------------- diff --git a/_docs/configure-drill/020-configuring-drill-memory.md b/_docs/configure-drill/020-configuring-drill-memory.md index 4b5c48c..7b36cac 100644 --- a/_docs/configure-drill/020-configuring-drill-memory.md +++ b/_docs/configure-drill/020-configuring-drill-memory.md @@ -1,6 +1,6 @@ --- title: "Configuring Drill Memory" -date: 2017-08-18 17:47:31 UTC +date: 2018-01-30 05:08:15 UTC parent: "Configure Drill" --- @@ -30,7 +30,7 @@ You can modify memory for each drillbit node in your cluster. To modify the memo After you edit `<drill_installation_directory>/conf/drill-env.sh`, [restart the drillbit]({{ site.baseurl }}/docs/starting-drill-in-distributed-mode) on the node. -## About the Drillbit Startup Script +### About the Drillbit Startup Script The `drill-env.sh` file contains the following options: @@ -47,4 +47,18 @@ DRILL_MAX_DIRECT_MEMORY is the Java direct memory limit per node. If performance is an issue, add -Dbounds=false, as shown in the following example: - export DRILL_JAVA_OPTS="$DRILL_JAVA_OPTS -Dbounds=false" + export DRILL_JAVA_OPTS="$DRILL_JAVA_OPTS -Dbounds=false" + +As of Drill 1.13, bounds checking for direct memory is disabled by default. To enable bounds checking for direct memory, use the DRILLBIT_JAVA_OPTS variable to pass the `drill.exec.memory.enable_unsafe_bounds_check` parameter in $DRILL_HOME/conf/drill-env.sh, as shown: + + export DRILL_JAVA_OPTS="$DRILL_JAVA_OPTS -Ddrill.exec.memory.enable_unsafe_bounds_check=true + + +For earlier versions of Drill (prior to 1.13), bounds checking is enabled by default. To disable bounds checking, set the `drill.enable_unsafe_memory_access property` to true, as shown: + + + export DRILL_JAVA_OPTS="$DRILL_JAVA_OPTS -Ddrill.enable_unsafe_memory_access =true + + + + http://git-wip-us.apache.org/repos/asf/drill/blob/f883ad51/_docs/data-sources-and-file-formats/050-json-data-model.md ---------------------------------------------------------------------- diff --git a/_docs/data-sources-and-file-formats/050-json-data-model.md b/_docs/data-sources-and-file-formats/050-json-data-model.md index 00b54e9..eef256e 100644 --- a/_docs/data-sources-and-file-formats/050-json-data-model.md +++ b/_docs/data-sources-and-file-formats/050-json-data-model.md @@ -1,6 +1,6 @@ --- title: "JSON Data Model" -date: 2016-01-07 +date: 2018-01-30 05:08:16 UTC parent: "Data Sources and File Formats" --- Drill supports [JSON (JavaScript Object Notation)](http://www.json.org/), a self-describing data format. The data itself implies its schema and has the following characteristics: @@ -22,12 +22,20 @@ JSON data consists of the following types: * Array: ordered values, separated by commas, enclosed in square brackets * Boolean: true or false -* Number: double-precision floating point number, including exponential numbers. No octal, hexadecimal, NaN, or Infinity * null: empty value * Object: unordered key/value collection enclosed in curly braces * String: Unicode enclosed in double quotation marks * Value: a string, number, true, false, null -* Whitespace: used between tokens +* Whitespace: used between tokens +* Number: double-precision floating point number, including exponential numbers, NaN, and Infinity. Octal and hexadecimal are not supported. + +Drill 1.13 and later supports NaN (Not-a-Number) and Infinity as numeric values. This support introduces the following options, which are set to âtrueâ by default: + + store.json.writer.allow_nan_inf + store.json.reader.allow_nan_inf + +Drill writes NaN and Infinity values as literals to a JSON file when `store.json.writer.allow_nan_inf` is set to true. When set to false, Drill writes NaN and Infinity values as string values to a JSON file. If a query selects NaN or Infinity values in a JSON file, and `store.json.reader.allow_nan_inf` is set to false, Drill returns an error message. + The following table shows SQL-JSON data type mapping:
