spark git commit: [SPARK-19585][DOC][SQL] Fix the cacheTable and uncacheTable api call in the doc

2017-02-13 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.1 7fe3543fd -> c8113b0ee [SPARK-19585][DOC][SQL] Fix the cacheTable and uncacheTable api call in the doc ## What changes were proposed in this pull request?

spark git commit: [SPARK-19585][DOC][SQL] Fix the cacheTable and uncacheTable api call in the doc

2017-02-13 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 1ab97310e -> 9b5e460a9 [SPARK-19585][DOC][SQL] Fix the cacheTable and uncacheTable api call in the doc ## What changes were proposed in this pull request?

spark git commit: [SPARK-19539][SQL] Block duplicate temp table during creation

2017-02-13 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 6e45b547c -> 1ab97310e [SPARK-19539][SQL] Block duplicate temp table during creation ## What changes were proposed in this pull request? Current `CREATE TEMPORARY TABLE ... ` is deprecated and recommend users to use `CREATE TEMPORARY VIEW

spark git commit: [SPARK-19115][SQL] Supporting Create Table Like Location

2017-02-13 Thread lixiao
Repository: spark Updated Branches: refs/heads/master e02ac303c -> 6e45b547c [SPARK-19115][SQL] Supporting Create Table Like Location What changes were proposed in this pull request? Support CREATE [EXTERNAL] TABLE LIKE LOCATION... syntax for Hive serde and datasource tables. In this PR,we

spark git commit: [SPARK-19429][PYTHON][SQL] Support slice arguments in Column.__getitem__

2017-02-13 Thread holden
Repository: spark Updated Branches: refs/heads/master 0169360ef -> e02ac303c [SPARK-19429][PYTHON][SQL] Support slice arguments in Column.__getitem__ ## What changes were proposed in this pull request? - Add support for `slice` arguments in `Column.__getitem__`. - Remove obsolete

spark git commit: [SPARK-19520][STREAMING] Do not encrypt data written to the WAL.

2017-02-13 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 9af8f743b -> 0169360ef [SPARK-19520][STREAMING] Do not encrypt data written to the WAL. Spark's I/O encryption uses an ephemeral key for each driver instance. So driver B cannot decrypt data written by driver A since it doesn't have the

spark git commit: [SPARK-19435][SQL] Type coercion between ArrayTypes

2017-02-13 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 905fdf0c2 -> 9af8f743b [SPARK-19435][SQL] Type coercion between ArrayTypes ## What changes were proposed in this pull request? This PR proposes to support type coercion between `ArrayType`s where the element types are compatible.

spark git commit: [SPARK-19529] TransportClientFactory.createClient() shouldn't call awaitUninterruptibly()

2017-02-13 Thread lian
Repository: spark Updated Branches: refs/heads/branch-2.0 23050c8a1 -> f50c4372c [SPARK-19529] TransportClientFactory.createClient() shouldn't call awaitUninterruptibly() This patch replaces a single `awaitUninterruptibly()` call with a plain `await()` call in Spark's `network-common`

spark git commit: [SPARK-19529] TransportClientFactory.createClient() shouldn't call awaitUninterruptibly()

2017-02-13 Thread lian
Repository: spark Updated Branches: refs/heads/branch-2.1 2968d8c06 -> 5db234730 [SPARK-19529] TransportClientFactory.createClient() shouldn't call awaitUninterruptibly() This patch replaces a single `awaitUninterruptibly()` call with a plain `await()` call in Spark's `network-common`

spark git commit: [HOTFIX][SPARK-19542][SS]Fix the missing import in DataStreamReaderWriterSuite

2017-02-13 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 328b22984 -> 2968d8c06 [HOTFIX][SPARK-19542][SS]Fix the missing import in DataStreamReaderWriterSuite Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2968d8c0

spark git commit: [SPARK-17714][CORE][TEST-MAVEN][TEST-HADOOP2.6] Avoid using ExecutorClassLoader to load Netty generated classes

2017-02-13 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 c5a7cb022 -> 328b22984 [SPARK-17714][CORE][TEST-MAVEN][TEST-HADOOP2.6] Avoid using ExecutorClassLoader to load Netty generated classes ## What changes were proposed in this pull request? Netty's `MessageToMessageEncoder` uses

spark git commit: [SPARK-17714][CORE][TEST-MAVEN][TEST-HADOOP2.6] Avoid using ExecutorClassLoader to load Netty generated classes

2017-02-13 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 3dbff9be0 -> 905fdf0c2 [SPARK-17714][CORE][TEST-MAVEN][TEST-HADOOP2.6] Avoid using ExecutorClassLoader to load Netty generated classes ## What changes were proposed in this pull request? Netty's `MessageToMessageEncoder` uses

spark git commit: [SPARK-19542][SS] Delete the temp checkpoint if a query is stopped without errors

2017-02-13 Thread brkyvz
Repository: spark Updated Branches: refs/heads/branch-2.1 ef4fb7ebc -> c5a7cb022 [SPARK-19542][SS] Delete the temp checkpoint if a query is stopped without errors ## What changes were proposed in this pull request? When a query uses a temp checkpoint dir, it's better to delete it if it's

spark git commit: [SPARK-19542][SS] Delete the temp checkpoint if a query is stopped without errors

2017-02-13 Thread brkyvz
Repository: spark Updated Branches: refs/heads/master 0417ce878 -> 3dbff9be0 [SPARK-19542][SS] Delete the temp checkpoint if a query is stopped without errors ## What changes were proposed in this pull request? When a query uses a temp checkpoint dir, it's better to delete it if it's

spark git commit: [SPARK-19514] Enhancing the test for Range interruption.

2017-02-13 Thread rxin
Repository: spark Updated Branches: refs/heads/master 1c4d10b10 -> 0417ce878 [SPARK-19514] Enhancing the test for Range interruption. Improve the test for SPARK-19514, so that it's clear which stage is being cancelled. Author: Ala Luszczak Closes #16914 from

spark git commit: [SPARK-19529] TransportClientFactory.createClient() shouldn't call awaitUninterruptibly()

2017-02-13 Thread lian
Repository: spark Updated Branches: refs/heads/master ab88b2410 -> 1c4d10b10 [SPARK-19529] TransportClientFactory.createClient() shouldn't call awaitUninterruptibly() ## What changes were proposed in this pull request? This patch replaces a single `awaitUninterruptibly()` call with a plain

spark git commit: [SPARK-19427][PYTHON][SQL] Support data type string as a returnType argument of UDF

2017-02-13 Thread holden
Repository: spark Updated Branches: refs/heads/master 5e7cd3322 -> ab88b2410 [SPARK-19427][PYTHON][SQL] Support data type string as a returnType argument of UDF ## What changes were proposed in this pull request? Add support for data type string as a return type argument of

spark git commit: [SPARK-19506][ML][PYTHON] Import warnings in pyspark.ml.util

2017-02-13 Thread holden
Repository: spark Updated Branches: refs/heads/branch-2.1 a3b675137 -> ef4fb7ebc [SPARK-19506][ML][PYTHON] Import warnings in pyspark.ml.util ## What changes were proposed in this pull request? Add missing `warnings` import. ## How was this patch tested? Manual tests. Author: zero323

spark git commit: [SPARK-19506][ML][PYTHON] Import warnings in pyspark.ml.util

2017-02-13 Thread holden
Repository: spark Updated Branches: refs/heads/master 4321ff9ed -> 5e7cd3322 [SPARK-19506][ML][PYTHON] Import warnings in pyspark.ml.util ## What changes were proposed in this pull request? Add missing `warnings` import. ## How was this patch tested? Manual tests. Author: zero323

spark git commit: [SPARK-19544][SQL] Improve error message when some column types are compatible and others are not in set operations

2017-02-13 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 04ad82253 -> 4321ff9ed [SPARK-19544][SQL] Improve error message when some column types are compatible and others are not in set operations ## What changes were proposed in this pull request? This PR proposes to fix the error message when

spark git commit: [SPARK-19496][SQL] to_date udf to return null when input date is invalid

2017-02-13 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 8f03ad547 -> 04ad82253 [SPARK-19496][SQL] to_date udf to return null when input date is invalid ## What changes were proposed in this pull request? Currently the udf `to_date` has different return value with an invalid date input. ```

spark git commit: [SPARK-19562][BUILD] Added exclude for dev/pr-deps to gitignore

2017-02-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 855a1b755 -> 8f03ad547 [SPARK-19562][BUILD] Added exclude for dev/pr-deps to gitignore ## What changes were proposed in this pull request? Just adding a missing .gitignore entry. ## How was this patch tested? Entry added, now repo is

spark git commit: [SPARK-19574][ML][DOCUMENTATION] Fix Liquid Exception: Start indices amount is not equal to end indices amount

2017-02-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 fe4fcc570 -> a3b675137 [SPARK-19574][ML][DOCUMENTATION] Fix Liquid Exception: Start indices amount is not equal to end indices amount ### What changes were proposed in this pull request? ``` Liquid Exception: Start indices amount is

spark git commit: [SPARK-19574][ML][DOCUMENTATION] Fix Liquid Exception: Start indices amount is not equal to end indices amount

2017-02-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 2bdbc8705 -> 855a1b755 [SPARK-19574][ML][DOCUMENTATION] Fix Liquid Exception: Start indices amount is not equal to end indices amount ### What changes were proposed in this pull request? ``` Liquid Exception: Start indices amount is not