[23/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/SimpleFutureAction.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/SimpleFutureAction.html b/site/docs/1.6

[05/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/broadcast/Broadcast.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/broadcast/Broadcast.html b/site/docs/1

[26/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/HashPartitioner.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/HashPartitioner.html b/site/docs/1.6.3/api

[35/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/allclasses-noframe.html -- diff --git a/site/docs/1.6.3/api/java/allclasses-noframe.html b/site/docs/1.6.3/api/java/allclasses-noframe.htm

[25/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/Logging.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/Logging.html b/site/docs/1.6.3/api/java/org/apache

[22/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/SparkContext.DoubleAccumulatorParam$.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/SparkContext.DoubleAc

[02/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/graphx/GraphLoader.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/graphx/GraphLoader.html b/site/docs/1.6

[07/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/package-summary.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/api/java/package-summary.html b/

[14/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaPairRDD.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaPairRDD.html b/site/doc

[10/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaSparkStatusTracker.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaSparkStatusTr

[27/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/ExceptionFailure.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/ExceptionFailure.html b/site/docs/1.6.3/a

[44/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/last_day.html -- diff --git a/site/docs/1.6.3/api/R/last_day.html b/site/docs/1.6.3/api/R/last_day.html new file mode 100644 index 000..e

[38/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/to_date.html -- diff --git a/site/docs/1.6.3/api/R/to_date.html b/site/docs/1.6.3/api/R/to_date.html new file mode 100644 index 000..0230

[28/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/CleanCheckpoint.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/CleanCheckpoint.html b/site/docs/1.6.3/api

[32/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/index.html -- diff --git a/site/docs/1.6.3/api/java/index.html b/site/docs/1.6.3/api/java/index.html new file mode 100644 index 000..f

[48/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/cacheTable.html -- diff --git a/site/docs/1.6.3/api/R/cacheTable.html b/site/docs/1.6.3/api/R/cacheTable.html new file mode 100644 index

[15/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaHadoopRDD.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaHadoopRDD.html b/site

[34/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/constant-values.html -- diff --git a/site/docs/1.6.3/api/java/constant-values.html b/site/docs/1.6.3/api/java/constant-values.html new fil

[40/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/shiftLeft.html -- diff --git a/site/docs/1.6.3/api/R/shiftLeft.html b/site/docs/1.6.3/api/R/shiftLeft.html new file mode 100644 index 000

[08/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/function/MapPartitionsFunction.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/api/java/function/

[42/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/printSchema.html -- diff --git a/site/docs/1.6.3/api/R/printSchema.html b/site/docs/1.6.3/api/R/printSchema.html new file mode 100644 index 0

[46/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/explain.html -- diff --git a/site/docs/1.6.3/api/R/explain.html b/site/docs/1.6.3/api/R/explain.html new file mode 100644 index 000..3fea

[01/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site f284a2687 -> 24d32b75d http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/graphx/PartitionStrategy.EdgePartition1D$.html

[19/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/SparkJobInfo.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/SparkJobInfo.html b/site/docs/1.6.3/api/java/

[24/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/RangeDependency.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/RangeDependency.html b/site/docs/1.6.3/api

[29/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/AccumulatorParam.IntAccumulatorParam$.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/AccumulatorParam.Int

[13/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaRDD.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaRDD.html b/site/docs/1.6.3/a

[50/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/README.md -- diff --git a/site/docs/1.6.3/README.md b/site/docs/1.6.3/README.md new file mode 100644 index 000..bcea93e --- /dev/null +++ b/site

[37/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/write.json.html -- diff --git a/site/docs/1.6.3/api/R/write.json.html b/site/docs/1.6.3/api/R/write.json.html new file mode 100644 index

[33/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/index-all.html -- diff --git a/site/docs/1.6.3/api/java/index-all.html b/site/docs/1.6.3/api/java/index-all.html new file mode 100644 inde

svn commit: r16850 - /dev/spark/spark-1.6.3/

2016-11-06 Thread rxin
Author: rxin Date: Sun Nov 6 07:41:46 2016 New Revision: 16850 Log: Add 1.6.3 artifacts Added: dev/spark/spark-1.6.3/ dev/spark/spark-1.6.3/spark-1.6.3-bin-cdh4.tgz (with props) dev/spark/spark-1.6.3/spark-1.6.3-bin-cdh4.tgz.asc dev/spark/spark-1.6.3/spark-1.6.3-bin-cdh4

svn commit: r16856 - /dev/spark/spark-1.6.3/ /release/spark/spark-1.6.3/

2016-11-06 Thread rxin
Author: rxin Date: Sun Nov 6 19:51:19 2016 New Revision: 16856 Log: Release 1.6.3 artifacts Added: release/spark/spark-1.6.3/ - copied from r16855, dev/spark/spark-1.6.3/ Removed: dev/spark/spark-1.6.3/ - To

spark git commit: [SPARK-18269][SQL] CSV datasource should read null properly when schema is lager than parsed tokens

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/master b89d0556d -> 556a3b7d0 [SPARK-18269][SQL] CSV datasource should read null properly when schema is lager than parsed tokens ## What changes were proposed in this pull request? Currently, there are the three cases when reading CSV by dataso

spark git commit: [SPARK-18269][SQL] CSV datasource should read null properly when schema is lager than parsed tokens

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 d2f2cf68a -> a8fbcdbf2 [SPARK-18269][SQL] CSV datasource should read null properly when schema is lager than parsed tokens ## What changes were proposed in this pull request? Currently, there are the three cases when reading CSV by da

spark git commit: [SPARK-18173][SQL] data source tables should support truncating partition

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/master 556a3b7d0 -> 46b2e4999 [SPARK-18173][SQL] data source tables should support truncating partition ## What changes were proposed in this pull request? Previously `TRUNCATE TABLE ... PARTITION` will always truncate the whole table for data s

spark git commit: [SPARK-18173][SQL] data source tables should support truncating partition

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 a8fbcdbf2 -> 9c78d355c [SPARK-18173][SQL] data source tables should support truncating partition ## What changes were proposed in this pull request? Previously `TRUNCATE TABLE ... PARTITION` will always truncate the whole table for da

[spark] Git Push Summary

2016-11-06 Thread rxin
Repository: spark Updated Tags: refs/tags/v1.6.3-rc2 [deleted] 1e8607474 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-11-06 Thread rxin
Repository: spark Updated Tags: refs/tags/v1.6.3-rc1 [deleted] 7375bb0c8 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-11-06 Thread rxin
Repository: spark Updated Tags: refs/tags/v1.6.3 [created] 1e8607474 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-11-06 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.2-rc1 [deleted] 1c2908eeb - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-18167][SQL] Disable flaky hive partition pruning test.

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/master 46b2e4999 -> 07ac3f09d [SPARK-18167][SQL] Disable flaky hive partition pruning test. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/07ac3f09 Tree: http://git-wip-us.ap

spark git commit: [SPARK-18167][SQL] Disable flaky hive partition pruning test.

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 9c78d355c -> 9ebd5e563 [SPARK-18167][SQL] Disable flaky hive partition pruning test. (cherry picked from commit 07ac3f09daf2b28436bc69f76badd1e36d756e4d) Signed-off-by: Reynold Xin Project: http://git-wip-us.apache.org/repos/asf/spar

[1/2] spark git commit: [SPARK-18296][SQL] Use consistent naming for expression test suites

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/master 07ac3f09d -> 9db06c442 http://git-wip-us.apache.org/repos/asf/spark/blob/9db06c44/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/NullFunctionsSuite.scala

[1/2] spark git commit: [SPARK-18296][SQL] Use consistent naming for expression test suites

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 9ebd5e563 -> 2fa1a632a http://git-wip-us.apache.org/repos/asf/spark/blob/2fa1a632/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/NullFunctionsSuite.scala

[2/2] spark git commit: [SPARK-18296][SQL] Use consistent naming for expression test suites

2016-11-06 Thread rxin
uites consistent with this naming convention. ## How was this patch tested? This is a test-only naming change. Author: Reynold Xin Closes #15793 from rxin/SPARK-18296. (cherry picked from commit 9db06c442cf85e41d51c7b167817f4e7971bf0da) Signed-off-by: Reynold Xin Project: http://git-wip-us.apach

[2/2] spark git commit: [SPARK-18296][SQL] Use consistent naming for expression test suites

2016-11-06 Thread rxin
uites consistent with this naming convention. ## How was this patch tested? This is a test-only naming change. Author: Reynold Xin Closes #15793 from rxin/SPARK-18296. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9db06c44 Tree:

spark git commit: [SPARK-16904][SQL] Removal of Hive Built-in Hash Functions and TestHiveFunctionRegistry

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9db06c442 -> 57626a557 [SPARK-16904][SQL] Removal of Hive Built-in Hash Functions and TestHiveFunctionRegistry ### What changes were proposed in this pull request? Currently, the Hive built-in `hash` function is not being used in Spark si

spark git commit: [SPARK-16904][SQL] Removal of Hive Built-in Hash Functions and TestHiveFunctionRegistry

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 2fa1a632a -> 410102957 [SPARK-16904][SQL] Removal of Hive Built-in Hash Functions and TestHiveFunctionRegistry ### What changes were proposed in this pull request? Currently, the Hive built-in `hash` function is not being used in Spar

spark git commit: [SPARK-18086] Add support for Hive session vars.

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3eda05703 -> 9b0593d5e [SPARK-18086] Add support for Hive session vars. ## What changes were proposed in this pull request? This adds support for Hive variables: * Makes values set via `spark-sql --hivevar name=value` accessible * Adds `g

spark git commit: [SPARK-18086] Add support for Hive session vars.

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 4af82d56f -> 29f59c733 [SPARK-18086] Add support for Hive session vars. ## What changes were proposed in this pull request? This adds support for Hive variables: * Makes values set via `spark-sql --hivevar name=value` accessible * Add

spark git commit: [SPARK-18261][STRUCTURED STREAMING] Add statistics to MemorySink for joining

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 29f59c733 -> 4943929d8 [SPARK-18261][STRUCTURED STREAMING] Add statistics to MemorySink for joining ## What changes were proposed in this pull request? Right now, there is no way to join the output of a memory sink with any table: > U

spark git commit: [SPARK-18261][STRUCTURED STREAMING] Add statistics to MemorySink for joining

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9b0593d5e -> c1a0c66bd [SPARK-18261][STRUCTURED STREAMING] Add statistics to MemorySink for joining ## What changes were proposed in this pull request? Right now, there is no way to join the output of a memory sink with any table: > Unsup

spark git commit: [SPARK-18217][SQL] Disallow creating permanent views based on temporary views or UDFs

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 4943929d8 -> 4cb4e5ff0 [SPARK-18217][SQL] Disallow creating permanent views based on temporary views or UDFs ### What changes were proposed in this pull request? Based on the discussion in [SPARK-18209](https://issues.apache.org/jira/

spark git commit: [SPARK-18217][SQL] Disallow creating permanent views based on temporary views or UDFs

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master c1a0c66bd -> 1da64e1fa [SPARK-18217][SQL] Disallow creating permanent views based on temporary views or UDFs ### What changes were proposed in this pull request? Based on the discussion in [SPARK-18209](https://issues.apache.org/jira/brow

spark git commit: [SPARK-16575][CORE] partition calculation mismatch with sc.binaryFiles

2016-11-07 Thread rxin
rst replicated and then tested upon the changes. Also the unit tests have been checked and passed. This contribution is my original work and I licence the work to the project under the project's open source license srowen hvanhovell rxin vanzin skyluc kmader zsxwing datafarmer Please have

spark git commit: [SPARK-16575][CORE] partition calculation mismatch with sc.binaryFiles

2016-11-07 Thread rxin
rst replicated and then tested upon the changes. Also the unit tests have been checked and passed. This contribution is my original work and I licence the work to the project under the project's open source license srowen hvanhovell rxin vanzin skyluc kmader zsxwing datafarmer Please have

[2/3] spark-website git commit: Add 1.6.3 release.

2016-11-07 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/b9aa4c3e/site/news/spark-2-0-0-released.html -- diff --git a/site/news/spark-2-0-0-released.html b/site/news/spark-2-0-0-released.html index dd2f3e8..070d5ac 100644 --- a/s

[3/3] spark-website git commit: Add 1.6.3 release.

2016-11-07 Thread rxin
Add 1.6.3 release. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/b9aa4c3e Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/b9aa4c3e Diff: http://git-wip-us.apache.org/repos/asf/spark-website/di

[1/3] spark-website git commit: Add 1.6.3 release.

2016-11-07 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 24d32b75d -> b9aa4c3ee http://git-wip-us.apache.org/repos/asf/spark-website/blob/b9aa4c3e/site/releases/spark-release-1-2-1.html -- diff --git a/site/releases/spar

spark git commit: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-08 Thread rxin
Repository: spark Updated Branches: refs/heads/master 73feaa30e -> 9c419698f [SPARK-18191][CORE] Port RDD API to use commit protocol ## What changes were proposed in this pull request? This PR port RDD API to use commit protocol, the changes made here: 1. Add new internal helper class that sa

spark git commit: [SPARK-17703][SQL][BACKPORT-2.0] Add unnamed version of addReferenceObj for minor objects.

2016-11-08 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 2a6850c70 -> f441b9ac6 [SPARK-17703][SQL][BACKPORT-2.0] Add unnamed version of addReferenceObj for minor objects. ## What changes were proposed in this pull request? This is a backport of #15276. There are many minor objects in refer

spark git commit: [SPARK-18368] Fix regexp_replace with task serialization.

2016-11-08 Thread rxin
Repository: spark Updated Branches: refs/heads/master 4afa39e22 -> b9192bb3f [SPARK-18368] Fix regexp_replace with task serialization. ## What changes were proposed in this pull request? This makes the result value both transient and lazy, so that if the RegExpReplace object is initialized t

spark git commit: [SPARK-18368] Fix regexp_replace with task serialization.

2016-11-08 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 0dc14f129 -> f67208369 [SPARK-18368] Fix regexp_replace with task serialization. ## What changes were proposed in this pull request? This makes the result value both transient and lazy, so that if the RegExpReplace object is initializ

spark git commit: [SPARK-18368] Fix regexp_replace with task serialization.

2016-11-08 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 0cceb1bfe -> bdddc661b [SPARK-18368] Fix regexp_replace with task serialization. ## What changes were proposed in this pull request? This makes the result value both transient and lazy, so that if the RegExpReplace object is initializ

spark git commit: [SPARK-18370][SQL] Add table information to InsertIntoHadoopFsRelationCommand

2016-11-09 Thread rxin
Repository: spark Updated Branches: refs/heads/master d4028de97 -> d8b81f778 [SPARK-18370][SQL] Add table information to InsertIntoHadoopFsRelationCommand ## What changes were proposed in this pull request? `InsertIntoHadoopFsRelationCommand` does not keep track if it inserts into a table and

spark git commit: [SPARK-18370][SQL] Add table information to InsertIntoHadoopFsRelationCommand

2016-11-09 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 80f58510a -> 4424c901e [SPARK-18370][SQL] Add table information to InsertIntoHadoopFsRelationCommand ## What changes were proposed in this pull request? `InsertIntoHadoopFsRelationCommand` does not keep track if it inserts into a table

spark git commit: [SPARK-18191][CORE][FOLLOWUP] Call `setConf` if `OutputFormat` is `Configurable`.

2016-11-09 Thread rxin
Repository: spark Updated Branches: refs/heads/master d8b81f778 -> 64fbdf1aa [SPARK-18191][CORE][FOLLOWUP] Call `setConf` if `OutputFormat` is `Configurable`. ## What changes were proposed in this pull request? We should call `setConf` if `OutputFormat` is `Configurable`, this should be don

spark git commit: [SPARK-18262][BUILD][SQL] JSON.org license is now CatX

2016-11-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master 22a9d064e -> 16eaad9da [SPARK-18262][BUILD][SQL] JSON.org license is now CatX ## What changes were proposed in this pull request? Try excluding org.json:json from hive-exec dep as it's Cat X now. It may be the case that it's not used by t

spark git commit: [SPARK-18262][BUILD][SQL] JSON.org license is now CatX

2016-11-10 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 b54d71b6f -> 62236b9eb [SPARK-18262][BUILD][SQL] JSON.org license is now CatX ## What changes were proposed in this pull request? Try excluding org.json:json from hive-exec dep as it's Cat X now. It may be the case that it's not used

spark git commit: [SPARK-17993][SQL] Fix Parquet log output redirection

2016-11-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master 16eaad9da -> b533fa2b2 [SPARK-17993][SQL] Fix Parquet log output redirection (Link to Jira issue: https://issues.apache.org/jira/browse/SPARK-17993) ## What changes were proposed in this pull request? PR #14690 broke parquet log output red

spark git commit: [SPARK-17993][SQL] Fix Parquet log output redirection

2016-11-10 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 62236b9eb -> be3933ddf [SPARK-17993][SQL] Fix Parquet log output redirection (Link to Jira issue: https://issues.apache.org/jira/browse/SPARK-17993) ## What changes were proposed in this pull request? PR #14690 broke parquet log output

spark git commit: [SPARK-17990][SPARK-18302][SQL] correct several partition related behaviours of ExternalCatalog

2016-11-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master b533fa2b2 -> 2f7461f31 [SPARK-17990][SPARK-18302][SQL] correct several partition related behaviours of ExternalCatalog ## What changes were proposed in this pull request? This PR corrects several partition related behaviors of `ExternalCa

spark git commit: [SPARK-17990][SPARK-18302][SQL] correct several partition related behaviours of ExternalCatalog

2016-11-10 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 be3933ddf -> c602894f2 [SPARK-17990][SPARK-18302][SQL] correct several partition related behaviours of ExternalCatalog ## What changes were proposed in this pull request? This PR corrects several partition related behaviors of `Extern

spark git commit: [SPARK-18403][SQL] Temporarily disable flaky ObjectHashAggregateSuite

2016-11-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master 2f7461f31 -> e0deee1f7 [SPARK-18403][SQL] Temporarily disable flaky ObjectHashAggregateSuite ## What changes were proposed in this pull request? Randomized tests in `ObjectHashAggregateSuite` is being flaky and breaks PR builds. This PR d

spark git commit: [SPARK-18185] Fix all forms of INSERT / OVERWRITE TABLE for Datasource tables

2016-11-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master e0deee1f7 -> a3356343c [SPARK-18185] Fix all forms of INSERT / OVERWRITE TABLE for Datasource tables ## What changes were proposed in this pull request? As of current 2.1, INSERT OVERWRITE with dynamic partitions against a Datasource tabl

spark git commit: [SPARK-18185] Fix all forms of INSERT / OVERWRITE TABLE for Datasource tables

2016-11-10 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 c602894f2 -> 064d4315f [SPARK-18185] Fix all forms of INSERT / OVERWRITE TABLE for Datasource tables ## What changes were proposed in this pull request? As of current 2.1, INSERT OVERWRITE with dynamic partitions against a Datasource

[spark] Git Push Summary

2016-11-11 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.2 [created] 584354eaa - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-11-11 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.2-rc3 [deleted] 584354eaa - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-11-11 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.2-rc2 [deleted] a6abe1ee2 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-18387][SQL] Add serialization to checkEvaluation.

2016-11-11 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 6e7310590 -> 99575e88f [SPARK-18387][SQL] Add serialization to checkEvaluation. ## What changes were proposed in this pull request? This removes the serialization test from RegexpExpressionsSuite and replaces it by serializing all expr

spark git commit: [SPARK-18387][SQL] Add serialization to checkEvaluation.

2016-11-11 Thread rxin
Repository: spark Updated Branches: refs/heads/master d42bb7cc4 -> 6e95325fc [SPARK-18387][SQL] Add serialization to checkEvaluation. ## What changes were proposed in this pull request? This removes the serialization test from RegexpExpressionsSuite and replaces it by serializing all expressi

spark git commit: [SPARK-18387][SQL] Add serialization to checkEvaluation.

2016-11-11 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 465e4b40b -> 87820da78 [SPARK-18387][SQL] Add serialization to checkEvaluation. ## What changes were proposed in this pull request? This removes the serialization test from RegexpExpressionsSuite and replaces it by serializing all expr

[09/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/java/org/apache/spark/JobExecutionStatus.html -- diff --git a/site/docs/2.0.2/api/java/org/apache/spark/JobExecutionStatus.html b/site/docs/2.0

[19/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/java/constant-values.html -- diff --git a/site/docs/2.0.2/api/java/constant-values.html b/site/docs/2.0.2/api/java/constant-values.html new fil

[12/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/java/org/apache/spark/ComplexFutureAction.html -- diff --git a/site/docs/2.0.2/api/java/org/apache/spark/ComplexFutureAction.html b/site/docs/2

[30/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/R/sd.html -- diff --git a/site/docs/2.0.2/api/R/sd.html b/site/docs/2.0.2/api/R/sd.html new file mode 100644 index 000..38f67ec --- /dev/nul

[04/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/java/org/apache/spark/SparkJobInfo.html -- diff --git a/site/docs/2.0.2/api/java/org/apache/spark/SparkJobInfo.html b/site/docs/2.0.2/api/java/

[24/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/R/window.html -- diff --git a/site/docs/2.0.2/api/R/window.html b/site/docs/2.0.2/api/R/window.html new file mode 100644 index 000..01536c1

[38/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/R/install.spark.html -- diff --git a/site/docs/2.0.2/api/R/install.spark.html b/site/docs/2.0.2/api/R/install.spark.html new file mode 100644 i

[01/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site b9aa4c3ee -> 0bd363165 http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/java/org/apache/spark/UnknownReason.html -- diff --gi

[06/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/java/org/apache/spark/SparkContext.html -- diff --git a/site/docs/2.0.2/api/java/org/apache/spark/SparkContext.html b/site/docs/2.0.2/api/java/

[45/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/R/corr.html -- diff --git a/site/docs/2.0.2/api/R/corr.html b/site/docs/2.0.2/api/R/corr.html new file mode 100644 index 000..9f058a4 --- /d

[07/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/java/org/apache/spark/SparkConf.html -- diff --git a/site/docs/2.0.2/api/java/org/apache/spark/SparkConf.html b/site/docs/2.0.2/api/java/org/ap

[14/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/java/org/apache/spark/AccumulatorParam.IntAccumulatorParam$.html -- diff --git a/site/docs/2.0.2/api/java/org/apache/spark/AccumulatorParam.Int

[02/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/java/org/apache/spark/TaskKilled.html -- diff --git a/site/docs/2.0.2/api/java/org/apache/spark/TaskKilled.html b/site/docs/2.0.2/api/java/org/

[22/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/R/write.text.html -- diff --git a/site/docs/2.0.2/api/R/write.text.html b/site/docs/2.0.2/api/R/write.text.html new file mode 100644 index

[37/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/R/last_day.html -- diff --git a/site/docs/2.0.2/api/R/last_day.html b/site/docs/2.0.2/api/R/last_day.html new file mode 100644 index 000..a

[11/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/java/org/apache/spark/ExecutorRemoved.html -- diff --git a/site/docs/2.0.2/api/java/org/apache/spark/ExecutorRemoved.html b/site/docs/2.0.2/api

[17/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/java/index.html -- diff --git a/site/docs/2.0.2/api/java/index.html b/site/docs/2.0.2/api/java/index.html new file mode 100644 index 000..f

[23/51] [partial] spark-website git commit: Add docs for 2.0.2.

2016-11-11 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0bd36316/site/docs/2.0.2/api/R/write.jdbc.html -- diff --git a/site/docs/2.0.2/api/R/write.jdbc.html b/site/docs/2.0.2/api/R/write.jdbc.html new file mode 100644 index

<    5   6   7   8   9   10   11   12   13   14   >