[3/3] spark-website git commit: Add 1.6.3 release.

2016-11-07 Thread rxin
Add 1.6.3 release. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/b9aa4c3e Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/b9aa4c3e Diff:

[2/3] spark-website git commit: Add 1.6.3 release.

2016-11-07 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/b9aa4c3e/site/news/spark-2-0-0-released.html -- diff --git a/site/news/spark-2-0-0-released.html b/site/news/spark-2-0-0-released.html index dd2f3e8..070d5ac 100644 ---

spark git commit: [SPARK-16575][CORE] partition calculation mismatch with sc.binaryFiles

2016-11-07 Thread rxin
rst replicated and then tested upon the changes. Also the unit tests have been checked and passed. This contribution is my original work and I licence the work to the project under the project's open source license srowen hvanhovell rxin vanzin skyluc kmader zsxwing datafarmer Please have a l

spark git commit: [SPARK-16575][CORE] partition calculation mismatch with sc.binaryFiles

2016-11-07 Thread rxin
rst replicated and then tested upon the changes. Also the unit tests have been checked and passed. This contribution is my original work and I licence the work to the project under the project's open source license srowen hvanhovell rxin vanzin skyluc kmader zsxwing datafarmer Please have a l

spark git commit: [SPARK-18217][SQL] Disallow creating permanent views based on temporary views or UDFs

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master c1a0c66bd -> 1da64e1fa [SPARK-18217][SQL] Disallow creating permanent views based on temporary views or UDFs ### What changes were proposed in this pull request? Based on the discussion in

spark git commit: [SPARK-18217][SQL] Disallow creating permanent views based on temporary views or UDFs

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 4943929d8 -> 4cb4e5ff0 [SPARK-18217][SQL] Disallow creating permanent views based on temporary views or UDFs ### What changes were proposed in this pull request? Based on the discussion in

spark git commit: [SPARK-18261][STRUCTURED STREAMING] Add statistics to MemorySink for joining

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 29f59c733 -> 4943929d8 [SPARK-18261][STRUCTURED STREAMING] Add statistics to MemorySink for joining ## What changes were proposed in this pull request? Right now, there is no way to join the output of a memory sink with any table: >

spark git commit: [SPARK-18261][STRUCTURED STREAMING] Add statistics to MemorySink for joining

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9b0593d5e -> c1a0c66bd [SPARK-18261][STRUCTURED STREAMING] Add statistics to MemorySink for joining ## What changes were proposed in this pull request? Right now, there is no way to join the output of a memory sink with any table: >

spark git commit: [SPARK-18086] Add support for Hive session vars.

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 4af82d56f -> 29f59c733 [SPARK-18086] Add support for Hive session vars. ## What changes were proposed in this pull request? This adds support for Hive variables: * Makes values set via `spark-sql --hivevar name=value` accessible *

spark git commit: [SPARK-18086] Add support for Hive session vars.

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3eda05703 -> 9b0593d5e [SPARK-18086] Add support for Hive session vars. ## What changes were proposed in this pull request? This adds support for Hive variables: * Makes values set via `spark-sql --hivevar name=value` accessible * Adds

spark git commit: [SPARK-16904][SQL] Removal of Hive Built-in Hash Functions and TestHiveFunctionRegistry

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 2fa1a632a -> 410102957 [SPARK-16904][SQL] Removal of Hive Built-in Hash Functions and TestHiveFunctionRegistry ### What changes were proposed in this pull request? Currently, the Hive built-in `hash` function is not being used in

spark git commit: [SPARK-16904][SQL] Removal of Hive Built-in Hash Functions and TestHiveFunctionRegistry

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9db06c442 -> 57626a557 [SPARK-16904][SQL] Removal of Hive Built-in Hash Functions and TestHiveFunctionRegistry ### What changes were proposed in this pull request? Currently, the Hive built-in `hash` function is not being used in Spark

[2/2] spark git commit: [SPARK-18296][SQL] Use consistent naming for expression test suites

2016-11-06 Thread rxin
consistent with this naming convention. ## How was this patch tested? This is a test-only naming change. Author: Reynold Xin <r...@databricks.com> Closes #15793 from rxin/SPARK-18296. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf

[2/2] spark git commit: [SPARK-18296][SQL] Use consistent naming for expression test suites

2016-11-06 Thread rxin
consistent with this naming convention. ## How was this patch tested? This is a test-only naming change. Author: Reynold Xin <r...@databricks.com> Closes #15793 from rxin/SPARK-18296. (cherry picked from commit 9db06c442cf85e41d51c7b167817f4e7971bf0da) Signed-off-by: Reynold Xin <r...@datab

[1/2] spark git commit: [SPARK-18296][SQL] Use consistent naming for expression test suites

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 9ebd5e563 -> 2fa1a632a http://git-wip-us.apache.org/repos/asf/spark/blob/2fa1a632/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/NullFunctionsSuite.scala

[1/2] spark git commit: [SPARK-18296][SQL] Use consistent naming for expression test suites

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/master 07ac3f09d -> 9db06c442 http://git-wip-us.apache.org/repos/asf/spark/blob/9db06c44/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/NullFunctionsSuite.scala

spark git commit: [SPARK-18167][SQL] Disable flaky hive partition pruning test.

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 9c78d355c -> 9ebd5e563 [SPARK-18167][SQL] Disable flaky hive partition pruning test. (cherry picked from commit 07ac3f09daf2b28436bc69f76badd1e36d756e4d) Signed-off-by: Reynold Xin Project:

spark git commit: [SPARK-18167][SQL] Disable flaky hive partition pruning test.

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/master 46b2e4999 -> 07ac3f09d [SPARK-18167][SQL] Disable flaky hive partition pruning test. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/07ac3f09 Tree:

[spark] Git Push Summary

2016-11-06 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.2-rc1 [deleted] 1c2908eeb - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-11-06 Thread rxin
Repository: spark Updated Tags: refs/tags/v1.6.3 [created] 1e8607474 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-11-06 Thread rxin
Repository: spark Updated Tags: refs/tags/v1.6.3-rc1 [deleted] 7375bb0c8 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-11-06 Thread rxin
Repository: spark Updated Tags: refs/tags/v1.6.3-rc2 [deleted] 1e8607474 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-18173][SQL] data source tables should support truncating partition

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 a8fbcdbf2 -> 9c78d355c [SPARK-18173][SQL] data source tables should support truncating partition ## What changes were proposed in this pull request? Previously `TRUNCATE TABLE ... PARTITION` will always truncate the whole table for

spark git commit: [SPARK-18173][SQL] data source tables should support truncating partition

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/master 556a3b7d0 -> 46b2e4999 [SPARK-18173][SQL] data source tables should support truncating partition ## What changes were proposed in this pull request? Previously `TRUNCATE TABLE ... PARTITION` will always truncate the whole table for data

spark git commit: [SPARK-18269][SQL] CSV datasource should read null properly when schema is lager than parsed tokens

2016-11-06 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 d2f2cf68a -> a8fbcdbf2 [SPARK-18269][SQL] CSV datasource should read null properly when schema is lager than parsed tokens ## What changes were proposed in this pull request? Currently, there are the three cases when reading CSV by

[48/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/cacheTable.html -- diff --git a/site/docs/1.6.3/api/R/cacheTable.html b/site/docs/1.6.3/api/R/cacheTable.html new file mode 100644 index

[15/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaHadoopRDD.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaHadoopRDD.html

[34/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/constant-values.html -- diff --git a/site/docs/1.6.3/api/java/constant-values.html b/site/docs/1.6.3/api/java/constant-values.html new

[40/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/shiftLeft.html -- diff --git a/site/docs/1.6.3/api/R/shiftLeft.html b/site/docs/1.6.3/api/R/shiftLeft.html new file mode 100644 index

[01/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site f284a2687 -> 24d32b75d http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/graphx/PartitionStrategy.EdgePartition1D$.html

[19/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/SparkJobInfo.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/SparkJobInfo.html

[24/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/RangeDependency.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/RangeDependency.html

[29/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/AccumulatorParam.IntAccumulatorParam$.html -- diff --git

[13/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaRDD.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaRDD.html

[50/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/README.md -- diff --git a/site/docs/1.6.3/README.md b/site/docs/1.6.3/README.md new file mode 100644 index 000..bcea93e --- /dev/null +++

[37/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/write.json.html -- diff --git a/site/docs/1.6.3/api/R/write.json.html b/site/docs/1.6.3/api/R/write.json.html new file mode 100644 index

[33/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/index-all.html -- diff --git a/site/docs/1.6.3/api/java/index-all.html b/site/docs/1.6.3/api/java/index-all.html new file mode 100644

[14/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaPairRDD.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaPairRDD.html

[10/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaSparkStatusTracker.html -- diff --git

[08/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/function/MapPartitionsFunction.html -- diff --git

[42/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/printSchema.html -- diff --git a/site/docs/1.6.3/api/R/printSchema.html b/site/docs/1.6.3/api/R/printSchema.html new file mode 100644 index

[46/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/explain.html -- diff --git a/site/docs/1.6.3/api/R/explain.html b/site/docs/1.6.3/api/R/explain.html new file mode 100644 index

[44/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/last_day.html -- diff --git a/site/docs/1.6.3/api/R/last_day.html b/site/docs/1.6.3/api/R/last_day.html new file mode 100644 index

[38/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/to_date.html -- diff --git a/site/docs/1.6.3/api/R/to_date.html b/site/docs/1.6.3/api/R/to_date.html new file mode 100644 index

[28/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/CleanCheckpoint.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/CleanCheckpoint.html

[21/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/SparkContext.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/SparkContext.html

[30/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/Accumulable.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/Accumulable.html

[11/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaSparkContext.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaSparkContext.html

[12/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaRDDLike.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaRDDLike.html

[20/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/SparkEnv.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/SparkEnv.html

[43/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/minute.html -- diff --git a/site/docs/1.6.3/api/R/minute.html b/site/docs/1.6.3/api/R/minute.html new file mode 100644 index

[36/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/allclasses-frame.html -- diff --git a/site/docs/1.6.3/api/java/allclasses-frame.html b/site/docs/1.6.3/api/java/allclasses-frame.html new

[49/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/agg.html -- diff --git a/site/docs/1.6.3/api/R/agg.html b/site/docs/1.6.3/api/R/agg.html new file mode 100644 index 000..3994971 ---

[23/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/SimpleFutureAction.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/SimpleFutureAction.html

[05/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/broadcast/Broadcast.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/broadcast/Broadcast.html

[26/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/HashPartitioner.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/HashPartitioner.html

[35/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/allclasses-noframe.html -- diff --git a/site/docs/1.6.3/api/java/allclasses-noframe.html

[22/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/SparkContext.DoubleAccumulatorParam$.html -- diff --git

[02/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/graphx/GraphLoader.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/graphx/GraphLoader.html

[07/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/package-summary.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/api/java/package-summary.html

[32/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/index.html -- diff --git a/site/docs/1.6.3/api/java/index.html b/site/docs/1.6.3/api/java/index.html new file mode 100644 index

[27/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/ExceptionFailure.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/ExceptionFailure.html

[16/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaDoubleRDD.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/api/java/JavaDoubleRDD.html

[17/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/TaskResultLost.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/TaskResultLost.html

[03/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/graphx/Graph.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/graphx/Graph.html

[45/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/hashCode.html -- diff --git a/site/docs/1.6.3/api/R/hashCode.html b/site/docs/1.6.3/api/R/hashCode.html new file mode 100644 index

[06/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/r/RRDD.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/api/r/RRDD.html

[47/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/cume_dist.html -- diff --git a/site/docs/1.6.3/api/R/cume_dist.html b/site/docs/1.6.3/api/R/cume_dist.html new file mode 100644 index

[41/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/row_number.html -- diff --git a/site/docs/1.6.3/api/R/row_number.html b/site/docs/1.6.3/api/R/row_number.html new file mode 100644 index

[09/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/api/java/function/FlatMapGroupsFunction.html -- diff --git

[25/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/Logging.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/Logging.html

[18/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/Success.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/Success.html

[31/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/lib/jquery.js -- diff --git a/site/docs/1.6.3/api/java/lib/jquery.js b/site/docs/1.6.3/api/java/lib/jquery.js new file mode 100644 index

[04/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/java/org/apache/spark/graphx/EdgeContext.html -- diff --git a/site/docs/1.6.3/api/java/org/apache/spark/graphx/EdgeContext.html

[39/51] [partial] spark-website git commit: Add 1.6.3 doc.

2016-11-06 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/24d32b75/site/docs/1.6.3/api/R/str.html -- diff --git a/site/docs/1.6.3/api/R/str.html b/site/docs/1.6.3/api/R/str.html new file mode 100644 index 000..170cdb4 ---

spark git commit: [SPARK-17183][SPARK-17983][SPARK-18101][SQL] put hive serde table schema to table properties like data source table

2016-11-05 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 42386e796 -> d3b606690 [SPARK-17183][SPARK-17983][SPARK-18101][SQL] put hive serde table schema to table properties like data source table ## What changes were proposed in this pull request? For data source tables, we will put its

spark git commit: [SPARK-17183][SPARK-17983][SPARK-18101][SQL] put hive serde table schema to table properties like data source table

2016-11-05 Thread rxin
Repository: spark Updated Branches: refs/heads/master 6e2701815 -> 95ec4e25b [SPARK-17183][SPARK-17983][SPARK-18101][SQL] put hive serde table schema to table properties like data source table ## What changes were proposed in this pull request? For data source tables, we will put its table

spark git commit: [SPARK-18260] Make from_json null safe

2016-11-05 Thread rxin
Repository: spark Updated Branches: refs/heads/master 8a9ca1924 -> 6e2701815 [SPARK-18260] Make from_json null safe ## What changes were proposed in this pull request? `from_json` is currently not safe against `null` rows. This PR adds a fix and a regression test for it. ## How was this

spark git commit: [SPARK-18260] Make from_json null safe

2016-11-05 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 707630147 -> 42386e796 [SPARK-18260] Make from_json null safe ## What changes were proposed in this pull request? `from_json` is currently not safe against `null` rows. This PR adds a fix and a regression test for it. ## How was

spark git commit: [SPARK-17710][FOLLOW UP] Add comments to state why 'Utils.classForName' is not used

2016-11-05 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 491db67a5 -> 707630147 [SPARK-17710][FOLLOW UP] Add comments to state why 'Utils.classForName' is not used ## What changes were proposed in this pull request? Add comments. ## How was this patch tested? Build passed. Author: Weiqing

spark git commit: [SPARK-17710][FOLLOW UP] Add comments to state why 'Utils.classForName' is not used

2016-11-05 Thread rxin
Repository: spark Updated Branches: refs/heads/master 0f7c9e84e -> 8a9ca1924 [SPARK-17710][FOLLOW UP] Add comments to state why 'Utils.classForName' is not used ## What changes were proposed in this pull request? Add comments. ## How was this patch tested? Build passed. Author: Weiqing

spark git commit: [SPARK-18189] [SQL] [Followup] Move test from ReplSuite to prevent java.lang.ClassCircularityError

2016-11-05 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 0a303a694 -> 491db67a5 [SPARK-18189] [SQL] [Followup] Move test from ReplSuite to prevent java.lang.ClassCircularityError closes #15774 (cherry picked from commit 0f7c9e84e0d00813bf56712097677add5657f19f) Signed-off-by: Reynold Xin

spark git commit: [SPARK-18189] [SQL] [Followup] Move test from ReplSuite to prevent java.lang.ClassCircularityError

2016-11-05 Thread rxin
Repository: spark Updated Branches: refs/heads/master 0e3312ee7 -> 0f7c9e84e [SPARK-18189] [SQL] [Followup] Move test from ReplSuite to prevent java.lang.ClassCircularityError closes #15774 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-18189][SQL][FOLLOWUP] Move test from ReplSuite to prevent java.lang.ClassCircularityError

2016-11-05 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 399597b04 -> 8b99e204a [SPARK-18189][SQL][FOLLOWUP] Move test from ReplSuite to prevent java.lang.ClassCircularityError ## What changes were proposed in this pull request? Move the test which is causing java.lang.ClassCircularityError

spark git commit: [SPARK-17337][SPARK-16804][SQL][BRANCH-2.0] Backport subquery related PRs

2016-11-04 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 c864e8a80 -> 399597b04 [SPARK-17337][SPARK-16804][SQL][BRANCH-2.0] Backport subquery related PRs ## What changes were proposed in this pull request? This PR backports two subquery related PRs to branch-2.0: -

spark git commit: [SPARK-18197][CORE] Optimise AppendOnlyMap implementation

2016-11-04 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 cfe76028b -> a2d7e25e7 [SPARK-18197][CORE] Optimise AppendOnlyMap implementation ## What changes were proposed in this pull request? This improvement works by using the fastest comparison test first and we observed a 1% throughput

spark git commit: [SPARK-18197][CORE] Optimise AppendOnlyMap implementation

2016-11-04 Thread rxin
Repository: spark Updated Branches: refs/heads/master 14f235d56 -> a42d738c5 [SPARK-18197][CORE] Optimise AppendOnlyMap implementation ## What changes were proposed in this pull request? This improvement works by using the fastest comparison test first and we observed a 1% throughput

spark git commit: Closing some stale/invalid pull requests

2016-11-04 Thread rxin
Repository: spark Updated Branches: refs/heads/master 27602c337 -> 14f235d56 Closing some stale/invalid pull requests Closes #15758 Closes #15753 Closes #12708 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/14f235d5

spark git commit: [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an initial capacity in OpenHashSet

2016-11-04 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 dae1581d9 -> c864e8a80 [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an initial capacity in OpenHashSet ## What changes were proposed in this pull request? This is a follow-up PR of #15741 in order to keep `nextPowerOf2`

spark git commit: [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an initial capacity in OpenHashSet

2016-11-04 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 8e145a94b -> cfe76028b [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an initial capacity in OpenHashSet ## What changes were proposed in this pull request? This is a follow-up PR of #15741 in order to keep `nextPowerOf2`

spark git commit: [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an initial capacity in OpenHashSet

2016-11-04 Thread rxin
Repository: spark Updated Branches: refs/heads/master a08463b1d -> 27602c337 [SPARK-18200][GRAPHX][FOLLOW-UP] Support zero as an initial capacity in OpenHashSet ## What changes were proposed in this pull request? This is a follow-up PR of #15741 in order to keep `nextPowerOf2` consistent.

spark git commit: [SPARK-18259][SQL] Do not capture Throwable in QueryExecution

2016-11-03 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 37550c492 -> 91d567150 [SPARK-18259][SQL] Do not capture Throwable in QueryExecution ## What changes were proposed in this pull request? `QueryExecution.toString` currently captures `java.lang.Throwable`s; this is far from a best

spark git commit: [SPARK-18259][SQL] Do not capture Throwable in QueryExecution

2016-11-03 Thread rxin
Repository: spark Updated Branches: refs/heads/master dc4c60098 -> aa412c55e [SPARK-18259][SQL] Do not capture Throwable in QueryExecution ## What changes were proposed in this pull request? `QueryExecution.toString` currently captures `java.lang.Throwable`s; this is far from a best practice

spark git commit: [SPARK-18138][DOCS] Document that Java 7, Python 2.6, Scala 2.10, Hadoop < 2.6 are deprecated in Spark 2.1.0

2016-11-03 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 af60b1ebb -> 37550c492 [SPARK-18138][DOCS] Document that Java 7, Python 2.6, Scala 2.10, Hadoop < 2.6 are deprecated in Spark 2.1.0 ## What changes were proposed in this pull request? Document that Java 7, Python 2.6, Scala 2.10,

spark git commit: [SPARK-18138][DOCS] Document that Java 7, Python 2.6, Scala 2.10, Hadoop < 2.6 are deprecated in Spark 2.1.0

2016-11-03 Thread rxin
Repository: spark Updated Branches: refs/heads/master f22954ad4 -> dc4c60098 [SPARK-18138][DOCS] Document that Java 7, Python 2.6, Scala 2.10, Hadoop < 2.6 are deprecated in Spark 2.1.0 ## What changes were proposed in this pull request? Document that Java 7, Python 2.6, Scala 2.10, Hadoop

spark git commit: [SPARK-18257][SS] Improve error reporting for FileStressSuite

2016-11-03 Thread rxin
d I manually verified error reporting by injecting some bug in the addBatch code for FileStreamSink. Author: Reynold Xin <r...@databricks.com> Closes #15757 from rxin/SPARK-18257. (cherry picked from commit f22954ad49bf5a32c7b6d8487cd38ffe0da904ca) Signed-off-by: Reynold Xin <r...@da

spark git commit: [SPARK-18257][SS] Improve error reporting for FileStressSuite

2016-11-03 Thread rxin
d I manually verified error reporting by injecting some bug in the addBatch code for FileStreamSink. Author: Reynold Xin <r...@databricks.com> Closes #15757 from rxin/SPARK-18257. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spa

spark git commit: [SPARK-18237][HIVE] hive.exec.stagingdir have no effect

2016-11-03 Thread rxin
Repository: spark Updated Branches: refs/heads/master b17057c0a -> 16293311c [SPARK-18237][HIVE] hive.exec.stagingdir have no effect hive.exec.stagingdir have no effect in spark2.0.1, Hive confs in hive-site.xml will be loaded in `hadoopConf`, so we should use `hadoopConf` in

spark git commit: [SPARK-18237][HIVE] hive.exec.stagingdir have no effect

2016-11-03 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 4f91630c8 -> 3e139e239 [SPARK-18237][HIVE] hive.exec.stagingdir have no effect hive.exec.stagingdir have no effect in spark2.0.1, Hive confs in hive-site.xml will be loaded in `hadoopConf`, so we should use `hadoopConf` in

spark git commit: [SPARK-18244][SQL] Rename partitionProviderIsHive -> tracksPartitionsInCatalog

2016-11-03 Thread rxin
atalog, as the old name was too Hive specific. ## How was this patch tested? Should be covered by existing tests. Author: Reynold Xin <r...@databricks.com> Closes #15750 from rxin/SPARK-18244. (cherry picked from commit b17057c0a69b9c56e503483d97f5dc209eef0884) Signed-off-by: Reynold Xin <r...

<    1   2   3   4   5   6   7   8   9   10   >