spark git commit: [SPARK-19058][SQL] fix partition related behaviors with DataFrameWriter.saveAsTable

2017-01-04 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 6873430cb -> 30345c43b [SPARK-19058][SQL] fix partition related behaviors with DataFrameWriter.saveAsTable ## What changes were proposed in this pull request? When we append data to a partitioned table with `DataFrameWriter.saveAsTable`,

spark git commit: [SPARK-18877][SQL][BACKPORT-2.0] CSVInferSchema.inferField` on DecimalType should find a common type with `typeSoFar`

2017-01-04 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.0 5ed2f1c11 -> 93549ff96 [SPARK-18877][SQL][BACKPORT-2.0] CSVInferSchema.inferField` on DecimalType should find a common type with `typeSoFar` ## What changes were proposed in this pull request? CSV type inferencing causes

[1/3] spark-website git commit: Spark Summit East (Feb 7-9th, 2017, Boston) agenda posted

2017-01-04 Thread yhuai
Repository: spark-website Updated Branches: refs/heads/asf-site 426a68ba8 -> 46a7a8027 http://git-wip-us.apache.org/repos/asf/spark-website/blob/46a7a802/site/screencasts/1-first-steps-with-spark.html -- diff --git

[3/3] spark-website git commit: Spark Summit East (Feb 7-9th, 2017, Boston) agenda posted

2017-01-04 Thread yhuai
Spark Summit East (Feb 7-9th, 2017, Boston) agenda posted Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/46a7a802 Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/46a7a802 Diff:

[2/3] spark-website git commit: Spark Summit East (Feb 7-9th, 2017, Boston) agenda posted

2017-01-04 Thread yhuai
http://git-wip-us.apache.org/repos/asf/spark-website/blob/46a7a802/site/news/spark-summit-2014-videos-posted.html -- diff --git a/site/news/spark-summit-2014-videos-posted.html b/site/news/spark-summit-2014-videos-posted.html

spark git commit: [SPARK-19009][DOC] Add streaming rest api doc

2017-01-04 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 00074b577 -> 6873430cb [SPARK-19009][DOC] Add streaming rest api doc ## What changes were proposed in this pull request? add streaming rest api doc related to pr #16253 cc saturday-shi srowen ## How was this patch tested? Author:

spark git commit: [SPARK-19062] Utils.writeByteBuffer bug fix

2017-01-04 Thread kayousterhout
Repository: spark Updated Branches: refs/heads/master 4262fb0d5 -> 00074b577 [SPARK-19062] Utils.writeByteBuffer bug fix This commit changes Utils.writeByteBuffer so that it does not change the position of the ByteBuffer that it writes out, and adds a unit test for this functionality. cc

spark git commit: [SPARK-18877][SQL][BACKPORT-2.1] CSVInferSchema.inferField` on DecimalType should find a common type with `typeSoFar`

2017-01-04 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.1 776255065 -> 1ecf1a953 [SPARK-18877][SQL][BACKPORT-2.1] CSVInferSchema.inferField` on DecimalType should find a common type with `typeSoFar` ## What changes were proposed in this pull request? CSV type inferencing causes

spark git commit: [SPARK-19070] Clean-up dataset actions

2017-01-04 Thread wenchen
Repository: spark Updated Branches: refs/heads/master a1e40b1f5 -> 4262fb0d5 [SPARK-19070] Clean-up dataset actions ## What changes were proposed in this pull request? Dataset actions currently spin off a new `Dataframe` only to track query execution. This PR simplifies this code path by

spark git commit: [MINOR][DOCS] Remove consecutive duplicated words/typo in Spark Repo

2017-01-04 Thread srowen
Repository: spark Updated Branches: refs/heads/master 7a8250581 -> a1e40b1f5 [MINOR][DOCS] Remove consecutive duplicated words/typo in Spark Repo ## What changes were proposed in this pull request? There are many locations in the Spark repo where the same word occurs consecutively. Sometimes

spark git commit: [SPARK-19054][ML] Eliminate extra pass in NB

2017-01-04 Thread srowen
Repository: spark Updated Branches: refs/heads/master 101556d0f -> 7a8250581 [SPARK-19054][ML] Eliminate extra pass in NB ## What changes were proposed in this pull request? eliminate unnecessary extra pass in NB's train ## How was this patch tested? existing tests Author: Zheng RuiFeng

spark git commit: [SPARK-19060][SQL] remove the supportsPartial flag in AggregateFunction

2017-01-04 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master fe1c895e1 -> 101556d0f [SPARK-19060][SQL] remove the supportsPartial flag in AggregateFunction ## What changes were proposed in this pull request? Now all aggregation functions support partial aggregate, we can remove the

spark git commit: [SPARK-19073] LauncherState should be only set to SUBMITTED after the application is submitted

2017-01-04 Thread srowen
Repository: spark Updated Branches: refs/heads/master cbd11d235 -> fe1c895e1 [SPARK-19073] LauncherState should be only set to SUBMITTED after the application is submitted ## What changes were proposed in this pull request? LauncherState should be only set to SUBMITTED after the application