spark git commit: [SPARK-22848][SQL] Eliminate mutable state from Stack

2017-12-20 Thread wenchen
Repository: spark Updated Branches: refs/heads/master d3ae3e1e8 -> cb9fc8d9b [SPARK-22848][SQL] Eliminate mutable state from Stack ## What changes were proposed in this pull request? This PR eliminates mutable states from the generated code for `Stack`. ## How was this patch tested?

svn commit: r23837 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_20_20_01-d3ae3e1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-20 Thread pwendell
Author: pwendell Date: Thu Dec 21 04:14:51 2017 New Revision: 23837 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_20_20_01-d3ae3e1 docs [This commit notification would consist of 1415 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-19634][SQL][ML][FOLLOW-UP] Improve interface of dataframe vectorized summarizer

2017-12-20 Thread yliang
Repository: spark Updated Branches: refs/heads/master 9c289a5cb -> d3ae3e1e8 [SPARK-19634][SQL][ML][FOLLOW-UP] Improve interface of dataframe vectorized summarizer ## What changes were proposed in this pull request? Make several improvements in dataframe vectorized summarizer. 1. Make the

spark git commit: [SPARK-22387][SQL] Propagate session configs to data source read/write options

2017-12-20 Thread wenchen
Repository: spark Updated Branches: refs/heads/master fb0562f34 -> 9c289a5cb [SPARK-22387][SQL] Propagate session configs to data source read/write options ## What changes were proposed in this pull request? Introduce a new interface `SessionConfigSupport` for `DataSourceV2`, it can help to

spark git commit: [SPARK-22810][ML][PYSPARK] Expose Python API for LinearRegression with huber loss.

2017-12-20 Thread yliang
Repository: spark Updated Branches: refs/heads/master 0114c89d0 -> fb0562f34 [SPARK-22810][ML][PYSPARK] Expose Python API for LinearRegression with huber loss. ## What changes were proposed in this pull request? Expose Python API for _LinearRegression_ with _huber_ loss. ## How was this

svn commit: r23836 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_20_16_01-b176014-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-20 Thread pwendell
Author: pwendell Date: Thu Dec 21 00:14:53 2017 New Revision: 23836 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_20_16_01-b176014 docs [This commit notification would consist of 1414 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22845][SCHEDULER] Modify spark.kubernetes.allocation.batch.delay to take time instead of int

2017-12-20 Thread vanzin
Repository: spark Updated Branches: refs/heads/master b17601485 -> 0114c89d0 [SPARK-22845][SCHEDULER] Modify spark.kubernetes.allocation.batch.delay to take time instead of int ## What changes were proposed in this pull request? Fixing configuration that was taking an int which should take

spark git commit: [SPARK-22847][CORE] Remove redundant code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 792915c84 -> b17601485 [SPARK-22847][CORE] Remove redundant code in AppStatusListener while assigning schedulingPool for stage ## What changes were proposed in this pull request? In AppStatusListener's onStageSubmitted(event:

spark git commit: [SPARK-22830] Scala Coding style has been improved in Spark Examples

2017-12-20 Thread srowen
Repository: spark Updated Branches: refs/heads/master c89b43118 -> 792915c84 [SPARK-22830] Scala Coding style has been improved in Spark Examples ## What changes were proposed in this pull request? * Under Spark Scala Examples: Some of the syntax were written like Java way, It has been

svn commit: r23834 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_20_12_02-c89b431-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-20 Thread pwendell
Author: pwendell Date: Wed Dec 20 20:18:05 2017 New Revision: 23834 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_20_12_02-c89b431 docs [This commit notification would consist of 1414 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22849] ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread lixiao
Repository: spark Updated Branches: refs/heads/master d762d110d -> c89b43118 [SPARK-22849] ivy.retrieve pattern should also consider `classifier` ## What changes were proposed in this pull request? In the previous PR https://github.com/apache/spark/pull/5755#discussion_r157848354, we dropped

spark git commit: [SPARK-22832][ML] BisectingKMeans unpersist unused datasets

2017-12-20 Thread srowen
Repository: spark Updated Branches: refs/heads/master 7798c9e6e -> d762d110d [SPARK-22832][ML] BisectingKMeans unpersist unused datasets ## What changes were proposed in this pull request? unpersist unused datasets ## How was this patch tested? existing tests and local check in Spark-Shell

spark git commit: [SPARK-22824] Restore old offset for binary compatibility

2017-12-20 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 7570eab6b -> 7798c9e6e [SPARK-22824] Restore old offset for binary compatibility ## What changes were proposed in this pull request? Some users depend on source compatibility with the org.apache.spark.sql.execution.streaming.Offset

spark git commit: [SPARK-22788][STREAMING] Use correct hadoop config for fs append support.

2017-12-20 Thread irashid
Repository: spark Updated Branches: refs/heads/master 9962390af -> 7570eab6b [SPARK-22788][STREAMING] Use correct hadoop config for fs append support. Still look at the old one in case any Spark user is setting it explicitly, though. Author: Marcelo Vanzin Closes

svn commit: r23819 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_20_00_01-9962390-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-20 Thread pwendell
Author: pwendell Date: Wed Dec 20 08:14:46 2017 New Revision: 23819 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_20_00_01-9962390 docs [This commit notification would consist of 1414 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]