[1/2] spark git commit: [SPARK-22789] Map-only continuous processing execution

2017-12-22 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master d23dc5b8e -> 8941a4abc http://git-wip-us.apache.org/repos/asf/spark/blob/8941a4ab/sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/sources/memoryV2.scala --

[2/2] spark git commit: [SPARK-22789] Map-only continuous processing execution

2017-12-22 Thread zsxwing
[SPARK-22789] Map-only continuous processing execution ## What changes were proposed in this pull request? Basic continuous execution, supporting map/flatMap/filter, with commits and advancement through RPC. ## How was this patch tested? new unit-ish tests (exercising execution end to end)

svn commit: r23873 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_22_16_01-d23dc5b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-22 Thread pwendell
Author: pwendell Date: Sat Dec 23 00:14:44 2017 New Revision: 23873 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_22_16_01-d23dc5b docs [This commit notification would consist of 1418 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22346][ML] VectorSizeHint Transformer for using VectorAssembler in StructuredSteaming

2017-12-22 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 13190a4f6 -> d23dc5b8e [SPARK-22346][ML] VectorSizeHint Transformer for using VectorAssembler in StructuredSteaming ## What changes were proposed in this pull request? A new VectorSizeHint transformer was added. This transformer is meant

svn commit: r23865 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_22_04_01-13190a4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-22 Thread pwendell
Author: pwendell Date: Fri Dec 22 12:18:50 2017 New Revision: 23865 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_22_04_01-13190a4 docs [This commit notification would consist of 1415 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22874][PYSPARK][SQL] Modify checking pandas version to use LooseVersion.

2017-12-22 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 8df1da396 -> 13190a4f6 [SPARK-22874][PYSPARK][SQL] Modify checking pandas version to use LooseVersion. ## What changes were proposed in this pull request? Currently we check pandas version by capturing if `ImportError` for the specific

svn commit: r23863 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_22_00_01-8df1da3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-22 Thread pwendell
Author: pwendell Date: Fri Dec 22 08:15:11 2017 New Revision: 23863 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_22_00_01-8df1da3 docs [This commit notification would consist of 1415 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]