spark git commit: [SPARK-23907] Removes regr_* functions in functions.scala

2018-05-11 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master f27a035da -> e3dabdf6e [SPARK-23907] Removes regr_* functions in functions.scala ## What changes were proposed in this pull request? This patch removes the various regr_* functions in functions.scala. They are so uncommon that I don't

svn commit: r26865 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_11_20_01-f27a035-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-11 Thread pwendell
Author: pwendell Date: Sat May 12 03:16:06 2018 New Revision: 26865 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_11_20_01-f27a035 docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r26862 - in /dev/spark/2.3.1-SNAPSHOT-2018_05_11_18_01-7de4bef-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-11 Thread pwendell
Author: pwendell Date: Sat May 12 01:15:20 2018 New Revision: 26862 Log: Apache Spark 2.3.1-SNAPSHOT-2018_05_11_18_01-7de4bef docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARKR] Require Java 8 for SparkR

2018-05-11 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.3 1d598b771 -> 7de4bef9e [SPARKR] Require Java 8 for SparkR This change updates the SystemRequirements and also includes a runtime check if the JVM is being launched by R. The runtime check is done by querying `java -version` ## How

spark git commit: [SPARKR] Require Java 8 for SparkR

2018-05-11 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 92f6f52ff -> f27a035da [SPARKR] Require Java 8 for SparkR This change updates the SystemRequirements and also includes a runtime check if the JVM is being launched by R. The runtime check is done by querying `java -version` ## How was

[1/2] spark git commit: [PYSPARK] Update py4j to version 0.10.7.

2018-05-11 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.1 8177b2148 -> 1d569f684 [PYSPARK] Update py4j to version 0.10.7. (cherry picked from commit cc613b552e753d03cb62661591de59e1c8d82c74) Signed-off-by: Marcelo Vanzin (cherry picked from commit

[2/2] spark git commit: [SPARKR] Match pyspark features in SparkR communication protocol.

2018-05-11 Thread vanzin
[SPARKR] Match pyspark features in SparkR communication protocol. (cherry picked from commit 628c7b517969c4a7ccb26ea67ab3dd61266073ca) Signed-off-by: Marcelo Vanzin (cherry picked from commit 16cd9ac5264831e061c033b26fe1173ebc88e5d1) Signed-off-by: Marcelo Vanzin

svn commit: r26859 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_11_16_01-92f6f52-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-11 Thread pwendell
Author: pwendell Date: Fri May 11 23:15:44 2018 New Revision: 26859 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_11_16_01-92f6f52 docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r26856 - in /dev/spark/2.3.1-SNAPSHOT-2018_05_11_14_01-1d598b7-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-11 Thread pwendell
Author: pwendell Date: Fri May 11 21:15:49 2018 New Revision: 26856 Log: Apache Spark 2.3.1-SNAPSHOT-2018_05_11_14_01-1d598b7 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r26854 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_11_12_01-928845a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-11 Thread pwendell
Author: pwendell Date: Fri May 11 19:16:20 2018 New Revision: 26854 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_11_12_01-928845a docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24067][BACKPORT-2.3][STREAMING][KAFKA] Allow non-consecutive offsets

2018-05-11 Thread koeninger
Repository: spark Updated Branches: refs/heads/branch-2.3 414e4e3d7 -> 1d598b771 [SPARK-24067][BACKPORT-2.3][STREAMING][KAFKA] Allow non-consecutive offsets ## What changes were proposed in this pull request? Backport of the bugfix in SPARK-17147 Add a configuration

spark git commit: [SPARK-24172][SQL] we should not apply operator pushdown to data source v2 many times

2018-05-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 54032682b -> 928845a42 [SPARK-24172][SQL] we should not apply operator pushdown to data source v2 many times ## What changes were proposed in this pull request? In `PushDownOperatorsToDataSource`, we use `transformUp` to match

[1/2] spark git commit: [PYSPARK] Update py4j to version 0.10.7.

2018-05-11 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.2 f9d6a16ce -> f96d13dd6 [PYSPARK] Update py4j to version 0.10.7. (cherry picked from commit cc613b552e753d03cb62661591de59e1c8d82c74) Signed-off-by: Marcelo Vanzin (cherry picked from commit