svn commit: r27035 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_21_20_01-84d31aa-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-21 Thread pwendell
Author: pwendell Date: Tue May 22 03:16:35 2018 New Revision: 27035 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_21_20_01-84d31aa docs [This commit notification would consist of 1463 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24209][SHS] Automatic retrieve proxyBase from Knox headers

2018-05-21 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 32447079e -> 84d31aa5d [SPARK-24209][SHS] Automatic retrieve proxyBase from Knox headers ## What changes were proposed in this pull request? The PR retrieves the proxyBase automatically from the header `X-Forwarded-Context` (if

spark git commit: [SPARK-24309][CORE] AsyncEventQueue should stop on interrupt.

2018-05-21 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 d88f3e474 -> 70b866548 [SPARK-24309][CORE] AsyncEventQueue should stop on interrupt. EventListeners can interrupt the event queue thread. In particular, when the EventLoggingListener writes to hdfs, hdfs can interrupt the thread.

spark git commit: [SPARK-24309][CORE] AsyncEventQueue should stop on interrupt.

2018-05-21 Thread vanzin
Repository: spark Updated Branches: refs/heads/master b550b2a1a -> 32447079e [SPARK-24309][CORE] AsyncEventQueue should stop on interrupt. EventListeners can interrupt the event queue thread. In particular, when the EventLoggingListener writes to hdfs, hdfs can interrupt the thread. When

svn commit: r27034 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_21_16_01-b550b2a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-21 Thread pwendell
Author: pwendell Date: Mon May 21 23:15:45 2018 New Revision: 27034 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_21_16_01-b550b2a docs [This commit notification would consist of 1463 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24325] Tests for Hadoop's LinesReader

2018-05-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/master ffaefe755 -> b550b2a1a [SPARK-24325] Tests for Hadoop's LinesReader ## What changes were proposed in this pull request? The tests cover basic functionality of [Hadoop

spark git commit: [SPARK-7132][ML] Add fit with validation set to spark.ml GBT

2018-05-21 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master a33dcf4a0 -> ffaefe755 [SPARK-7132][ML] Add fit with validation set to spark.ml GBT ## What changes were proposed in this pull request? Add fit with validation set to spark.ml GBT ## How was this patch tested? Will add later. Author:

spark git commit: [SPARK-24234][SS] Reader for continuous processing shuffle

2018-05-21 Thread tdas
Repository: spark Updated Branches: refs/heads/master 03e90f65b -> a33dcf4a0 [SPARK-24234][SS] Reader for continuous processing shuffle ## What changes were proposed in this pull request? Read RDD for continuous processing shuffle, as well as the initial RPC-based row receiver.

svn commit: r27028 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_21_12_01-03e90f6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-21 Thread pwendell
Author: pwendell Date: Mon May 21 19:16:00 2018 New Revision: 27028 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_21_12_01-03e90f6 docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24250][SQL] support accessing SQLConf inside tasks

2018-05-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master a6e883feb -> 03e90f65b [SPARK-24250][SQL] support accessing SQLConf inside tasks re-submit https://github.com/apache/spark/pull/21299 which broke build. A few new commits are added to fix the SQLConf problem in

svn commit: r27020 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_21_08_01-a6e883f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-21 Thread pwendell
Author: pwendell Date: Mon May 21 15:16:02 2018 New Revision: 27020 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_21_08_01-a6e883f docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23935][SQL] Adding map_entries function

2018-05-21 Thread ueshin
Repository: spark Updated Branches: refs/heads/master e480eccd9 -> a6e883feb [SPARK-23935][SQL] Adding map_entries function ## What changes were proposed in this pull request? This PR adds `map_entries` function that returns an unordered array of all entries in the given map. ## How was

svn commit: r27018 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_21_05_39-e480ecc-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-21 Thread pwendell
Author: pwendell Date: Mon May 21 12:53:39 2018 New Revision: 27018 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_21_05_39-e480ecc docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24323][SQL] Fix lint-java errors

2018-05-21 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 6d7d45a1a -> e480eccd9 [SPARK-24323][SQL] Fix lint-java errors ## What changes were proposed in this pull request? This PR fixes the following errors reported by `lint-java` ``` % dev/lint-java Using `mvn` from path: /usr/bin/mvn

spark git commit: [SPARK-24242][SQL] RangeExec should have correct outputOrdering and outputPartitioning

2018-05-21 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master f32b7faf7 -> 6d7d45a1a [SPARK-24242][SQL] RangeExec should have correct outputOrdering and outputPartitioning ## What changes were proposed in this pull request? Logical `Range` node has been added with `outputOrdering` recently. It's