svn commit: r24045 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_05_20_01-bf65cd3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-05 Thread pwendell
Author: pwendell Date: Sat Jan 6 04:15:07 2018 New Revision: 24045 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_05_20_01-bf65cd3 docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r24044 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_05_18_01-3e3e938-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-05 Thread pwendell
Author: pwendell Date: Sat Jan 6 02:15:21 2018 New Revision: 24044 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_05_18_01-3e3e938 docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-22960][K8S] Revert use of ARG base_image in images

2018-01-05 Thread vanzin
Repository: spark Updated Branches: refs/heads/master e8af7e8ae -> bf65cd3cd [SPARK-22960][K8S] Revert use of ARG base_image in images ## What changes were proposed in this pull request? This PR reverts the `ARG base_image` before `FROM` in the images of driver, executor, and init-container,

spark git commit: [SPARK-22960][K8S] Revert use of ARG base_image in images

2018-01-05 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 bf853018c -> 3e3e9386e [SPARK-22960][K8S] Revert use of ARG base_image in images ## What changes were proposed in this pull request? This PR reverts the `ARG base_image` before `FROM` in the images of driver, executor, and init-contai

spark git commit: [SPARK-22937][SQL] SQL elt output binary for binary inputs

2018-01-05 Thread lixiao
Repository: spark Updated Branches: refs/heads/master ea9568330 -> e8af7e8ae [SPARK-22937][SQL] SQL elt output binary for binary inputs ## What changes were proposed in this pull request? This pr modified `elt` to output binary for binary inputs. `elt` in the current master always output data

spark git commit: [SPARK-22937][SQL] SQL elt output binary for binary inputs

2018-01-05 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 55afac4e7 -> bf853018c [SPARK-22937][SQL] SQL elt output binary for binary inputs ## What changes were proposed in this pull request? This pr modified `elt` to output binary for binary inputs. `elt` in the current master always output d

spark git commit: [SPARK-22914][DEPLOY] Register history.ui.port

2018-01-05 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 d1f422c1c -> 55afac4e7 [SPARK-22914][DEPLOY] Register history.ui.port ## What changes were proposed in this pull request? Register spark.history.ui.port as a known spark conf to be used in substitution expressions even if it's not set

spark git commit: [SPARK-22914][DEPLOY] Register history.ui.port

2018-01-05 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 930b90a84 -> ea9568330 [SPARK-22914][DEPLOY] Register history.ui.port ## What changes were proposed in this pull request? Register spark.history.ui.port as a known spark conf to be used in substitution expressions even if it's not set exp

svn commit: r24043 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_05_14_01-d1f422c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-05 Thread pwendell
Author: pwendell Date: Fri Jan 5 22:15:17 2018 New Revision: 24043 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_05_14_01-d1f422c docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r24042 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_05_12_01-930b90a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-05 Thread pwendell
Author: pwendell Date: Fri Jan 5 20:15:02 2018 New Revision: 24042 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_05_12_01-930b90a docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-13030][ML] Follow-up cleanups for OneHotEncoderEstimator

2018-01-05 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-2.3 0a30e9350 -> d1f422c1c [SPARK-13030][ML] Follow-up cleanups for OneHotEncoderEstimator ## What changes were proposed in this pull request? Follow-up cleanups for the OneHotEncoderEstimator PR. See some discussion in the original PR:

spark git commit: [SPARK-13030][ML] Follow-up cleanups for OneHotEncoderEstimator

2018-01-05 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master c0b7424ec -> 930b90a84 [SPARK-13030][ML] Follow-up cleanups for OneHotEncoderEstimator ## What changes were proposed in this pull request? Follow-up cleanups for the OneHotEncoderEstimator PR. See some discussion in the original PR: http

svn commit: r24041 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_05_10_01-0a30e93-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-05 Thread pwendell
Author: pwendell Date: Fri Jan 5 18:15:23 2018 New Revision: 24041 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_05_10_01-0a30e93 docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-22940][SQL] HiveExternalCatalogVersionsSuite should succeed on platforms that don't have wget

2018-01-05 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 fd4e30476 -> 0a30e9350 [SPARK-22940][SQL] HiveExternalCatalogVersionsSuite should succeed on platforms that don't have wget ## What changes were proposed in this pull request? Modified HiveExternalCatalogVersionsSuite.scala to use Uti

spark git commit: [SPARK-22940][SQL] HiveExternalCatalogVersionsSuite should succeed on platforms that don't have wget

2018-01-05 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 51c33bd0d -> c0b7424ec [SPARK-22940][SQL] HiveExternalCatalogVersionsSuite should succeed on platforms that don't have wget ## What changes were proposed in this pull request? Modified HiveExternalCatalogVersionsSuite.scala to use Utils.d

svn commit: r24040 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_05_08_01-51c33bd-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-05 Thread pwendell
Author: pwendell Date: Fri Jan 5 16:17:56 2018 New Revision: 24040 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_05_08_01-51c33bd docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r24039 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_05_06_01-fd4e304-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-05 Thread pwendell
Author: pwendell Date: Fri Jan 5 14:15:01 2018 New Revision: 24039 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_05_06_01-fd4e304 docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-22961][REGRESSION] Constant columns should generate QueryPlanConstraints

2018-01-05 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 f9dcdbcef -> fd4e30476 [SPARK-22961][REGRESSION] Constant columns should generate QueryPlanConstraints ## What changes were proposed in this pull request? #19201 introduced the following regression: given something like `df.withColumn

spark git commit: [SPARK-22961][REGRESSION] Constant columns should generate QueryPlanConstraints

2018-01-05 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 6cff7d19f -> 51c33bd0d [SPARK-22961][REGRESSION] Constant columns should generate QueryPlanConstraints ## What changes were proposed in this pull request? #19201 introduced the following regression: given something like `df.withColumn("c"

svn commit: r24037 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_05_02_01-f9dcdbc-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-05 Thread pwendell
Author: pwendell Date: Fri Jan 5 10:15:21 2018 New Revision: 24037 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_05_02_01-f9dcdbc docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r24035 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_05_00_01-6cff7d1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-05 Thread pwendell
Author: pwendell Date: Fri Jan 5 08:15:59 2018 New Revision: 24035 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_05_00_01-6cff7d1 docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---