svn commit: r31018 - in /dev/spark/3.0.0-SNAPSHOT-2018_11_20_20_57-4b7f7ef-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-20 Thread pwendell
Author: pwendell Date: Wed Nov 21 05:10:40 2018 New Revision: 31018 Log: Apache Spark 3.0.0-SNAPSHOT-2018_11_20_20_57-4b7f7ef docs [This commit notification would consist of 1755 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r31015 - in /dev/spark/2.4.1-SNAPSHOT-2018_11_20_18_56-d8e05d2-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-20 Thread pwendell
Author: pwendell Date: Wed Nov 21 03:10:31 2018 New Revision: 31015 Log: Apache Spark 2.4.1-SNAPSHOT-2018_11_20_18_56-d8e05d2 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-26120][TESTS][SS][SPARKR] Fix a streaming query leak in Structured Streaming R tests

2018-11-20 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.4 3bb9fff68 -> d8e05d23a [SPARK-26120][TESTS][SS][SPARKR] Fix a streaming query leak in Structured Streaming R tests ## What changes were proposed in this pull request? Stop the streaming query in `Specify a schema by using a

spark git commit: [SPARK-26120][TESTS][SS][SPARKR] Fix a streaming query leak in Structured Streaming R tests

2018-11-20 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 2df34db58 -> 4b7f7ef50 [SPARK-26120][TESTS][SS][SPARKR] Fix a streaming query leak in Structured Streaming R tests ## What changes were proposed in this pull request? Stop the streaming query in `Specify a schema by using a DDL-formatted

spark git commit: [SPARK-26122][SQL] Support encoding for multiLine in CSV datasource

2018-11-20 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 47851056c -> 2df34db58 [SPARK-26122][SQL] Support encoding for multiLine in CSV datasource ## What changes were proposed in this pull request? In the PR, I propose to pass the CSV option `encoding`/`charset` to `uniVocity` parser to

svn commit: r31014 - in /dev/spark/3.0.0-SNAPSHOT-2018_11_20_16_52-4785105-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-20 Thread pwendell
Author: pwendell Date: Wed Nov 21 01:05:38 2018 New Revision: 31014 Log: Apache Spark 3.0.0-SNAPSHOT-2018_11_20_16_52-4785105 docs [This commit notification would consist of 1755 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-26124][BUILD] Update plugins to latest versions

2018-11-20 Thread srowen
Repository: spark Updated Branches: refs/heads/master 23bcd6ce4 -> 47851056c [SPARK-26124][BUILD] Update plugins to latest versions ## What changes were proposed in this pull request? Update many plugins we use to the latest version, especially MiMa, which entails excluding some new errors

spark git commit: [SPARK-26043][HOTFIX] Hotfix a change to SparkHadoopUtil that doesn't work in 2.11

2018-11-20 Thread srowen
Repository: spark Updated Branches: refs/heads/master 42c48387c -> 23bcd6ce4 [SPARK-26043][HOTFIX] Hotfix a change to SparkHadoopUtil that doesn't work in 2.11 ## What changes were proposed in this pull request? Hotfix a change to SparkHadoopUtil that doesn't work in 2.11 ## How was this

svn commit: r31013 - in /dev/spark/2.4.1-SNAPSHOT-2018_11_20_14_51-3bb9fff-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-20 Thread pwendell
Author: pwendell Date: Tue Nov 20 23:07:56 2018 New Revision: 31013 Log: Apache Spark 2.4.1-SNAPSHOT-2018_11_20_14_51-3bb9fff docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r31012 - in /dev/spark/2.3.3-SNAPSHOT-2018_11_20_14_51-0fb830c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-20 Thread pwendell
Author: pwendell Date: Tue Nov 20 23:06:40 2018 New Revision: 31012 Log: Apache Spark 2.3.3-SNAPSHOT-2018_11_20_14_51-0fb830c docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r31009 - in /dev/spark/3.0.0-SNAPSHOT-2018_11_20_12_48-42c4838-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-20 Thread pwendell
Author: pwendell Date: Tue Nov 20 21:00:38 2018 New Revision: 31009 Log: Apache Spark 3.0.0-SNAPSHOT-2018_11_20_12_48-42c4838 docs [This commit notification would consist of 1755 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [BUILD] refactor dev/lint-python in to something readable

2018-11-20 Thread shaneknapp
Repository: spark Updated Branches: refs/heads/master db136d360 -> 42c48387c [BUILD] refactor dev/lint-python in to something readable ## What changes were proposed in this pull request? `dev/lint-python` is a mess of nearly unreadable bash. i would like to fix that as best as i can. ##

spark git commit: [SPARK-26084][SQL] Fixes unresolved AggregateExpression.references exception

2018-11-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.3 90e4dd1cb -> 0fb830c49 [SPARK-26084][SQL] Fixes unresolved AggregateExpression.references exception ## What changes were proposed in this pull request? This PR fixes an exception in `AggregateExpression.references` called on

spark git commit: [SPARK-26084][SQL] Fixes unresolved AggregateExpression.references exception

2018-11-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.4 c28a27a25 -> 3bb9fff68 [SPARK-26084][SQL] Fixes unresolved AggregateExpression.references exception ## What changes were proposed in this pull request? This PR fixes an exception in `AggregateExpression.references` called on

spark git commit: [SPARK-26084][SQL] Fixes unresolved AggregateExpression.references exception

2018-11-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master ab61ddb34 -> db136d360 [SPARK-26084][SQL] Fixes unresolved AggregateExpression.references exception ## What changes were proposed in this pull request? This PR fixes an exception in `AggregateExpression.references` called on unresolved

svn commit: r31003 - in /dev/spark/2.4.1-SNAPSHOT-2018_11_20_10_44-c28a27a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-20 Thread pwendell
Author: pwendell Date: Tue Nov 20 18:58:34 2018 New Revision: 31003 Log: Apache Spark 2.4.1-SNAPSHOT-2018_11_20_10_44-c28a27a docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r31001 - in /dev/spark/3.0.0-SNAPSHOT-2018_11_20_08_39-ab61ddb-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-20 Thread pwendell
Author: pwendell Date: Tue Nov 20 16:51:54 2018 New Revision: 31001 Log: Apache Spark 3.0.0-SNAPSHOT-2018_11_20_08_39-ab61ddb docs [This commit notification would consist of 1755 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-26118][WEB UI] Introducing spark.ui.requestHeaderSize for setting HTTP requestHeaderSize

2018-11-20 Thread irashid
Repository: spark Updated Branches: refs/heads/master c34c42234 -> ab61ddb34 [SPARK-26118][WEB UI] Introducing spark.ui.requestHeaderSize for setting HTTP requestHeaderSize ## What changes were proposed in this pull request? Introducing spark.ui.requestHeaderSize for configuring Jetty's

spark git commit: [SPARK-26118][WEB UI] Introducing spark.ui.requestHeaderSize for setting HTTP requestHeaderSize

2018-11-20 Thread irashid
Repository: spark Updated Branches: refs/heads/branch-2.4 096e0d8f0 -> c28a27a25 [SPARK-26118][WEB UI] Introducing spark.ui.requestHeaderSize for setting HTTP requestHeaderSize ## What changes were proposed in this pull request? Introducing spark.ui.requestHeaderSize for configuring Jetty's

spark git commit: [SPARK-26076][BUILD][MINOR] Revise ambiguous error message from load-spark-env.sh

2018-11-20 Thread srowen
Repository: spark Updated Branches: refs/heads/master a00aaf649 -> c34c42234 [SPARK-26076][BUILD][MINOR] Revise ambiguous error message from load-spark-env.sh ## What changes were proposed in this pull request? When I try to run scripts (e.g. `start-master.sh`/`start-history-server.sh ` in

spark git commit: [MINOR][YARN] Make memLimitExceededLogMessage more clean

2018-11-20 Thread srowen
Repository: spark Updated Branches: refs/heads/master a09d5ba88 -> a00aaf649 [MINOR][YARN] Make memLimitExceededLogMessage more clean ## What changes were proposed in this pull request? Current `memLimitExceededLogMessage`: