svn commit: r28730 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_14_20_02-ed075e1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-14 Thread pwendell
Author: pwendell Date: Wed Aug 15 03:16:35 2018 New Revision: 28730 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_14_20_02-ed075e1 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23874][SQL][PYTHON] Upgrade Apache Arrow to 0.10.0

2018-08-14 Thread cutlerb
Repository: spark Updated Branches: refs/heads/master 92fd7f321 -> ed075e1ff [SPARK-23874][SQL][PYTHON] Upgrade Apache Arrow to 0.10.0 ## What changes were proposed in this pull request? Upgrade Apache Arrow to 0.10.0 Version 0.10.0 has a number of bug fixes and improvements with the

spark git commit: [SPARK-25115][CORE] Eliminate extra memory copy done when a ByteBuf is used that is backed by > 1 ByteBuffer.

2018-08-14 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 3c614d056 -> 92fd7f321 [SPARK-25115][CORE] Eliminate extra memory copy done when a ByteBuf is used that is backed by > 1 ByteBuffer. …d by > 1 ByteBuffer. ## What changes were proposed in this pull request? Check how many ByteBuffer

spark git commit: [SPARK-25113][SQL] Add logging to CodeGenerator when any generated method's bytecode size goes above HugeMethodLimit

2018-08-14 Thread lixiao
Repository: spark Updated Branches: refs/heads/master b81e3031f -> 3c614d056 [SPARK-25113][SQL] Add logging to CodeGenerator when any generated method's bytecode size goes above HugeMethodLimit ## What changes were proposed in this pull request? Add logging for all generated methods from

svn commit: r28729 - in /dev/spark/2.3.3-SNAPSHOT-2018_08_14_14_01-34191e6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-14 Thread pwendell
Author: pwendell Date: Tue Aug 14 21:15:27 2018 New Revision: 28729 Log: Apache Spark 2.3.3-SNAPSHOT-2018_08_14_14_01-34191e6 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r28728 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_14_12_02-b81e303-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-14 Thread pwendell
Author: pwendell Date: Tue Aug 14 19:16:27 2018 New Revision: 28728 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_14_12_02-b81e303 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25043] print master and appId from spark-sql on startup

2018-08-14 Thread tgraves
Repository: spark Updated Branches: refs/heads/master 102487584 -> b81e3031f [SPARK-25043] print master and appId from spark-sql on startup ## What changes were proposed in this pull request? A small change to print the master and appId from spark-sql as with logging turned down all the way

spark git commit: [SPARK-25088][CORE][MESOS][DOCS] Update Rest Server docs & defaults.

2018-08-14 Thread srowen
Repository: spark Updated Branches: refs/heads/master 80784a1de -> 102487584 [SPARK-25088][CORE][MESOS][DOCS] Update Rest Server docs & defaults. ## What changes were proposed in this pull request? (a) disabled rest submission server by default in standalone mode (b) fails the standalone

spark git commit: [SPARK-25051][SQL] FixNullability should not stop on AnalysisBarrier

2018-08-14 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 0856b82b3 -> 34191e663 [SPARK-25051][SQL] FixNullability should not stop on AnalysisBarrier ## What changes were proposed in this pull request? The introduction of `AnalysisBarrier` prevented `FixNullability` to go through all the

spark git commit: [SPARK-18057][FOLLOW-UP] Use 127.0.0.1 to avoid zookeeper picking up an ipv6 address

2018-08-14 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 42263fd0c -> 80784a1de [SPARK-18057][FOLLOW-UP] Use 127.0.0.1 to avoid zookeeper picking up an ipv6 address ## What changes were proposed in this pull request? I'm still seeing the Kafka tests failed randomly due to

svn commit: r28724 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_14_08_02-42263fd-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-14 Thread pwendell
Author: pwendell Date: Tue Aug 14 15:17:02 2018 New Revision: 28724 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_14_08_02-42263fd docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r28721 - in /dev/spark/2.3.3-SNAPSHOT-2018_08_14_06_01-0856b82-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-14 Thread pwendell
Author: pwendell Date: Tue Aug 14 13:15:57 2018 New Revision: 28721 Log: Apache Spark 2.3.3-SNAPSHOT-2018_08_14_06_01-0856b82 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23938][SQL] Add map_zip_with function

2018-08-14 Thread ueshin
Repository: spark Updated Branches: refs/heads/master e2ab7deae -> 42263fd0c [SPARK-23938][SQL] Add map_zip_with function ## What changes were proposed in this pull request? This PR adds a new SQL function called ```map_zip_with```. It merges the two given maps into a single map by applying

spark git commit: [MINOR][SQL][DOC] Fix `to_json` example in function description and doc

2018-08-14 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.2 1e73ee248 -> 6641aa620 [MINOR][SQL][DOC] Fix `to_json` example in function description and doc ## What changes were proposed in this pull request? This PR fixes the an example for `to_json` in doc and function description. -

spark git commit: [MINOR][SQL][DOC] Fix `to_json` example in function description and doc

2018-08-14 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 29a040361 -> 0856b82b3 [MINOR][SQL][DOC] Fix `to_json` example in function description and doc ## What changes were proposed in this pull request? This PR fixes the an example for `to_json` in doc and function description. -

spark git commit: [MINOR][SQL][DOC] Fix `to_json` example in function description and doc

2018-08-14 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 3eb52092b -> e2ab7deae [MINOR][SQL][DOC] Fix `to_json` example in function description and doc ## What changes were proposed in this pull request? This PR fixes the an example for `to_json` in doc and function description. -

svn commit: r28708 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_14_00_02-3eb5209-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-14 Thread pwendell
Author: pwendell Date: Tue Aug 14 07:17:03 2018 New Revision: 28708 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_14_00_02-3eb5209 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r28707 - in /dev/spark/v2.3.2-rc5-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2018-08-14 Thread jshao
Author: jshao Date: Tue Aug 14 06:54:52 2018 New Revision: 28707 Log: Apache Spark v2.3.2-rc5 docs [This commit notification would consist of 1446 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]