spark git commit: add one supported type missing from the javadoc

Repository: spark Updated Branches: refs/heads/master e4fee395e -> c7c0b086a add one supported type missing from the javadoc ## What changes were proposed in this pull request? The supported java.math.BigInteger type is not mentioned in the javadoc of Encoders.bean() ## How was this patch

spark git commit: [SPARK-24216][SQL] Spark TypedAggregateExpression uses getSimpleName that is not safe in scala

Repository: spark Updated Branches: refs/heads/branch-2.3 d42610440 -> 9d63e540e [SPARK-24216][SQL] Spark TypedAggregateExpression uses getSimpleName that is not safe in scala When user create a aggregator object in scala and pass the aggregator to Spark Dataset's agg() method, Spark's will

svn commit: r27499 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_15_18_01-d426104-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Sat Jun 16 01:15:16 2018 New Revision: 27499 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_15_18_01-d426104 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27494 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_15_16_01-e4fee39-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Jun 15 23:16:01 2018 New Revision: 27494 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_15_16_01-e4fee39 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24452][SQL][CORE] Avoid possible overflow in int add or multiple

Repository: spark Updated Branches: refs/heads/branch-2.3 a7d378e78 -> d42610440 [SPARK-24452][SQL][CORE] Avoid possible overflow in int add or multiple This PR fixes possible overflow in int add or multiply. In particular, their overflows in multiply are detected by

spark git commit: [SPARK-24525][SS] Provide an option to limit number of rows in a MemorySink

Repository: spark Updated Branches: refs/heads/master 90da7dc24 -> e4fee395e [SPARK-24525][SS] Provide an option to limit number of rows in a MemorySink ## What changes were proposed in this pull request? Provide an option to limit number of rows in a MemorySink. Currently, MemorySink and

spark git commit: [SPARK-24452][SQL][CORE] Avoid possible overflow in int add or multiple

Repository: spark Updated Branches: refs/heads/master b5ccf0d39 -> 90da7dc24 [SPARK-24452][SQL][CORE] Avoid possible overflow in int add or multiple ## What changes were proposed in this pull request? This PR fixes possible overflow in int add or multiply. In particular, their overflows in

spark git commit: [SPARK-24396][SS][PYSPARK] Add Structured Streaming ForeachWriter for python

Repository: spark Updated Branches: refs/heads/master 495d8cf09 -> b5ccf0d39 [SPARK-24396][SS][PYSPARK] Add Structured Streaming ForeachWriter for python ## What changes were proposed in this pull request? This PR adds `foreach` for streaming queries in Python. Users will be able to specify

svn commit: r27492 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_15_12_01-495d8cf-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Jun 15 19:15:50 2018 New Revision: 27492 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_15_12_01-495d8cf docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27490 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_15_10_01-a7d378e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Jun 15 17:15:38 2018 New Revision: 27490 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_15_10_01-a7d378e docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24490][WEBUI] Use WebUI.addStaticHandler in web UIs

Repository: spark Updated Branches: refs/heads/master 6567fc43a -> 495d8cf09 [SPARK-24490][WEBUI] Use WebUI.addStaticHandler in web UIs `WebUI` defines `addStaticHandler` that web UIs don't use (and simply introduce duplication). Let's clean them up and remove duplications. Local build and

spark git commit: [SPARK-24531][TESTS] Replace 2.3.0 version with 2.3.1

Repository: spark Updated Branches: refs/heads/branch-2.3 d3255a571 -> a7d378e78 [SPARK-24531][TESTS] Replace 2.3.0 version with 2.3.1 The PR updates the 2.3 version tested to the new release 2.3.1. existing UTs Author: Marco Gaido Closes #21543 from mgaido91/patch-1. (cherry picked from

svn commit: r27484 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_15_06_01-d3255a5-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Jun 15 13:15:24 2018 New Revision: 27484 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_15_06_01-d3255a5 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: revert [SPARK-21743][SQL] top-most limit should not cause memory leak

Repository: spark Updated Branches: refs/heads/branch-2.3 7f1708a44 -> d3255a571 revert [SPARK-21743][SQL] top-most limit should not cause memory leak ## What changes were proposed in this pull request? There is a performance regression in Spark 2.3. When we read a big compressed text file

svn commit: r27481 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_15_04_02-6567fc4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Jun 15 11:20:31 2018 New Revision: 27481 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_15_04_02-6567fc4 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27480 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_15_02_01-7f1708a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Jun 15 09:15:40 2018 New Revision: 27480 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_15_02_01-7f1708a docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [PYTHON] Fix typo in serializer exception

Repository: spark Updated Branches: refs/heads/master 22daeba59 -> 6567fc43a [PYTHON] Fix typo in serializer exception ## What changes were proposed in this pull request? Fix typo in exception raised in Python serializer ## How was this patch tested? No code changes Please review

spark git commit: [PYTHON] Fix typo in serializer exception

Repository: spark Updated Branches: refs/heads/branch-2.3 e6bf325de -> 7f1708a44 [PYTHON] Fix typo in serializer exception ## What changes were proposed in this pull request? Fix typo in exception raised in Python serializer ## How was this patch tested? No code changes Please review

svn commit: r27475 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_15_00_01-22daeba-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Jun 15 07:17:08 2018 New Revision: 27475 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_15_00_01-22daeba docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]