svn commit: r28830 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_18_20_02-6b8fbbf-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-18 Thread pwendell
Author: pwendell Date: Sun Aug 19 03:16:10 2018 New Revision: 28830 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_18_20_02-6b8fbbf docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25141][SQL][TEST] Modify tests for higher-order functions to check bind method.

2018-08-18 Thread ueshin
Repository: spark Updated Branches: refs/heads/master a8a1ac01c -> 6b8fbbfb1 [SPARK-25141][SQL][TEST] Modify tests for higher-order functions to check bind method. ## What changes were proposed in this pull request? We should also check `HigherOrderFunction.bind` method passes expected

svn commit: r28828 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_18_12_02-a8a1ac0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-18 Thread pwendell
Author: pwendell Date: Sat Aug 18 19:16:12 2018 New Revision: 28828 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_18_12_02-a8a1ac0 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24959][SQL] Speed up count() for JSON and CSV

2018-08-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 14d7c1c3e -> a8a1ac01c [SPARK-24959][SQL] Speed up count() for JSON and CSV ## What changes were proposed in this pull request? In the PR, I propose to skip invoking of the CSV/JSON parser per each line in the case if the required schema

svn commit: r28824 - in /dev/spark/2.3.3-SNAPSHOT-2018_08_18_06_02-032f6d9-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-18 Thread pwendell
Author: pwendell Date: Sat Aug 18 13:16:05 2018 New Revision: 28824 Log: Apache Spark 2.3.3-SNAPSHOT-2018_08_18_06_02-032f6d9 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r28823 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_18_04_02-14d7c1c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-18 Thread pwendell
Author: pwendell Date: Sat Aug 18 11:18:19 2018 New Revision: 28823 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_18_04_02-14d7c1c docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24863][SS] Report Kafka offset lag as a custom metrics

2018-08-18 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 9047cc0f2 -> 14d7c1c3e [SPARK-24863][SS] Report Kafka offset lag as a custom metrics ## What changes were proposed in this pull request? This builds on top of SPARK-24748 to report 'offset lag' as a custom metrics for Kafka structured

spark git commit: [SPARK-24886][INFRA] Fix the testing script to increase timeout for Jenkins build (from 340m to 400m)

2018-08-18 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 4dd87d8ff -> 9047cc0f2 [SPARK-24886][INFRA] Fix the testing script to increase timeout for Jenkins build (from 340m to 400m) ## What changes were proposed in this pull request? This PR targets to increase the timeout from 340 to 400m.

spark git commit: [SPARK-25142][PYSPARK] Add error messages when Python worker could not open socket in `_load_from_socket`.

2018-08-18 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master f454d5287 -> 4dd87d8ff [SPARK-25142][PYSPARK] Add error messages when Python worker could not open socket in `_load_from_socket`. ## What changes were proposed in this pull request? Sometimes Python worker can't open socket in

spark git commit: [MINOR][DOC][SQL] use one line for annotation arg value

2018-08-18 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master e3cf13d7b -> f454d5287 [MINOR][DOC][SQL] use one line for annotation arg value ## What changes were proposed in this pull request? Put annotation args in one line, or API doc generation will fail. ~~~ [error]

spark git commit: [MINOR][DOC][SQL] use one line for annotation arg value

2018-08-18 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 34191e663 -> 032f6d9ba [MINOR][DOC][SQL] use one line for annotation arg value ## What changes were proposed in this pull request? Put annotation args in one line, or API doc generation will fail. ~~~ [error]

spark git commit: [SPARK-25137][SPARK SHELL] NumberFormatException` when starting spark-shell from Mac terminal

2018-08-18 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 10f2b6fa0 -> e3cf13d7b [SPARK-25137][SPARK SHELL] NumberFormatException` when starting spark-shell from Mac terminal ## What changes were proposed in this pull request? When starting spark-shell from Mac terminal (MacOS High Sirra

svn commit: r28822 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_18_00_02-10f2b6f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-18 Thread pwendell
Author: pwendell Date: Sat Aug 18 07:16:21 2018 New Revision: 28822 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_18_00_02-10f2b6f docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]