svn commit: r24771 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_06_20_01-c36fecc-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-06 Thread pwendell
Author: pwendell Date: Wed Feb 7 04:15:20 2018 New Revision: 24771 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_06_20_01-c36fecc docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r24765 - in /dev/spark/2.3.1-SNAPSHOT-2018_02_06_18_01-874d3f8-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-06 Thread pwendell
Author: pwendell Date: Wed Feb 7 02:15:30 2018 New Revision: 24765 Log: Apache Spark 2.3.1-SNAPSHOT-2018_02_06_18_01-874d3f8 docs [This commit notification would consist of 1442 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23327][SQL] Update the description and tests of three external API or functions

2018-02-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master b96a083b1 -> c36fecc3b [SPARK-23327][SQL] Update the description and tests of three external API or functions ## What changes were proposed in this pull request? Update the description and tests of three external API or functions `createF

spark git commit: [SPARK-23327][SQL] Update the description and tests of three external API or functions

2018-02-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 f9c913263 -> 874d3f89f [SPARK-23327][SQL] Update the description and tests of three external API or functions ## What changes were proposed in this pull request? Update the description and tests of three external API or functions `cre

svn commit: r24764 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_06_16_01-b96a083-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-06 Thread pwendell
Author: pwendell Date: Wed Feb 7 00:15:01 2018 New Revision: 24764 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_06_16_01-b96a083 docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r24762 - in /dev/spark/2.3.1-SNAPSHOT-2018_02_06_14_01-f9c9132-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-06 Thread pwendell
Author: pwendell Date: Tue Feb 6 22:15:24 2018 New Revision: 24762 Log: Apache Spark 2.3.1-SNAPSHOT-2018_02_06_14_01-f9c9132 docs [This commit notification would consist of 1442 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23315][SQL] failed to get output from canonicalized data source v2 related plans

2018-02-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 775e1 -> f9c913263 [SPARK-23315][SQL] failed to get output from canonicalized data source v2 related plans ## What changes were proposed in this pull request? `DataSourceV2Relation` keeps a `fullOutput` and resolves the real outp

spark git commit: [SPARK-23315][SQL] failed to get output from canonicalized data source v2 related plans

2018-02-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master caf304456 -> b96a083b1 [SPARK-23315][SQL] failed to get output from canonicalized data source v2 related plans ## What changes were proposed in this pull request? `DataSourceV2Relation` keeps a `fullOutput` and resolves the real output o

spark git commit: [MINOR][TEST] Fix class name for Pandas UDF tests

2018-02-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 036a04b29 -> 775e1 [MINOR][TEST] Fix class name for Pandas UDF tests In https://github.com/apache/spark/commit/b2ce17b4c9fea58140a57ca1846b2689b15c0d61, I mistakenly renamed `VectorizedUDFTests` to `ScalarPandasUDF`. This PR fixes

spark git commit: [MINOR][TEST] Fix class name for Pandas UDF tests

2018-02-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master ac7454cac -> caf304456 [MINOR][TEST] Fix class name for Pandas UDF tests ## What changes were proposed in this pull request? In https://github.com/apache/spark/commit/b2ce17b4c9fea58140a57ca1846b2689b15c0d61, I mistakenly renamed `Vector

spark git commit: [SPARK-23312][SQL][FOLLOWUP] add a config to turn off vectorized cache reader

2018-02-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 7782fd03a -> 036a04b29 [SPARK-23312][SQL][FOLLOWUP] add a config to turn off vectorized cache reader ## What changes were proposed in this pull request? https://github.com/apache/spark/pull/20483 tried to provide a way to turn off the

spark git commit: [SPARK-23312][SQL][FOLLOWUP] add a config to turn off vectorized cache reader

2018-02-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 7db9979ba -> ac7454cac [SPARK-23312][SQL][FOLLOWUP] add a config to turn off vectorized cache reader ## What changes were proposed in this pull request? https://github.com/apache/spark/pull/20483 tried to provide a way to turn off the new

svn commit: r24747 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_06_12_01-7db9979-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-06 Thread pwendell
Author: pwendell Date: Tue Feb 6 20:15:32 2018 New Revision: 24747 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_06_12_01-7db9979 docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23310][CORE][FOLLOWUP] Fix Java style check issues.

2018-02-06 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 a51154482 -> 7782fd03a [SPARK-23310][CORE][FOLLOWUP] Fix Java style check issues. ## What changes were proposed in this pull request? This is a follow-up of #20492 which broke lint-java checks. This pr fixes the lint-java issues. ```

spark git commit: [SPARK-23310][CORE][FOLLOWUP] Fix Java style check issues.

2018-02-06 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 63c5bf13c -> 7db9979ba [SPARK-23310][CORE][FOLLOWUP] Fix Java style check issues. ## What changes were proposed in this pull request? This is a follow-up of #20492 which broke lint-java checks. This pr fixes the lint-java issues. ``` [ERR

spark-website git commit: Direct security-related emails to secur...@apache.org for Spark

2018-02-06 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 464ddc703 -> 3f874c90a Direct security-related emails to secur...@apache.org for Spark Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/3f874c9

svn commit: r24725 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_06_04_01-63c5bf1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-06 Thread pwendell
Author: pwendell Date: Tue Feb 6 12:21:01 2018 New Revision: 24725 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_06_04_01-63c5bf1 docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r24723 - in /dev/spark/2.3.1-SNAPSHOT-2018_02_06_02_01-a511544-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-06 Thread pwendell
Author: pwendell Date: Tue Feb 6 10:15:57 2018 New Revision: 24723 Log: Apache Spark 2.3.1-SNAPSHOT-2018_02_06_02_01-a511544 docs [This commit notification would consist of 1442 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23334][SQL][PYTHON] Fix pandas_udf with return type StringType() to handle str type properly in Python 2.

2018-02-06 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 44933033e -> a51154482 [SPARK-23334][SQL][PYTHON] Fix pandas_udf with return type StringType() to handle str type properly in Python 2. ## What changes were proposed in this pull request? In Python 2, when `pandas_udf` tries to return

spark git commit: [SPARK-23334][SQL][PYTHON] Fix pandas_udf with return type StringType() to handle str type properly in Python 2.

2018-02-06 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 8141c3e3d -> 63c5bf13c [SPARK-23334][SQL][PYTHON] Fix pandas_udf with return type StringType() to handle str type properly in Python 2. ## What changes were proposed in this pull request? In Python 2, when `pandas_udf` tries to return str

spark git commit: [SPARK-23290][SQL][PYTHON][BACKPORT-2.3] Use datetime.date for date type when converting Spark DataFrame to Pandas DataFrame.

2018-02-06 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 521494d7b -> 44933033e [SPARK-23290][SQL][PYTHON][BACKPORT-2.3] Use datetime.date for date type when converting Spark DataFrame to Pandas DataFrame. ## What changes were proposed in this pull request? This is a backport of #20506. In

svn commit: r24720 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_06_00_01-8141c3e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-06 Thread pwendell
Author: pwendell Date: Tue Feb 6 08:15:48 2018 New Revision: 24720 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_06_00_01-8141c3e docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---