spark git commit: [SPARK-22980][PYTHON][SQL] Clarify the length of each series is of each batch within scalar Pandas UDF

2018-01-12 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 60bcb4685 -> ca27d9cb5 [SPARK-22980][PYTHON][SQL] Clarify the length of each series is of each batch within scalar Pandas UDF ## What changes were proposed in this pull request? This PR proposes to add a note that saying the length

spark git commit: [SPARK-22980][PYTHON][SQL] Clarify the length of each series is of each batch within scalar Pandas UDF

2018-01-12 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 55dbfbca3 -> cd9f49a2a [SPARK-22980][PYTHON][SQL] Clarify the length of each series is of each batch within scalar Pandas UDF ## What changes were proposed in this pull request? This PR proposes to add a note that saying the length of a

svn commit: r24173 - in /dev/spark/2.3.1-SNAPSHOT-2018_01_12_18_01-60bcb46-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-12 Thread pwendell
Author: pwendell Date: Sat Jan 13 02:15:11 2018 New Revision: 24173 Log: Apache Spark 2.3.1-SNAPSHOT-2018_01_12_18_01-60bcb46 docs [This commit notification would consist of 1440 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r24170 - in /dev/spark/2.4.0-SNAPSHOT-2018_01_12_16_01-55dbfbc-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-12 Thread pwendell
Author: pwendell Date: Sat Jan 13 00:14:56 2018 New Revision: 24170 Log: Apache Spark 2.4.0-SNAPSHOT-2018_01_12_16_01-55dbfbc docs [This commit notification would consist of 1440 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[1/2] spark git commit: Revert "[SPARK-22908] Add kafka source and sink for continuous processing."

2018-01-12 Thread sameerag
Repository: spark Updated Branches: refs/heads/branch-2.3 02176f4c2 -> 60bcb4685 http://git-wip-us.apache.org/repos/asf/spark/blob/60bcb468/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2.scala

[2/2] spark git commit: Revert "[SPARK-22908] Add kafka source and sink for continuous processing."

2018-01-12 Thread sameerag
Revert "[SPARK-22908] Add kafka source and sink for continuous processing." This reverts commit f891ee3249e04576dd579cbab6f8f1632550e6bd. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/60bcb468 Tree:

[2/2] spark git commit: Revert "[SPARK-22908] Add kafka source and sink for continuous processing."

2018-01-12 Thread sameerag
Revert "[SPARK-22908] Add kafka source and sink for continuous processing." This reverts commit 6f7aaed805070d29dcba32e04ca7a1f581fa54b9. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/55dbfbca Tree:

[1/2] spark git commit: Revert "[SPARK-22908] Add kafka source and sink for continuous processing."

2018-01-12 Thread sameerag
Repository: spark Updated Branches: refs/heads/master 54277398a -> 55dbfbca3 http://git-wip-us.apache.org/repos/asf/spark/blob/55dbfbca/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2.scala

svn commit: r24168 - in /dev/spark/2.3.1-SNAPSHOT-2018_01_12_14_01-02176f4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-12 Thread pwendell
Author: pwendell Date: Fri Jan 12 22:15:03 2018 New Revision: 24168 Log: Apache Spark 2.3.1-SNAPSHOT-2018_01_12_14_01-02176f4 docs [This commit notification would consist of 1440 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r24164 - /dev/spark/KEYS

2018-01-12 Thread sameerag
Author: sameerag Date: Fri Jan 12 20:35:10 2018 New Revision: 24164 Log: Update Keys Modified: dev/spark/KEYS Modified: dev/spark/KEYS == --- dev/spark/KEYS (original) +++ dev/spark/KEYS Fri Jan 12 20:35:10 2018 @@

svn commit: r24163 - in /dev/spark/2.4.0-SNAPSHOT-2018_01_12_12_01-5427739-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-12 Thread pwendell
Author: pwendell Date: Fri Jan 12 20:15:43 2018 New Revision: 24163 Log: Apache Spark 2.4.0-SNAPSHOT-2018_01_12_12_01-5427739 docs [This commit notification would consist of 1440 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22975][SS] MetricsReporter should not throw exception when there was no progress reported

2018-01-12 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.2 20eea20c7 -> 105ae8680 [SPARK-22975][SS] MetricsReporter should not throw exception when there was no progress reported ## What changes were proposed in this pull request? `MetricsReporter ` assumes that there has been some progress

spark git commit: [SPARK-22975][SS] MetricsReporter should not throw exception when there was no progress reported

2018-01-12 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.3 db27a9365 -> 02176f4c2 [SPARK-22975][SS] MetricsReporter should not throw exception when there was no progress reported ## What changes were proposed in this pull request? `MetricsReporter ` assumes that there has been some progress

spark git commit: [SPARK-22975][SS] MetricsReporter should not throw exception when there was no progress reported

2018-01-12 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 7bd14cfd4 -> 54277398a [SPARK-22975][SS] MetricsReporter should not throw exception when there was no progress reported ## What changes were proposed in this pull request? `MetricsReporter ` assumes that there has been some progress for

spark git commit: [MINOR][BUILD] Fix Java linter errors

2018-01-12 Thread sameerag
Repository: spark Updated Branches: refs/heads/branch-2.3 6152da389 -> db27a9365 [MINOR][BUILD] Fix Java linter errors ## What changes were proposed in this pull request? This PR cleans up the java-lint errors (for v2.3.0-rc1 tag). Hopefully, this will be the final one. ``` $ dev/lint-java

spark git commit: [MINOR][BUILD] Fix Java linter errors

2018-01-12 Thread sameerag
Repository: spark Updated Branches: refs/heads/master 651f76153 -> 7bd14cfd4 [MINOR][BUILD] Fix Java linter errors ## What changes were proposed in this pull request? This PR cleans up the java-lint errors (for v2.3.0-rc1 tag). Hopefully, this will be the final one. ``` $ dev/lint-java

spark git commit: [SPARK-22982] Remove unsafe asynchronous close() call from FileDownloadChannel

2018-01-12 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 acab4e7a0 -> 20eea20c7 [SPARK-22982] Remove unsafe asynchronous close() call from FileDownloadChannel ## What changes were proposed in this pull request? This patch fixes a severe asynchronous IO bug in Spark's Netty-based file

spark git commit: [SPARK-23028] Bump master branch version to 2.4.0-SNAPSHOT

2018-01-12 Thread wenchen
Repository: spark Updated Branches: refs/heads/master f5300fbbe -> 651f76153 [SPARK-23028] Bump master branch version to 2.4.0-SNAPSHOT ## What changes were proposed in this pull request? This patch bumps the master branch version to `2.4.0-SNAPSHOT`. ## How was this patch tested? N/A

svn commit: r24158 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_12_08_01-f5300fb-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-12 Thread pwendell
Author: pwendell Date: Fri Jan 12 16:14:58 2018 New Revision: 24158 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_12_08_01-f5300fb docs [This commit notification would consist of 1440 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: Update rdd-programming-guide.md

2018-01-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master 505086806 -> f5300fbbe Update rdd-programming-guide.md ## What changes were proposed in this pull request? Small typing correction - double word ## How was this patch tested? Please review http://spark.apache.org/contributing.html

svn commit: r24154 - in /dev/spark/2.3.1-SNAPSHOT-2018_01_12_06_01-6152da3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-12 Thread pwendell
Author: pwendell Date: Fri Jan 12 14:14:42 2018 New Revision: 24154 Log: Apache Spark 2.3.1-SNAPSHOT-2018_01_12_06_01-6152da3 docs [This commit notification would consist of 1440 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r24152 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_12_04_01-5050868-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-12 Thread pwendell
Author: pwendell Date: Fri Jan 12 12:20:04 2018 New Revision: 24152 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_12_04_01-5050868 docs [This commit notification would consist of 1440 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r24150 - in /dev/spark/2.3.1-SNAPSHOT-2018_01_12_02_01-d512d87-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-12 Thread pwendell
Author: pwendell Date: Fri Jan 12 10:15:20 2018 New Revision: 24150 Log: Apache Spark 2.3.1-SNAPSHOT-2018_01_12_02_01-d512d87 docs [This commit notification would consist of 1440 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23025][SQL] Support Null type in scala reflection

2018-01-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 d512d873b -> 6152da389 [SPARK-23025][SQL] Support Null type in scala reflection ## What changes were proposed in this pull request? Add support for `Null` type in the `schemaFor` method for Scala reflection. ## How was this patch

spark git commit: [SPARK-23025][SQL] Support Null type in scala reflection

2018-01-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/master a7d98d53c -> 505086806 [SPARK-23025][SQL] Support Null type in scala reflection ## What changes were proposed in this pull request? Add support for `Null` type in the `schemaFor` method for Scala reflection. ## How was this patch tested?

spark git commit: [SPARK-23008][ML][FOLLOW-UP] mark OneHotEncoder python API deprecated

2018-01-12 Thread mlnick
Repository: spark Updated Branches: refs/heads/branch-2.3 3ae3e1bb7 -> d512d873b [SPARK-23008][ML][FOLLOW-UP] mark OneHotEncoder python API deprecated ## What changes were proposed in this pull request? mark OneHotEncoder python API deprecated ## How was this patch tested? N/A Author:

spark git commit: [SPARK-23008][ML][FOLLOW-UP] mark OneHotEncoder python API deprecated

2018-01-12 Thread mlnick
Repository: spark Updated Branches: refs/heads/master cbe7c6fbf -> a7d98d53c [SPARK-23008][ML][FOLLOW-UP] mark OneHotEncoder python API deprecated ## What changes were proposed in this pull request? mark OneHotEncoder python API deprecated ## How was this patch tested? N/A Author:

svn commit: r24149 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_12_00_01-cbe7c6f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-12 Thread pwendell
Author: pwendell Date: Fri Jan 12 08:15:11 2018 New Revision: 24149 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_12_00_01-cbe7c6f docs [This commit notification would consist of 1440 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]