spark git commit: [SPARK-23122][PYSPARK][FOLLOWUP] Replace registerTempTable by createOrReplaceTempView

2018-02-07 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master c36fecc3b -> 9775df67f [SPARK-23122][PYSPARK][FOLLOWUP] Replace registerTempTable by createOrReplaceTempView ## What changes were proposed in this pull request? Replace `registerTempTable` by `createOrReplaceTempView`. ## How was this pat

spark git commit: [SPARK-23122][PYSPARK][FOLLOWUP] Replace registerTempTable by createOrReplaceTempView

2018-02-07 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 874d3f89f -> cb22e830b [SPARK-23122][PYSPARK][FOLLOWUP] Replace registerTempTable by createOrReplaceTempView ## What changes were proposed in this pull request? Replace `registerTempTable` by `createOrReplaceTempView`. ## How was this

spark git commit: [SPARK-23319][TESTS] Explicitly specify Pandas and PyArrow versions in PySpark tests (to skip or test)

2018-02-07 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 9775df67f -> 71cfba04a [SPARK-23319][TESTS] Explicitly specify Pandas and PyArrow versions in PySpark tests (to skip or test) ## What changes were proposed in this pull request? This PR proposes to explicitly specify Pandas and PyArrow ve

svn commit: r24788 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_07_08_01-71cfba0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-07 Thread pwendell
Author: pwendell Date: Wed Feb 7 16:19:52 2018 New Revision: 24788 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_07_08_01-71cfba0 docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23345][SQL] Remove open stream record even closing it fails

2018-02-07 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 71cfba04a -> 9841ae031 [SPARK-23345][SQL] Remove open stream record even closing it fails ## What changes were proposed in this pull request? When `DebugFilesystem` closes opened stream, if any exception occurs, we still need to remove th

spark git commit: [SPARK-23345][SQL] Remove open stream record even closing it fails

2018-02-07 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 cb22e830b -> 05239afc9 [SPARK-23345][SQL] Remove open stream record even closing it fails ## What changes were proposed in this pull request? When `DebugFilesystem` closes opened stream, if any exception occurs, we still need to remov

svn commit: r24793 - in /dev/spark/2.3.1-SNAPSHOT-2018_02_07_10_01-05239af-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-07 Thread pwendell
Author: pwendell Date: Wed Feb 7 18:17:45 2018 New Revision: 24793 Log: Apache Spark 2.3.1-SNAPSHOT-2018_02_07_10_01-05239af docs [This commit notification would consist of 1442 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r24795 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_07_12_01-9841ae0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-07 Thread pwendell
Author: pwendell Date: Wed Feb 7 20:20:36 2018 New Revision: 24795 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_07_12_01-9841ae0 docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 APIs

2018-02-07 Thread tdas
Repository: spark Updated Branches: refs/heads/master 9841ae031 -> 30295bf5a [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 APIs ## What changes were proposed in this pull request? This PR migrates the MemoryStream to DataSourceV2 APIs. One additional change is in the reported keys

svn commit: r24808 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_07_16_01-30295bf-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-07 Thread pwendell
Author: pwendell Date: Thu Feb 8 00:14:48 2018 New Revision: 24808 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_07_16_01-30295bf docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23300][TESTS][BRANCH-2.3] Prints out if Pandas and PyArrow are installed or not in PySpark SQL tests

2018-02-07 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 05239afc9 -> 2ba07d5b1 [SPARK-23300][TESTS][BRANCH-2.3] Prints out if Pandas and PyArrow are installed or not in PySpark SQL tests This PR backports https://github.com/apache/spark/pull/20473 to branch-2.3. Author: hyukjinkwon Close

svn commit: r24813 - in /dev/spark/2.3.1-SNAPSHOT-2018_02_07_18_01-2ba07d5-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-07 Thread pwendell
Author: pwendell Date: Thu Feb 8 02:15:09 2018 New Revision: 24813 Log: Apache Spark 2.3.1-SNAPSHOT-2018_02_07_18_01-2ba07d5 docs [This commit notification would consist of 1442 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23319][TESTS][FOLLOWUP] Fix a test for Python 3 without pandas.

2018-02-07 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 30295bf5a -> a62f30d3f [SPARK-23319][TESTS][FOLLOWUP] Fix a test for Python 3 without pandas. ## What changes were proposed in this pull request? This is a followup pr of #20487. When importing module but it doesn't exists, the error mess

svn commit: r24815 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_07_20_01-a62f30d-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-07 Thread pwendell
Author: pwendell Date: Thu Feb 8 04:15:19 2018 New Revision: 24815 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_07_20_01-a62f30d docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: Revert [SPARK-22279][SQL] Turn on spark.sql.hive.convertMetastoreOrc by default

2018-02-07 Thread wenchen
Repository: spark Updated Branches: refs/heads/master a62f30d3f -> 3473fda6d Revert [SPARK-22279][SQL] Turn on spark.sql.hive.convertMetastoreOrc by default ## What changes were proposed in this pull request? This is to revert the changes made in https://github.com/apache/spark/pull/19499 ,

spark git commit: Revert [SPARK-22279][SQL] Turn on spark.sql.hive.convertMetastoreOrc by default

2018-02-07 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.3 2ba07d5b1 -> db59e5542 Revert [SPARK-22279][SQL] Turn on spark.sql.hive.convertMetastoreOrc by default ## What changes were proposed in this pull request? This is to revert the changes made in https://github.com/apache/spark/pull/1949

svn commit: r24817 - in /dev/spark/2.3.1-SNAPSHOT-2018_02_07_22_01-db59e55-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-07 Thread pwendell
Author: pwendell Date: Thu Feb 8 06:15:34 2018 New Revision: 24817 Log: Apache Spark 2.3.1-SNAPSHOT-2018_02_07_22_01-db59e55 docs [This commit notification would consist of 1442 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23319][TESTS][BRANCH-2.3] Explicitly specify Pandas and PyArrow versions in PySpark tests (to skip or test)

2018-02-07 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 db59e5542 -> 053830256 [SPARK-23319][TESTS][BRANCH-2.3] Explicitly specify Pandas and PyArrow versions in PySpark tests (to skip or test) This PR backports https://github.com/apache/spark/pull/20487 to branch-2.3. Author: hyukjinkwon