spark git commit: [SPARK-22604][SQL] remove the get address methods from ColumnVector

2017-11-24 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 70221903f -> e3fd93f14 [SPARK-22604][SQL] remove the get address methods from ColumnVector ## What changes were proposed in this pull request? `nullsNativeAddress` and `valuesNativeAddress` are only used in tests and benchmark, no need

spark git commit: [SPARK-22596][SQL] set ctx.currentVars in CodegenSupport.consume

2017-11-24 Thread lixiao
Repository: spark Updated Branches: refs/heads/master a1877f45c -> 70221903f [SPARK-22596][SQL] set ctx.currentVars in CodegenSupport.consume ## What changes were proposed in this pull request? `ctx.currentVars` means the input variables for the current operator, which is already decided in

svn commit: r23279 - in /dev/spark/spark-2.2.1-rc2-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/

2017-11-24 Thread felixcheung
Author: felixcheung Date: Sat Nov 25 03:01:04 2017 New Revision: 23279 Log: Apache Spark spark-2.2.1-rc2 docs [This commit notification would consist of 1388 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r23278 - /dev/spark/spark-2.2.1-rc2-bin/

2017-11-24 Thread felixcheung
Author: felixcheung Date: Sat Nov 25 02:44:26 2017 New Revision: 23278 Log: Apache Spark spark-2.2.1-rc2 Added: dev/spark/spark-2.2.1-rc2-bin/ dev/spark/spark-2.2.1-rc2-bin/SparkR_2.2.1.tar.gz (with props) dev/spark/spark-2.2.1-rc2-bin/SparkR_2.2.1.tar.gz.asc

[1/2] spark git commit: Preparing Spark release v2.2.1-rc2

2017-11-24 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 c3b5df22a -> 455cea622 Preparing Spark release v2.2.1-rc2 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e30e2698 Tree:

[2/2] spark git commit: Preparing development version 2.2.2-SNAPSHOT

2017-11-24 Thread felixcheung
Preparing development version 2.2.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/455cea62 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/455cea62 Diff:

[spark] Git Push Summary

2017-11-24 Thread felixcheung
Repository: spark Updated Tags: refs/tags/v2.2.1-rc2 [created] e30e2698a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: fix typo

2017-11-24 Thread felixcheung
fix typo Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c3b5df22 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c3b5df22 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c3b5df22 Branch:

[1/2] spark git commit: [SPARK-22495] Fix setup of SPARK_HOME variable on Windows

2017-11-24 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 ad57141f9 -> c3b5df22a [SPARK-22495] Fix setup of SPARK_HOME variable on Windows ## What changes were proposed in this pull request? This is a cherry pick of the original PR 19370 onto branch-2.2 as suggested in

spark git commit: [SPARK-22597][SQL] Add spark-sql cmd script for Windows users

2017-11-24 Thread wenchen
Repository: spark Updated Branches: refs/heads/master efd0036ec -> a1877f45c [SPARK-22597][SQL] Add spark-sql cmd script for Windows users ## What changes were proposed in this pull request? This PR proposes to add cmd scripts so that Windows users can also run `spark-sql` script. ## How

spark git commit: [SPARK-22537][CORE] Aggregation of map output statistics on driver faces single point bottleneck

2017-11-24 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 449e26ecd -> efd0036ec [SPARK-22537][CORE] Aggregation of map output statistics on driver faces single point bottleneck ## What changes were proposed in this pull request? In adaptive execution, the map output statistics of all mappers

spark git commit: [SPARK-22559][CORE] history server: handle exception on opening corrupted listing.ldb

2017-11-24 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 554adc77d -> 449e26ecd [SPARK-22559][CORE] history server: handle exception on opening corrupted listing.ldb ## What changes were proposed in this pull request? Currently history server v2 failed to start if `listing.ldb` is corrupted.

spark git commit: [SPARK-22595][SQL] fix flaky test: CastSuite.SPARK-22500: cast for struct should not generate codes beyond 64KB

2017-11-24 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 f4c457a30 -> ad57141f9 [SPARK-22595][SQL] fix flaky test: CastSuite.SPARK-22500: cast for struct should not generate codes beyond 64KB This PR reduces the number of fields in the test case of `CastSuite` to fix an issue that is

spark git commit: [SPARK-22595][SQL] fix flaky test: CastSuite.SPARK-22500: cast for struct should not generate codes beyond 64KB

2017-11-24 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 62a826f17 -> 554adc77d [SPARK-22595][SQL] fix flaky test: CastSuite.SPARK-22500: cast for struct should not generate codes beyond 64KB ## What changes were proposed in this pull request? This PR reduces the number of fields in the test

spark git commit: [SPARK-22591][SQL] GenerateOrdering shouldn't change CodegenContext.INPUT_ROW

2017-11-24 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 f8e73d029 -> f4c457a30 [SPARK-22591][SQL] GenerateOrdering shouldn't change CodegenContext.INPUT_ROW ## What changes were proposed in this pull request? When I played with codegen in developing another PR, I found the value of

spark git commit: [SPARK-22591][SQL] GenerateOrdering shouldn't change CodegenContext.INPUT_ROW

2017-11-24 Thread wenchen
Repository: spark Updated Branches: refs/heads/master c1217565e -> 62a826f17 [SPARK-22591][SQL] GenerateOrdering shouldn't change CodegenContext.INPUT_ROW ## What changes were proposed in this pull request? When I played with codegen in developing another PR, I found the value of

spark git commit: [SPARK-17920][SQL] [FOLLOWUP] Backport PR 19779 to branch-2.2

2017-11-24 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 b17f4063c -> f8e73d029 [SPARK-17920][SQL] [FOLLOWUP] Backport PR 19779 to branch-2.2 ## What changes were proposed in this pull request? A followup of https://github.com/apache/spark/pull/19795 , to simplify the file creation. ##