spark git commit: [SPARK-20425][SQL] Support a vertical display mode for Dataset.show

2017-04-26 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 66636ef0b -> b4724db19 [SPARK-20425][SQL] Support a vertical display mode for Dataset.show ## What changes were proposed in this pull request? This pr added a new display mode for `Dataset.show` to print output rows vertically (one line

[1/2] spark git commit: Preparing Spark release v2.2.0-rc1

2017-04-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-2.2 d6efda512 -> 75544c019 Preparing Spark release v2.2.0-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8ccb4a57 Tree:

[2/2] spark git commit: Preparing development version 2.2.0-SNAPSHOT

2017-04-26 Thread pwendell
Preparing development version 2.2.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/75544c01 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/75544c01 Diff:

[spark] Git Push Summary

2017-04-26 Thread pwendell
Repository: spark Updated Tags: refs/tags/v2.2.0-rc1 [created] 8ccb4a57c - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-20435][CORE] More thorough redaction of sensitive information

2017-04-26 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.2 b48bb3ab2 -> d6efda512 [SPARK-20435][CORE] More thorough redaction of sensitive information This change does a more thorough redaction of sensitive information from logs and UI Add unit tests that ensure that no regressions happen

spark git commit: [SPARK-20435][CORE] More thorough redaction of sensitive information

2017-04-26 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 2ba1eba37 -> 66636ef0b [SPARK-20435][CORE] More thorough redaction of sensitive information This change does a more thorough redaction of sensitive information from logs and UI Add unit tests that ensure that no regressions happen that

spark git commit: [SPARK-12868][SQL] Allow adding jars from hdfs

2017-04-26 Thread vanzin
Repository: spark Updated Branches: refs/heads/master a277ae80a -> 2ba1eba37 [SPARK-12868][SQL] Allow adding jars from hdfs ## What changes were proposed in this pull request? Spark 2.2 is going to be cut, it'll be great if SPARK-12868 can be resolved before that. There have been several PRs

spark git commit: [SPARK-12868][SQL] Allow adding jars from hdfs

2017-04-26 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.2 e278876ba -> b48bb3ab2 [SPARK-12868][SQL] Allow adding jars from hdfs ## What changes were proposed in this pull request? Spark 2.2 is going to be cut, it'll be great if SPARK-12868 can be resolved before that. There have been several

spark git commit: [SPARK-20474] Fixing OnHeapColumnVector reallocation

2017-04-26 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.2 6709bcf6e -> e278876ba [SPARK-20474] Fixing OnHeapColumnVector reallocation ## What changes were proposed in this pull request? OnHeapColumnVector reallocation copies to the new storage data up to 'elementsAppended'. This variable is

spark git commit: [SPARK-20474] Fixing OnHeapColumnVector reallocation

2017-04-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master 99c6cf9ef -> a277ae80a [SPARK-20474] Fixing OnHeapColumnVector reallocation ## What changes were proposed in this pull request? OnHeapColumnVector reallocation copies to the new storage data up to 'elementsAppended'. This variable is only

spark git commit: [SPARK-20473] Enabling missing types in ColumnVector.Array

2017-04-26 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.2 b65858bb3 -> 6709bcf6e [SPARK-20473] Enabling missing types in ColumnVector.Array ## What changes were proposed in this pull request? ColumnVector implementations originally did not support some Catalyst types (float, short, and

spark git commit: [SPARK-20473] Enabling missing types in ColumnVector.Array

2017-04-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master 66dd5b83f -> 99c6cf9ef [SPARK-20473] Enabling missing types in ColumnVector.Array ## What changes were proposed in this pull request? ColumnVector implementations originally did not support some Catalyst types (float, short, and boolean).

spark git commit: [SPARK-20391][CORE] Rename memory related fields in ExecutorSummay

2017-04-26 Thread irashid
Repository: spark Updated Branches: refs/heads/master dbb06c689 -> 66dd5b83f [SPARK-20391][CORE] Rename memory related fields in ExecutorSummay ## What changes were proposed in this pull request? This is a follow-up of #14617 to make the name of memory related fields more meaningful. Here

spark git commit: [SPARK-20391][CORE] Rename memory related fields in ExecutorSummay

2017-04-26 Thread irashid
Repository: spark Updated Branches: refs/heads/branch-2.2 34dec68d7 -> b65858bb3 [SPARK-20391][CORE] Rename memory related fields in ExecutorSummay ## What changes were proposed in this pull request? This is a follow-up of #14617 to make the name of memory related fields more meaningful.

spark git commit: [MINOR][ML] Fix some PySpark & SparkR flaky tests

2017-04-26 Thread yliang
Repository: spark Updated Branches: refs/heads/branch-2.2 612952251 -> 34dec68d7 [MINOR][ML] Fix some PySpark & SparkR flaky tests ## What changes were proposed in this pull request? Some PySpark & SparkR tests run with tiny dataset and tiny ```maxIter```, which means they are not converged.

spark git commit: [MINOR][ML] Fix some PySpark & SparkR flaky tests

2017-04-26 Thread yliang
Repository: spark Updated Branches: refs/heads/master 7fecf5130 -> dbb06c689 [MINOR][ML] Fix some PySpark & SparkR flaky tests ## What changes were proposed in this pull request? Some PySpark & SparkR tests run with tiny dataset and tiny ```maxIter```, which means they are not converged. I

spark git commit: [SPARK-19812] YARN shuffle service fails to relocate recovery DB acro…

2017-04-26 Thread tgraves
Repository: spark Updated Branches: refs/heads/master 7a365257e -> 7fecf5130 [SPARK-19812] YARN shuffle service fails to relocate recovery DB acro… …ss NFS directories ## What changes were proposed in this pull request? Change from using java Files.move to use Hadoop filesystem

spark git commit: [SPARK-19812] YARN shuffle service fails to relocate recovery DB acro…

2017-04-26 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-2.2 a2f5ced32 -> 612952251 [SPARK-19812] YARN shuffle service fails to relocate recovery DB acro… …ss NFS directories ## What changes were proposed in this pull request? Change from using java Files.move to use Hadoop filesystem

spark git commit: [SPARK-20400][DOCS] Remove References to 3rd Party Vendor Tools

2017-04-26 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 c8803c068 -> a2f5ced32 [SPARK-20400][DOCS] Remove References to 3rd Party Vendor Tools ## What changes were proposed in this pull request? Simple documentation change to remove explicit vendor references. ## How was this patch

spark git commit: [SPARK-20400][DOCS] Remove References to 3rd Party Vendor Tools

2017-04-26 Thread srowen
Repository: spark Updated Branches: refs/heads/master df58a95a3 -> 7a365257e [SPARK-20400][DOCS] Remove References to 3rd Party Vendor Tools ## What changes were proposed in this pull request? Simple documentation change to remove explicit vendor references. ## How was this patch tested?