spark git commit: [SPARK-21042][SQL] Document Dataset.union is resolution by position

2017-06-09 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.2 869af5bcb -> 815a0820b [SPARK-21042][SQL] Document Dataset.union is resolution by position ## What changes were proposed in this pull request? Document Dataset.union is resolution by position, not by name, since this has been a

spark git commit: [SPARK-21042][SQL] Document Dataset.union is resolution by position

2017-06-09 Thread rxin
Repository: spark Updated Branches: refs/heads/master 571635488 -> b78e3849b [SPARK-21042][SQL] Document Dataset.union is resolution by position ## What changes were proposed in this pull request? Document Dataset.union is resolution by position, not by name, since this has been a confusing

spark git commit: [SPARK-20918][SQL] Use FunctionIdentifier as function identifiers in FunctionRegistry

2017-06-09 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 82faacd79 -> 571635488 [SPARK-20918][SQL] Use FunctionIdentifier as function identifiers in FunctionRegistry ### What changes were proposed in this pull request? Currently, the unquoted string of a function identifier is being used as the

spark git commit: [SPARK-20997][CORE] driver-cores' standalone or Mesos or YARN in Cluster deploy mode only.

2017-06-09 Thread srowen
Repository: spark Updated Branches: refs/heads/master 6491cbf06 -> 82faacd79 [SPARK-20997][CORE] driver-cores' standalone or Mesos or YARN in Cluster deploy mode only. ## What changes were proposed in this pull request? '--driver-cores' standalone or Mesos or YARN in Cluster deploy mode

[1/2] spark-website git commit: Break out security info into dedicated page, to match other ASF projects who list security information

2017-06-09 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 004856aaa -> fda1364c8 http://git-wip-us.apache.org/repos/asf/spark-website/blob/fda1364c/site/releases/spark-release-1-0-1.html -- diff --git

[2/2] spark-website git commit: Break out security info into dedicated page, to match other ASF projects who list security information

2017-06-09 Thread srowen
Break out security info into dedicated page, to match other ASF projects who list security information Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/fda1364c Tree:

spark git commit: Fix bug in JavaRegressionMetricsExample.

2017-06-09 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 714153c79 -> 869af5bcb Fix bug in JavaRegressionMetricsExample. the original code cant visit the last element of the"parts" array. so the v[v.length–1] always equals 0 ## What changes were proposed in this pull request? change the

spark git commit: Fix bug in JavaRegressionMetricsExample.

2017-06-09 Thread srowen
Repository: spark Updated Branches: refs/heads/master 033839559 -> 6491cbf06 Fix bug in JavaRegressionMetricsExample. the original code cant visit the last element of the"parts" array. so the v[v.length–1] always equals 0 ## What changes were proposed in this pull request? change the

spark git commit: Fixed broken link

2017-06-09 Thread srowen
Repository: spark Updated Branches: refs/heads/master bdcd6e4c6 -> 033839559 Fixed broken link ## What changes were proposed in this pull request? I fixed some incorrect formatting on a link in the docs ## How was this patch tested? I looked at the markdown preview before and after, and

spark git commit: Fixed broken link

2017-06-09 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 3f6812cf8 -> 714153c79 Fixed broken link ## What changes were proposed in this pull request? I fixed some incorrect formatting on a link in the docs ## How was this patch tested? I looked at the markdown preview before and after,

spark git commit: [SPARK-20995][CORE] Spark-env.sh.template' should add 'YARN_CONF_DIR' configuration instructions.

2017-06-09 Thread srowen
Repository: spark Updated Branches: refs/heads/master 5a3371883 -> bdcd6e4c6 [SPARK-20995][CORE] Spark-env.sh.template' should add 'YARN_CONF_DIR' configuration instructions. ## What changes were proposed in this pull request? Ensure that `HADOOP_CONF_DIR` or `YARN_CONF_DIR` points to the

spark git commit: [SPARK-14408][CORE] Changed RDD.treeAggregate to use fold instead of reduce

2017-06-09 Thread srowen
Repository: spark Updated Branches: refs/heads/master 2a23cdd07 -> 5a3371883 [SPARK-14408][CORE] Changed RDD.treeAggregate to use fold instead of reduce ## What changes were proposed in this pull request? Previously, `RDD.treeAggregate` used `reduceByKey` and `reduce` in its implementation,