spark git commit: [SPARK-19495][SQL] Make SQLConf slightly more extensible - addendum

2017-04-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 8129d59d0 -> 626b4cafc [SPARK-19495][SQL] Make SQLConf slightly more extensible - addendum ## What changes were proposed in this pull request? This is a tiny addendum to SPARK-19495 to remove the private visibility for copy, which is the o

spark git commit: [MINOR][DOCS] Fix typo in Hive Examples

2017-04-06 Thread rxin
Repository: spark Updated Branches: refs/heads/master a4491626e -> 8129d59d0 [MINOR][DOCS] Fix typo in Hive Examples ## What changes were proposed in this pull request? Fix typo in hive examples from "DaraFrames" to "DataFrames" ## How was this patch tested? N/A Please review http://spark.

[2/2] spark git commit: [SPARK-17019][CORE] Expose on-heap and off-heap memory usage in various places

2017-04-06 Thread irashid
[SPARK-17019][CORE] Expose on-heap and off-heap memory usage in various places ## What changes were proposed in this pull request? With [SPARK-13992](https://issues.apache.org/jira/browse/SPARK-13992), Spark supports persisting data into off-heap memory, but the usage of on-heap and off-heap me

[1/2] spark git commit: [SPARK-17019][CORE] Expose on-heap and off-heap memory usage in various places

2017-04-06 Thread irashid
Repository: spark Updated Branches: refs/heads/master 5a693b413 -> a4491626e http://git-wip-us.apache.org/repos/asf/spark/blob/a4491626/core/src/test/resources/spark-events/app-20161116163331- -- diff --git a/core/src/test/

spark git commit: [SPARK-20195][SPARKR][SQL] add createTable catalog API and deprecate createExternalTable

2017-04-06 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master bccc33019 -> 5a693b413 [SPARK-20195][SPARKR][SQL] add createTable catalog API and deprecate createExternalTable ## What changes were proposed in this pull request? Following up on #17483, add createTable (which is new in 2.2.0) and deprec

spark git commit: [SPARK-20196][PYTHON][SQL] update doc for catalog functions for all languages, add pyspark refreshByPath API

2017-04-06 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master d009fb369 -> bccc33019 [SPARK-20196][PYTHON][SQL] update doc for catalog functions for all languages, add pyspark refreshByPath API ## What changes were proposed in this pull request? Update doc to remove external for createTable, add ref

spark git commit: [SPARK-20064][PYSPARK] Bump the PySpark verison number to 2.2

2017-04-06 Thread srowen
Repository: spark Updated Branches: refs/heads/master c8fc1f3ba -> d009fb369 [SPARK-20064][PYSPARK] Bump the PySpark verison number to 2.2 ## What changes were proposed in this pull request? PySpark version in version.py was lagging behind Versioning is in line with PEP 440: https://www.pytho

spark git commit: [SPARK-20085][MESOS] Configurable mesos labels for executors

2017-04-06 Thread srowen
Repository: spark Updated Branches: refs/heads/master e156b5dd3 -> c8fc1f3ba [SPARK-20085][MESOS] Configurable mesos labels for executors ## What changes were proposed in this pull request? Add spark.mesos.task.labels configuration option to add mesos key:value labels to the executor. "k1:

spark git commit: [SPARK-19953][ML] Random Forest Models use parent UID when being fit

2017-04-06 Thread mlnick
Repository: spark Updated Branches: refs/heads/master 5142e5d4e -> e156b5dd3 [SPARK-19953][ML] Random Forest Models use parent UID when being fit ## What changes were proposed in this pull request? The ML `RandomForestClassificationModel` and `RandomForestRegressionModel` were not using the