spark git commit: Fixed typo

2016-08-09 Thread rxin
Repository: spark Updated Branches: refs/heads/master 121643bc7 -> 9dc3e602d Fixed typo ## What changes were proposed in this pull request? Fixed small typo - "value ... ~~in~~ is null" ## How was this patch tested? Still compiles! Author: Michał Kiełbowicz Closes #14569 from jupblb/ty

spark git commit: Fixed typo

2016-08-09 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 2d136dba4 -> 475ee3815 Fixed typo ## What changes were proposed in this pull request? Fixed small typo - "value ... ~~in~~ is null" ## How was this patch tested? Still compiles! Author: Michał Kiełbowicz Closes #14569 from jupbl

spark git commit: Make logDir easily copy/paste-able

2016-08-09 Thread rxin
Repository: spark Updated Branches: refs/heads/master b89b3a5c8 -> 121643bc7 Make logDir easily copy/paste-able In many terminals double-clicking and dragging also includes the trailing period. Simply remove this to make the value more easily copy/pasteable. Example value: `hdfs://mybox-123

spark git commit: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-09 Thread davies
Repository: spark Updated Branches: refs/heads/branch-2.0 44115e90e -> 2d136dba4 [SPARK-16905] SQL DDL: MSCK REPAIR TABLE MSCK REPAIR TABLE could be used to recover the partitions in external catalog based on partitions in file system. Another syntax is: ALTER TABLE table RECOVER PARTITIONS

spark git commit: [SPARK-16956] Make ApplicationState.MAX_NUM_RETRY configurable

2016-08-09 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.6 a3b06ae0b -> ace458f03 [SPARK-16956] Make ApplicationState.MAX_NUM_RETRY configurable ## What changes were proposed in this pull request? This patch introduces a new configuration, `spark.deploy.maxExecutorRetries`, to let users confi

spark git commit: [SPARK-16956] Make ApplicationState.MAX_NUM_RETRY configurable

2016-08-09 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-2.0 41d9dcac3 -> 44115e90e [SPARK-16956] Make ApplicationState.MAX_NUM_RETRY configurable ## What changes were proposed in this pull request? This patch introduces a new configuration, `spark.deploy.maxExecutorRetries`, to let users confi

spark git commit: [SPARK-16956] Make ApplicationState.MAX_NUM_RETRY configurable

2016-08-09 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 92da22878 -> b89b3a5c8 [SPARK-16956] Make ApplicationState.MAX_NUM_RETRY configurable ## What changes were proposed in this pull request? This patch introduces a new configuration, `spark.deploy.maxExecutorRetries`, to let users configure

spark git commit: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-09 Thread davies
Repository: spark Updated Branches: refs/heads/master 29081b587 -> 92da22878 [SPARK-16905] SQL DDL: MSCK REPAIR TABLE ## What changes were proposed in this pull request? MSCK REPAIR TABLE could be used to recover the partitions in external catalog based on partitions in file system. Another

spark git commit: [SPARK-16950] [PYSPARK] fromOffsets parameter support in KafkaUtils.createDirectStream for python3

2016-08-09 Thread davies
Repository: spark Updated Branches: refs/heads/branch-2.0 bbbd3cb15 -> 41d9dcac3 [SPARK-16950] [PYSPARK] fromOffsets parameter support in KafkaUtils.createDirectStream for python3 ## What changes were proposed in this pull request? Ability to use KafkaUtils.createDirectStream with starting o

spark git commit: [SPARK-16950] [PYSPARK] fromOffsets parameter support in KafkaUtils.createDirectStream for python3

2016-08-09 Thread davies
Repository: spark Updated Branches: refs/heads/master 182e11904 -> 29081b587 [SPARK-16950] [PYSPARK] fromOffsets parameter support in KafkaUtils.createDirectStream for python3 ## What changes were proposed in this pull request? Ability to use KafkaUtils.createDirectStream with starting offse

spark git commit: [SPARK-16933][ML] Fix AFTAggregator in AFTSurvivalRegression serializes unnecessary data.

2016-08-09 Thread yliang
Repository: spark Updated Branches: refs/heads/master 511f52f84 -> 182e11904 [SPARK-16933][ML] Fix AFTAggregator in AFTSurvivalRegression serializes unnecessary data. ## What changes were proposed in this pull request? Similar to ```LeastSquaresAggregator``` in #14109, ```AFTAggregator``` use

[1/2] spark git commit: [SPARK-16964][SQL] Remove private[sql] and private[spark] from sql.execution package

2016-08-09 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 62e621244 -> 511f52f84 http://git-wip-us.apache.org/repos/asf/spark/blob/511f52f8/sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala -- d

[2/2] spark git commit: [SPARK-16964][SQL] Remove private[sql] and private[spark] from sql.execution package

2016-08-09 Thread wenchen
[SPARK-16964][SQL] Remove private[sql] and private[spark] from sql.execution package ## What changes were proposed in this pull request? This package is meant to be internal, and as a result it does not make sense to mark things as private[sql] or private[spark]. It simply makes debugging harder

spark git commit: [SPARK-16809] enable history server links in dispatcher UI

2016-08-09 Thread srowen
Repository: spark Updated Branches: refs/heads/master 2154345b6 -> 62e621244 [SPARK-16809] enable history server links in dispatcher UI ## What changes were proposed in this pull request? Links the Spark Mesos Dispatcher UI to the history server UI - adds spark.mesos.dispatcher.historyServer

spark git commit: [SPARK-16940][SQL] `checkAnswer` should raise `TestFailedException` for wrong results

2016-08-09 Thread srowen
Repository: spark Updated Branches: refs/heads/master af710e5bd -> 2154345b6 [SPARK-16940][SQL] `checkAnswer` should raise `TestFailedException` for wrong results ## What changes were proposed in this pull request? This PR fixes the following to make `checkAnswer` raise `TestFailedException`

spark git commit: [SPARK-16522][MESOS] Spark application throws exception on exit.

2016-08-09 Thread srowen
Repository: spark Updated Branches: refs/heads/master 801e4d097 -> af710e5bd [SPARK-16522][MESOS] Spark application throws exception on exit. ## What changes were proposed in this pull request? Spark applications running on Mesos throw exception upon exit. For details, refer to https://issues

spark git commit: [SPARK-16606][CORE] Misleading warning for SparkContext.getOrCreate "WARN SparkContext: Use an existing SparkContext, some configuration may not take effect."

2016-08-09 Thread srowen
Repository: spark Updated Branches: refs/heads/master bb2b9d0a4 -> 801e4d097 [SPARK-16606][CORE] Misleading warning for SparkContext.getOrCreate "WARN SparkContext: Use an existing SparkContext, some configuration may not take effect." ## What changes were proposed in this pull request? Spa