spark git commit: [DOC] add config option spark.ui.enabled into document

2016-08-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master 2a105134e -> 91f2735a1 [DOC] add config option spark.ui.enabled into document ## What changes were proposed in this pull request? The configuration doc lost the config option `spark.ui.enabled` (default value is `true`) I think this

spark git commit: [SPARK-17003][BUILD][BRANCH-1.6] release-build.sh is missing hive-thriftserver for scala 2.11

2016-08-12 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.6 b3ecff640 -> 909231d7a [SPARK-17003][BUILD][BRANCH-1.6] release-build.sh is missing hive-thriftserver for scala 2.11 ## What changes were proposed in this pull request? hive-thriftserver works with Scala 2.11

spark git commit: [SPARK-16771][SQL] WITH clause should not fall into infinite loop.

2016-08-12 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master bbae20ade -> 2a105134e [SPARK-16771][SQL] WITH clause should not fall into infinite loop. ## What changes were proposed in this pull request? This PR changes the CTE resolving rule to use only **forward-declared** tables in order to

spark git commit: [SPARK-17013][SQL] Parse negative numeric literals

2016-08-12 Thread rxin
Repository: spark Updated Branches: refs/heads/master abff92bfd -> 00e103a6e [SPARK-17013][SQL] Parse negative numeric literals ## What changes were proposed in this pull request? This patch updates the SQL parser to parse negative numeric literals as numeric literals, instead of unary minus

spark git commit: [SPARK-17013][SQL] Parse negative numeric literals

2016-08-12 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 b4047fc21 -> bde94cd71 [SPARK-17013][SQL] Parse negative numeric literals ## What changes were proposed in this pull request? This patch updates the SQL parser to parse negative numeric literals as numeric literals, instead of unary

spark git commit: [SPARK-16975][SQL] Column-partition path starting '_' should be handled correctly

2016-08-12 Thread lian
Repository: spark Updated Branches: refs/heads/branch-2.0 0fb01496c -> b4047fc21 [SPARK-16975][SQL] Column-partition path starting '_' should be handled correctly Currently, Spark ignores path names starting with underscore `_` and `.`. This causes read-failures for the column-partitioned

spark git commit: [SPARK-16868][WEB UI] Fix executor be both dead and alive on executor ui.

2016-08-12 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 1c9a386c6 -> 4ec5c360c [SPARK-16868][WEB UI] Fix executor be both dead and alive on executor ui. ## What changes were proposed in this pull request? In a heavy pressure of the spark application, since the executor will register it to

spark git commit: [SPARK-16598][SQL][TEST] Added a test case for verifying the table identifier parsing

2016-08-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master f4482225c -> 79e2caa13 [SPARK-16598][SQL][TEST] Added a test case for verifying the table identifier parsing What changes were proposed in this pull request? So far, the test cases of `TableIdentifierParserSuite` do not cover the

spark git commit: [MINOR][DOC] Fix style in examples across documentation

2016-08-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master 993923c8f -> f4482225c [MINOR][DOC] Fix style in examples across documentation ## What changes were proposed in this pull request? This PR fixes the documentation as below: - Python has 4 spaces and Java and Scala has 2 spaces (See

spark git commit: [SPARK-16985] Change dataFormat from yyyyMMddHHmm to yyyyMMddHHmmss

2016-08-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master 00e103a6e -> 993923c8f [SPARK-16985] Change dataFormat from MMddHHmm to MMddHHmmss ## What changes were proposed in this pull request? In our cluster, sometimes the sql output maybe overrided. When I submit some sql, all insert

spark git commit: [SPARK-16975][SQL] Column-partition path starting '_' should be handled correctly

2016-08-12 Thread lian
Repository: spark Updated Branches: refs/heads/master ccc6dc0f4 -> abff92bfd [SPARK-16975][SQL] Column-partition path starting '_' should be handled correctly ## What changes were proposed in this pull request? Currently, Spark ignores path names starting with underscore `_` and `.`. This

spark git commit: [MINOR][ML] Rename TreeEnsembleModels to TreeEnsembleModel for PySpark

2016-08-12 Thread yliang
Repository: spark Updated Branches: refs/heads/master ac84fb64d -> ccc6dc0f4 [MINOR][ML] Rename TreeEnsembleModels to TreeEnsembleModel for PySpark ## What changes were proposed in this pull request? Fix the typo of ```TreeEnsembleModels``` for PySpark, it should ```TreeEnsembleModel```

spark git commit: [SPARK-13081][PYSPARK][SPARK_SUBMIT] Allow set pythonExec of driver and executor through conf…

2016-08-12 Thread vanzin
Repository: spark Updated Branches: refs/heads/master ea0bf91b4 -> 7a9e25c38 [SPARK-13081][PYSPARK][SPARK_SUBMIT] Allow set pythonExec of driver and executor through conf… Before this PR, user have to export environment variable to specify the python of driver & executor which is not so

spark git commit: [SPARK-17022][YARN] Handle potential deadlock in driver handling messages

2016-08-12 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.0 bc683f037 -> 0fb01496c [SPARK-17022][YARN] Handle potential deadlock in driver handling messages ## What changes were proposed in this pull request? We directly send RequestExecutors to AM instead of transfer it to