[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13670 **[Test build #62195 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62195/consoleFull)** for PR 13670 at commit

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62194/ Test PASSed. ---

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13670 **[Test build #62194 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62194/consoleFull)** for PR 13670 at commit

[GitHub] spark pull request #13990: [SPARK-16287][SQL] Implement str_to_map SQL funct...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13990#discussion_r70546286 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -393,3 +394,54 @@ case class

[GitHub] spark issue #14166: [MINOR][YARN] Fix code error in yarn-cluster unit test

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14166 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #14155: [SPARK-16498][SQL][WIP] move hive hack for data s...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14155#discussion_r70545811 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -327,6 +326,32 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark issue #13409: [SPARK-15667][SQL]Throw exception if columns number of o...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13409 **[Test build #62200 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62200/consoleFull)** for PR 13409 at commit

[GitHub] spark pull request #14166: [MINOR][YARN] Fix code error in yarn-cluster unit...

2016-07-12 Thread sharkdtu
GitHub user sharkdtu opened a pull request: https://github.com/apache/spark/pull/14166 [MINOR][YARN] Fix code error in yarn-cluster unit test ## What changes were proposed in this pull request? Fix code error in yarn-cluster unit test. ## How was this patch

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14165 **[Test build #62199 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62199/consoleFull)** for PR 14165 at commit

[GitHub] spark pull request #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14138 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14138 thanks, merging to master and 2.0! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14132 Hi, @hvanhovell . So far, I tried in the following way for `HINT_PREFIX`. Due to the prefix overlapping, `BRACKETED_COMMENT` seems to eat the HINT. Could you give me some advice more?

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14165 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62197/ Test FAILed. ---

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14165 **[Test build #62197 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62197/consoleFull)** for PR 14165 at commit

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14165 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14165 **[Test build #62197 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62197/consoleFull)** for PR 14165 at commit

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14132 **[Test build #62198 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62198/consoleFull)** for PR 14132 at commit

[GitHub] spark pull request #14165: [SPARK-16503] SparkSession should provide Spark v...

2016-07-12 Thread lw-lin
GitHub user lw-lin opened a pull request: https://github.com/apache/spark/pull/14165 [SPARK-16503] SparkSession should provide Spark version ## What changes were proposed in this pull request? This patch adds the following to SparkSession: ```scala /** The

[GitHub] spark issue #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Queries

2016-07-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14132 Now, only minor `HINT_PREFIX` remains. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62191/ Test PASSed. ---

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13670 **[Test build #62191 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62191/consoleFull)** for PR 13670 at commit

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14162 > If its the leveldb file not being created, that should be fixed by aab99d3 That's great, and in my view that also means that any failure in the startup of the shuffle service should

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/14162 I'd be curious if you find out what was wrong with that node. If its the leveldb file not being created, that should be fixed by

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

2016-07-12 Thread nblintao
Github user nblintao commented on the issue: https://github.com/apache/spark/pull/14158 Thanks, @ajbozarth. That's a great point. When no execution in a table has SQL text, this column shouldn't be shown. I'll fix this. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #14152: [SPARK-16395] [STREAMING] Fail if too many Checkp...

2016-07-12 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/14152#discussion_r70541473 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala --- @@ -18,8 +18,8 @@ package org.apache.spark.streaming import

[GitHub] spark pull request #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web ...

2016-07-12 Thread nblintao
Github user nblintao commented on a diff in the pull request: https://github.com/apache/spark/pull/14158#discussion_r70541399 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ui/AllExecutionsPage.scala --- @@ -103,6 +104,9 @@ private[ui] abstract class

[GitHub] spark issue #13617: [SPARK-10409] [ML] Add Multilayer Perceptron Regression ...

2016-07-12 Thread avulanov
Github user avulanov commented on the issue: https://github.com/apache/spark/pull/13617 @JeremyNixon Thanks for the comprehensive list of references! The internal API of Spark ANN is designed to be flexible and can handle different types of layers. However, only a part of the

[GitHub] spark issue #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Queries

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14132 **[Test build #62196 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62196/consoleFull)** for PR 14132 at commit

[GitHub] spark issue #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Queries

2016-07-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14132 So far, I couldn't do the following two advices. I just inform you that I'm still working these. :) - `HINT_PREFIX` - `| hintName=identifier '(' parameters+=identifier

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14147 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62193/ Test PASSed. ---

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14147 **[Test build #62193 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62193/consoleFull)** for PR 14147 at commit

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14147 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13670 **[Test build #62195 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62195/consoleFull)** for PR 13670 at commit

[GitHub] spark issue #14161: [MINOR] Fix Java style errors and remove unused imports

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14161 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62189/ Test PASSed. ---

[GitHub] spark issue #14161: [MINOR] Fix Java style errors and remove unused imports

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14161 **[Test build #62189 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62189/consoleFull)** for PR 14161 at commit

[GitHub] spark issue #14161: [MINOR] Fix Java style errors and remove unused imports

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14161 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/13670 @kishorvpatil thanks, I'll check it out --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13670 **[Test build #62194 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62194/consoleFull)** for PR 13670 at commit

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread kishorvpatil
Github user kishorvpatil commented on the issue: https://github.com/apache/spark/pull/13670 @ajbozarth, I have fixed the issue with safari exception. Its because `parser.baseURI` is `null`. I switched to `document.baseURI`. It looks fine on testing. Let me know if you still see this

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

2016-07-12 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/14158 Checked it out and gave it a test run and it looks good, just one issue. When the user only uses the dataframes api it will never show any SQL Text (only "-"), should we check if there is no SQL

[GitHub] spark issue #14164: Allow comparisons between UDTs and Datatypes

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14164 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14119 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14164: Allow comparisons between UDTs and Datatypes

2016-07-12 Thread damnMeddlingKid
GitHub user damnMeddlingKid opened a pull request: https://github.com/apache/spark/pull/14164 Allow comparisons between UDTs and Datatypes ## What changes were proposed in this pull request? Currently UDTs can not be compared to Datatypes even if their sqlTypes match. this

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14119 **[Test build #62192 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62192/consoleFull)** for PR 14119 at commit

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14119 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62192/ Test PASSed. ---

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14162 Some more info: you're correct in that, int this case, the application eventually fails because containers keep getting started on the "bad" node. --- If your project is set up for it, you can

[GitHub] spark issue #14163: [SPARK-15923][YARN] Spark Application rest api returns '...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14163 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #14163: [SPARK-15923][YARN] Spark Application rest api re...

2016-07-12 Thread Sherry302
GitHub user Sherry302 opened a pull request: https://github.com/apache/spark/pull/14163 [SPARK-15923][YARN] Spark Application rest api returns 'no such app: … ## What changes were proposed in this pull request? Update monitoring.md. …' You can merge this pull

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14147 **[Test build #62193 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62193/consoleFull)** for PR 14147 at commit

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-12 Thread aokolnychyi
Github user aokolnychyi commented on the issue: https://github.com/apache/spark/pull/14119 **Summary of the updates** - `JavaSparkSQL.java` file was removed. I kept it initially since the file itself was quite old (2+ years) and it was present in your original WIP branch

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14119 **[Test build #62192 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62192/consoleFull)** for PR 14119 at commit

[GitHub] spark issue #34: [SPARK-972] Added detailed callsite info for ValueError in ...

2016-07-12 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/34 **[Test build #48 has finished](https://jenkins.test.databricks.com/job/spark-pull-request-builder/48/consoleFull)** for PR 34 at commit

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14162 I'm trying to get access to more information about the original issue to answer all the questions; I know it was caused because for some reason the YARN "local-dirs" were all read only, and the

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13670 **[Test build #62191 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62191/consoleFull)** for PR 13670 at commit

[GitHub] spark issue #34: [SPARK-972] Added detailed callsite info for ValueError in ...

2016-07-12 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/34 **[Test build #48 has started](https://jenkins.test.databricks.com/job/spark-pull-request-builder/48/consoleFull)** for PR 34 at commit

[GitHub] spark issue #14160: [SPARK-16502] update depreciated ParquetFileReader()

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14160 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14160: [SPARK-16502] update depreciated ParquetFileReader()

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14160 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62188/ Test PASSed. ---

[GitHub] spark issue #14160: [SPARK-16502] update depreciated ParquetFileReader()

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14160 **[Test build #62188 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62188/consoleFull)** for PR 14160 at commit

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/14162 Correct, MR throws an exception, but again a lot of that is legacy from hadoop 1.x when it was the only thing running. The auxiliary services were added just for that originally. You could very

[GitHub] spark issue #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Queries

2016-07-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14132 I'm back. I'll resolve them. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14162 To answer my own question: the MR service throws exceptions when there's an error during initialization. (See `ShuffleHandler.java`, there's no swallowing of exceptions during `serviceInit` and

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14162 > What is the case you are seeing this issue? I'm ok with changing it if we have a good reason. Well, I guess "good reason" is in the eye of the beholder. :-) My argument for the change is

[GitHub] spark pull request #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Qu...

2016-07-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r70525213 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -86,6 +86,7 @@ class Analyzer(

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14162 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62190/ Test PASSed. ---

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14162 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14162 **[Test build #62190 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62190/consoleFull)** for PR 14162 at commit

[GitHub] spark issue #14116: [SPARK-16452][SQL][WIP] Support basic INFORMATION_SCHEMA

2016-07-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14116 Actually, this PR makes that test more robust generally. But, at the final commit of this PR, if this is not required, I will revert the change on R side in order to make PR smaller. ---

[GitHub] spark issue #14116: [SPARK-16452][SQL][WIP] Support basic INFORMATION_SCHEMA

2016-07-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14116 Spark temporary views (tables) are included, too. When you specify any databases, `show tables` also returns the tables of the database and the Spark temporary table. --- If your project is

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/14162 So we had specifically decided to have this behavior when this was first written. The reason is that an issue with the spark shuffle services shouldn't stop other services from running fine on

[GitHub] spark issue #14113: [SPARK-16457] [SQL] Fix Wrong Messages when CTAS with a ...

2016-07-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14113 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13756: [SPARK-16041][SQL] Disallow Duplicate Columns in partiti...

2016-07-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13756 cc @liancheng @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14162 **[Test build #62190 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62190/consoleFull)** for PR 14162 at commit

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r70519430 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,330 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r70519286 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -97,6 +97,49 @@ package object config { .toSequence

[GitHub] spark issue #14161: [MINOR] Fix Java style errors and remove unused imports

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14161 **[Test build #62189 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62189/consoleFull)** for PR 14161 at commit

[GitHub] spark issue #14161: [MINOR] Fix Java style errors and remove unused imports

2016-07-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14161 LGTM if it passes tests, yes --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14162 @tgravescs --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #14162: [SPARK-16505][yarn] Propagate error during shuffl...

2016-07-12 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/14162 [SPARK-16505][yarn] Propagate error during shuffle service startup. This prevents the NM from starting when something is wrong, which would lead to later errors which are confusing and harder to

[GitHub] spark pull request #14161: [MINOR] Fix Java style errors and remove unused i...

2016-07-12 Thread keypointt
GitHub user keypointt opened a pull request: https://github.com/apache/spark/pull/14161 [MINOR] Fix Java style errors and remove unused imports ## What changes were proposed in this pull request? Fix Java style errors and remove unused imports, which are randomly found

[GitHub] spark issue #14160: [SPARK-16502] update depreciated ParquetFileReader()

2016-07-12 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/14160 I'll fix these styles, thanks a lot Sean --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13894 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62187/ Test PASSed. ---

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13894 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14160: [SPARK-16502] update depreciated ParquetFileReader()

2016-07-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14160 Yeah, the problem is we don't have anything that runs dev/lint-java regularly. If you find it currently shows errors in master, go ahead and fix them in a [MINOR] PR. --- If your project is set up

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13894 **[Test build #62187 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62187/consoleFull)** for PR 13894 at commit

[GitHub] spark issue #14160: [SPARK-16502] update depreciated ParquetFileReader()

2016-07-12 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/14160 Hi @srowen I just found it's a duplicate so I closed it. But, when I ran `./dev/lint-java` I got these style problems. I'm just wondering for these random tiny style fixes, what should I

[GitHub] spark issue #14160: [SPARK-16502] update depreciated ParquetFileReader()

2016-07-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14160 I don't know that there's actually a problem, just saying that this is the kind of thing we should be careful about. There are a number of build warnings like this. Your change could be fine. ---

[GitHub] spark issue #14160: [SPARK-16502] update depreciated ParquetFileReader()

2016-07-12 Thread keypointt
Github user keypointt commented on the issue: https://github.com/apache/spark/pull/14160 oh I see...sorry didn't notice it's for backward compatibility I'll close it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request #14160: [SPARK-16502] update depreciated ParquetFileReade...

2016-07-12 Thread keypointt
Github user keypointt closed the pull request at: https://github.com/apache/spark/pull/14160 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14159: [SQL][PARQUET] Fix for Vectorized Parquet filter pushdow...

2016-07-12 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14159 https://github.com/apache/spark/pull/14160 solves the same thing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #14160: [SPARK-16502] update depreciated ParquetFileReader()

2016-07-12 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14160 https://github.com/apache/spark/pull/14159 solves the same thing... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/13670 Made a pass through and some mostly minor comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13894 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62185/ Test FAILed. ---

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13894 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13894 **[Test build #62185 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62185/consoleFull)** for PR 13894 at commit

[GitHub] spark issue #14160: [SPARK-16502] update depreciated ParquetFileReader()

2016-07-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14160 The thing we have to be careful of in general is making some change that isn't compatible with older versions of things like Hadoop (and their Parquet dependencies). This change could break older

[GitHub] spark issue #14116: [SPARK-16452][SQL][WIP] Support basic INFORMATION_SCHEMA

2016-07-12 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/14116 maybe I'm missing something, shouldn't `show tables` only returns tables from the select database? if I didn't `use information_schema` then `show tables` shouldn't include `tables`,

[GitHub] spark pull request #14116: [SPARK-16452][SQL][WIP] Support basic INFORMATION...

2016-07-12 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14116#discussion_r70511249 --- Diff: R/pkg/inst/tests/testthat/test_sparkSQL.R --- @@ -502,20 +502,21 @@ test_that("jsonRDD() on a RDD with json string", { })

<    1   2   3   4   5   6   >