[GitHub] spark issue #14151: [SPARK-16496][SQL] Add wholetext as option for reading t...

2016-07-12 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14151 For now let's just do it for text file. I took a look - I guess it is ok to leave them in datasources for now. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #14172: [SPARK-16516][SQL] Support for pushing down filters for ...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14172 **[Test build #62214 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62214/consoleFull)** for PR 14172 at commit

[GitHub] spark issue #14172: [SPARK-16516][SQL] Support for pushing down filters for ...

2016-07-12 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14172 @liancheng I thought both were omitted in the original codes because `BigDecimal` and `Timestamp` are not supported but it seems they are and work fine. Could you please take a look? --- If

[GitHub] spark pull request #14172: [SPARK-16516][SQL] Support for pushing down filte...

2016-07-12 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/14172 [SPARK-16516][SQL] Support for pushing down filters for decimal and timestamp types in ORC ## What changes were proposed in this pull request? It seems ORC supports all the types in

[GitHub] spark issue #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid unnecessa...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14036 **[Test build #62213 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62213/consoleFull)** for PR 14036 at commit

[GitHub] spark issue #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid unnecessa...

2016-07-12 Thread techaddict
Github user techaddict commented on the issue: https://github.com/apache/spark/pull/14036 @cloud-fan Updated the PR, all tests should pass now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid unnecessa...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14036 **[Test build #62212 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62212/consoleFull)** for PR 14036 at commit

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14158 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14158 **[Test build #62207 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62207/consoleFull)** for PR 14158 at commit

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14158 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62207/ Test PASSed. ---

[GitHub] spark issue #14169: [WIP][SPARK-16515][SQL]set default record reader and wri...

2016-07-12 Thread adrian-wang
Github user adrian-wang commented on the issue: https://github.com/apache/spark/pull/14169 This is strange because I can pass the specific test on my local. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #14068: [SPARK-16469] enhanced simulate multiply

2016-07-12 Thread uzadude
Github user uzadude commented on the issue: https://github.com/apache/spark/pull/14068 Have done the requested nit changes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14171: [SPARKR][MINOR] R examples and test updates

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14171 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62211/ Test PASSed. ---

[GitHub] spark issue #14171: [SPARKR][MINOR] R examples and test updates

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14171 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14171: [SPARKR][MINOR] R examples and test updates

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14171 **[Test build #62211 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62211/consoleFull)** for PR 14171 at commit

[GitHub] spark pull request #14151: [SPARK-16496][SQL] Add wholetext as option for re...

2016-07-12 Thread ScrapCodes
Github user ScrapCodes commented on a diff in the pull request: https://github.com/apache/spark/pull/14151#discussion_r70564698 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/HadoopFileWholeTextReader.scala --- @@ -0,0 +1,53 @@ +/* + *

[GitHub] spark issue #14151: [SPARK-16496][SQL] Add wholetext as option for reading t...

2016-07-12 Thread ScrapCodes
Github user ScrapCodes commented on the issue: https://github.com/apache/spark/pull/14151 Actually what you said sounds like a nice idea, I was considering is it possible to propogate this as an option in all other formats like CSV and Json too ? --- If your project is set up for

[GitHub] spark pull request #14151: [SPARK-16496][SQL] Add wholetext as option for re...

2016-07-12 Thread ScrapCodes
Github user ScrapCodes commented on a diff in the pull request: https://github.com/apache/spark/pull/14151#discussion_r70564514 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/HadoopFileWholeTextReader.scala --- @@ -0,0 +1,53 @@ +/* + *

[GitHub] spark pull request #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid un...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14036#discussion_r70564289 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -249,11 +241,12 @@ case class Divide(left:

[GitHub] spark issue #14171: [SPARKR][MINOR] R examples and test updates

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14171 **[Test build #62211 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62211/consoleFull)** for PR 14171 at commit

[GitHub] spark pull request #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid un...

2016-07-12 Thread techaddict
Github user techaddict commented on a diff in the pull request: https://github.com/apache/spark/pull/14036#discussion_r70563932 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -249,11 +241,12 @@ case class Divide(left:

[GitHub] spark pull request #14171: [SPARKR][MINOR] R examples and test updates

2016-07-12 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/14171 [SPARKR][MINOR] R examples and test updates ## What changes were proposed in this pull request? Minor example updates ## How was this patch tested? manual

[GitHub] spark issue #14149: [SPARK-16435][YARN][MINOR] Add warning log if initialExe...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14149 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14149: [SPARK-16435][YARN][MINOR] Add warning log if initialExe...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14149 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62204/ Test PASSed. ---

[GitHub] spark issue #14170: [MINOR][SQL][TEST] Remove timezone setting from DataFram...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14170 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62206/ Test PASSed. ---

[GitHub] spark issue #14149: [SPARK-16435][YARN][MINOR] Add warning log if initialExe...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14149 **[Test build #62204 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62204/consoleFull)** for PR 14149 at commit

[GitHub] spark issue #14170: [MINOR][SQL][TEST] Remove timezone setting from DataFram...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14170 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14170: [MINOR][SQL][TEST] Remove timezone setting from DataFram...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14170 **[Test build #62206 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62206/consoleFull)** for PR 14170 at commit

[GitHub] spark pull request #14111: [SPARK-16456][SQL] Reuse the uncorrelated scalar ...

2016-07-12 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/14111#discussion_r70563183 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala --- @@ -263,7 +263,9 @@ abstract class QueryPlan[PlanType <:

[GitHub] spark pull request #13990: [SPARK-16287][SQL] Implement str_to_map SQL funct...

2016-07-12 Thread techaddict
Github user techaddict commented on a diff in the pull request: https://github.com/apache/spark/pull/13990#discussion_r70562875 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/StringFunctionsSuite.scala --- @@ -384,4 +384,39 @@ class StringFunctionsSuite extends QueryTest

[GitHub] spark pull request #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid un...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14036#discussion_r70562757 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -249,11 +241,12 @@ case class Divide(left:

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

2016-07-12 Thread nblintao
Github user nblintao commented on the issue: https://github.com/apache/spark/pull/14158 **In the commit above, I made three adjustments:** 1. If the query has no related query text, show a blank in that field. 1. If there is no query in the table has a query text, not

[GitHub] spark pull request #13990: [SPARK-16287][SQL] Implement str_to_map SQL funct...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13990#discussion_r70562486 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/StringFunctionsSuite.scala --- @@ -384,4 +384,39 @@ class StringFunctionsSuite extends QueryTest

[GitHub] spark pull request #13990: [SPARK-16287][SQL] Implement str_to_map SQL funct...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13990#discussion_r70562420 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ComplexTypeSuite.scala --- @@ -246,4 +246,26 @@ class ComplexTypeSuite

[GitHub] spark pull request #13990: [SPARK-16287][SQL] Implement str_to_map SQL funct...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13990#discussion_r70562365 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -393,3 +394,56 @@ case class

[GitHub] spark pull request #13990: [SPARK-16287][SQL] Implement str_to_map SQL funct...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13990#discussion_r70562343 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -393,3 +394,56 @@ case class

[GitHub] spark pull request #13704: [SPARK-15985][SQL] Eliminate redundant cast from ...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13704#discussion_r70562239 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SimplifyCastsSuite.scala --- @@ -0,0 +1,121 @@ +/* + * Licensed to

[GitHub] spark issue #14169: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14169 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14169: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14169 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62205/ Test FAILed. ---

[GitHub] spark issue #14169: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14169 **[Test build #62205 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62205/consoleFull)** for PR 14169 at commit

[GitHub] spark issue #14111: [SPARK-16456][SQL] Reuse the uncorrelated scalar subquer...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14111 I have a simpler idea to implement this feature: 1. in `SparkPlan`, build a map from distinct subqueries to future result, and still keep the original subquery list. 2. in

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13990 **[Test build #62210 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62210/consoleFull)** for PR 13990 at commit

[GitHub] spark issue #14168: [SPARK-16514] [SQL] Fix various regex codegen bugs

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14168 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14168: [SPARK-16514] [SQL] Fix various regex codegen bugs

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14168 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62202/ Test PASSed. ---

[GitHub] spark issue #14168: [SPARK-16514] [SQL] Fix various regex codegen bugs

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14168 **[Test build #62202 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62202/consoleFull)** for PR 14168 at commit

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13990 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62209/ Test FAILed. ---

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13990 **[Test build #62209 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62209/consoleFull)** for PR 13990 at commit

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13990 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13990 **[Test build #62209 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62209/consoleFull)** for PR 13990 at commit

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-12 Thread techaddict
Github user techaddict commented on the issue: https://github.com/apache/spark/pull/13990 @cloud-fan all comments addressed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13990 **[Test build #62208 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62208/consoleFull)** for PR 13990 at commit

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14158 **[Test build #62207 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62207/consoleFull)** for PR 14158 at commit

[GitHub] spark pull request #14111: [SPARK-16456][SQL] Reuse the uncorrelated scalar ...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14111#discussion_r70560854 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala --- @@ -263,7 +263,9 @@ abstract class QueryPlan[PlanType <:

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/14162 > To be fair if you have a bug in another part of the shuffle service that is not in the startup path, it still could take out your whole cluster. That can't be fixed until the NM runs aux

[GitHub] spark pull request #13990: [SPARK-16287][SQL] Implement str_to_map SQL funct...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13990#discussion_r70560643 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -393,3 +394,54 @@ case class

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread kishorvpatil
Github user kishorvpatil commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70560042 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage-template.html --- @@ -0,0 +1,102 @@ + +

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread kishorvpatil
Github user kishorvpatil commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70560022 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #13990: [SPARK-16287][SQL] Implement str_to_map SQL funct...

2016-07-12 Thread techaddict
Github user techaddict commented on a diff in the pull request: https://github.com/apache/spark/pull/13990#discussion_r70559727 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -393,3 +394,54 @@ case class

[GitHub] spark issue #14170: [MINOR][SQL][TEST] Remove timezone setting from DataFram...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14170 **[Test build #62206 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62206/consoleFull)** for PR 14170 at commit

[GitHub] spark issue #14169: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14169 **[Test build #62205 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62205/consoleFull)** for PR 14169 at commit

[GitHub] spark issue #14170: [MINOR][SQL][TEST] Remove timezone setting from DataFram...

2016-07-12 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/14170 cc @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14132 Hi, @rxin . Could you review this PR again when you have some time? All the features are implemented and Spark Parser accepts general hints now. --- If your project is set up for it,

[GitHub] spark pull request #14170: [MINOR][SQL][TEST] Remove timezone setting from D...

2016-07-12 Thread brkyvz
GitHub user brkyvz opened a pull request: https://github.com/apache/spark/pull/14170 [MINOR][SQL][TEST] Remove timezone setting from DataFrameTimeWindowingSuite ## What changes were proposed in this pull request? It's unnecessary. `QueryTest` already sets it. You can merge

[GitHub] spark issue #14149: [SPARK-16435][YARN][MINOR] Add warning log if initialExe...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14149 **[Test build #62204 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62204/consoleFull)** for PR 14149 at commit

[GitHub] spark issue #14111: [SPARK-16456][SQL] Reuse the uncorrelated scalar subquer...

2016-07-12 Thread lianhuiwang
Github user lianhuiwang commented on the issue: https://github.com/apache/spark/pull/14111 cc @rxin @hvanhovell @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14169: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14169 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62203/ Test FAILed. ---

[GitHub] spark issue #14169: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14169 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14169: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14169 **[Test build #62203 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62203/consoleFull)** for PR 14169 at commit

[GitHub] spark issue #14169: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14169 **[Test build #62203 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62203/consoleFull)** for PR 14169 at commit

[GitHub] spark pull request #14169: [SPARK-16515][SQL]set default record reader and w...

2016-07-12 Thread adrian-wang
GitHub user adrian-wang opened a pull request: https://github.com/apache/spark/pull/14169 [SPARK-16515][SQL]set default record reader and writer for script transformation ## What changes were proposed in this pull request? In `ScriptInputOutputSchema`, we read default

[GitHub] spark issue #14168: [SPARK-16514] [SQL] Fix various regex codegen bugs

2016-07-12 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14168 Sure --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14129: [SPARK-16280][SQL][WIP] Implement histogram_numeric SQL ...

2016-07-12 Thread tilumi
Github user tilumi commented on the issue: https://github.com/apache/spark/pull/14129 Ok, I'll change the implementation to non-array version and run benchmark on both versions. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-07-12 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13704 Addressed a comment. Since the following code cannot pass information on `valueContainsNull = false`, I use the current code. ``` def map(mapType: MapType): AttributeReference =

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14132 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14132 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62198/ Test PASSed. ---

[GitHub] spark issue #34: [SPARK-972] Added detailed callsite info for ValueError in ...

2016-07-12 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/34 **[Test build #49 has finished](https://jenkins.test.databricks.com/job/spark-pull-request-builder/49/consoleFull)** for PR 34 at commit

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14132 **[Test build #62198 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62198/consoleFull)** for PR 14132 at commit

[GitHub] spark issue #14168: [MINOR] [SQL] Fix various regex codegen bugs

2016-07-12 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14168 @ericl please open a JIRA ticket for this. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14168: [MINOR] [SQL] Fix various regex codegen bugs

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14168 **[Test build #62202 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62202/consoleFull)** for PR 14168 at commit

[GitHub] spark pull request #14168: [MINOR] [SQL] Fix various regex codegen bugs

2016-07-12 Thread ericl
GitHub user ericl opened a pull request: https://github.com/apache/spark/pull/14168 [MINOR] [SQL] Fix various regex codegen bugs ## What changes were proposed in this pull request? RegexExtract and RegexReplace currently crash on non-nullable input due use of a hard-coded

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14165 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62199/ Test PASSed. ---

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14165 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #34: [SPARK-972] Added detailed callsite info for ValueError in ...

2016-07-12 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/34 **[Test build #49 has started](https://jenkins.test.databricks.com/job/spark-pull-request-builder/49/consoleFull)** for PR 34 at commit

[GitHub] spark pull request #14166: [MINOR][YARN] Fix code error in yarn-cluster unit...

2016-07-12 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14166#discussion_r70554897 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala --- @@ -97,7 +97,7 @@ class YarnClusterSuite extends

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14165 **[Test build #62199 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62199/consoleFull)** for PR 14165 at commit

[GitHub] spark issue #7786: [SPARK-9468][Yarn][Core] Avoid scheduling tasks on preemp...

2016-07-12 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/7786 @vazin, sorry for the delay. I think your concern is valid that this change will probably harm the performance since 15 seconds (preemption waiting) is not a short time. But

[GitHub] spark pull request #7786: [SPARK-9468][Yarn][Core] Avoid scheduling tasks on...

2016-07-12 Thread jerryshao
Github user jerryshao closed the pull request at: https://github.com/apache/spark/pull/7786 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14163: [SPARK-15923][YARN] Spark Application rest api re...

2016-07-12 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14163#discussion_r70553491 --- Diff: docs/monitoring.md --- @@ -224,10 +224,12 @@ both running applications, and in the history server. The endpoints are mounted for the

[GitHub] spark issue #13409: [SPARK-15667][SQL]Throw exception if columns number of o...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13409 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62200/ Test FAILed. ---

[GitHub] spark issue #13409: [SPARK-15667][SQL]Throw exception if columns number of o...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13409 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13409: [SPARK-15667][SQL]Throw exception if columns number of o...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13409 **[Test build #62200 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62200/consoleFull)** for PR 13409 at commit

[GitHub] spark issue #14167: [WIP] [SPARK-16194] Mesos Driver env vars

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14167 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14167: [WIP] [SPARK-16194] Mesos Driver env vars

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14167 **[Test build #62201 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62201/consoleFull)** for PR 14167 at commit

[GitHub] spark issue #14167: [WIP] [SPARK-16194] Mesos Driver env vars

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14167 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62201/ Test FAILed. ---

[GitHub] spark issue #14167: [WIP] [SPARK-16194] Mesos Driver env vars

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14167 **[Test build #62201 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62201/consoleFull)** for PR 14167 at commit

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14132 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62196/ Test FAILed. ---

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14132 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14132 **[Test build #62196 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62196/consoleFull)** for PR 14132 at commit

[GitHub] spark pull request #14167: [WIP] [SPARK-16194] Mesos Driver env vars

2016-07-12 Thread mgummelt
GitHub user mgummelt opened a pull request: https://github.com/apache/spark/pull/14167 [WIP] [SPARK-16194] Mesos Driver env vars ## What changes were proposed in this pull request? Added new configuration namespace: spark.mesos.env.* This allows a user submitting a

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62195/ Test PASSed. ---

  1   2   3   4   5   6   >