[GitHub] spark issue #14170: [MINOR][SQL][TEST] Remove timezone setting from DataFram...

2016-07-12 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/14170 cc @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if t

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14132 Hi, @rxin . Could you review this PR again when you have some time? All the features are implemented and Spark Parser accepts general hints now. --- If your project is set up for it, y

[GitHub] spark pull request #14170: [MINOR][SQL][TEST] Remove timezone setting from D...

2016-07-12 Thread brkyvz
GitHub user brkyvz opened a pull request: https://github.com/apache/spark/pull/14170 [MINOR][SQL][TEST] Remove timezone setting from DataFrameTimeWindowingSuite ## What changes were proposed in this pull request? It's unnecessary. `QueryTest` already sets it. You can merge

[GitHub] spark issue #14149: [SPARK-16435][YARN][MINOR] Add warning log if initialExe...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14149 **[Test build #62204 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62204/consoleFull)** for PR 14149 at commit [`e69a026`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #14169: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14169 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62203/ Test FAILed. ---

[GitHub] spark issue #14111: [SPARK-16456][SQL] Reuse the uncorrelated scalar subquer...

2016-07-12 Thread lianhuiwang
Github user lianhuiwang commented on the issue: https://github.com/apache/spark/pull/14111 cc @rxin @hvanhovell @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #14169: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14169 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14169: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14169 **[Test build #62203 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62203/consoleFull)** for PR 14169 at commit [`671a2ba`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14169: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14169 **[Test build #62203 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62203/consoleFull)** for PR 14169 at commit [`671a2ba`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #14169: [SPARK-16515][SQL]set default record reader and w...

2016-07-12 Thread adrian-wang
GitHub user adrian-wang opened a pull request: https://github.com/apache/spark/pull/14169 [SPARK-16515][SQL]set default record reader and writer for script transformation ## What changes were proposed in this pull request? In `ScriptInputOutputSchema`, we read default `Reco

[GitHub] spark issue #14168: [SPARK-16514] [SQL] Fix various regex codegen bugs

2016-07-12 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14168 Sure --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #14129: [SPARK-16280][SQL][WIP] Implement histogram_numeric SQL ...

2016-07-12 Thread tilumi
Github user tilumi commented on the issue: https://github.com/apache/spark/pull/14129 Ok, I'll change the implementation to non-array version and run benchmark on both versions. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-07-12 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13704 Addressed a comment. Since the following code cannot pass information on `valueContainsNull = false`, I use the current code. ``` def map(mapType: MapType): AttributeReference = Attribute

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14132 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14132 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62198/ Test PASSed. ---

[GitHub] spark issue #34: [SPARK-972] Added detailed callsite info for ValueError in ...

2016-07-12 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/34 **[Test build #49 has finished](https://jenkins.test.databricks.com/job/spark-pull-request-builder/49/consoleFull)** for PR 34 at commit [`f5ea08c`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14132 **[Test build #62198 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62198/consoleFull)** for PR 14132 at commit [`61e4b1b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14168: [MINOR] [SQL] Fix various regex codegen bugs

2016-07-12 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14168 @ericl please open a JIRA ticket for this. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark issue #14168: [MINOR] [SQL] Fix various regex codegen bugs

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14168 **[Test build #62202 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62202/consoleFull)** for PR 14168 at commit [`4524d97`](https://github.com/apache/spark/commit/4

[GitHub] spark pull request #14168: [MINOR] [SQL] Fix various regex codegen bugs

2016-07-12 Thread ericl
GitHub user ericl opened a pull request: https://github.com/apache/spark/pull/14168 [MINOR] [SQL] Fix various regex codegen bugs ## What changes were proposed in this pull request? RegexExtract and RegexReplace currently crash on non-nullable input due use of a hard-coded l

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14165 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62199/ Test PASSed. ---

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14165 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #34: [SPARK-972] Added detailed callsite info for ValueError in ...

2016-07-12 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/34 **[Test build #49 has started](https://jenkins.test.databricks.com/job/spark-pull-request-builder/49/consoleFull)** for PR 34 at commit [`f5ea08c`](https://github.com/apache/spark/commit/f5

[GitHub] spark pull request #14166: [MINOR][YARN] Fix code error in yarn-cluster unit...

2016-07-12 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14166#discussion_r70554897 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala --- @@ -97,7 +97,7 @@ class YarnClusterSuite extends BaseYarnClusterSuite

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14165 **[Test build #62199 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62199/consoleFull)** for PR 14165 at commit [`97f6b92`](https://github.com/apache/spark/commit/

[GitHub] spark issue #7786: [SPARK-9468][Yarn][Core] Avoid scheduling tasks on preemp...

2016-07-12 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/7786 @vazin, sorry for the delay. I think your concern is valid that this change will probably harm the performance since 15 seconds (preemption waiting) is not a short time. But your

[GitHub] spark pull request #7786: [SPARK-9468][Yarn][Core] Avoid scheduling tasks on...

2016-07-12 Thread jerryshao
Github user jerryshao closed the pull request at: https://github.com/apache/spark/pull/7786 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] spark pull request #14163: [SPARK-15923][YARN] Spark Application rest api re...

2016-07-12 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14163#discussion_r70553491 --- Diff: docs/monitoring.md --- @@ -224,10 +224,12 @@ both running applications, and in the history server. The endpoints are mounted for the histor

[GitHub] spark issue #13409: [SPARK-15667][SQL]Throw exception if columns number of o...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13409 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62200/ Test FAILed. ---

[GitHub] spark issue #13409: [SPARK-15667][SQL]Throw exception if columns number of o...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13409 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13409: [SPARK-15667][SQL]Throw exception if columns number of o...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13409 **[Test build #62200 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62200/consoleFull)** for PR 13409 at commit [`50977da`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14167: [WIP] [SPARK-16194] Mesos Driver env vars

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14167 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14167: [WIP] [SPARK-16194] Mesos Driver env vars

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14167 **[Test build #62201 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62201/consoleFull)** for PR 14167 at commit [`e706ca6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14167: [WIP] [SPARK-16194] Mesos Driver env vars

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14167 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62201/ Test FAILed. ---

[GitHub] spark issue #14167: [WIP] [SPARK-16194] Mesos Driver env vars

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14167 **[Test build #62201 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62201/consoleFull)** for PR 14167 at commit [`e706ca6`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14132 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62196/ Test FAILed. ---

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14132 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14132 **[Test build #62196 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62196/consoleFull)** for PR 14132 at commit [`5c76e25`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14167: [WIP] [SPARK-16194] Mesos Driver env vars

2016-07-12 Thread mgummelt
GitHub user mgummelt opened a pull request: https://github.com/apache/spark/pull/14167 [WIP] [SPARK-16194] Mesos Driver env vars ## What changes were proposed in this pull request? Added new configuration namespace: spark.mesos.env.* This allows a user submitting a

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62195/ Test PASSed. ---

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13670 **[Test build #62195 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62195/consoleFull)** for PR 13670 at commit [`3454193`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62194/ Test PASSed. ---

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13670 **[Test build #62194 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62194/consoleFull)** for PR 13670 at commit [`55419aa`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13990: [SPARK-16287][SQL] Implement str_to_map SQL funct...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13990#discussion_r70546286 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -393,3 +394,54 @@ case class CreateNamedSt

[GitHub] spark issue #14166: [MINOR][YARN] Fix code error in yarn-cluster unit test

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14166 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #14155: [SPARK-16498][SQL][WIP] move hive hack for data s...

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14155#discussion_r70545811 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -327,6 +326,32 @@ class SparkSqlAstBuilder(conf: SQLConf) exte

[GitHub] spark issue #13409: [SPARK-15667][SQL]Throw exception if columns number of o...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13409 **[Test build #62200 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62200/consoleFull)** for PR 13409 at commit [`50977da`](https://github.com/apache/spark/commit/5

[GitHub] spark pull request #14166: [MINOR][YARN] Fix code error in yarn-cluster unit...

2016-07-12 Thread sharkdtu
GitHub user sharkdtu opened a pull request: https://github.com/apache/spark/pull/14166 [MINOR][YARN] Fix code error in yarn-cluster unit test ## What changes were proposed in this pull request? Fix code error in yarn-cluster unit test. ## How was this patch tes

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14165 **[Test build #62199 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62199/consoleFull)** for PR 14165 at commit [`97f6b92`](https://github.com/apache/spark/commit/9

[GitHub] spark pull request #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14138 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14138 thanks, merging to master and 2.0! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14132 Hi, @hvanhovell . So far, I tried in the following way for `HINT_PREFIX`. Due to the prefix overlapping, `BRACKETED_COMMENT` seems to eat the HINT. Could you give me some advice more?

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14165 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62197/ Test FAILed. ---

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14165 **[Test build #62197 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62197/consoleFull)** for PR 14165 at commit [`4309100`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14165 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14165: [SPARK-16503] SparkSession should provide Spark version

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14165 **[Test build #62197 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62197/consoleFull)** for PR 14165 at commit [`4309100`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14132 **[Test build #62198 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62198/consoleFull)** for PR 14132 at commit [`61e4b1b`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #14165: [SPARK-16503] SparkSession should provide Spark v...

2016-07-12 Thread lw-lin
GitHub user lw-lin opened a pull request: https://github.com/apache/spark/pull/14165 [SPARK-16503] SparkSession should provide Spark version ## What changes were proposed in this pull request? This patch adds the following to SparkSession: ```scala /** The versi

[GitHub] spark issue #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Queries

2016-07-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14132 Now, only minor `HINT_PREFIX` remains. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62191/ Test PASSed. ---

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13670 **[Test build #62191 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62191/consoleFull)** for PR 13670 at commit [`2453e21`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14162 > If its the leveldb file not being created, that should be fixed by aab99d3 That's great, and in my view that also means that any failure in the startup of the shuffle service should actua

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/14162 I'd be curious if you find out what was wrong with that node. If its the leveldb file not being created, that should be fixed by https://github.com/apache/spark/commit/aab99d31a927adfa921

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

2016-07-12 Thread nblintao
Github user nblintao commented on the issue: https://github.com/apache/spark/pull/14158 Thanks, @ajbozarth. That's a great point. When no execution in a table has SQL text, this column shouldn't be shown. I'll fix this. --- If your project is set up for it, you can reply to this emai

[GitHub] spark pull request #14152: [SPARK-16395] [STREAMING] Fail if too many Checkp...

2016-07-12 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/14152#discussion_r70541473 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala --- @@ -18,8 +18,8 @@ package org.apache.spark.streaming import j

[GitHub] spark pull request #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web ...

2016-07-12 Thread nblintao
Github user nblintao commented on a diff in the pull request: https://github.com/apache/spark/pull/14158#discussion_r70541399 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ui/AllExecutionsPage.scala --- @@ -103,6 +104,9 @@ private[ui] abstract class ExecutionTab

[GitHub] spark issue #13617: [SPARK-10409] [ML] Add Multilayer Perceptron Regression ...

2016-07-12 Thread avulanov
Github user avulanov commented on the issue: https://github.com/apache/spark/pull/13617 @JeremyNixon Thanks for the comprehensive list of references! The internal API of Spark ANN is designed to be flexible and can handle different types of layers. However, only a part of the

[GitHub] spark issue #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Queries

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14132 **[Test build #62196 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62196/consoleFull)** for PR 14132 at commit [`5c76e25`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #14132: [SPARK-16475][SQL][WIP] Broadcast Hint for SQL Queries

2016-07-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14132 So far, I couldn't do the following two advices. I just inform you that I'm still working these. :) - `HINT_PREFIX` - `| hintName=identifier '(' parameters+=identifier parameters+=

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14147 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62193/ Test PASSed. ---

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14147 **[Test build #62193 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62193/consoleFull)** for PR 14147 at commit [`8f5fb63`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14147 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13670 **[Test build #62195 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62195/consoleFull)** for PR 13670 at commit [`3454193`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #14161: [MINOR] Fix Java style errors and remove unused imports

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14161 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62189/ Test PASSed. ---

[GitHub] spark issue #14161: [MINOR] Fix Java style errors and remove unused imports

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14161 **[Test build #62189 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62189/consoleFull)** for PR 14161 at commit [`e2b2edf`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14161: [MINOR] Fix Java style errors and remove unused imports

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14161 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/13670 @kishorvpatil thanks, I'll check it out --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13670 **[Test build #62194 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62194/consoleFull)** for PR 13670 at commit [`55419aa`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread kishorvpatil
Github user kishorvpatil commented on the issue: https://github.com/apache/spark/pull/13670 @ajbozarth, I have fixed the issue with safari exception. Its because `parser.baseURI` is `null`. I switched to `document.baseURI`. It looks fine on testing. Let me know if you still see this i

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

2016-07-12 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/14158 Checked it out and gave it a test run and it looks good, just one issue. When the user only uses the dataframes api it will never show any SQL Text (only "-"), should we check if there is no SQL T

[GitHub] spark issue #14164: Allow comparisons between UDTs and Datatypes

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14164 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14119 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14164: Allow comparisons between UDTs and Datatypes

2016-07-12 Thread damnMeddlingKid
GitHub user damnMeddlingKid opened a pull request: https://github.com/apache/spark/pull/14164 Allow comparisons between UDTs and Datatypes ## What changes were proposed in this pull request? Currently UDTs can not be compared to Datatypes even if their sqlTypes match. this leads

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14119 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62192/ Test PASSed. ---

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14119 **[Test build #62192 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62192/consoleFull)** for PR 14119 at commit [`7451fc7`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14162 Some more info: you're correct in that, int this case, the application eventually fails because containers keep getting started on the "bad" node. --- If your project is set up for it, you can reply

[GitHub] spark issue #14163: [SPARK-15923][YARN] Spark Application rest api returns '...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14163 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #14163: [SPARK-15923][YARN] Spark Application rest api re...

2016-07-12 Thread Sherry302
GitHub user Sherry302 opened a pull request: https://github.com/apache/spark/pull/14163 [SPARK-15923][YARN] Spark Application rest api returns 'no such app: … ## What changes were proposed in this pull request? Update monitoring.md. …' You can merge this pull reques

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14147 **[Test build #62193 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62193/consoleFull)** for PR 14147 at commit [`8f5fb63`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-12 Thread aokolnychyi
Github user aokolnychyi commented on the issue: https://github.com/apache/spark/pull/14119 **Summary of the updates** - `JavaSparkSQL.java` file was removed. I kept it initially since the file itself was quite old (2+ years) and it was present in your original WIP branch alon

[GitHub] spark issue #14119: [SPARK-16303][DOCS][EXAMPLES][WIP] Updated SQL programmi...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14119 **[Test build #62192 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62192/consoleFull)** for PR 14119 at commit [`7451fc7`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #34: [SPARK-972] Added detailed callsite info for ValueError in ...

2016-07-12 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/34 **[Test build #48 has finished](https://jenkins.test.databricks.com/job/spark-pull-request-builder/48/consoleFull)** for PR 34 at commit [`30bda81`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #14162: [SPARK-16505][yarn] Propagate error during shuffle servi...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14162 I'm trying to get access to more information about the original issue to answer all the questions; I know it was caused because for some reason the YARN "local-dirs" were all read only, and the level

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13670 **[Test build #62191 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62191/consoleFull)** for PR 13670 at commit [`2453e21`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #34: [SPARK-972] Added detailed callsite info for ValueError in ...

2016-07-12 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/34 **[Test build #48 has started](https://jenkins.test.databricks.com/job/spark-pull-request-builder/48/consoleFull)** for PR 34 at commit [`30bda81`](https://github.com/apache/spark/commit/30

[GitHub] spark issue #14160: [SPARK-16502] update depreciated ParquetFileReader()

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14160 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14160: [SPARK-16502] update depreciated ParquetFileReader()

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14160 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62188/ Test PASSed. ---

<    1   2   3   4   5   6   >