[GitHub] spark pull request #17297: [SPARK-14649][CORE] DagScheduler should not run d...

Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/17297#discussion_r106774285 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala --- @@ -193,13 +193,6 @@ private[spark] class TaskSchedulerImpl

[GitHub] spark issue #16209: [WIP][SPARK-10849][SQL] Adds option to the JDBC data sou...

Github user maropu commented on the issue: https://github.com/apache/spark/pull/16209 Sorry to cutting in though, IMHO we need to have general logic to inject user-defined types via `UDTRegistration` into the DDL parser (`CatalystSqlParser`). If we have the logic, we could use the

[GitHub] spark issue #17312: [SPARK-19973] Display num of executors for the stage.

Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/17312 @rxin Thanks a lot. I added a number after `Aggregated Metrics by Executor` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #17312: [SPARK-19973] Display num of executors for the stage.

Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/17312  --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #17297: [SPARK-14649][CORE] DagScheduler should not run duplicat...

Github user squito commented on the issue: https://github.com/apache/spark/pull/17297 I'm a bit confused by the description: > 1. When a fetch failure happens, the task set manager ask the dag scheduler to abort all the non-running tasks. However, the running tasks in the

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106774155 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -20,19 +20,347 @@ package

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106774124 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -20,19 +20,347 @@ package

[GitHub] spark pull request #17088: [SPARK-19753][CORE] Un-register all shuffle outpu...

Github user sitalkedia commented on a diff in the pull request: https://github.com/apache/spark/pull/17088#discussion_r106774067 --- Diff: core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala --- @@ -394,6 +394,68 @@ class DAGSchedulerSuite extends SparkFunSuite

[GitHub] spark pull request #17088: [SPARK-19753][CORE] Un-register all shuffle outpu...

Github user sitalkedia commented on a diff in the pull request: https://github.com/apache/spark/pull/17088#discussion_r106774060 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1390,7 +1401,34 @@ class DAGScheduler( } } else

[GitHub] spark pull request #17088: [SPARK-19753][CORE] Un-register all shuffle outpu...

Github user sitalkedia commented on a diff in the pull request: https://github.com/apache/spark/pull/17088#discussion_r106774040 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1365,18 +1369,25 @@ class DAGScheduler( */

[GitHub] spark pull request #17088: [SPARK-19753][CORE] Un-register all shuffle outpu...

Github user sitalkedia commented on a diff in the pull request: https://github.com/apache/spark/pull/17088#discussion_r106774047 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1390,7 +1401,34 @@ class DAGScheduler( } } else

[GitHub] spark pull request #17088: [SPARK-19753][CORE] Un-register all shuffle outpu...

Github user sitalkedia commented on a diff in the pull request: https://github.com/apache/spark/pull/17088#discussion_r106774045 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1390,7 +1401,34 @@ class DAGScheduler( } } else

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106773943 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -20,19 +20,347 @@ package

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106773716 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -83,9 +411,19 @@ object ReorderJoin extends

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106773686 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -20,19 +20,347 @@ package

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106773624 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -20,19 +20,347 @@ package

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106773584 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -20,19 +20,347 @@ package

[GitHub] spark issue #17312: [SPARK-19973] Display num of executors for the stage.

Github user rxin commented on the issue: https://github.com/apache/spark/pull/17312 Can you put a screenshot here? Might actually be useful to have. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #17318: [SPARK-19896][SQL] Throw an exception if case classes ha...

Github user rxin commented on the issue: https://github.com/apache/spark/pull/17318 Can you put the after exception in the pr description as well? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #17337: [SQL][MINOR] Fix scaladoc for UDFRegistration

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17337 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17337: [SQL][MINOR] Fix scaladoc for UDFRegistration

Github user rxin commented on the issue: https://github.com/apache/spark/pull/17337 Merging in master/branch-2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #17138: [SPARK-17080] [SQL] join reorder

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17138#discussion_r106773079 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala --- @@ -0,0 +1,297 @@ +/* + * Licensed

[GitHub] spark pull request #17138: [SPARK-17080] [SQL] join reorder

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17138#discussion_r106773023 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala --- @@ -0,0 +1,297 @@ +/* + * Licensed

[GitHub] spark pull request #17138: [SPARK-17080] [SQL] join reorder

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17138#discussion_r106773013 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala --- @@ -0,0 +1,297 @@ +/* + * Licensed

[GitHub] spark issue #17333: [SPARK-19997] [SQL]fix proxy ugi could not get tgt to ca...

Github user yaooqinn commented on the issue: https://github.com/apache/spark/pull/17333 @jerryshao 😂 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106772868 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -20,19 +20,347 @@ package

[GitHub] spark pull request #17240: [SPARK-19915][SQL] Improve join reorder: simplify...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17240#discussion_r106772853 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala --- @@ -36,27 +36,24 @@ case class

[GitHub] spark issue #17338: [SPARK-19990][SQL]create a temp file for file in test.ja...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17338 **[Test build #74769 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74769/testReport)** for PR 17338 at commit

[GitHub] spark pull request #17338: [SPARK-19990][SQL]create a temp file for file in ...

GitHub user windpiger opened a pull request: https://github.com/apache/spark/pull/17338 [SPARK-19990][SQL]create a temp file for file in test.jar's resource when run test accross different modules ## What changes were proposed in this pull request? After we have merged the

[GitHub] spark issue #17112: [WIP] Measurement for SPARK-16929.

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17112 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74765/ Test FAILed. ---

[GitHub] spark issue #17112: [WIP] Measurement for SPARK-16929.

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17112 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17112: [WIP] Measurement for SPARK-16929.

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17112 **[Test build #74765 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74765/testReport)** for PR 17112 at commit

[GitHub] spark issue #17191: [SPARK-14471][SQL] Aliases in SELECT could be used in GR...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17191 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74764/ Test PASSed. ---

[GitHub] spark issue #17191: [SPARK-14471][SQL] Aliases in SELECT could be used in GR...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17191 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17191: [SPARK-14471][SQL] Aliases in SELECT could be used in GR...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17191 **[Test build #74764 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74764/testReport)** for PR 17191 at commit

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17219 **[Test build #74767 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74767/testReport)** for PR 17219 at commit

[GitHub] spark issue #17088: [SPARK-19753][CORE] Un-register all shuffle output on a ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17088 **[Test build #74768 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74768/testReport)** for PR 17088 at commit

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106772404 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -20,19 +20,347 @@ package

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106772374 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -20,19 +20,347 @@ package

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17219 **[Test build #74766 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74766/testReport)** for PR 17219 at commit

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17192 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17192 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74763/ Test PASSed. ---

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106772124 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -20,19 +20,347 @@ package

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17192 **[Test build #74763 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74763/testReport)** for PR 17192 at commit

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106772029 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -20,19 +20,340 @@ package

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106771968 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SimpleCatalystConf.scala --- @@ -40,6 +40,9 @@ case class SimpleCatalystConf(

[GitHub] spark issue #17337: [SQL][MINOR] Fix scaladoc for UDFRegistration

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17337 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17337: [SQL][MINOR] Fix scaladoc for UDFRegistration

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17337 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74762/ Test PASSed. ---

[GitHub] spark issue #17337: [SQL][MINOR] Fix scaladoc for UDFRegistration

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17337 **[Test build #74762 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74762/testReport)** for PR 17337 at commit

[GitHub] spark issue #17216: [SPARK-19873][SS] Record num shuffle partitions in offse...

Github user tdas commented on the issue: https://github.com/apache/spark/pull/17216 Seems like an unrelated failure. Probably a flaky test. On Mar 17, 2017 4:23 PM, "UCB AMPLab" wrote: > Merged build finished. Test FAILed. > > —

[GitHub] spark issue #17164: [SPARK-16844][SQL] Support codegen for sort-based aggrea...

Github user maropu commented on the issue: https://github.com/apache/spark/pull/17164 @hvanhovell ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #17318: [SPARK-19896][SQL] Throw an exception if case classes ha...

Github user maropu commented on the issue: https://github.com/apache/spark/pull/17318 @cloud-fan ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #17191: [SPARK-14471][SQL] Aliases in SELECT could be use...

Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/17191#discussion_r106770623 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -2598,4 +2598,26 @@ class SQLQuerySuite extends QueryTest with

[GitHub] spark issue #17191: [SPARK-14471][SQL] Aliases in SELECT could be used in GR...

Github user maropu commented on the issue: https://github.com/apache/spark/pull/17191 @gatorsmile I checked and actually MySQL and PostgreSQL cannnot use numbers as alias names; ``` // PostgreSQL postgres=# SELECT gkey1 AS 1 FROM t2; ERROR: syntax error at or

[GitHub] spark issue #17109: [SPARK-19740][MESOS]Add support in Spark to pass arbitra...

Github user yanji84 commented on the issue: https://github.com/apache/spark/pull/17109 hello, any update on this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17112: [WIP] Measurement for SPARK-16929.

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17112 **[Test build #74765 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74765/testReport)** for PR 17112 at commit

[GitHub] spark issue #17191: [SPARK-14471][SQL] Aliases in SELECT could be used in GR...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17191 **[Test build #74764 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74764/testReport)** for PR 17191 at commit

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16867 @squito Sure. I did test for 100k tasks. The results are as below: | | time cost | | --| -- | | insert | 135ms, 122ms, 119ms, 120ms, 163ms | |

[GitHub] spark issue #17286: [SPARK-19915][SQL] Exclude cartesian product candidates ...

Github user ioana-delaney commented on the issue: https://github.com/apache/spark/pull/17286 @wzhfy Some thoughts on how to solve the Cartesian problem as part of the join enumeration algorithm is to apply a similar strategy to the one that we discuss for star-plans. You keep track

[GitHub] spark issue #17191: [SPARK-14471][SQL] Aliases in SELECT could be used in GR...

Github user maropu commented on the issue: https://github.com/apache/spark/pull/17191 aha, I'll check and just a sec. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17192 (I just rebased to resolve the conflicts) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17192 **[Test build #74763 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74763/testReport)** for PR 17192 at commit

[GitHub] spark issue #17337: [SQL][MINOR] Fix scaladoc for UDFRegistration

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17337 **[Test build #74762 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74762/testReport)** for PR 17337 at commit

[GitHub] spark pull request #17337: [SQL][MINOR] Fix scaladoc for UDFRegistration

GitHub user jaceklaskowski opened a pull request: https://github.com/apache/spark/pull/17337 [SQL][MINOR] Fix scaladoc for UDFRegistration ## What changes were proposed in this pull request? Fix scaladoc for UDFRegistration ## How was this patch tested?

[GitHub] spark issue #17333: [SPARK-19997] [SQL]fix proxy ugi could not get tgt to ca...

Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/17333 What a coincidence 😄 ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16626 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16626 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74761/ Test PASSed. ---

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16626 **[Test build #74761 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74761/testReport)** for PR 16626 at commit

[GitHub] spark pull request #17315: [SPARK-19949][SQL] unify bad record handling in C...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17315#discussion_r106768186 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/FailureSafeParser.scala --- @@ -0,0 +1,68 @@ +/* + * Licensed to the

[GitHub] spark pull request #17315: [SPARK-19949][SQL] unify bad record handling in C...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17315#discussion_r106767486 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/FailureSafeParser.scala --- @@ -0,0 +1,68 @@ +/* + * Licensed to the

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user ioana-delaney commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106767465 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -20,19 +20,347 @@ package

[GitHub] spark issue #17327: [SPARK-19721][SS][BRANCH-2.1] Good error message for ver...

Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/17327 Thanks! Closed this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #17327: [SPARK-19721][SS][BRANCH-2.1] Good error message ...

Github user lw-lin closed the pull request at: https://github.com/apache/spark/pull/17327 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

Github user ron8hu commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106766281 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala --- @@ -20,19 +20,347 @@ package

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

Github user xwu0226 commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106765877 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -296,6 +297,45 @@ class SessionCatalog( }

[GitHub] spark issue #14615: [SPARK-17029] make toJSON not go through rdd form but op...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14615 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14615: [SPARK-17029] make toJSON not go through rdd form but op...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14615 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74759/ Test PASSed. ---

[GitHub] spark issue #14615: [SPARK-17029] make toJSON not go through rdd form but op...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14615 **[Test build #74759 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74759/testReport)** for PR 14615 at commit

[GitHub] spark pull request #17326: [SPARK-19985][ML] Fixed copy method for some ML M...

Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/17326#discussion_r106765091 --- Diff: mllib/src/test/scala/org/apache/spark/ml/classification/MultilayerPerceptronClassifierSuite.scala --- @@ -74,6 +74,7 @@ class

[GitHub] spark issue #17014: [SPARK-18608][ML] Fix double-caching in ML algorithms

Github user hhbyyh commented on the issue: https://github.com/apache/spark/pull/17014 Hi @zhengruifeng , is there any update? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17191: [SPARK-14471][SQL] Aliases in SELECT could be used in GR...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17191 What is the behaviors of MySQL and Postgres when we use digits as alias? ```SQL SELECT k1 AS `2`, k2 AS a, SUM(v) FROM t GROUP BY 2, k2 ``` You might need to replace backticks

[GitHub] spark issue #17179: [SPARK-19067][SS] Processing-time-based timeout in MapGr...

Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/17179 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #17216: [SPARK-19873][SS] Record num shuffle partitions in offse...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17216 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17216: [SPARK-19873][SS] Record num shuffle partitions in offse...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17216 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74760/ Test FAILed. ---

[GitHub] spark issue #17216: [SPARK-19873][SS] Record num shuffle partitions in offse...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17216 **[Test build #74760 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74760/testReport)** for PR 17216 at commit

[GitHub] spark pull request #17216: [SPARK-19873][SS] Record num shuffle partitions i...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17216 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17216: [SPARK-19873][SS] Record num shuffle partitions in offse...

Github user tdas commented on the issue: https://github.com/apache/spark/pull/17216 LGTM. Merging it to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17216: [SPARK-19873][SS] Record num shuffle partitions in offse...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17216 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17216: [SPARK-19873][SS] Record num shuffle partitions in offse...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17216 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74758/ Test PASSed. ---

[GitHub] spark issue #17216: [SPARK-19873][SS] Record num shuffle partitions in offse...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17216 **[Test build #74758 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74758/testReport)** for PR 17216 at commit

[GitHub] spark issue #17216: [SPARK-19873][SS] Record num shuffle partitions in offse...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17216 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17216: [SPARK-19873][SS] Record num shuffle partitions in offse...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17216 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74757/ Test PASSed. ---

[GitHub] spark issue #17216: [SPARK-19873][SS] Record num shuffle partitions in offse...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17216 **[Test build #74757 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74757/testReport)** for PR 17216 at commit

[GitHub] spark pull request #17330: [SPARK-19993][SQL][WIP] Caching logical plans con...

Github user dilipbiswal commented on a diff in the pull request: https://github.com/apache/spark/pull/17330#discussion_r106761010 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/subquery.scala --- @@ -61,6 +63,36 @@ abstract class

[GitHub] spark issue #17088: [SPARK-19753][CORE] Un-register all shuffle output on a ...

Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/17088 Ok that makes sense. I wanted to make sure that there wasn't some bug in SlaveLost (which might lead to a simpler fix than this) but @squito's description makes it clear that there are a

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16626 **[Test build #74761 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74761/testReport)** for PR 16626 at commit

[GitHub] spark pull request #17216: [SPARK-19873][SS] Record num shuffle partitions i...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/17216#discussion_r106759443 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -256,6 +259,15 @@ class StreamExecution(

[GitHub] spark pull request #17330: [SPARK-19993][SQL][WIP] Caching logical plans con...

Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/17330#discussion_r106758290 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/subquery.scala --- @@ -61,6 +63,36 @@ abstract class SubqueryExpression(

[GitHub] spark pull request #17216: [SPARK-19873][SS] Record num shuffle partitions i...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/17216#discussion_r106757213 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -256,6 +259,15 @@ class StreamExecution(

[GitHub] spark issue #17216: [SPARK-19873][SS] Record num shuffle partitions in offse...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17216 **[Test build #74760 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74760/testReport)** for PR 17216 at commit

  1   2   3   4   5   >