[jira] [Assigned] (SPARK-33214) HiveExternalCatalogVersionsSuite shouldn't use or delete hard-coded /tmp directory

2020-11-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33214: --- Assignee: Erik Krogen > HiveExternalCatalogVersionsSuite shouldn't use or delete hard-coded

[jira] [Resolved] (SPARK-33214) HiveExternalCatalogVersionsSuite shouldn't use or delete hard-coded /tmp directory

2020-11-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33214. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30122 [https://gith

[jira] [Resolved] (SPARK-33321) Migrate ANALYZE TABLE to new resolution framework

2020-11-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33321. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30229 [https://gith

[jira] [Assigned] (SPARK-33321) Migrate ANALYZE TABLE to new resolution framework

2020-11-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33321: --- Assignee: Terry Kim > Migrate ANALYZE TABLE to new resolution framework > -

[jira] [Resolved] (SPARK-33333) Upgrade Jetty to 9.4.28.v20200408

2020-11-03 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-3. - Fix Version/s: 3.0.2 Resolution: Fixed Issue resolved by pull request 30240 [https://gith

[jira] [Assigned] (SPARK-33333) Upgrade Jetty to 9.4.28.v20200408

2020-11-03 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-3: --- Assignee: Dongjoon Hyun > Upgrade Jetty to 9.4.28.v20200408 > -

[jira] [Commented] (SPARK-33337) Support subexpression elimination in branches of conditional expressions

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225886#comment-17225886 ] Apache Spark commented on SPARK-7: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-33337) Support subexpression elimination in branches of conditional expressions

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7: Assignee: Apache Spark (was: L. C. Hsieh) > Support subexpression elimination in branche

[jira] [Assigned] (SPARK-33337) Support subexpression elimination in branches of conditional expressions

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7: Assignee: L. C. Hsieh (was: Apache Spark) > Support subexpression elimination in branche

[jira] [Assigned] (SPARK-33337) Support subexpression elimination in branches of conditional expressions

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7: Assignee: L. C. Hsieh (was: Apache Spark) > Support subexpression elimination in branche

[jira] [Created] (SPARK-33337) Support subexpression elimination in branches of conditional expressions

2020-11-03 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-7: --- Summary: Support subexpression elimination in branches of conditional expressions Key: SPARK-7 URL: https://issues.apache.org/jira/browse/SPARK-7 Project: Spark

[jira] [Commented] (SPARK-33282) Replace Probot Autolabeler with Github Action

2020-11-03 Thread Kyle Bendickson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225879#comment-17225879 ] Kyle Bendickson commented on SPARK-33282: - Oh and I will merge this in my local

[jira] [Comment Edited] (SPARK-33282) Replace Probot Autolabeler with Github Action

2020-11-03 Thread Kyle Bendickson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225874#comment-17225874 ] Kyle Bendickson edited comment on SPARK-33282 at 11/4/20, 5:55 AM: ---

[jira] [Commented] (SPARK-33282) Replace Probot Autolabeler with Github Action

2020-11-03 Thread Kyle Bendickson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225874#comment-17225874 ] Kyle Bendickson commented on SPARK-33282: - I've opened a WIP PR for this [~hyukj

[jira] [Assigned] (SPARK-33282) Replace Probot Autolabeler with Github Action

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33282: Assignee: Apache Spark > Replace Probot Autolabeler with Github Action >

[jira] [Commented] (SPARK-33282) Replace Probot Autolabeler with Github Action

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225863#comment-17225863 ] Apache Spark commented on SPARK-33282: -- User 'kbendick' has created a pull request

[jira] [Assigned] (SPARK-33282) Replace Probot Autolabeler with Github Action

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33282: Assignee: (was: Apache Spark) > Replace Probot Autolabeler with Github Action > -

[jira] [Commented] (SPARK-33336) provided an invalid fromOffset when spark streaming running

2020-11-03 Thread Yu Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-6?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225858#comment-17225858 ] Yu Wang commented on SPARK-6: - https://issues.apache.org/jira/browse/SPARK-27196 htt

[jira] [Created] (SPARK-33336) provided an invalid fromOffset when spark streaming running

2020-11-03 Thread Yu Wang (Jira)
Yu Wang created SPARK-6: --- Summary: provided an invalid fromOffset when spark streaming running Key: SPARK-6 URL: https://issues.apache.org/jira/browse/SPARK-6 Project: Spark Issue Type

[jira] [Commented] (SPARK-33282) Replace Probot Autolabeler with Github Action

2020-11-03 Thread Kyle Bendickson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225856#comment-17225856 ] Kyle Bendickson commented on SPARK-33282: - Ok so I have a WIP PR / Phase one PR.

[jira] [Assigned] (SPARK-33323) Add query resolved check before convert hive relation

2020-11-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33323: --- Assignee: ulysses you > Add query resolved check before convert hive relation > ---

[jira] [Resolved] (SPARK-33323) Add query resolved check before convert hive relation

2020-11-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33323. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30230 [https://gith

[jira] [Assigned] (SPARK-33335) Support array_contains_array func

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5: Assignee: (was: Apache Spark) > Support array_contains_array func > -

[jira] [Commented] (SPARK-33335) Support array_contains_array func

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225837#comment-17225837 ] Apache Spark commented on SPARK-5: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-33335) Support array_contains_array func

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5: Assignee: Apache Spark > Support array_contains_array func >

[jira] [Created] (SPARK-33335) Support array_contains_array func

2020-11-03 Thread angerszhu (Jira)
angerszhu created SPARK-5: - Summary: Support array_contains_array func Key: SPARK-5 URL: https://issues.apache.org/jira/browse/SPARK-5 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-33300) Rule SimplifyCasts will not work for nested columns

2020-11-03 Thread chendihao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chendihao resolved SPARK-33300. --- Resolution: Not A Bug > Rule SimplifyCasts will not work for nested columns > --

[jira] [Commented] (SPARK-33300) Rule SimplifyCasts will not work for nested columns

2020-11-03 Thread chendihao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225812#comment-17225812 ] chendihao commented on SPARK-33300: --- Thanks [~EveLiao] . That's great and resolve my p

[jira] [Commented] (SPARK-33328) Fix Flaky HiveThriftHttpServerSuite

2020-11-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225794#comment-17225794 ] Hyukjin Kwon commented on SPARK-33328: -- GitHub actions uses Hadoop 3. The test fail

[jira] [Commented] (SPARK-33328) Fix Flaky HiveThriftHttpServerSuite

2020-11-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225779#comment-17225779 ] Yuming Wang commented on SPARK-33328: - Does Github Action also have this issue? > F

[jira] [Commented] (SPARK-33277) Python/Pandas UDF right after off-heap vectorized reader could cause executor crash.

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225757#comment-17225757 ] Apache Spark commented on SPARK-33277: -- User 'ueshin' has created a pull request fo

[jira] [Commented] (SPARK-33277) Python/Pandas UDF right after off-heap vectorized reader could cause executor crash.

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225756#comment-17225756 ] Apache Spark commented on SPARK-33277: -- User 'ueshin' has created a pull request fo

[jira] [Commented] (SPARK-33282) Replace Probot Autolabeler with Github Action

2020-11-03 Thread Kyle Bendickson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225740#comment-17225740 ] Kyle Bendickson commented on SPARK-33282: - I have also noticed, at least in my l

[jira] [Created] (SPARK-33334) Spark to Handle Nano seconds in Timestamps

2020-11-03 Thread Akhil Chalamalasetty (Jira)
Akhil Chalamalasetty created SPARK-4: Summary: Spark to Handle Nano seconds in Timestamps Key: SPARK-4 URL: https://issues.apache.org/jira/browse/SPARK-4 Project: Spark Is

[jira] [Commented] (SPARK-33333) Upgrade Jetty to 9.4.28.v20200408

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225734#comment-17225734 ] Apache Spark commented on SPARK-3: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-33333) Upgrade Jetty to 9.4.28.v20200408

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225733#comment-17225733 ] Apache Spark commented on SPARK-3: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-33333) Upgrade Jetty to 9.4.28.v20200408

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225732#comment-17225732 ] Apache Spark commented on SPARK-3: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-33333) Upgrade Jetty to 9.4.28.v20200408

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: (was: Apache Spark) > Upgrade Jetty to 9.4.28.v20200408 > -

[jira] [Assigned] (SPARK-33333) Upgrade Jetty to 9.4.28.v20200408

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: Apache Spark > Upgrade Jetty to 9.4.28.v20200408 >

[jira] [Commented] (SPARK-33333) Upgrade Jetty to 9.4.28.v20200408

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225730#comment-17225730 ] Apache Spark commented on SPARK-3: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-33333) Upgrade Jetty to 9.4.28.v20200408

2020-11-03 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-3: - Summary: Upgrade Jetty to 9.4.28.v20200408 Key: SPARK-3 URL: https://issues.apache.org/jira/browse/SPARK-3 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-33295) Upgrade ORC to 1.6.6

2020-11-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-33295: - Fix Version/s: (was: 3.1.0) > Upgrade ORC to 1.6.6 > - > >

[jira] [Created] (SPARK-33332) Errors in running spark job on K8 with RPC Authentication Secret File properties

2020-11-03 Thread Surbhi Aggarwal (Jira)
Surbhi Aggarwal created SPARK-2: --- Summary: Errors in running spark job on K8 with RPC Authentication Secret File properties Key: SPARK-2 URL: https://issues.apache.org/jira/browse/SPARK-2

[jira] [Updated] (SPARK-33331) Limit the number of pending blocks in memory when RemoteBlockPushResolver defers a block

2020-11-03 Thread Chandni Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-1: -- Summary: Limit the number of pending blocks in memory when RemoteBlockPushResolver defers a bl

[jira] [Created] (SPARK-33331) Limit the number of pending blocks in memory when {{RemoteBlockPushResolver}} defers a block

2020-11-03 Thread Chandni Singh (Jira)
Chandni Singh created SPARK-1: - Summary: Limit the number of pending blocks in memory when {{RemoteBlockPushResolver}} defers a block Key: SPARK-1 URL: https://issues.apache.org/jira/browse/SPARK-1

[jira] [Commented] (SPARK-33282) Replace Probot Autolabeler with Github Action

2020-11-03 Thread Kyle Bendickson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225709#comment-17225709 ] Kyle Bendickson commented on SPARK-33282: - Hey guys. Sorry I've been a litle slo

[jira] [Commented] (SPARK-33330) Catalyst StringType converter unable to convert enum type

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225705#comment-17225705 ] Apache Spark commented on SPARK-0: -- User 'malduarte' has created a pull request

[jira] [Assigned] (SPARK-33330) Catalyst StringType converter unable to convert enum type

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-0: Assignee: Apache Spark > Catalyst StringType converter unable to convert enum type >

[jira] [Assigned] (SPARK-33330) Catalyst StringType converter unable to convert enum type

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-0: Assignee: (was: Apache Spark) > Catalyst StringType converter unable to convert enum

[jira] [Commented] (SPARK-33330) Catalyst StringType converter unable to convert enum type

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225704#comment-17225704 ] Apache Spark commented on SPARK-0: -- User 'malduarte' has created a pull request

[jira] [Commented] (SPARK-33330) Catalyst StringType converter unable to convert enum type

2020-11-03 Thread Miguel Duarte (Jira)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225702#comment-17225702 ] Miguel Duarte commented on SPARK-0: --- PR with fix here https://github.com/apach

[jira] [Created] (SPARK-33330) Catalyst StringType converter unable to convert enum type

2020-11-03 Thread Miguel Duarte (Jira)
Miguel Duarte created SPARK-0: - Summary: Catalyst StringType converter unable to convert enum type Key: SPARK-0 URL: https://issues.apache.org/jira/browse/SPARK-0 Project: Spark I

[jira] [Commented] (SPARK-33300) Rule SimplifyCasts will not work for nested columns

2020-11-03 Thread Aoyuan Liao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225625#comment-17225625 ] Aoyuan Liao commented on SPARK-33300: - [~tobe] Actually, it is not a bug. It did sim

[jira] [Created] (SPARK-33329) Pluggable API to fetch shuffle merger locations with Push based shuffle

2020-11-03 Thread Venkata krishnan Sowrirajan (Jira)
Venkata krishnan Sowrirajan created SPARK-33329: --- Summary: Pluggable API to fetch shuffle merger locations with Push based shuffle Key: SPARK-33329 URL: https://issues.apache.org/jira/browse/SPARK-33

[jira] [Updated] (SPARK-33328) Fix Flaky HiveThriftHttpServerSuite

2020-11-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33328: -- Description: After launching successfully `HiveThriftServer2 started successfully`, the test

[jira] [Commented] (SPARK-33328) Fix Flaky HiveThriftHttpServerSuite

2020-11-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225614#comment-17225614 ] Dongjoon Hyun commented on SPARK-33328: --- This looks more serious. cc [~hyukjin.kwo

[jira] [Updated] (SPARK-33328) Fix Flaky HiveThriftHttpServerSuite

2020-11-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33328: -- Description: After launching successfully `HiveThriftServer2 started successfully`, the test

[jira] [Updated] (SPARK-33328) Fix Flaky HiveThriftHttpServerSuite

2020-11-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33328: -- Description: After launching successfully `HiveThriftServer2 started successfully`, the test

[jira] [Updated] (SPARK-33328) Fix Flaky HiveThriftHttpServerSuite

2020-11-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33328: -- Attachment: failure_rate.png > Fix Flaky HiveThriftHttpServerSuite > -

[jira] [Created] (SPARK-33328) Fix Flaky HiveThriftHttpServerSuite

2020-11-03 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-33328: - Summary: Fix Flaky HiveThriftHttpServerSuite Key: SPARK-33328 URL: https://issues.apache.org/jira/browse/SPARK-33328 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-33273) Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

2020-11-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225601#comment-17225601 ] Dongjoon Hyun edited comment on SPARK-33273 at 11/3/20, 6:32 PM: -

[jira] [Commented] (SPARK-33273) Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

2020-11-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225601#comment-17225601 ] Dongjoon Hyun commented on SPARK-33273: --- Even in a single profile combination, thi

[jira] [Updated] (SPARK-33273) Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

2020-11-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33273: -- Attachment: failures.png > Fix Flaky Test: ThriftServerQueryTestSuite. > subquery_scalar_subq

[jira] [Updated] (SPARK-33156) Upgrade GithubAction image from 18.04 to 20.04

2020-11-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33156: -- Fix Version/s: 2.4.8 > Upgrade GithubAction image from 18.04 to 20.04 > --

[jira] [Commented] (SPARK-33293) Refactor WriteToDataSourceV2Exec and reduce code duplication

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225518#comment-17225518 ] Apache Spark commented on SPARK-33293: -- User 'sunchao' has created a pull request f

[jira] [Commented] (SPARK-33293) Refactor WriteToDataSourceV2Exec and reduce code duplication

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225517#comment-17225517 ] Apache Spark commented on SPARK-33293: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-33008) Division by zero on divide-like operations returns incorrect result

2020-11-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33008: --- Assignee: Lu Lu > Division by zero on divide-like operations returns incorrect result > ---

[jira] [Updated] (SPARK-33327) grouped by first and last against date column returns incorrect results

2020-11-03 Thread Punit Shah (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Punit Shah updated SPARK-33327: --- Attachment: users.csv > grouped by first and last against date column returns incorrect results > --

[jira] [Created] (SPARK-33327) grouped by first and last against date column returns incorrect results

2020-11-03 Thread Punit Shah (Jira)
Punit Shah created SPARK-33327: -- Summary: grouped by first and last against date column returns incorrect results Key: SPARK-33327 URL: https://issues.apache.org/jira/browse/SPARK-33327 Project: Spark

[jira] [Resolved] (SPARK-33284) In the Storage UI page, clicking any field to sort the table will cause the header content to be lost

2020-11-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-33284. -- Fix Version/s: 3.1.0 Assignee: akiyamaneko Resolution: Fixed Resolved by https

[jira] [Assigned] (SPARK-33285) Too many "Auto-application to `()` is deprecated." related compilation warnings

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33285: Assignee: (was: Apache Spark) > Too many "Auto-application to `()` is deprecated." r

[jira] [Commented] (SPARK-33285) Too many "Auto-application to `()` is deprecated." related compilation warnings

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225444#comment-17225444 ] Apache Spark commented on SPARK-33285: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-33285) Too many "Auto-application to `()` is deprecated." related compilation warnings

2020-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33285: Assignee: Apache Spark > Too many "Auto-application to `()` is deprecated." related comp

[jira] [Assigned] (SPARK-33257) Support Column inputs in PySpark ordering functions (asc*, desc*)

2020-11-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33257: Assignee: Maciej Szymkiewicz > Support Column inputs in PySpark ordering functions (asc*,

[jira] [Resolved] (SPARK-33257) Support Column inputs in PySpark ordering functions (asc*, desc*)

2020-11-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33257. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30227 [https://gi

[jira] [Commented] (SPARK-29392) Remove use of deprecated symbol literal " 'name " syntax in favor Symbol("name")

2020-11-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225354#comment-17225354 ] Sean R. Owen commented on SPARK-29392: -- I think it's OK to open a follow-up to fix

[jira] [Created] (SPARK-33326) Partition Parameters are not updated even after ANALYZE TABLE command

2020-11-03 Thread Daniel (Jira)
Daniel created SPARK-33326: -- Summary: Partition Parameters are not updated even after ANALYZE TABLE command Key: SPARK-33326 URL: https://issues.apache.org/jira/browse/SPARK-33326 Project: Spark Is

[jira] [Updated] (SPARK-33326) Partition Parameters are not updated even after ANALYZE TABLE command

2020-11-03 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel updated SPARK-33326: --- Description: Here are the reproduction steps: {code:java} scala> spark.sql("CREATE TABLE t (a string,b strin

[jira] [Commented] (SPARK-33325) Spark executors pod are not shutting down when losing driver connection

2020-11-03 Thread Hadrien Kohl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225310#comment-17225310 ] Hadrien Kohl commented on SPARK-33325: -- Other possibilities are that a shutdown hoo

[jira] [Commented] (SPARK-33325) Spark executors pod are not shutting down when losing driver connection

2020-11-03 Thread Hadrien Kohl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225296#comment-17225296 ] Hadrien Kohl commented on SPARK-33325: -- Strange thing is I can see that the log mes

[jira] [Updated] (SPARK-33325) Spark executors pod are not shutting down when losing driver connection

2020-11-03 Thread Hadrien Kohl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hadrien Kohl updated SPARK-33325: - Description: In situations where the executors lose contact with the driver, the java process d

[jira] [Created] (SPARK-33325) Spark executors pod are not shutting down when losing driver connection

2020-11-03 Thread Hadrien Kohl (Jira)
Hadrien Kohl created SPARK-33325: Summary: Spark executors pod are not shutting down when losing driver connection Key: SPARK-33325 URL: https://issues.apache.org/jira/browse/SPARK-33325 Project: Spar

[jira] [Commented] (SPARK-33150) Groupby key may not be unique when using window

2020-11-03 Thread Dieter De Paepe (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225258#comment-17225258 ] Dieter De Paepe commented on SPARK-33150: - Good that there are workarounds. But