[jira] [Commented] (SPARK-34984) ANSI intervals formatting in hive results

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17316905#comment-17316905 ] Apache Spark commented on SPARK-34984: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34984) ANSI intervals formatting in hive results

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34984: Assignee: Max Gekk (was: Apache Spark) > ANSI intervals formatting in hive results > ---

[jira] [Assigned] (SPARK-34984) ANSI intervals formatting in hive results

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34984: Assignee: Apache Spark (was: Max Gekk) > ANSI intervals formatting in hive results > ---

[jira] [Commented] (SPARK-34984) ANSI intervals formatting in hive results

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17316907#comment-17316907 ] Apache Spark commented on SPARK-34984: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-34987) AQE improve: change shuffle hash join to sort merge join when skewed shuffle hash join exists

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17316910#comment-17316910 ] Apache Spark commented on SPARK-34987: -- User 'exmy' has created a pull request for

[jira] [Assigned] (SPARK-34987) AQE improve: change shuffle hash join to sort merge join when skewed shuffle hash join exists

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34987: Assignee: Apache Spark > AQE improve: change shuffle hash join to sort merge join when sk

[jira] [Assigned] (SPARK-34987) AQE improve: change shuffle hash join to sort merge join when skewed shuffle hash join exists

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34987: Assignee: (was: Apache Spark) > AQE improve: change shuffle hash join to sort merge j

[jira] [Commented] (SPARK-34987) AQE improve: change shuffle hash join to sort merge join when skewed shuffle hash join exists

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17316911#comment-17316911 ] Apache Spark commented on SPARK-34987: -- User 'exmy' has created a pull request for

[jira] [Commented] (SPARK-34986) Aggregate ordinal should judge is it contains agg function

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17316913#comment-17316913 ] Apache Spark commented on SPARK-34986: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-34986) Aggregate ordinal should judge is it contains agg function

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34986: Assignee: Apache Spark > Aggregate ordinal should judge is it contains agg function > ---

[jira] [Assigned] (SPARK-34986) Aggregate ordinal should judge is it contains agg function

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34986: Assignee: (was: Apache Spark) > Aggregate ordinal should judge is it contains agg fun

[jira] [Commented] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17316949#comment-17316949 ] Apache Spark commented on SPARK-34212: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17316950#comment-17316950 ] Apache Spark commented on SPARK-34212: -- User 'wangyum' has created a pull request f

[jira] [Created] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34988: -- Summary: Upgrade Jetty for CVE-2021-28165 Key: SPARK-34988 URL: https://issues.apache.org/jira/browse/SPARK-34988 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34988: --- Description: CVE-2021-28165 affects the version of Jetty that Spark uses and it seems to be

[jira] [Assigned] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34988: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade Jetty for CVE-2021-28165 > --

[jira] [Commented] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317000#comment-17317000 ] Apache Spark commented on SPARK-34988: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34988: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade Jetty for CVE-2021-28165 > --

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317034#comment-17317034 ] Attila Zsolt Piros commented on SPARK-34738: hi [~shaneknapp]! Can you ple

[jira] [Updated] (SPARK-34985) Different execution plans under jdbc and hdfs

2021-04-08 Thread lianjunzhi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lianjunzhi updated SPARK-34985: --- Description: Hive has two non-partitioned tables, trade_order and trade_order_goods. These two tabl

[jira] [Commented] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317066#comment-17317066 ] Nick Hryhoriev commented on SPARK-11844: I have experienced the same issue with

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/8/21, 10:35 AM:

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/8/21, 10:49 AM:

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/8/21, 10:51 AM:

[jira] [Resolved] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34988. -- Resolution: Fixed > Upgrade Jetty for CVE-2021-28165 > > >

[jira] [Updated] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34988: - Fix Version/s: 3.2.0 > Upgrade Jetty for CVE-2021-28165 > > >

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/8/21, 11:50 AM:

[jira] [Created] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
Ali Afroozeh created SPARK-34989: Summary: Improve the performance of mapChildren and withNewChildren methods Key: SPARK-34989 URL: https://issues.apache.org/jira/browse/SPARK-34989 Project: Spark

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Commented] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317130#comment-17317130 ] Apache Spark commented on SPARK-34988: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317131#comment-17317131 ] Apache Spark commented on SPARK-34988: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317132#comment-17317132 ] Apache Spark commented on SPARK-34989: -- User 'dbaliafroozeh' has created a pull req

[jira] [Commented] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317133#comment-17317133 ] Apache Spark commented on SPARK-34988: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34989: Assignee: (was: Apache Spark) > Improve the performance of mapChildren and withNewChi

[jira] [Assigned] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34989: Assignee: Apache Spark > Improve the performance of mapChildren and withNewChildren metho

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Updated] (SPARK-34932) deprecate GROUP BY ... GROUPING SETS (...) and promote GROUP BY GROUPING SETS (...)

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-34932: Summary: deprecate GROUP BY ... GROUPING SETS (...) and promote GROUP BY GROUPING SETS (...) (was

[jira] [Reopened] (SPARK-34946) Block unsupported correlated scalar subquery in Aggregate

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-34946: - > Block unsupported correlated scalar subquery in Aggregate > --

[jira] [Resolved] (SPARK-34946) Block unsupported correlated scalar subquery in Aggregate

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34946. - Fix Version/s: 3.2.0 Assignee: Allison Wang Resolution: Fixed > Block unsupporte

[jira] [Created] (SPARK-34990) Add a test for Parquet Modular Encryption in Spark

2021-04-08 Thread Maya Anderson (Jira)
Maya Anderson created SPARK-34990: - Summary: Add a test for Parquet Modular Encryption in Spark Key: SPARK-34990 URL: https://issues.apache.org/jira/browse/SPARK-34990 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-33233) CUBE/ROLLUP can't support UnresolvedOrdinal

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33233: --- Assignee: angerszhu > CUBE/ROLLUP can't support UnresolvedOrdinal > ---

[jira] [Resolved] (SPARK-33233) CUBE/ROLLUP can't support UnresolvedOrdinal

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33233. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30145 [https://gith

[jira] [Resolved] (SPARK-34962) Explicit representation of star in MergeIntoTable's Update and Insert action

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34962. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32067 [https://gith

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/8/21, 2:22 PM: -

[jira] [Created] (SPARK-34991) Mark GlobalLimit outputPartitioning as SinglePartition

2021-04-08 Thread ulysses you (Jira)
ulysses you created SPARK-34991: --- Summary: Mark GlobalLimit outputPartitioning as SinglePartition Key: SPARK-34991 URL: https://issues.apache.org/jira/browse/SPARK-34991 Project: Spark Issue Ty

[jira] [Commented] (SPARK-34881) New SQL Function: TRY_CAST

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317254#comment-17317254 ] Apache Spark commented on SPARK-34881: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34884: Assignee: Apache Spark (was: Yuming Wang) > Improve dynamic partition pruning evaluation

[jira] [Commented] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317255#comment-17317255 ] Apache Spark commented on SPARK-34884: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34884: Assignee: Yuming Wang (was: Apache Spark) > Improve dynamic partition pruning evaluation

[jira] [Created] (SPARK-34992) Index Appending when Duplicate Column names

2021-04-08 Thread Hallah Butt (Jira)
Hallah Butt created SPARK-34992: --- Summary: Index Appending when Duplicate Column names Key: SPARK-34992 URL: https://issues.apache.org/jira/browse/SPARK-34992 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34988: - Fix Version/s: 3.0.3 3.1.2 2.4.8 > Upgrade Jetty for CVE-2

[jira] [Resolved] (SPARK-34984) ANSI intervals formatting in hive results

2021-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34984. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32087 [https://gith

[jira] [Updated] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-34738: Attachment: integration-tests.log > Upgrade Minikube and kubernetes cluster version on Jenkins > -

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317334#comment-17317334 ] Shane Knapp commented on SPARK-34738: - done (attached to the issue) > Upgrade Minik

[jira] [Comment Edited] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317334#comment-17317334 ] Shane Knapp edited comment on SPARK-34738 at 4/8/21, 4:45 PM:

[jira] [Created] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-08 Thread Lauri Koobas (Jira)
Lauri Koobas created SPARK-34993: Summary: from_json() acts differently on created and literal strings with backslashes Key: SPARK-34993 URL: https://issues.apache.org/jira/browse/SPARK-34993 Project:

[jira] [Updated] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-08 Thread Lauri Koobas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lauri Koobas updated SPARK-34993: - Description: JSON string with the value that contains backslashes fails to be recovered by `fro

[jira] [Updated] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-08 Thread Lauri Koobas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lauri Koobas updated SPARK-34993: - Description: JSON string with the value that contains backslashes fails to be recovered by `fro

[jira] [Updated] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-08 Thread Lauri Koobas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lauri Koobas updated SPARK-34993: - Description: JSON string with the value that contains backslashes fails to be recovered by `fro

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317381#comment-17317381 ] Attila Zsolt Piros commented on SPARK-34738: No worries. I have guess. Che

[jira] [Comment Edited] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317381#comment-17317381 ] Attila Zsolt Piros edited comment on SPARK-34738 at 4/8/21, 6:02 PM: -

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317391#comment-17317391 ] Attila Zsolt Piros commented on SPARK-34738: >From the log we can see the mo

[jira] [Assigned] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34905: Assignee: Apache Spark > Enable ANSI intervals in SQLQueryTestSuite > ---

[jira] [Commented] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317395#comment-17317395 ] Apache Spark commented on SPARK-34905: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317396#comment-17317396 ] Apache Spark commented on SPARK-34905: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34905: Assignee: (was: Apache Spark) > Enable ANSI intervals in SQLQueryTestSuite >

[jira] [Assigned] (SPARK-34973) Cleanup unused fields and methods in vectorized Parquet reader

2021-04-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-34973: --- Assignee: Chao Sun > Cleanup unused fields and methods in vectorized Parquet reader > -

[jira] [Resolved] (SPARK-34973) Cleanup unused fields and methods in vectorized Parquet reader

2021-04-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34973. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32071 [https://gith

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317409#comment-17317409 ] Shane Knapp commented on SPARK-34738: - i think it's more than suspicious!  :) https

[jira] [Created] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-34994: --- Summary: Fix git error when pushing the tag after release script succeeds Key: SPARK-34994 URL: https://issues.apache.org/jira/browse/SPARK-34994 Project: Spark

[jira] [Commented] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317412#comment-17317412 ] Apache Spark commented on SPARK-34994: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34994: Assignee: (was: Apache Spark) > Fix git error when pushing the tag after release scri

[jira] [Assigned] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34994: Assignee: Apache Spark > Fix git error when pushing the tag after release script succeeds

[jira] [Commented] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317413#comment-17317413 ] Apache Spark commented on SPARK-34994: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317418#comment-17317418 ] Shane Knapp commented on SPARK-34738: - {noformat} Given path (/opt/spark/pv-tests/tm

[jira] [Comment Edited] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317418#comment-17317418 ] Shane Knapp edited comment on SPARK-34738 at 4/8/21, 6:40 PM:

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317426#comment-17317426 ] Attila Zsolt Piros commented on SPARK-34738: [~shaneknapp] the operator is I

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-04-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317436#comment-17317436 ] Shane Knapp commented on SPARK-34738: - no, you're right.  i just noticed that 'minik

[jira] [Updated] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

2021-04-08 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34989: - Description: One of the main performance bottlenecks in query compilation is overly-generic tre

[jira] [Created] (SPARK-34995) Port/integrate Koalas remaining codes into PySpark

2021-04-08 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-34995: - Summary: Port/integrate Koalas remaining codes into PySpark Key: SPARK-34995 URL: https://issues.apache.org/jira/browse/SPARK-34995 Project: Spark Issue Ty

[jira] [Created] (SPARK-34996) Port Koalas Series related unit tests into PySpark

2021-04-08 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-34996: Summary: Port Koalas Series related unit tests into PySpark Key: SPARK-34996 URL: https://issues.apache.org/jira/browse/SPARK-34996 Project: Spark Issue Type

[jira] [Created] (SPARK-34997) Make graceful shutdown controllable by property

2021-04-08 Thread Oleg Kuznetsov (Jira)
Oleg Kuznetsov created SPARK-34997: -- Summary: Make graceful shutdown controllable by property Key: SPARK-34997 URL: https://issues.apache.org/jira/browse/SPARK-34997 Project: Spark Issue Typ

[jira] [Updated] (SPARK-34995) Port/integrate Koalas remaining codes into PySpark

2021-04-08 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-34995: -- Description: There are some more commits remaining after the main codes were ported. -  [http

[jira] [Assigned] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-34994: --- Assignee: L. C. Hsieh > Fix git error when pushing the tag after release script succeeds >

[jira] [Resolved] (SPARK-34994) Fix git error when pushing the tag after release script succeeds

2021-04-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34994. - Fix Version/s: 2.4.8 Resolution: Fixed Issue resolved by pull request 32100 [https://gith

[jira] [Resolved] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34674. --- Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pul

[jira] [Assigned] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34674: - Assignee: Sergey Kotlov > Spark app on k8s doesn't terminate without call to sparkConte

[jira] [Created] (SPARK-34998) Consolidate PySpark testing utils

2021-04-08 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-34998: Summary: Consolidate PySpark testing utils Key: SPARK-34998 URL: https://issues.apache.org/jira/browse/SPARK-34998 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-34998) Consolidate PySpark testing utils

2021-04-08 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-34998. -- Resolution: Duplicate > Consolidate PySpark testing utils > -

[jira] [Created] (SPARK-34999) Consolidate PySpark testing utils

2021-04-08 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-34999: Summary: Consolidate PySpark testing utils Key: SPARK-34999 URL: https://issues.apache.org/jira/browse/SPARK-34999 Project: Spark Issue Type: Sub-task

[jira] [Closed] (SPARK-34998) Consolidate PySpark testing utils

2021-04-08 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng closed SPARK-34998. Duplicated. > Consolidate PySpark testing utils > - > >

[jira] [Created] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread KarlManong (Jira)
KarlManong created SPARK-35000: -- Summary: Spark App in container will not exit when exception happen Key: SPARK-35000 URL: https://issues.apache.org/jira/browse/SPARK-35000 Project: Spark Issue

[jira] [Updated] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread KarlManong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KarlManong updated SPARK-35000: --- Attachment: 21664.stack > Spark App in container will not exit when exception happen > -

[jira] [Updated] (SPARK-35000) Spark App in container will not exit when exception happen

2021-04-08 Thread KarlManong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KarlManong updated SPARK-35000: --- Attachment: screenshot-1.png > Spark App in container will not exit when exception happen >

  1   2   >