[jira] [Commented] (SPARK-35496) Upgrade Scala 2.13 to 2.13.7

2021-08-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406355#comment-17406355 ] Dongjoon Hyun commented on SPARK-35496: --- Yep. I support [~srowen]'s decision. > Upgrade Scala

[jira] [Resolved] (SPARK-36565) "Unscaled value too large for precision" while reading simple parquet file readable with parquet-tools and pandas

2021-08-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36565. -- Resolution: Invalid > "Unscaled value too large for precision" while reading simple parquet

[jira] [Resolved] (SPARK-36548) Throwing NoClassDefFoundError for Logging$class

2021-08-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36548. -- Resolution: Invalid > Throwing NoClassDefFoundError for Logging$class >

[jira] [Commented] (SPARK-36572) Removal of netty-3.9.9.Final.jar dependent code and use only netty-all-4.1.47.Final.jar in Spark 2.4.x

2021-08-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406346#comment-17406346 ] Hyukjin Kwon commented on SPARK-36572: -- [~sshukla05] for a question, let's interact with mailing

[jira] [Resolved] (SPARK-36572) Removal of netty-3.9.9.Final.jar dependent code and use only netty-all-4.1.47.Final.jar in Spark 2.4.x

2021-08-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36572. -- Resolution: Invalid > Removal of netty-3.9.9.Final.jar dependent code and use only >

[jira] [Commented] (SPARK-36581) Add back transformAllExpressions to AnalysisHelper

2021-08-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406345#comment-17406345 ] Hyukjin Kwon commented on SPARK-36581: -- {{AnalysisHelper}} is not an API .. it's under private

[jira] [Updated] (SPARK-36577) Spark on K8s: Driver pod keeps running when executor allocator terminates with Fatal exception

2021-08-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36577: - Priority: Major (was: Critical) > Spark on K8s: Driver pod keeps running when executor

[jira] [Resolved] (SPARK-36589) Creating a value in json which represents decimal

2021-08-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36589. -- Resolution: Not A Problem > Creating a value in json which represents decimal >

[jira] [Commented] (SPARK-36589) Creating a value in json which represents decimal

2021-08-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406344#comment-17406344 ] Hyukjin Kwon commented on SPARK-36589: -- You can turn on {{prefersDecimal}} option. > Creating a

[jira] [Updated] (SPARK-36596) Review and fix issues in 3.2.0 Documents

2021-08-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36596: - Priority: Critical (was: Major) > Review and fix issues in 3.2.0 Documents >

[jira] [Resolved] (SPARK-36601) Reading a valid JSON file causes a NPE

2021-08-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36601. -- Resolution: Duplicate > Reading a valid JSON file causes a NPE >

[jira] [Updated] (SPARK-36604) timestamp type column analyze result is wrong

2021-08-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36604: - Description: when we create table with timestamp column type, the min and max data of the

[jira] [Commented] (SPARK-36607) Support BooleanType in UnwrapCastInBinaryComparison

2021-08-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406343#comment-17406343 ] Hyukjin Kwon commented on SPARK-36607: -- cc [~csun] FYI > Support BooleanType in

[jira] [Resolved] (SPARK-36606) Enhance the docs and tests of try_add/try_divide

2021-08-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36606. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33861

[jira] [Resolved] (SPARK-36583) Upgrade commons-pool2 from 2.6.2 to 2.11.1

2021-08-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36583. -- Fix Version/s: 3.3.0 Assignee: Yang Jie Resolution: Fixed Fixed in

[jira] [Resolved] (SPARK-36605) Upgrade Jackson to 2.12.5

2021-08-28 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36605. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33860

[jira] [Updated] (SPARK-36605) Upgrade Jackson to 2.12.5

2021-08-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36605: --- Description: Recently, Jackson 2.12.5 was released and it seems to be expected as the last

[jira] [Updated] (SPARK-36605) Upgrade Jackson to 2.12.5

2021-08-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36605: --- Description: Recently, Jackson 2.12.5 was released and it seems to be expected as the last

[jira] [Created] (SPARK-36607) Support BooleanType in UnwrapCastInBinaryComparison

2021-08-28 Thread Kazuyuki Tanimura (Jira)
Kazuyuki Tanimura created SPARK-36607: - Summary: Support BooleanType in UnwrapCastInBinaryComparison Key: SPARK-36607 URL: https://issues.apache.org/jira/browse/SPARK-36607 Project: Spark

[jira] [Assigned] (SPARK-36606) Enhance the docs and tests of try_add/try_divide

2021-08-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36606: Assignee: Gengliang Wang (was: Apache Spark) > Enhance the docs and tests of

[jira] [Assigned] (SPARK-36606) Enhance the docs and tests of try_add/try_divide

2021-08-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36606: Assignee: Apache Spark (was: Gengliang Wang) > Enhance the docs and tests of

[jira] [Commented] (SPARK-36606) Enhance the docs and tests of try_add/try_divide

2021-08-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406163#comment-17406163 ] Apache Spark commented on SPARK-36606: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-36606) Enhance the docs and tests of try_add/try_divide

2021-08-28 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-36606: -- Summary: Enhance the docs and tests of try_add/try_divide Key: SPARK-36606 URL: https://issues.apache.org/jira/browse/SPARK-36606 Project: Spark Issue

[jira] [Resolved] (SPARK-36509) Executors don't get rescheduled in standalone mode when worker dies

2021-08-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36509. Target Version/s: 3.2.0, 3.1.3, 3.0.4 Assignee: Kousuke Saruta

[jira] [Commented] (SPARK-36604) timestamp type column analyze result is wrong

2021-08-28 Thread YuanGuanhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406158#comment-17406158 ] YuanGuanhu commented on SPARK-36604: I'd like to work on this. > timestamp type column analyze

[jira] [Commented] (SPARK-36605) Upgrade Jackson to 2.12.5

2021-08-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406152#comment-17406152 ] Apache Spark commented on SPARK-36605: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36605) Upgrade Jackson to 2.12.5

2021-08-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36605: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade Jackson to 2.12.5 >

[jira] [Assigned] (SPARK-36605) Upgrade Jackson to 2.12.5

2021-08-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36605: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade Jackson to 2.12.5 >

[jira] [Commented] (SPARK-36605) Upgrade Jackson to 2.12.5

2021-08-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406151#comment-17406151 ] Apache Spark commented on SPARK-36605: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-36605) Upgrade Jackson to 2.12.5

2021-08-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36605: --- Description: Recently, Jackson 2.12.5 was released and it seems to be expected as the last

[jira] [Created] (SPARK-36605) Upgrade Jackson to 2.12.5

2021-08-28 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36605: -- Summary: Upgrade Jackson to 2.12.5 Key: SPARK-36605 URL: https://issues.apache.org/jira/browse/SPARK-36605 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-36604) timestamp type column analyze result is wrong

2021-08-28 Thread YuanGuanhu (Jira)
YuanGuanhu created SPARK-36604: -- Summary: timestamp type column analyze result is wrong Key: SPARK-36604 URL: https://issues.apache.org/jira/browse/SPARK-36604 Project: Spark Issue Type: Bug