[jira] [Resolved] (SPARK-38140) Desc column stats (min, max) for timestamp type is not consistent with the value due to time zone difference

2022-02-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38140. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35440

[jira] [Assigned] (SPARK-38140) Desc column stats (min, max) for timestamp type is not consistent with the value due to time zone difference

2022-02-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38140: --- Assignee: Zhenhua Wang > Desc column stats (min, max) for timestamp type is not consistent

[jira] [Updated] (SPARK-38270) SQL CLI AM should keep same exitcode with client

2022-02-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-38270: -- Description: Currently for SQL CLI, we all use shutdown hook to stop SC {code:java} // Clean up

[jira] [Created] (SPARK-38270) SQL CLI AM should keep same exitcode with client

2022-02-20 Thread angerszhu (Jira)
angerszhu created SPARK-38270: - Summary: SQL CLI AM should keep same exitcode with client Key: SPARK-38270 URL: https://issues.apache.org/jira/browse/SPARK-38270 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-37475) Add Scale Parameter to Floor and Ceil functions

2022-02-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37475: --- Assignee: Sathiya Kumar > Add Scale Parameter to Floor and Ceil functions >

[jira] [Resolved] (SPARK-37475) Add Scale Parameter to Floor and Ceil functions

2022-02-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37475. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34729

[jira] [Resolved] (SPARK-38227) Apply strict nullability of nested column in time window / session window

2022-02-20 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-38227. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35543

[jira] [Assigned] (SPARK-38227) Apply strict nullability of nested column in time window / session window

2022-02-20 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-38227: --- Assignee: Jungtaek Lim > Apply strict nullability of nested column in time window /

[jira] [Commented] (SPARK-38269) Clean up redundant type cast

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495325#comment-17495325 ] Apache Spark commented on SPARK-38269: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38269) Clean up redundant type cast

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38269: Assignee: (was: Apache Spark) > Clean up redundant type cast >

[jira] [Assigned] (SPARK-38269) Clean up redundant type cast

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38269: Assignee: Apache Spark > Clean up redundant type cast > > >

[jira] [Created] (SPARK-38269) Clean up redundant type cast

2022-02-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-38269: Summary: Clean up redundant type cast Key: SPARK-38269 URL: https://issues.apache.org/jira/browse/SPARK-38269 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

2022-02-20 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495322#comment-17495322 ] melin edited comment on SPARK-38200 at 2/21/22, 5:17 AM: - [~beliefer]   oracle:

[jira] [Comment Edited] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

2022-02-20 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495322#comment-17495322 ] melin edited comment on SPARK-38200 at 2/21/22, 5:17 AM: - [~beliefer]   oracle:

[jira] [Commented] (SPARK-38236) Absolute file paths specified in create/alter table are treated as relative

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495324#comment-17495324 ] Apache Spark commented on SPARK-38236: -- User 'bozhang2820' has created a pull request for this

[jira] [Commented] (SPARK-38236) Absolute file paths specified in create/alter table are treated as relative

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495323#comment-17495323 ] Apache Spark commented on SPARK-38236: -- User 'bozhang2820' has created a pull request for this

[jira] [Commented] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

2022-02-20 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495322#comment-17495322 ] melin commented on SPARK-38200: --- [~beliefer]   > [SQL] Spark JDBC Savemode Supports replace >

[jira] [Assigned] (SPARK-38268) Hide the "failOnError" field in the toString method of Abs/CheckOverflow

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38268: Assignee: Gengliang Wang (was: Apache Spark) > Hide the "failOnError" field in the

[jira] [Commented] (SPARK-38268) Hide the "failOnError" field in the toString method of Abs/CheckOverflow

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495318#comment-17495318 ] Apache Spark commented on SPARK-38268: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-38268) Hide the "failOnError" field in the toString method of Abs/CheckOverflow

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495319#comment-17495319 ] Apache Spark commented on SPARK-38268: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-38268) Hide the "failOnError" field in the toString method of Abs/CheckOverflow

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38268: Assignee: Apache Spark (was: Gengliang Wang) > Hide the "failOnError" field in the

[jira] [Created] (SPARK-38268) Hide the "failOnError" field in the toString method of Abs/CheckOverflow

2022-02-20 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-38268: -- Summary: Hide the "failOnError" field in the toString method of Abs/CheckOverflow Key: SPARK-38268 URL: https://issues.apache.org/jira/browse/SPARK-38268

[jira] [Commented] (SPARK-38267) Replace pattern matches on boolean expressions with conditional statements

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495311#comment-17495311 ] Apache Spark commented on SPARK-38267: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38267) Replace pattern matches on boolean expressions with conditional statements

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38267: Assignee: Apache Spark > Replace pattern matches on boolean expressions with conditional

[jira] [Assigned] (SPARK-38267) Replace pattern matches on boolean expressions with conditional statements

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38267: Assignee: (was: Apache Spark) > Replace pattern matches on boolean expressions with

[jira] [Commented] (SPARK-38267) Replace pattern matches on boolean expressions with conditional statements

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495310#comment-17495310 ] Apache Spark commented on SPARK-38267: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-38267) Replace pattern matches on boolean expressions with conditional statements

2022-02-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-38267: Summary: Replace pattern matches on boolean expressions with conditional statements Key: SPARK-38267 URL: https://issues.apache.org/jira/browse/SPARK-38267 Project: Spark

[jira] [Updated] (SPARK-38258) [proposal] collect & update statistics automatically when spark SQL is running

2022-02-20 Thread gabrywu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gabrywu updated SPARK-38258: Description: As we all know, table & column statistics are very important to spark SQL optimizer,

[jira] [Updated] (SPARK-38258) [proposal] collect & update statistics automatically when spark SQL is running

2022-02-20 Thread gabrywu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gabrywu updated SPARK-38258: Description: As we all know, table & column statistics are very important to spark SQL optimizer,

[jira] [Commented] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

2022-02-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495305#comment-17495305 ] jiaan.geng commented on SPARK-38200: [~melin] OK. Does other SQL could finish the same work as

[jira] [Updated] (SPARK-38258) [proposal] collect & update statistics automatically when spark SQL is running

2022-02-20 Thread gabrywu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gabrywu updated SPARK-38258: Description: As we all know, table & column statistics are very important to spark SQL optimizer,

[jira] [Commented] (SPARK-37090) Upgrade libthrift to resolve security vulnerabilities

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495295#comment-17495295 ] Apache Spark commented on SPARK-37090: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-37090) Upgrade libthrift to resolve security vulnerabilities

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495294#comment-17495294 ] Apache Spark commented on SPARK-37090: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-37090) Upgrade libthrift to resolve security vulnerabilities

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495293#comment-17495293 ] Apache Spark commented on SPARK-37090: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-38266) UnresolvedException: Invalid call to dataType on unresolved object caused by GetDateFieldOperations

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495286#comment-17495286 ] Apache Spark commented on SPARK-38266: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Resolved] (SPARK-38266) UnresolvedException: Invalid call to dataType on unresolved object caused by GetDateFieldOperations

2022-02-20 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-38266. -- Resolution: Fixed > UnresolvedException: Invalid call to dataType on unresolved object caused by >

[jira] [Assigned] (SPARK-38266) UnresolvedException: Invalid call to dataType on unresolved object caused by GetDateFieldOperations

2022-02-20 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi reassigned SPARK-38266: Assignee: wuyi > UnresolvedException: Invalid call to dataType on unresolved object caused by >

[jira] [Commented] (SPARK-38266) UnresolvedException: Invalid call to dataType on unresolved object caused by GetDateFieldOperations

2022-02-20 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495285#comment-17495285 ] wuyi commented on SPARK-38266: -- Issue resolved by https://github.com/apache/spark/pull/35568 >

[jira] [Created] (SPARK-38266) UnresolvedException: Invalid call to dataType on unresolved object caused by GetDateFieldOperations

2022-02-20 Thread wuyi (Jira)
wuyi created SPARK-38266: Summary: UnresolvedException: Invalid call to dataType on unresolved object caused by GetDateFieldOperations Key: SPARK-38266 URL: https://issues.apache.org/jira/browse/SPARK-38266

[jira] [Resolved] (SPARK-38261) Sync missing R packages with CI

2022-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38261. -- Assignee: Khalid Mammadov Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-38261) Sync missing R packages with CI

2022-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-38261: - Fix Version/s: 3.3.0 > Sync missing R packages with CI > --- > >

[jira] [Commented] (SPARK-38265) Update comments of ExecutorAllocationClient

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495271#comment-17495271 ] Apache Spark commented on SPARK-38265: -- User 'Shockang' has created a pull request for this issue:

[jira] [Commented] (SPARK-38265) Update comments of ExecutorAllocationClient

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495270#comment-17495270 ] Apache Spark commented on SPARK-38265: -- User 'Shockang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38265) Update comments of ExecutorAllocationClient

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38265: Assignee: Apache Spark > Update comments of ExecutorAllocationClient >

[jira] [Assigned] (SPARK-38265) Update comments of ExecutorAllocationClient

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38265: Assignee: (was: Apache Spark) > Update comments of ExecutorAllocationClient >

[jira] [Commented] (SPARK-38265) Update comments of ExecutorAllocationClient

2022-02-20 Thread Shockang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495269#comment-17495269 ] Shockang commented on SPARK-38265: -- Working on this. > Update comments of ExecutorAllocationClient >

[jira] [Created] (SPARK-38265) Update comments of ExecutorAllocationClient

2022-02-20 Thread Shockang (Jira)
Shockang created SPARK-38265: Summary: Update comments of ExecutorAllocationClient Key: SPARK-38265 URL: https://issues.apache.org/jira/browse/SPARK-38265 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-38264) Add `DataFrame.resample` for pandas API on Spark.

2022-02-20 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-38264: --- Summary: Add `DataFrame.resample` for pandas API on Spark. Key: SPARK-38264 URL: https://issues.apache.org/jira/browse/SPARK-38264 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37426) Inline type hints for python/pyspark/mllib/regression.py

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495257#comment-17495257 ] Apache Spark commented on SPARK-37426: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37426) Inline type hints for python/pyspark/mllib/regression.py

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37426: Assignee: Apache Spark > Inline type hints for python/pyspark/mllib/regression.py >

[jira] [Commented] (SPARK-37426) Inline type hints for python/pyspark/mllib/regression.py

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495256#comment-17495256 ] Apache Spark commented on SPARK-37426: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37426) Inline type hints for python/pyspark/mllib/regression.py

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37426: Assignee: (was: Apache Spark) > Inline type hints for

[jira] [Assigned] (SPARK-37400) Inline type hints for python/pyspark/mllib/classification.py

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37400: Assignee: (was: Apache Spark) > Inline type hints for

[jira] [Assigned] (SPARK-37400) Inline type hints for python/pyspark/mllib/classification.py

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37400: Assignee: Apache Spark > Inline type hints for python/pyspark/mllib/classification.py >

[jira] [Commented] (SPARK-37400) Inline type hints for python/pyspark/mllib/classification.py

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495255#comment-17495255 ] Apache Spark commented on SPARK-37400: -- User 'zero323' has created a pull request for this issue:

[jira] [Resolved] (SPARK-37090) Upgrade libthrift to resolve security vulnerabilities

2022-02-20 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37090. -- Fix Version/s: 3.3.0 Resolution: Fixed Resolved by

[jira] [Assigned] (SPARK-37090) Upgrade libthrift to resolve security vulnerabilities

2022-02-20 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37090: Assignee: Yuming Wang > Upgrade libthrift to resolve security vulnerabilities >

[jira] [Resolved] (SPARK-36994) Upgrade Apache Thrift

2022-02-20 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36994. -- Resolution: Duplicate > Upgrade Apache Thrift > - > >

[jira] [Reopened] (SPARK-37090) Upgrade libthrift to resolve security vulnerabilities

2022-02-20 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reopened SPARK-37090: -- I'm going to 'reverse' the direction of the Duplicate as the PRs ended up being vs this JIRA >

[jira] [Commented] (SPARK-38262) Upgrade Google guava to version 30.0-jre

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495220#comment-17495220 ] Apache Spark commented on SPARK-38262: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Assigned] (SPARK-38262) Upgrade Google guava to version 30.0-jre

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38262: Assignee: (was: Apache Spark) > Upgrade Google guava to version 30.0-jre >

[jira] [Assigned] (SPARK-38262) Upgrade Google guava to version 30.0-jre

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38262: Assignee: Apache Spark > Upgrade Google guava to version 30.0-jre >

[jira] [Commented] (SPARK-38262) Upgrade Google guava to version 30.0-jre

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495219#comment-17495219 ] Apache Spark commented on SPARK-38262: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Updated] (SPARK-38262) Upgrade Google guava to version 30.0-jre

2022-02-20 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38262: Description: Apache Spark is using com.google.guava:guava version 14.0.1 which has two

[jira] [Created] (SPARK-38263) StructType explode

2022-02-20 Thread Sayed Mohammad Hossein Torabi (Jira)
Sayed Mohammad Hossein Torabi created SPARK-38263: - Summary: StructType explode Key: SPARK-38263 URL: https://issues.apache.org/jira/browse/SPARK-38263 Project: Spark Issue

[jira] [Updated] (SPARK-38262) Upgrade Google guava to version 30.0-jre

2022-02-20 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38262: Description: Apache Spark are using com.google.guava:guava version 14.0.1 which has two

[jira] [Created] (SPARK-38262) Upgrade Google guava to version 30.0-jre

2022-02-20 Thread Jira
Bjørn Jørgensen created SPARK-38262: --- Summary: Upgrade Google guava to version 30.0-jre Key: SPARK-38262 URL: https://issues.apache.org/jira/browse/SPARK-38262 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-38261) Sync missing R packages with CI

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38261: Assignee: (was: Apache Spark) > Sync missing R packages with CI >

[jira] [Commented] (SPARK-38261) Sync missing R packages with CI

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495179#comment-17495179 ] Apache Spark commented on SPARK-38261: -- User 'khalidmammadov' has created a pull request for this

[jira] [Assigned] (SPARK-38261) Sync missing R packages with CI

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38261: Assignee: Apache Spark > Sync missing R packages with CI >

[jira] [Created] (SPARK-38261) Sync missing R packages with CI

2022-02-20 Thread Khalid Mammadov (Jira)
Khalid Mammadov created SPARK-38261: --- Summary: Sync missing R packages with CI Key: SPARK-38261 URL: https://issues.apache.org/jira/browse/SPARK-38261 Project: Spark Issue Type: Github

[jira] [Commented] (SPARK-37954) old columns should not be available after select or drop

2022-02-20 Thread Varun Shah (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495177#comment-17495177 ] Varun Shah commented on SPARK-37954: Hi [~andrewfmurphy], there are 2 reasons you dont see any error

[jira] [Commented] (SPARK-38260) Remove dependence on commons-net

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495156#comment-17495156 ] Apache Spark commented on SPARK-38260: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38260) Remove dependence on commons-net

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38260: Assignee: Apache Spark > Remove dependence on commons-net >

[jira] [Assigned] (SPARK-38260) Remove dependence on commons-net

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38260: Assignee: (was: Apache Spark) > Remove dependence on commons-net >

[jira] [Commented] (SPARK-38260) Remove dependence on commons-net

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495155#comment-17495155 ] Apache Spark commented on SPARK-38260: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-38260) Remove dependence on commons-net

2022-02-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-38260: Summary: Remove dependence on commons-net Key: SPARK-38260 URL: https://issues.apache.org/jira/browse/SPARK-38260 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-38259) Upgrade netty to 4.1.74

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495149#comment-17495149 ] Apache Spark commented on SPARK-38259: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38259) Upgrade netty to 4.1.74

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38259: Assignee: Apache Spark > Upgrade netty to 4.1.74 > --- > >

[jira] [Assigned] (SPARK-38259) Upgrade netty to 4.1.74

2022-02-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38259: Assignee: (was: Apache Spark) > Upgrade netty to 4.1.74 > --- >

[jira] [Created] (SPARK-38259) Upgrade netty to 4.1.74

2022-02-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-38259: Summary: Upgrade netty to 4.1.74 Key: SPARK-38259 URL: https://issues.apache.org/jira/browse/SPARK-38259 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-38258) [proposal] collect & update statistics automatically when spark SQL is running

2022-02-20 Thread gabrywu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gabrywu updated SPARK-38258: Affects Version/s: 2.4.0 > [proposal] collect & update statistics automatically when spark SQL is running

[jira] [Updated] (SPARK-38258) [proposal] collect & update statistics automatically when spark SQL is running

2022-02-20 Thread gabrywu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gabrywu updated SPARK-38258: Description: As we all know, table & column statistics are very important to spark SQL optimizer,

[jira] [Created] (SPARK-38258) [proposal] collect & update statistics automatically when spark SQL is running

2022-02-20 Thread gabrywu (Jira)
gabrywu created SPARK-38258: --- Summary: [proposal] collect & update statistics automatically when spark SQL is running Key: SPARK-38258 URL: https://issues.apache.org/jira/browse/SPARK-38258 Project: Spark