[jira] [Created] (SPARK-41231) Built-in SQL Function Improvement

2022-11-22 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41231: - Summary: Built-in SQL Function Improvement Key: SPARK-41231 URL: https://issues.apache.org/jira/browse/SPARK-41231 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-41229) When using `db_ name.temp_ table_name`, an exception will be thrown

2022-11-22 Thread jingxiong zhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jingxiong zhong updated SPARK-41229: Description: SQL1: ```with table_hive1 as(select * from db1.table_hive) select * from db1.

[jira] [Commented] (SPARK-41228) Rename COLUMN_NOT_IN_GROUP_BY_CLAUSE to MISSING_AGGREGATION

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637600#comment-17637600 ] Apache Spark commented on SPARK-41228: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-41228) Rename COLUMN_NOT_IN_GROUP_BY_CLAUSE to MISSING_AGGREGATION

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41228: Assignee: (was: Apache Spark) > Rename COLUMN_NOT_IN_GROUP_BY_CLAUSE to MISSING_AGGRE

[jira] [Commented] (SPARK-41228) Rename COLUMN_NOT_IN_GROUP_BY_CLAUSE to MISSING_AGGREGATION

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637599#comment-17637599 ] Apache Spark commented on SPARK-41228: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-41228) Rename COLUMN_NOT_IN_GROUP_BY_CLAUSE to MISSING_AGGREGATION

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41228: Assignee: Apache Spark > Rename COLUMN_NOT_IN_GROUP_BY_CLAUSE to MISSING_AGGREGATION > --

[jira] [Assigned] (SPARK-41230) Remove `str` from Aggregate expression type

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41230: Assignee: Apache Spark > Remove `str` from Aggregate expression type > --

[jira] [Commented] (SPARK-41230) Remove `str` from Aggregate expression type

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637597#comment-17637597 ] Apache Spark commented on SPARK-41230: -- User 'amaliujia' has created a pull request

[jira] [Assigned] (SPARK-41230) Remove `str` from Aggregate expression type

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41230: Assignee: (was: Apache Spark) > Remove `str` from Aggregate expression type > ---

[jira] [Commented] (SPARK-41230) Remove `str` from Aggregate expression type

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637596#comment-17637596 ] Apache Spark commented on SPARK-41230: -- User 'amaliujia' has created a pull request

[jira] [Commented] (SPARK-41229) When using `db_ name.temp_ table_name`, an exception will be thrown

2022-11-22 Thread jingxiong zhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637595#comment-17637595 ] jingxiong zhong commented on SPARK-41229: - [~cloud_fan] Could you help me about

[jira] [Updated] (SPARK-41230) Remove `str` from Aggregate expression type

2022-11-22 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-41230: - Summary: Remove `str` from Aggregate expression type (was: Remove `str` from Aggregate) > Remove `str`

[jira] [Updated] (SPARK-41230) Remove `str` from Aggregate

2022-11-22 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-41230: - Summary: Remove `str` from Aggregate (was: Remove `str` from Class Aggregate in Plan.py) > Remove `str

[jira] [Commented] (SPARK-41227) Implement `DataFrame.crossJoin`

2022-11-22 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637593#comment-17637593 ] Rui Wang commented on SPARK-41227: -- +1 to have this to match existing PySpark API. > I

[jira] [Commented] (SPARK-41183) Add an extension API to do plan normalization for caching

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637594#comment-17637594 ] Apache Spark commented on SPARK-41183: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-41230) Remove `str` from Class Aggregate in Plan.py

2022-11-22 Thread Rui Wang (Jira)
Rui Wang created SPARK-41230: Summary: Remove `str` from Class Aggregate in Plan.py Key: SPARK-41230 URL: https://issues.apache.org/jira/browse/SPARK-41230 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-35531) Can not insert into hive bucket table if create table with upper case schema

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637592#comment-17637592 ] Apache Spark commented on SPARK-35531: -- User 'wankunde' has created a pull request

[jira] [Commented] (SPARK-35531) Can not insert into hive bucket table if create table with upper case schema

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637591#comment-17637591 ] Apache Spark commented on SPARK-35531: -- User 'wankunde' has created a pull request

[jira] [Updated] (SPARK-41229) When using `db_ name.temp_ table_name`, an exception will be thrown

2022-11-22 Thread jingxiong zhong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jingxiong zhong updated SPARK-41229: Description: SQL1: ```with table_hive1 as(select * from db1.table_hive) select * from db1.

[jira] [Created] (SPARK-41229) When using `db_ name.temp_ table_name`, an exception will be thrown

2022-11-22 Thread jingxiong zhong (Jira)
jingxiong zhong created SPARK-41229: --- Summary: When using `db_ name.temp_ table_name`, an exception will be thrown Key: SPARK-41229 URL: https://issues.apache.org/jira/browse/SPARK-41229 Project: Sp

[jira] [Commented] (SPARK-41219) Regression in IntegralDivide returning null instead of 0

2022-11-22 Thread Raza Jafri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637587#comment-17637587 ] Raza Jafri commented on SPARK-41219: Thank you for looking into this issue. I have a

[jira] [Resolved] (SPARK-40948) Introduce new error class: PATH_NOT_FOUND

2022-11-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40948. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38575 [https://github.com

[jira] [Assigned] (SPARK-40948) Introduce new error class: PATH_NOT_FOUND

2022-11-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40948: Assignee: Haejoon Lee > Introduce new error class: PATH_NOT_FOUND > -

[jira] [Commented] (SPARK-41228) Rename COLUMN_NOT_IN_GROUP_BY_CLAUSE to MISSING_AGGREGATION

2022-11-22 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637567#comment-17637567 ] Haejoon Lee commented on SPARK-41228: - I'm working on this > Rename COLUMN_NOT_IN_G

[jira] [Created] (SPARK-41228) Rename COLUMN_NOT_IN_GROUP_BY_CLAUSE to MISSING_AGGREGATION

2022-11-22 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-41228: --- Summary: Rename COLUMN_NOT_IN_GROUP_BY_CLAUSE to MISSING_AGGREGATION Key: SPARK-41228 URL: https://issues.apache.org/jira/browse/SPARK-41228 Project: Spark Is

[jira] [Commented] (SPARK-41206) Assign a name to the error class _LEGACY_ERROR_TEMP_1233

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637557#comment-17637557 ] Apache Spark commented on SPARK-41206: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-41227) Implement `DataFrame.crossJoin`

2022-11-22 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-41227: Summary: Implement `DataFrame.crossJoin` Key: SPARK-41227 URL: https://issues.apache.org/jira/browse/SPARK-41227 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-41201) Implement `DataFrame.SelectExpr` in Python client

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637521#comment-17637521 ] Apache Spark commented on SPARK-41201: -- User 'zhengruifeng' has created a pull requ

[jira] [Resolved] (SPARK-41201) Implement `DataFrame.SelectExpr` in Python client

2022-11-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41201. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38723 [https://gi

[jira] [Assigned] (SPARK-41201) Implement `DataFrame.SelectExpr` in Python client

2022-11-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41201: Assignee: Rui Wang > Implement `DataFrame.SelectExpr` in Python client >

[jira] [Updated] (SPARK-41226) Refactor Spark types by introducing physical types

2022-11-22 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-41226: Description: I am creating this one for Desmond Cheong since he can't signup for an account becau

[jira] [Updated] (SPARK-39591) SPIP: Asynchronous Offset Management in Structured Streaming

2022-11-22 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-39591: - Shepherd: Jungtaek Lim > SPIP: Asynchronous Offset Management in Structured Streaming >

[jira] [Assigned] (SPARK-41226) Refactor Spark types by introducing physical types

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41226: Assignee: Apache Spark > Refactor Spark types by introducing physical types > ---

[jira] [Assigned] (SPARK-41226) Refactor Spark types by introducing physical types

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41226: Assignee: (was: Apache Spark) > Refactor Spark types by introducing physical types >

[jira] [Commented] (SPARK-41226) Refactor Spark types by introducing physical types

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637464#comment-17637464 ] Apache Spark commented on SPARK-41226: -- User 'desmondcheongzx' has created a pull r

[jira] [Commented] (SPARK-41226) Refactor Spark types by introducing physical types

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637463#comment-17637463 ] Apache Spark commented on SPARK-41226: -- User 'desmondcheongzx' has created a pull r

[jira] [Created] (SPARK-41226) Refactor Spark types by introducing physical types

2022-11-22 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41226: -- Summary: Refactor Spark types by introducing physical types Key: SPARK-41226 URL: https://issues.apache.org/jira/browse/SPARK-41226 Project: Spark Issue

[jira] [Assigned] (SPARK-41225) Disable unsupported functions

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41225: Assignee: (was: Apache Spark) > Disable unsupported functions > -

[jira] [Assigned] (SPARK-41225) Disable unsupported functions

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41225: Assignee: Apache Spark > Disable unsupported functions > - >

[jira] [Commented] (SPARK-41225) Disable unsupported functions

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637457#comment-17637457 ] Apache Spark commented on SPARK-41225: -- User 'grundprinzip' has created a pull requ

[jira] [Created] (SPARK-41225) Disable unsupported functions

2022-11-22 Thread Martin Grund (Jira)
Martin Grund created SPARK-41225: Summary: Disable unsupported functions Key: SPARK-41225 URL: https://issues.apache.org/jira/browse/SPARK-41225 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-39591) SPIP: Offset Management Improvements in Structured Streaming

2022-11-22 Thread Boyang Jerry Peng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Jerry Peng updated SPARK-39591: -- Description: Currently in Structured Streaming, at the beginning of every micro-batch

[jira] [Updated] (SPARK-39591) SPIP: Asynchronous Offset Management in Structured Streaming

2022-11-22 Thread Boyang Jerry Peng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Jerry Peng updated SPARK-39591: -- Summary: SPIP: Asynchronous Offset Management in Structured Streaming (was: SPIP: Off

[jira] [Updated] (SPARK-39591) SPIP: Offset Management Improvements in Structured Streaming

2022-11-22 Thread Boyang Jerry Peng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Jerry Peng updated SPARK-39591: -- Summary: SPIP: Offset Management Improvements in Structured Streaming (was: Offset Ma

[jira] [Updated] (SPARK-39591) SPIP: Offset Management Improvements in Structured Streaming

2022-11-22 Thread Boyang Jerry Peng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Jerry Peng updated SPARK-39591: -- Labels: SPIP (was: ) > SPIP: Offset Management Improvements in Structured Streaming >

[jira] [Updated] (SPARK-39591) Offset Management Improvements in Structured Streaming

2022-11-22 Thread Boyang Jerry Peng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Jerry Peng updated SPARK-39591: -- Labels: SPIP (was: ) > Offset Management Improvements in Structured Streaming > -

[jira] [Updated] (SPARK-39591) Offset Management Improvements in Structured Streaming

2022-11-22 Thread Boyang Jerry Peng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Jerry Peng updated SPARK-39591: -- Labels: (was: SPIP) > Offset Management Improvements in Structured Streaming > -

[jira] [Updated] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-11-22 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41053: --- Description: After SPARK-18085, the Spark history server(SHS) becomes more scalable for pro

[jira] [Updated] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-11-22 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41053: --- Attachment: Better Spark UI scalability and Driver stability for large applications.pdf > B

[jira] [Resolved] (SPARK-41054) Support disk-based KVStore in live UI

2022-11-22 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-41054. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38567 [https:

[jira] (SPARK-37313) Child stage using merged output or not should be based on the availability of merged output from parent stage

2022-11-22 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37313 ] Mars deleted comment on SPARK-37313: -- was (Author: JIRAUSER290821): as comment said [https://github.com/apache/spark/pull/34461#issuecomment-964557253] I'm working on this Issue and trying to imple

[jira] [Commented] (SPARK-40988) Test case for insert partition should verify value

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637252#comment-17637252 ] Apache Spark commented on SPARK-40988: -- User 'rangareddy' has created a pull reques

[jira] [Assigned] (SPARK-40988) Test case for insert partition should verify value

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40988: Assignee: Apache Spark > Test case for insert partition should verify value > --

[jira] [Assigned] (SPARK-40988) Test case for insert partition should verify value

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40988: Assignee: (was: Apache Spark) > Test case for insert partition should verify value >

[jira] [Commented] (SPARK-40988) Test case for insert partition should verify value

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637251#comment-17637251 ] Apache Spark commented on SPARK-40988: -- User 'rangareddy' has created a pull reques

[jira] [Commented] (SPARK-41219) Regression in IntegralDivide returning null instead of 0

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637239#comment-17637239 ] Apache Spark commented on SPARK-41219: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-41219) Regression in IntegralDivide returning null instead of 0

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41219: Assignee: (was: Apache Spark) > Regression in IntegralDivide returning null instead o

[jira] [Assigned] (SPARK-41219) Regression in IntegralDivide returning null instead of 0

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41219: Assignee: Apache Spark > Regression in IntegralDivide returning null instead of 0 > -

[jira] [Commented] (SPARK-41184) Fill NA tests are flaky

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637223#comment-17637223 ] Apache Spark commented on SPARK-41184: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-41184) Fill NA tests are flaky

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637222#comment-17637222 ] Apache Spark commented on SPARK-41184: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-41184) Fill NA tests are flaky

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637221#comment-17637221 ] Apache Spark commented on SPARK-41184: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-41165) Arrow collect should factor in failures

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637219#comment-17637219 ] Apache Spark commented on SPARK-41165: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-41165) Arrow collect should factor in failures

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637220#comment-17637220 ] Apache Spark commented on SPARK-41165: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-41224) Optimize Arrow collect to stream the result from server to client

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637218#comment-17637218 ] Apache Spark commented on SPARK-41224: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-41224) Optimize Arrow collect to stream the result from server to client

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41224: Assignee: Apache Spark > Optimize Arrow collect to stream the result from server to clien

[jira] [Assigned] (SPARK-41224) Optimize Arrow collect to stream the result from server to client

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41224: Assignee: (was: Apache Spark) > Optimize Arrow collect to stream the result from serv

[jira] [Comment Edited] (SPARK-41219) Regression in IntegralDivide returning null instead of 0

2022-11-22 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637216#comment-17637216 ] XiDuo You edited comment on SPARK-41219 at 11/22/22 11:59 AM:

[jira] [Commented] (SPARK-41219) Regression in IntegralDivide returning null instead of 0

2022-11-22 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637216#comment-17637216 ] XiDuo You commented on SPARK-41219: --- it seems the root reason is decimal.toPrecision w

[jira] [Created] (SPARK-41224) Optimize Arrow collect to stream the result from server to client

2022-11-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41224: Summary: Optimize Arrow collect to stream the result from server to client Key: SPARK-41224 URL: https://issues.apache.org/jira/browse/SPARK-41224 Project: Spark

[jira] [Assigned] (SPARK-41180) Assign an error class to "Cannot parse the data type"

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41180: Assignee: (was: Apache Spark) > Assign an error class to "Cannot parse the data type"

[jira] [Assigned] (SPARK-41180) Assign an error class to "Cannot parse the data type"

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41180: Assignee: Apache Spark > Assign an error class to "Cannot parse the data type" >

[jira] [Commented] (SPARK-41223) Upgrade slf4j to 2.0.4

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637207#comment-17637207 ] Apache Spark commented on SPARK-41223: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-41223) Upgrade slf4j to 2.0.4

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637205#comment-17637205 ] Apache Spark commented on SPARK-41223: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-41223) Upgrade slf4j to 2.0.4

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41223: Assignee: Apache Spark > Upgrade slf4j to 2.0.4 > -- > >

[jira] [Assigned] (SPARK-41223) Upgrade slf4j to 2.0.4

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41223: Assignee: (was: Apache Spark) > Upgrade slf4j to 2.0.4 > -- > >

[jira] [Commented] (SPARK-41219) Regression in IntegralDivide returning null instead of 0

2022-11-22 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637201#comment-17637201 ] XiDuo You commented on SPARK-41219: --- I'm looking at this > Regression in IntegralDivi

[jira] [Created] (SPARK-41223) Upgrade slf4j to 2.0.4

2022-11-22 Thread Yang Jie (Jira)
Yang Jie created SPARK-41223: Summary: Upgrade slf4j to 2.0.4 Key: SPARK-41223 URL: https://issues.apache.org/jira/browse/SPARK-41223 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-41222) Unify the typing definitions

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637199#comment-17637199 ] Apache Spark commented on SPARK-41222: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41222) Unify the typing definitions

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41222: Assignee: (was: Apache Spark) > Unify the typing definitions > --

[jira] [Assigned] (SPARK-41222) Unify the typing definitions

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41222: Assignee: Apache Spark > Unify the typing definitions > > >

[jira] [Commented] (SPARK-41222) Unify the typing definitions

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637195#comment-17637195 ] Apache Spark commented on SPARK-41222: -- User 'zhengruifeng' has created a pull requ

[jira] [Created] (SPARK-41222) Unify the typing definitions

2022-11-22 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41222: - Summary: Unify the typing definitions Key: SPARK-41222 URL: https://issues.apache.org/jira/browse/SPARK-41222 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-41220) Range partitioner sample supports column pruning

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637149#comment-17637149 ] Apache Spark commented on SPARK-41220: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-41220) Range partitioner sample supports column pruning

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41220: Assignee: (was: Apache Spark) > Range partitioner sample supports column pruning > --

[jira] [Assigned] (SPARK-41220) Range partitioner sample supports column pruning

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41220: Assignee: Apache Spark > Range partitioner sample supports column pruning > -

[jira] [Commented] (SPARK-41220) Range partitioner sample supports column pruning

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637148#comment-17637148 ] Apache Spark commented on SPARK-41220: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-41135) Rename UNSUPPORTED_EMPTY_LOCATION to INVALID_EMPTY_LOCATION

2022-11-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41135: Assignee: Haejoon Lee > Rename UNSUPPORTED_EMPTY_LOCATION to INVALID_EMPTY_LOCATION > ---

[jira] [Resolved] (SPARK-41135) Rename UNSUPPORTED_EMPTY_LOCATION to INVALID_EMPTY_LOCATION

2022-11-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41135. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38650 [https://github.com

[jira] [Commented] (SPARK-41221) Add the error class INVALID_FORMAT

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637129#comment-17637129 ] Apache Spark commented on SPARK-41221: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-41221) Add the error class INVALID_FORMAT

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41221: Assignee: Max Gekk (was: Apache Spark) > Add the error class INVALID_FORMAT > --

[jira] [Commented] (SPARK-41221) Add the error class INVALID_FORMAT

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637128#comment-17637128 ] Apache Spark commented on SPARK-41221: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-41221) Add the error class INVALID_FORMAT

2022-11-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41221: Assignee: Apache Spark (was: Max Gekk) > Add the error class INVALID_FORMAT > --

[jira] [Created] (SPARK-41221) Add the error class INVALID_FORMAT

2022-11-22 Thread Max Gekk (Jira)
Max Gekk created SPARK-41221: Summary: Add the error class INVALID_FORMAT Key: SPARK-41221 URL: https://issues.apache.org/jira/browse/SPARK-41221 Project: Spark Issue Type: Sub-task Com

[jira] [Resolved] (SPARK-41212) Implement `DataFrame.isEmpty`

2022-11-22 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41212. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38734 [https://

[jira] [Assigned] (SPARK-41212) Implement `DataFrame.isEmpty`

2022-11-22 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41212: - Assignee: Ruifeng Zheng > Implement `DataFrame.isEmpty` > -

[jira] [Commented] (SPARK-41219) Regression in IntegralDivide returning null instead of 0

2022-11-22 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637102#comment-17637102 ] Yuming Wang commented on SPARK-41219: - cc [~ulysses] > Regression in IntegralDivide

[jira] [Commented] (SPARK-38230) InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases

2022-11-22 Thread Gabor Roczei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637096#comment-17637096 ] Gabor Roczei commented on SPARK-38230: -- Hi [~coalchan], [Your pull request|https:/

[jira] [Created] (SPARK-41220) Range partitioner sample supports column pruning

2022-11-22 Thread XiDuo You (Jira)
XiDuo You created SPARK-41220: - Summary: Range partitioner sample supports column pruning Key: SPARK-41220 URL: https://issues.apache.org/jira/browse/SPARK-41220 Project: Spark Issue Type: Improv