[jira] [Commented] (SPARK-37578) DSV2 is not updating Output Metrics

[ https://issues.apache.org/jira/browse/SPARK-37578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480360#comment-17480360 ] Apache Spark commented on SPARK-37578: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-37985) Fix flaky test SPARK-37578

[ https://issues.apache.org/jira/browse/SPARK-37985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37985: Assignee: Apache Spark > Fix flaky test SPARK-37578 > -- > >

[jira] [Assigned] (SPARK-37985) Fix flaky test SPARK-37578

[ https://issues.apache.org/jira/browse/SPARK-37985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37985: Assignee: (was: Apache Spark) > Fix flaky test SPARK-37578 >

[jira] [Commented] (SPARK-37985) Fix flaky test SPARK-37578

[ https://issues.apache.org/jira/browse/SPARK-37985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480359#comment-17480359 ] Apache Spark commented on SPARK-37985: -- User 'AngersZh' has created a pull request for this

[jira] [Created] (SPARK-37985) Fix flaky test SPARK-37578

angerszhu created SPARK-37985: - Summary: Fix flaky test SPARK-37578 Key: SPARK-37985 URL: https://issues.apache.org/jira/browse/SPARK-37985 Project: Spark Issue Type: Task Components:

[jira] [Assigned] (SPARK-37984) Avoid calculating all outstanding requests to improve performance.

[ https://issues.apache.org/jira/browse/SPARK-37984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37984: Assignee: Apache Spark > Avoid calculating all outstanding requests to improve

[jira] [Assigned] (SPARK-37984) Avoid calculating all outstanding requests to improve performance.

[ https://issues.apache.org/jira/browse/SPARK-37984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37984: Assignee: (was: Apache Spark) > Avoid calculating all outstanding requests to

[jira] [Commented] (SPARK-37984) Avoid calculating all outstanding requests to improve performance.

[ https://issues.apache.org/jira/browse/SPARK-37984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480351#comment-17480351 ] Apache Spark commented on SPARK-37984: -- User 'weixiuli' has created a pull request for this issue:

[jira] [Updated] (SPARK-37984) Avoid calculating all outstanding requests to improve performance.

[ https://issues.apache.org/jira/browse/SPARK-37984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weixiuli updated SPARK-37984: - Description: Avoid calculating all outstanding requests to improve performance. (was: Avoid computing

[jira] [Created] (SPARK-37984) Avoid computing all outstanding requests to improve performance.

weixiuli created SPARK-37984: Summary: Avoid computing all outstanding requests to improve performance. Key: SPARK-37984 URL: https://issues.apache.org/jira/browse/SPARK-37984 Project: Spark

[jira] [Commented] (SPARK-37731) refactor and cleanup function lookup in Analyzer

[ https://issues.apache.org/jira/browse/SPARK-37731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480323#comment-17480323 ] Apache Spark commented on SPARK-37731: -- User 'allisonwang-db' has created a pull request for this

[jira] [Commented] (SPARK-37982) Use error classes in the execution errors related to unsupported input type

[ https://issues.apache.org/jira/browse/SPARK-37982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480309#comment-17480309 ] Apache Spark commented on SPARK-37982: -- User 'leesf' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37982) Use error classes in the execution errors related to unsupported input type

[ https://issues.apache.org/jira/browse/SPARK-37982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37982: Assignee: Apache Spark > Use error classes in the execution errors related to

[jira] [Assigned] (SPARK-37982) Use error classes in the execution errors related to unsupported input type

[ https://issues.apache.org/jira/browse/SPARK-37982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37982: Assignee: (was: Apache Spark) > Use error classes in the execution errors related to

[jira] [Commented] (SPARK-37982) Use error classes in the execution errors related to unsupported input type

[ https://issues.apache.org/jira/browse/SPARK-37982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480308#comment-17480308 ] Apache Spark commented on SPARK-37982: -- User 'leesf' has created a pull request for this issue:

[jira] [Resolved] (SPARK-37981) Deletes columns with all Null as default.

[ https://issues.apache.org/jira/browse/SPARK-37981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37981. Resolution: Duplicate > Deletes columns with all Null as default. >

[jira] [Commented] (SPARK-18591) Replace hash-based aggregates with sort-based ones if inputs already sorted

[ https://issues.apache.org/jira/browse/SPARK-18591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480300#comment-17480300 ] Cheng Su commented on SPARK-18591: -- Just FYI, the Jira should be fixed by

[jira] [Assigned] (SPARK-37983) Backout agg build time metrics from sort aggregate

[ https://issues.apache.org/jira/browse/SPARK-37983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37983: Assignee: (was: Apache Spark) > Backout agg build time metrics from sort aggregate >

[jira] [Assigned] (SPARK-37983) Backout agg build time metrics from sort aggregate

[ https://issues.apache.org/jira/browse/SPARK-37983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37983: Assignee: Apache Spark > Backout agg build time metrics from sort aggregate >

[jira] [Commented] (SPARK-37983) Backout agg build time metrics from sort aggregate

[ https://issues.apache.org/jira/browse/SPARK-37983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480298#comment-17480298 ] Apache Spark commented on SPARK-37983: -- User 'c21' has created a pull request for this issue:

[jira] [Created] (SPARK-37983) Backout agg build time metrics from sort aggregate

Cheng Su created SPARK-37983: Summary: Backout agg build time metrics from sort aggregate Key: SPARK-37983 URL: https://issues.apache.org/jira/browse/SPARK-37983 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37981) Deletes columns with all Null as default.

[ https://issues.apache.org/jira/browse/SPARK-37981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480293#comment-17480293 ] Bjørn Jørgensen commented on SPARK-37981: - [^json_null.json] {code:java} from pyspark

[jira] [Created] (SPARK-37982) Use error classes in the execution errors related to unsupported input type

leesf created SPARK-37982: - Summary: Use error classes in the execution errors related to unsupported input type Key: SPARK-37982 URL: https://issues.apache.org/jira/browse/SPARK-37982 Project: Spark

[jira] [Comment Edited] (SPARK-37981) Deletes columns with all Null as default.

[ https://issues.apache.org/jira/browse/SPARK-37981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480291#comment-17480291 ] Maciej Szymkiewicz edited comment on SPARK-37981 at 1/21/22, 11:37 PM:

[jira] [Commented] (SPARK-37981) Deletes columns with all Null as default.

[ https://issues.apache.org/jira/browse/SPARK-37981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480291#comment-17480291 ] Maciej Szymkiewicz commented on SPARK-37981: This doesn't seem valid.

[jira] [Updated] (SPARK-37981) Deletes columns with all Null as default.

[ https://issues.apache.org/jira/browse/SPARK-37981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-37981: Attachment: json_null.json > Deletes columns with all Null as default. >

[jira] [Updated] (SPARK-37981) Deletes columns with all Null as default.

[ https://issues.apache.org/jira/browse/SPARK-37981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37981: - Affects Version/s: 3.2.0 (was: 3.2.1) Priority: Major

[jira] [Created] (SPARK-37981) Deletes columns with all Null as default.

Bjørn Jørgensen created SPARK-37981: --- Summary: Deletes columns with all Null as default. Key: SPARK-37981 URL: https://issues.apache.org/jira/browse/SPARK-37981 Project: Spark Issue Type:

[jira] [Created] (SPARK-37980) Extend METADATA column to support row indexes for file based data sources

Prakhar Jain created SPARK-37980: Summary: Extend METADATA column to support row indexes for file based data sources Key: SPARK-37980 URL: https://issues.apache.org/jira/browse/SPARK-37980 Project:

[jira] [Commented] (SPARK-37936) Use error classes in the parsing errors of intervals

[ https://issues.apache.org/jira/browse/SPARK-37936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480099#comment-17480099 ] Senthil Kumar commented on SPARK-37936: --- [~maxgekk] ,  I have queries which matches    *

[jira] [Assigned] (SPARK-37907) StaticInvoke should support ConstantFolding

[ https://issues.apache.org/jira/browse/SPARK-37907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37907: --- Assignee: angerszhu > StaticInvoke should support ConstantFolding >

[jira] [Resolved] (SPARK-37907) StaticInvoke should support ConstantFolding

[ https://issues.apache.org/jira/browse/SPARK-37907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37907. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35207

[jira] [Resolved] (SPARK-37950) Take EXTERNAL as a reserved table property

[ https://issues.apache.org/jira/browse/SPARK-37950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37950. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35268

[jira] [Assigned] (SPARK-37950) Take EXTERNAL as a reserved table property

[ https://issues.apache.org/jira/browse/SPARK-37950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37950: --- Assignee: PengLei > Take EXTERNAL as a reserved table property >

[jira] [Commented] (SPARK-37979) Switch to more generic error classes in AES functions

[ https://issues.apache.org/jira/browse/SPARK-37979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480021#comment-17480021 ] Apache Spark commented on SPARK-37979: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37979) Switch to more generic error classes in AES functions

[ https://issues.apache.org/jira/browse/SPARK-37979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37979: Assignee: Apache Spark (was: Max Gekk) > Switch to more generic error classes in AES

[jira] [Commented] (SPARK-37979) Switch to more generic error classes in AES functions

[ https://issues.apache.org/jira/browse/SPARK-37979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480020#comment-17480020 ] Apache Spark commented on SPARK-37979: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37979) Switch to more generic error classes in AES functions

[ https://issues.apache.org/jira/browse/SPARK-37979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37979: Assignee: Max Gekk (was: Apache Spark) > Switch to more generic error classes in AES

[jira] [Created] (SPARK-37979) Switch to more generic error classes in AES functions

Max Gekk created SPARK-37979: Summary: Switch to more generic error classes in AES functions Key: SPARK-37979 URL: https://issues.apache.org/jira/browse/SPARK-37979 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-37972) Typing incompatibilities with numpy==1.22.x

[ https://issues.apache.org/jira/browse/SPARK-37972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37972. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-37972) Typing incompatibilities with numpy==1.22.x

[ https://issues.apache.org/jira/browse/SPARK-37972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37972: -- Assignee: Maciej Szymkiewicz > Typing incompatibilities with numpy==1.22.x >

[jira] [Commented] (SPARK-34805) PySpark loses metadata in DataFrame fields when selecting nested columns

[ https://issues.apache.org/jira/browse/SPARK-34805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479989#comment-17479989 ] Apache Spark commented on SPARK-34805: -- User 'kevinwallimann' has created a pull request for this

[jira] [Assigned] (SPARK-34805) PySpark loses metadata in DataFrame fields when selecting nested columns

[ https://issues.apache.org/jira/browse/SPARK-34805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34805: Assignee: Apache Spark > PySpark loses metadata in DataFrame fields when selecting

[jira] [Assigned] (SPARK-34805) PySpark loses metadata in DataFrame fields when selecting nested columns

[ https://issues.apache.org/jira/browse/SPARK-34805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34805: Assignee: (was: Apache Spark) > PySpark loses metadata in DataFrame fields when

[jira] [Commented] (SPARK-34805) PySpark loses metadata in DataFrame fields when selecting nested columns

[ https://issues.apache.org/jira/browse/SPARK-34805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479991#comment-17479991 ] Apache Spark commented on SPARK-34805: -- User 'kevinwallimann' has created a pull request for this

[jira] [Commented] (SPARK-37929) Support cascade mode for `dropNamespace` API

[ https://issues.apache.org/jira/browse/SPARK-37929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479988#comment-17479988 ] Apache Spark commented on SPARK-37929: -- User 'beliefer' has created a pull request for this issue:

[jira] [Resolved] (SPARK-36649) Support Trigger.AvailableNow on Kafka data source

[ https://issues.apache.org/jira/browse/SPARK-36649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li resolved SPARK-36649. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35238

[jira] (SPARK-28516) Data Type Formatting Functions: `to_char`

[ https://issues.apache.org/jira/browse/SPARK-28516 ] jiaan.geng deleted comment on SPARK-28516: was (Author: beliefer): I'm working on. > Data Type Formatting Functions: `to_char` > - > >

[jira] [Commented] (SPARK-28516) Data Type Formatting Functions: `to_char`

[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479903#comment-17479903 ] Apache Spark commented on SPARK-28516: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-28516) Data Type Formatting Functions: `to_char`

[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28516: Assignee: Apache Spark > Data Type Formatting Functions: `to_char` >

[jira] [Assigned] (SPARK-28516) Data Type Formatting Functions: `to_char`

[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28516: Assignee: (was: Apache Spark) > Data Type Formatting Functions: `to_char` >

[jira] [Commented] (SPARK-37950) Take EXTERNAL as a reserved table property

[ https://issues.apache.org/jira/browse/SPARK-37950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479902#comment-17479902 ] Apache Spark commented on SPARK-37950: -- User 'Peng-Lei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37950) Take EXTERNAL as a reserved table property

[ https://issues.apache.org/jira/browse/SPARK-37950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37950: Assignee: (was: Apache Spark) > Take EXTERNAL as a reserved table property >

[jira] [Commented] (SPARK-37950) Take EXTERNAL as a reserved table property

[ https://issues.apache.org/jira/browse/SPARK-37950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479901#comment-17479901 ] Apache Spark commented on SPARK-37950: -- User 'Peng-Lei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37950) Take EXTERNAL as a reserved table property

[ https://issues.apache.org/jira/browse/SPARK-37950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37950: Assignee: Apache Spark > Take EXTERNAL as a reserved table property >

[jira] [Updated] (SPARK-37978) Remove the unnecessary ChunkFetchFailureException class

[ https://issues.apache.org/jira/browse/SPARK-37978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weixiuli updated SPARK-37978: - Description: The ChunkFetchFailureException is unnecessary and can be replaced by RuntimeException.

[jira] [Updated] (SPARK-37978) Remove the unnecessary ChunkFetchFailureException class

[ https://issues.apache.org/jira/browse/SPARK-37978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weixiuli updated SPARK-37978: - Summary: Remove the unnecessary ChunkFetchFailureException class (was: Remove the useless

[jira] [Assigned] (SPARK-37978) Remove the useless ChunkFetchFailureException class

[ https://issues.apache.org/jira/browse/SPARK-37978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37978: Assignee: (was: Apache Spark) > Remove the useless ChunkFetchFailureException class

[jira] [Commented] (SPARK-37978) Remove the useless ChunkFetchFailureException class

[ https://issues.apache.org/jira/browse/SPARK-37978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479881#comment-17479881 ] Apache Spark commented on SPARK-37978: -- User 'weixiuli' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37978) Remove the useless ChunkFetchFailureException class

[ https://issues.apache.org/jira/browse/SPARK-37978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37978: Assignee: Apache Spark > Remove the useless ChunkFetchFailureException class >