[jira] [Updated] (SPARK-46119) Override toString method for UnresolvedAlias

[ https://issues.apache.org/jira/browse/SPARK-46119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46119: --- Labels: pull-request-available (was: ) > Override toString method for UnresolvedAlias >

[jira] [Updated] (SPARK-46120) Remove helper function DataFrame.withPlan

[ https://issues.apache.org/jira/browse/SPARK-46120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46120: --- Labels: pull-request-available (was: ) > Remove helper function DataFrame.withPlan >

[jira] [Created] (SPARK-46120) Remove helper function DataFrame.withPlan

Ruifeng Zheng created SPARK-46120: - Summary: Remove helper function DataFrame.withPlan Key: SPARK-46120 URL: https://issues.apache.org/jira/browse/SPARK-46120 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-46119) Override toString method for UnresolvedAlias

Yuming Wang created SPARK-46119: --- Summary: Override toString method for UnresolvedAlias Key: SPARK-46119 URL: https://issues.apache.org/jira/browse/SPARK-46119 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46117) Enhancing readability of PySpark API reference by hiding verbose typehints.

[ https://issues.apache.org/jira/browse/SPARK-46117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46117: --- Labels: pull-request-available (was: ) > Enhancing readability of PySpark API reference by

[jira] [Created] (SPARK-46118) Use `SparkSession.sessionState.conf` instead of `sqlContext.conf`

Yang Jie created SPARK-46118: Summary: Use `SparkSession.sessionState.conf` instead of `sqlContext.conf` Key: SPARK-46118 URL: https://issues.apache.org/jira/browse/SPARK-46118 Project: Spark

[jira] [Updated] (SPARK-46118) Use `SparkSession.sessionState.conf` instead of `sqlContext.conf`

[ https://issues.apache.org/jira/browse/SPARK-46118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46118: --- Labels: pull-request-available (was: ) > Use `SparkSession.sessionState.conf` instead of

[jira] [Created] (SPARK-46117) Enhancing readability of PySpark API reference by hiding verbose typehints.

Haejoon Lee created SPARK-46117: --- Summary: Enhancing readability of PySpark API reference by hiding verbose typehints. Key: SPARK-46117 URL: https://issues.apache.org/jira/browse/SPARK-46117 Project:

[jira] [Assigned] (SPARK-46114) Define IndexError for PySpark error framework

[ https://issues.apache.org/jira/browse/SPARK-46114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46114: Assignee: Hyukjin Kwon > Define IndexError for PySpark error framework >

[jira] [Resolved] (SPARK-46114) Define IndexError for PySpark error framework

[ https://issues.apache.org/jira/browse/SPARK-46114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46114. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44028

[jira] [Updated] (SPARK-46116) Adding "Q Support" and "Mailing Lists" link into PySpark doc homepage.

[ https://issues.apache.org/jira/browse/SPARK-46116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46116: Description: It is aimed at improving user engagement and providing quick access to community

[jira] [Updated] (SPARK-46116) Adding "Q Support" and "Mailing Lists" link into PySpark doc homepage.

[ https://issues.apache.org/jira/browse/SPARK-46116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46116: Summary: Adding "Q Support" and "Mailing Lists" link into PySpark doc homepage. (was: Enriching

[jira] [Updated] (SPARK-46116) Adding "Q Support" and "Mailing Lists" link into PySpark doc homepage.

[ https://issues.apache.org/jira/browse/SPARK-46116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46116: --- Labels: pull-request-available (was: ) > Adding "Q Support" and "Mailing Lists" link into

[jira] [Updated] (SPARK-46116) Enriching PySpark doc with "Useful links" including Q Support and Mailing Lists

[ https://issues.apache.org/jira/browse/SPARK-46116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46116: Summary: Enriching PySpark doc with "Useful links" including Q Support and Mailing Lists (was:

[jira] [Updated] (SPARK-46116) Enriching "Useful links" on PySpark docs including "Q Support" and "Mailing Lists"

[ https://issues.apache.org/jira/browse/SPARK-46116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46116: Summary: Enriching "Useful links" on PySpark docs including "Q Support" and "Mailing Lists"

[jira] [Updated] (SPARK-46116) Enriching PySpark doc with "Useful links" Including Q Support and Mailing Lists

[ https://issues.apache.org/jira/browse/SPARK-46116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46116: Summary: Enriching PySpark doc with "Useful links" Including Q Support and Mailing Lists (was:

[jira] [Updated] (SPARK-46116) Enriching PySpark Documentation with "Useful Links" Including Q Support and Mailing Lists

[ https://issues.apache.org/jira/browse/SPARK-46116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46116: Summary: Enriching PySpark Documentation with "Useful Links" Including Q Support and Mailing

[jira] [Created] (SPARK-46116) Add "Q Support" Link to PySpark Documentation Homepage

Haejoon Lee created SPARK-46116: --- Summary: Add "Q Support" Link to PySpark Documentation Homepage Key: SPARK-46116 URL: https://issues.apache.org/jira/browse/SPARK-46116 Project: Spark Issue

[jira] [Created] (SPARK-46115) Restrict charsets in encode()

Max Gekk created SPARK-46115: Summary: Restrict charsets in encode() Key: SPARK-46115 URL: https://issues.apache.org/jira/browse/SPARK-46115 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-46105) df.emptyDataFrame shows 1 if we repartition(1) in Spark 3.3.x and above

[ https://issues.apache.org/jira/browse/SPARK-46105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17789908#comment-17789908 ] XiDuo You commented on SPARK-46105: --- Please see SPARK-39915 > df.emptyDataFrame shows 1 if we

[jira] [Commented] (SPARK-45311) Encoder fails on many "NoSuchElementException: None.get" since 3.4.x, search for an encoder for a generic type, and since 3.5.x isn't "an expression encoder"

[ https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17789905#comment-17789905 ] Marc Le Bihan commented on SPARK-45311: --- Thanks. I only had to change the :

[jira] [Updated] (SPARK-46114) Define IndexError for PySpark error framework

[ https://issues.apache.org/jira/browse/SPARK-46114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46114: --- Labels: pull-request-available (was: ) > Define IndexError for PySpark error framework >

[jira] [Created] (SPARK-46114) Define IndexError for PySpark error framework

Hyukjin Kwon created SPARK-46114: Summary: Define IndexError for PySpark error framework Key: SPARK-46114 URL: https://issues.apache.org/jira/browse/SPARK-46114 Project: Spark Issue Type:

[jira] [Created] (SPARK-46112) Enforce usage of PySpark-specific Exceptions over built-in Python Exceptions

Haejoon Lee created SPARK-46112: --- Summary: Enforce usage of PySpark-specific Exceptions over built-in Python Exceptions Key: SPARK-46112 URL: https://issues.apache.org/jira/browse/SPARK-46112 Project:

[jira] [Updated] (SPARK-46111) Add copyright to the PySpark official documentation.

[ https://issues.apache.org/jira/browse/SPARK-46111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46111: --- Labels: pull-request-available (was: ) > Add copyright to the PySpark official

[jira] [Created] (SPARK-46111) Add copyright to the PySpark official documentation.

Haejoon Lee created SPARK-46111: --- Summary: Add copyright to the PySpark official documentation. Key: SPARK-46111 URL: https://issues.apache.org/jira/browse/SPARK-46111 Project: Spark Issue

[jira] [Assigned] (SPARK-45699) Fix "Widening conversion from `TypeA` to `TypeB` is deprecated because it loses precision"

[ https://issues.apache.org/jira/browse/SPARK-45699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45699: Assignee: Hannah Amundson > Fix "Widening conversion from `TypeA` to `TypeB` is deprecated

[jira] [Resolved] (SPARK-45699) Fix "Widening conversion from `TypeA` to `TypeB` is deprecated because it loses precision"

[ https://issues.apache.org/jira/browse/SPARK-45699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45699. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43890

[jira] [Updated] (SPARK-45888) Apply error class framework to state data source & state metadata data source

[ https://issues.apache.org/jira/browse/SPARK-45888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45888: --- Labels: pull-request-available (was: ) > Apply error class framework to state data source

[jira] [Updated] (SPARK-46110) Use error classes in catalog, conf, connect, observation, pandas modules

[ https://issues.apache.org/jira/browse/SPARK-46110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46110: --- Labels: pull-request-available (was: ) > Use error classes in catalog, conf, connect,

[jira] [Created] (SPARK-46110) Use error classes in catalog, conf, connect, observation, pandas modules

Hyukjin Kwon created SPARK-46110: Summary: Use error classes in catalog, conf, connect, observation, pandas modules Key: SPARK-46110 URL: https://issues.apache.org/jira/browse/SPARK-46110 Project:

[jira] [Deleted] (SPARK-46109) Migrate to error classes in PySpark

[ https://issues.apache.org/jira/browse/SPARK-46109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-46109: - > Migrate to error classes in PySpark > --- > >

[jira] [Updated] (SPARK-46109) Migrate to error classes in PySpark

[ https://issues.apache.org/jira/browse/SPARK-46109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46109: - > Migrate to error classes in PySpark > --- > >

[jira] [Created] (SPARK-46109) Migrate to error classes in PySpark

Hyukjin Kwon created SPARK-46109: Summary: Migrate to error classes in PySpark Key: SPARK-46109 URL: https://issues.apache.org/jira/browse/SPARK-46109 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46108) XML: keepInnerXmlAsRaw option

Ufuk Süngü created SPARK-46108: -- Summary: XML: keepInnerXmlAsRaw option Key: SPARK-46108 URL: https://issues.apache.org/jira/browse/SPARK-46108 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-32933) Use keyword-only syntax for keyword_only methods

[ https://issues.apache.org/jira/browse/SPARK-32933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17789874#comment-17789874 ] Hyukjin Kwon commented on SPARK-32933: -- Here the PR and JIRA:

[jira] [Updated] (SPARK-46107) Deprecate pyspark.keyword_only API

[ https://issues.apache.org/jira/browse/SPARK-46107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46107: --- Labels: pull-request-available (was: ) > Deprecate pyspark.keyword_only API >

[jira] [Created] (SPARK-46107) Deprecate pyspark.keyword_only API

Hyukjin Kwon created SPARK-46107: Summary: Deprecate pyspark.keyword_only API Key: SPARK-46107 URL: https://issues.apache.org/jira/browse/SPARK-46107 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46094) Add support for code profiling executors

[ https://issues.apache.org/jira/browse/SPARK-46094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46094: --- Labels: pull-request-available (was: ) > Add support for code profiling executors >

[jira] [Resolved] (SPARK-46074) [CONNECT][SCALA] Insufficient details in error when a UDF fails

[ https://issues.apache.org/jira/browse/SPARK-46074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46074. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43983

[jira] [Assigned] (SPARK-46074) [CONNECT][SCALA] Insufficient details in error when a UDF fails

[ https://issues.apache.org/jira/browse/SPARK-46074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46074: Assignee: Niranjan Jayakar > [CONNECT][SCALA] Insufficient details in error when a UDF

[jira] [Commented] (SPARK-45311) Encoder fails on many "NoSuchElementException: None.get" since 3.4.x, search for an encoder for a generic type, and since 3.5.x isn't "an expression encoder"

[ https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17789867#comment-17789867 ] Giambattista Bloisi commented on SPARK-45311: - The issue arise while Encoders.bean is

[jira] [Updated] (SPARK-42655) Incorrect ambiguous column reference error

[ https://issues.apache.org/jira/browse/SPARK-42655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42655: --- Labels: pull-request-available (was: ) > Incorrect ambiguous column reference error >

[jira] [Resolved] (SPARK-45974) Add scan.filterAttributes non-empty judgment for RowLevelOperationRuntimeGroupFiltering

[ https://issues.apache.org/jira/browse/SPARK-45974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45974. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-45974) Add scan.filterAttributes non-empty judgment for RowLevelOperationRuntimeGroupFiltering

[ https://issues.apache.org/jira/browse/SPARK-45974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45974: --- Assignee: Zhen Wang > Add scan.filterAttributes non-empty judgment for >

[jira] [Updated] (SPARK-46106) If the hive table is a table, the outsourcing information will be displayed during ShowCreateTableCommand.

[ https://issues.apache.org/jira/browse/SPARK-46106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46106: --- Labels: pull-request-available (was: ) > If the hive table is a table, the outsourcing

[jira] [Created] (SPARK-46106) If the hive table is a table, the outsourcing information will be displayed during ShowCreateTableCommand.

guihuawen created SPARK-46106: - Summary: If the hive table is a table, the outsourcing information will be displayed during ShowCreateTableCommand. Key: SPARK-46106 URL:

[jira] [Updated] (SPARK-39769) Rename trait Unevaluable

[ https://issues.apache.org/jira/browse/SPARK-39769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-39769: --- Labels: pull-request-available (was: ) > Rename trait Unevaluable >

[jira] [Resolved] (SPARK-45826) Add a SQL config for extra stack traces in Origin

[ https://issues.apache.org/jira/browse/SPARK-45826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45826. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43695

[jira] [Updated] (SPARK-46101) Replace (string|array).size with (string|array).length in module SQL

[ https://issues.apache.org/jira/browse/SPARK-46101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46101: --- Labels: pull-request-available (was: ) > Replace (string|array).size with