[jira] [Commented] (SPARK-43106) Data lost from the table if the INSERT OVERWRITE query fails

[ https://issues.apache.org/jira/browse/SPARK-43106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717882#comment-17717882 ] kalyan s commented on SPARK-43106: -- Thank you for the response [~dongjoon] . Most of the workloads

[jira] [Commented] (SPARK-43237) Handle null exception message in event log

[ https://issues.apache.org/jira/browse/SPARK-43237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717875#comment-17717875 ] Snoot.io commented on SPARK-43237: -- User 'warrenzhu25' has created a pull request for this issue:

[jira] [Resolved] (SPARK-43237) Handle null exception message in event log

[ https://issues.apache.org/jira/browse/SPARK-43237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-43237. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-43237) Handle null exception message in event log

[ https://issues.apache.org/jira/browse/SPARK-43237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-43237: --- Assignee: Zhongwei Zhu > Handle null exception message in event log >

[jira] [Resolved] (SPARK-43270) Implement __dir__() in pyspark.sql.dataframe.DataFrame to include columns

[ https://issues.apache.org/jira/browse/SPARK-43270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43270. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40907

[jira] [Assigned] (SPARK-43270) Implement __dir__() in pyspark.sql.dataframe.DataFrame to include columns

[ https://issues.apache.org/jira/browse/SPARK-43270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43270: Assignee: Beishao Cao > Implement __dir__() in pyspark.sql.dataframe.DataFrame to

[jira] [Resolved] (SPARK-42940) Session management support streaming connect

[ https://issues.apache.org/jira/browse/SPARK-42940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42940. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40937

[jira] [Assigned] (SPARK-42940) Session management support streaming connect

[ https://issues.apache.org/jira/browse/SPARK-42940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42940: Assignee: Raghu Angadi > Session management support streaming connect >

[jira] [Created] (SPARK-43324) DataSource V2: Handle UPDATE commands for delta-based sources

Anton Okolnychyi created SPARK-43324: Summary: DataSource V2: Handle UPDATE commands for delta-based sources Key: SPARK-43324 URL: https://issues.apache.org/jira/browse/SPARK-43324 Project: Spark

[jira] [Created] (SPARK-43323) DataFrame.toPandas with Arrow enabled should handle exceptions properly

Takuya Ueshin created SPARK-43323: - Summary: DataFrame.toPandas with Arrow enabled should handle exceptions properly Key: SPARK-43323 URL: https://issues.apache.org/jira/browse/SPARK-43323 Project:

[jira] [Commented] (SPARK-43106) Data lost from the table if the INSERT OVERWRITE query fails

[ https://issues.apache.org/jira/browse/SPARK-43106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717855#comment-17717855 ] Dongjoon Hyun commented on SPARK-43106: --- Thank you for reporting. To narrow down your issue more,

[jira] [Updated] (SPARK-43322) Spark SQL docs for explode_outer and posexplode_outer omit behavior for null/empty

[ https://issues.apache.org/jira/browse/SPARK-43322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Juchnicki updated SPARK-43322: - Issue Type: Documentation (was: Improvement) > Spark SQL docs for explode_outer and

[jira] [Created] (SPARK-43322) Spark SQL docs for explode_outer and posexplode_outer omit behavior for null/empty

Robert Juchnicki created SPARK-43322: Summary: Spark SQL docs for explode_outer and posexplode_outer omit behavior for null/empty Key: SPARK-43322 URL: https://issues.apache.org/jira/browse/SPARK-43322

[jira] [Created] (SPARK-43321) Impl Dataset#JoinWith

Zhen Li created SPARK-43321: --- Summary: Impl Dataset#JoinWith Key: SPARK-43321 URL: https://issues.apache.org/jira/browse/SPARK-43321 Project: Spark Issue Type: Improvement Components:

[jira] [Created] (SPARK-43320) Directly call Hive 2.3.9 API

Cheng Pan created SPARK-43320: - Summary: Directly call Hive 2.3.9 API Key: SPARK-43320 URL: https://issues.apache.org/jira/browse/SPARK-43320 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-43319) Remove usage of deprecated DefaultKubernetesClient

Cheng Pan created SPARK-43319: - Summary: Remove usage of deprecated DefaultKubernetesClient Key: SPARK-43319 URL: https://issues.apache.org/jira/browse/SPARK-43319 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-43263) Upgrade FasterXML jackson to 2.15.0

[ https://issues.apache.org/jira/browse/SPARK-43263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-43263. -- Fix Version/s: 3.5.0 Assignee: Bjørn Jørgensen Resolution: Fixed Resolved by

[jira] [Created] (SPARK-43318) spark reader csv and json support wholetext parameters

melin created SPARK-43318: - Summary: spark reader csv and json support wholetext parameters Key: SPARK-43318 URL: https://issues.apache.org/jira/browse/SPARK-43318 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-43170) The spark sql like statement is pushed down to parquet for execution, but the data cannot be queried

[ https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717611#comment-17717611 ] Steve Loughran commented on SPARK-43170: FWIW, using S3 URLs

[jira] [Commented] (SPARK-43235) ClientDistributedCacheManager doesn't set the LocalResourceVisibility.PRIVATE if isPublic throws exception

[ https://issues.apache.org/jira/browse/SPARK-43235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717566#comment-17717566 ] Pralabh Kumar commented on SPARK-43235: --- [~gurwls223] Can u please look into this .  >

[jira] [Commented] (SPARK-43306) Migrate `ValueError` from Spark SQL types into error class

[ https://issues.apache.org/jira/browse/SPARK-43306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717565#comment-17717565 ] ASF GitHub Bot commented on SPARK-43306: User 'itholic' has created a pull request for this

[jira] [Commented] (SPARK-43304) Enable test_to_latex by supporting jinja2>=3.0.0

[ https://issues.apache.org/jira/browse/SPARK-43304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717564#comment-17717564 ] ASF GitHub Bot commented on SPARK-43304: User 'itholic' has created a pull request for this

[jira] [Commented] (SPARK-43304) Enable test_to_latex by supporting jinja2>=3.0.0

[ https://issues.apache.org/jira/browse/SPARK-43304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717563#comment-17717563 ] ASF GitHub Bot commented on SPARK-43304: User 'itholic' has created a pull request for this

[jira] [Commented] (SPARK-42843) Assign a name to the error class _LEGACY_ERROR_TEMP_2007

[ https://issues.apache.org/jira/browse/SPARK-42843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717555#comment-17717555 ] ASF GitHub Bot commented on SPARK-42843: User 'liang3zy22' has created a pull request for this

[jira] [Created] (SPARK-43317) Support combine adjacent aggregation

XiDuo You created SPARK-43317: - Summary: Support combine adjacent aggregation Key: SPARK-43317 URL: https://issues.apache.org/jira/browse/SPARK-43317 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-43316) Add more CTE SQL tests

Runyao.Chen created SPARK-43316: --- Summary: Add more CTE SQL tests Key: SPARK-43316 URL: https://issues.apache.org/jira/browse/SPARK-43316 Project: Spark Issue Type: Test Components: