[jira] [Updated] (SPARK-45917) Statically register Python Data Source

[ https://issues.apache.org/jira/browse/SPARK-45917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45917: - Summary: Statically register Python Data Source (was: Statically register Data Source) >

[jira] [Created] (SPARK-45917) Statically register Data Source

Hyukjin Kwon created SPARK-45917: Summary: Statically register Data Source Key: SPARK-45917 URL: https://issues.apache.org/jira/browse/SPARK-45917 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-45916) Investigate runtime registration and feasibility of overwriting the datasource

Hyukjin Kwon created SPARK-45916: Summary: Investigate runtime registration and feasibility of overwriting the datasource Key: SPARK-45916 URL: https://issues.apache.org/jira/browse/SPARK-45916

[jira] [Assigned] (SPARK-45783) Improve exception message when no remote url is set

[ https://issues.apache.org/jira/browse/SPARK-45783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45783: Assignee: Allison Wang > Improve exception message when no remote url is set >

[jira] [Resolved] (SPARK-45783) Improve exception message when no remote url is set

[ https://issues.apache.org/jira/browse/SPARK-45783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45783. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43653

[jira] [Assigned] (SPARK-45859) Make UDF objects in ml.functions lazy

[ https://issues.apache.org/jira/browse/SPARK-45859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45859: Assignee: Ruifeng Zheng > Make UDF objects in ml.functions lazy >

[jira] [Resolved] (SPARK-45859) Make UDF objects in ml.functions lazy

[ https://issues.apache.org/jira/browse/SPARK-45859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45859. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43739

[jira] [Resolved] (SPARK-45733) (Python) Support different retry policies for connect client

[ https://issues.apache.org/jira/browse/SPARK-45733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45733. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43591

[jira] [Assigned] (SPARK-45733) (Python) Support different retry policies for connect client

[ https://issues.apache.org/jira/browse/SPARK-45733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45733: Assignee: Alice Sayutina > (Python) Support different retry policies for connect client

[jira] [Resolved] (SPARK-45899) Set errorClass in errorInfoToThrowable

[ https://issues.apache.org/jira/browse/SPARK-45899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45899. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43772

[jira] [Assigned] (SPARK-45899) Set errorClass in errorInfoToThrowable

[ https://issues.apache.org/jira/browse/SPARK-45899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45899: Assignee: Yihong He > Set errorClass in errorInfoToThrowable >

[jira] [Assigned] (SPARK-45837) Report underlying error in scala client

[ https://issues.apache.org/jira/browse/SPARK-45837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45837: Assignee: Alice Sayutina > Report underlying error in scala client >

[jira] [Resolved] (SPARK-45837) Report underlying error in scala client

[ https://issues.apache.org/jira/browse/SPARK-45837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45837. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43719

[jira] [Resolved] (SPARK-45852) Gracefully deal with recursion exception during Spark Connect logging

[ https://issues.apache.org/jira/browse/SPARK-45852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45852. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43732

[jira] [Assigned] (SPARK-45798) Assert server-side session ID in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-45798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45798: Assignee: Martin Grund > Assert server-side session ID in Spark Connect >

[jira] [Resolved] (SPARK-45798) Assert server-side session ID in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-45798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45798. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43664

[jira] [Resolved] (SPARK-45639) Support loading Python data sources in DataFrameReader

[ https://issues.apache.org/jira/browse/SPARK-45639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45639. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43630

[jira] [Assigned] (SPARK-45639) Support loading Python data sources in DataFrameReader

[ https://issues.apache.org/jira/browse/SPARK-45639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45639: Assignee: Allison Wang > Support loading Python data sources in DataFrameReader >

[jira] [Assigned] (SPARK-45555) Returning a debuggable object for failed assertion

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-4: Assignee: Haejoon Lee > Returning a debuggable object for failed assertion >

[jira] [Resolved] (SPARK-45555) Returning a debuggable object for failed assertion

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-4. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43444

[jira] [Resolved] (SPARK-45223) Refine docstring of `Column.when`

[ https://issues.apache.org/jira/browse/SPARK-45223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45223. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43688

[jira] [Assigned] (SPARK-45223) Refine docstring of `Column.when`

[ https://issues.apache.org/jira/browse/SPARK-45223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45223: Assignee: Hyukjin Kwon > Refine docstring of `Column.when` >

[jira] [Resolved] (SPARK-45808) Improve error details for Spark Connect Client in Python

[ https://issues.apache.org/jira/browse/SPARK-45808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45808. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43667

[jira] [Assigned] (SPARK-45808) Improve error details for Spark Connect Client in Python

[ https://issues.apache.org/jira/browse/SPARK-45808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45808: Assignee: Martin Grund > Improve error details for Spark Connect Client in Python >

[jira] [Resolved] (SPARK-45186) XML: Refine docstring of schema_of_xml

[ https://issues.apache.org/jira/browse/SPARK-45186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45186. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43681

[jira] [Assigned] (SPARK-45186) XML: Refine docstring of schema_of_xml

[ https://issues.apache.org/jira/browse/SPARK-45186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45186: Assignee: Hyukjin Kwon > XML: Refine docstring of schema_of_xml >

[jira] [Assigned] (SPARK-45811) XML: Refine docstring of from_xml

[ https://issues.apache.org/jira/browse/SPARK-45811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45811: Assignee: Hyukjin Kwon > XML: Refine docstring of from_xml >

[jira] [Resolved] (SPARK-45811) XML: Refine docstring of from_xml

[ https://issues.apache.org/jira/browse/SPARK-45811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45811. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43680

[jira] [Assigned] (SPARK-45222) Refine docstring of `DataFrameReader.json`

[ https://issues.apache.org/jira/browse/SPARK-45222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45222: Assignee: Hyukjin Kwon > Refine docstring of `DataFrameReader.json` >

[jira] [Resolved] (SPARK-45809) Refine docstring of `lit`

[ https://issues.apache.org/jira/browse/SPARK-45809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45809. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43679

[jira] [Assigned] (SPARK-45809) Refine docstring of `lit`

[ https://issues.apache.org/jira/browse/SPARK-45809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45809: Assignee: Hyukjin Kwon > Refine docstring of `lit` > - > >

[jira] [Resolved] (SPARK-45222) Refine docstring of `DataFrameReader.json`

[ https://issues.apache.org/jira/browse/SPARK-45222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45222. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43687

[jira] [Assigned] (SPARK-45260) Refine docstring of count_distinct

[ https://issues.apache.org/jira/browse/SPARK-45260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45260: Assignee: Allison Wang > Refine docstring of count_distinct >

[jira] [Resolved] (SPARK-45260) Refine docstring of count_distinct

[ https://issues.apache.org/jira/browse/SPARK-45260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45260. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43686

[jira] [Resolved] (SPARK-45259) Refine docstring of `count`

[ https://issues.apache.org/jira/browse/SPARK-45259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45259. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43685

[jira] [Assigned] (SPARK-45259) Refine docstring of `count`

[ https://issues.apache.org/jira/browse/SPARK-45259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45259: Assignee: Hyukjin Kwon > Refine docstring of `count` > --- > >

[jira] [Resolved] (SPARK-45258) Refine docstring of `sum`

[ https://issues.apache.org/jira/browse/SPARK-45258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45258. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43684

[jira] [Assigned] (SPARK-45258) Refine docstring of `sum`

[ https://issues.apache.org/jira/browse/SPARK-45258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45258: Assignee: Hyukjin Kwon > Refine docstring of `sum` > - > >

[jira] [Updated] (SPARK-44728) Improve PySpark documentations

[ https://issues.apache.org/jira/browse/SPARK-44728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-44728: - Fix Version/s: (was: 4.0.0) > Improve PySpark documentations >

[jira] [Updated] (SPARK-45186) XML: Refine docstring of schema_of_xml

[ https://issues.apache.org/jira/browse/SPARK-45186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45186: - Summary: XML: Refine docstring of schema_of_xml (was: XML: Refine docstring of from_xml,

[jira] [Created] (SPARK-45811) XML: Refine docstring of from_xml

Hyukjin Kwon created SPARK-45811: Summary: XML: Refine docstring of from_xml Key: SPARK-45811 URL: https://issues.apache.org/jira/browse/SPARK-45811 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-45809) Refine docstring of `lit`

Hyukjin Kwon created SPARK-45809: Summary: Refine docstring of `lit` Key: SPARK-45809 URL: https://issues.apache.org/jira/browse/SPARK-45809 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-45773) Refine docstring of `SparkSession.builder.config`

[ https://issues.apache.org/jira/browse/SPARK-45773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45773: Assignee: Allison Wang > Refine docstring of `SparkSession.builder.config` >

[jira] [Resolved] (SPARK-45773) Refine docstring of `SparkSession.builder.config`

[ https://issues.apache.org/jira/browse/SPARK-45773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45773. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43639

[jira] [Assigned] (SPARK-45780) Propagate all Spark Connect client threadlocal in InheritableThread

[ https://issues.apache.org/jira/browse/SPARK-45780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45780: Assignee: Juliusz Sompolski > Propagate all Spark Connect client threadlocal in

[jira] [Resolved] (SPARK-45780) Propagate all Spark Connect client threadlocal in InheritableThread

[ https://issues.apache.org/jira/browse/SPARK-45780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45780. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43649

[jira] [Resolved] (SPARK-45768) Make faulthandler a runtime configuration for Python execution in SQL

[ https://issues.apache.org/jira/browse/SPARK-45768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45768. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43635

[jira] [Assigned] (SPARK-45768) Make faulthandler a runtime configuration for Python execution in SQL

[ https://issues.apache.org/jira/browse/SPARK-45768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45768: Assignee: Hyukjin Kwon > Make faulthandler a runtime configuration for Python execution

[jira] [Updated] (SPARK-45768) Make faulthandler a runtime configuration for Python execution in SQL

[ https://issues.apache.org/jira/browse/SPARK-45768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45768: - Summary: Make faulthandler a runtime configuration for Python execution in SQL (was: Make

[jira] [Created] (SPARK-45768) Make faulthanlder a runtime configuration for Python execution in SQL

Hyukjin Kwon created SPARK-45768: Summary: Make faulthanlder a runtime configuration for Python execution in SQL Key: SPARK-45768 URL: https://issues.apache.org/jira/browse/SPARK-45768 Project: Spark

[jira] [Resolved] (SPARK-45761) Upgrade `Volcano` to 1.8.1

[ https://issues.apache.org/jira/browse/SPARK-45761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45761. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43624

[jira] [Assigned] (SPARK-45680) ReleaseSession to close Spark Connect session

[ https://issues.apache.org/jira/browse/SPARK-45680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45680: Assignee: Juliusz Sompolski > ReleaseSession to close Spark Connect session >

[jira] [Resolved] (SPARK-45680) ReleaseSession to close Spark Connect session

[ https://issues.apache.org/jira/browse/SPARK-45680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45680. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43546

[jira] [Resolved] (SPARK-45654) Add Python data source write API

[ https://issues.apache.org/jira/browse/SPARK-45654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45654. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43516

[jira] [Assigned] (SPARK-45654) Add Python data source write API

[ https://issues.apache.org/jira/browse/SPARK-45654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45654: Assignee: Allison Wang > Add Python data source write API >

[jira] [Assigned] (SPARK-45739) Catch IOException instead of EOFException alone for faulthandler

[ https://issues.apache.org/jira/browse/SPARK-45739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45739: Assignee: Hyukjin Kwon > Catch IOException instead of EOFException alone for

[jira] [Resolved] (SPARK-45739) Catch IOException instead of EOFException alone for faulthandler

[ https://issues.apache.org/jira/browse/SPARK-45739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45739. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43600

[jira] [Resolved] (SPARK-45732) Upgrade commons-text to 1.11.0

[ https://issues.apache.org/jira/browse/SPARK-45732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45732. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43590

[jira] [Assigned] (SPARK-45732) Upgrade commons-text to 1.11.0

[ https://issues.apache.org/jira/browse/SPARK-45732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45732: Assignee: BingKun Pan > Upgrade commons-text to 1.11.0 > --

[jira] [Created] (SPARK-45739) Catch IOException instead of EOFException alone for faulthandler

Hyukjin Kwon created SPARK-45739: Summary: Catch IOException instead of EOFException alone for faulthandler Key: SPARK-45739 URL: https://issues.apache.org/jira/browse/SPARK-45739 Project: Spark

[jira] [Assigned] (SPARK-45735) Reenable CatalogTests without Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-45735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45735: Assignee: Hyukjin Kwon > Reenable CatalogTests without Spark Connect >

[jira] [Resolved] (SPARK-45735) Reenable CatalogTests without Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-45735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45735. -- Fix Version/s: 3.5.1 4.0.0 3.4.2 Resolution:

[jira] [Created] (SPARK-45735) Reenable CatalogTests without Spark Connect

Hyukjin Kwon created SPARK-45735: Summary: Reenable CatalogTests without Spark Connect Key: SPARK-45735 URL: https://issues.apache.org/jira/browse/SPARK-45735 Project: Spark Issue Type: New

[jira] [Resolved] (SPARK-45729) Fix PySpark testing guide links

[ https://issues.apache.org/jira/browse/SPARK-45729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45729. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43587

[jira] [Assigned] (SPARK-45729) Fix PySpark testing guide links

[ https://issues.apache.org/jira/browse/SPARK-45729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45729: Assignee: Amanda Liu > Fix PySpark testing guide links > ---

[jira] [Resolved] (SPARK-45245) PythonWorkerFactory create gets stuck in case of worker failures

[ https://issues.apache.org/jira/browse/SPARK-45245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45245. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43023

[jira] [Assigned] (SPARK-45245) PythonWorkerFactory create gets stuck in case of worker failures

[ https://issues.apache.org/jira/browse/SPARK-45245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45245: Assignee: Raghu Angadi > PythonWorkerFactory create gets stuck in case of worker

[jira] [Assigned] (SPARK-45506) Support ivy URIs in SparkConnect addArtifact

[ https://issues.apache.org/jira/browse/SPARK-45506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45506: Assignee: Vsevolod Stepanov > Support ivy URIs in SparkConnect addArtifact >

[jira] [Resolved] (SPARK-45506) Support ivy URIs in SparkConnect addArtifact

[ https://issues.apache.org/jira/browse/SPARK-45506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45506. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43354

[jira] [Assigned] (SPARK-45723) Catalog methods avoid pandas conversion

[ https://issues.apache.org/jira/browse/SPARK-45723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45723: Assignee: Ruifeng Zheng > Catalog methods avoid pandas conversion >

[jira] [Resolved] (SPARK-45723) Catalog methods avoid pandas conversion

[ https://issues.apache.org/jira/browse/SPARK-45723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45723. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43583

[jira] [Resolved] (SPARK-44790) XML: to_xml

[ https://issues.apache.org/jira/browse/SPARK-44790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44790. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43503

[jira] [Assigned] (SPARK-44790) XML: to_xml

[ https://issues.apache.org/jira/browse/SPARK-44790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44790: Assignee: Sandip Agarwala > XML: to_xml > --- > > Key:

[jira] [Resolved] (SPARK-45554) Introduce flexible parameter to assertSchemaEqual

[ https://issues.apache.org/jira/browse/SPARK-45554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45554. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43450

[jira] [Assigned] (SPARK-45552) Introduce flexible parameters to assertDataFrameEqual

[ https://issues.apache.org/jira/browse/SPARK-45552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45552: Assignee: Haejoon Lee > Introduce flexible parameters to assertDataFrameEqual >

[jira] [Resolved] (SPARK-45552) Introduce flexible parameters to assertDataFrameEqual

[ https://issues.apache.org/jira/browse/SPARK-45552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45552. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43433

[jira] [Resolved] (SPARK-45674) Improve error message for JVM-dependent attributes on Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-45674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45674. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43537

[jira] [Resolved] (SPARK-45706) Makes entire Binder build fails fast during setting up

[ https://issues.apache.org/jira/browse/SPARK-45706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45706. -- Fix Version/s: 4.0.0 3.5.1 Assignee: Hyukjin Kwon

[jira] [Created] (SPARK-45706) Makes entire Binder build fails fast during setting up

Hyukjin Kwon created SPARK-45706: Summary: Makes entire Binder build fails fast during setting up Key: SPARK-45706 URL: https://issues.apache.org/jira/browse/SPARK-45706 Project: Spark Issue

[jira] [Assigned] (SPARK-40820) Creating StructType from Json

[ https://issues.apache.org/jira/browse/SPARK-40820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40820: Assignee: Anthony Wainer Cachay Guivin > Creating StructType from Json >

[jira] [Resolved] (SPARK-40820) Creating StructType from Json

[ https://issues.apache.org/jira/browse/SPARK-40820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40820. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43474

[jira] [Updated] (SPARK-45670) SparkSubmit does not support --total-executor-cores when deploying on K8s

[ https://issues.apache.org/jira/browse/SPARK-45670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45670: - Fix Version/s: 3.4.2 3.5.1 > SparkSubmit does not support

[jira] [Resolved] (SPARK-45670) SparkSubmit does not support --total-executor-cores when deploying on K8s

[ https://issues.apache.org/jira/browse/SPARK-45670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45670. -- Fix Version/s: 3.3.4 Resolution: Fixed Issue resolved by pull request 43548

[jira] [Assigned] (SPARK-45670) SparkSubmit does not support --total-executor-cores when deploying on K8s

[ https://issues.apache.org/jira/browse/SPARK-45670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45670: Assignee: Cheng Pan > SparkSubmit does not support --total-executor-cores when deploying

[jira] [Resolved] (SPARK-45679) Add clusterBy in DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-45679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45679. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43544

[jira] [Assigned] (SPARK-45679) Add clusterBy in DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-45679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45679: Assignee: Zhen Li > Add clusterBy in DataFrame API > -- > >

[jira] [Reopened] (SPARK-45651) Snapshots of some packages are not published any more

[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-45651: -- Reverted in https://github.com/apache/spark/commit/df0262f29969fe40f53dee070a150f2bfe98484c >

[jira] [Resolved] (SPARK-45651) Snapshots of some packages are not published any more

[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45651. -- Fix Version/s: (was: 4.0.0) Assignee: (was: Enrico Minack) Resolution:

[jira] [Comment Edited] (SPARK-45651) Snapshots of some packages are not published any more

[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780127#comment-17780127 ] Hyukjin Kwon edited comment on SPARK-45651 at 10/27/23 12:48 AM: -

[jira] [Reopened] (SPARK-45651) Snapshots of some packages are not published any more

[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-45651: -- > Snapshots of some packages are not published any more >

[jira] [Assigned] (SPARK-45635) Cleanup unused import for PySpark testing

[ https://issues.apache.org/jira/browse/SPARK-45635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45635: Assignee: Haejoon Lee > Cleanup unused import for PySpark testing >

[jira] [Resolved] (SPARK-45635) Cleanup unused import for PySpark testing

[ https://issues.apache.org/jira/browse/SPARK-45635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45635. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43489

[jira] [Resolved] (SPARK-45634) Remove `get_dtype_counts` from Pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-45634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45634. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43488

[jira] [Assigned] (SPARK-45634) Remove `get_dtype_counts` from Pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-45634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45634: Assignee: Haejoon Lee > Remove `get_dtype_counts` from Pandas API on Spark >

[jira] [Assigned] (SPARK-45661) Add toNullable in StructType, MapType and ArrayType

[ https://issues.apache.org/jira/browse/SPARK-45661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45661: Assignee: Hyukjin Kwon > Add toNullable in StructType, MapType and ArrayType >

[jira] [Resolved] (SPARK-45661) Add toNullable in StructType, MapType and ArrayType

[ https://issues.apache.org/jira/browse/SPARK-45661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45661. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43523

[jira] [Assigned] (SPARK-45656) Fix observation when named observations with the same name on different datasets.

[ https://issues.apache.org/jira/browse/SPARK-45656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45656: Assignee: Takuya Ueshin > Fix observation when named observations with the same name on

[jira] [Resolved] (SPARK-45656) Fix observation when named observations with the same name on different datasets.

[ https://issues.apache.org/jira/browse/SPARK-45656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45656. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43519

[jira] [Commented] (SPARK-45662) Pyspark union method throw 'pyspark.sql.utils.IllegalArgumentException: requirement failed'

[ https://issues.apache.org/jira/browse/SPARK-45662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779397#comment-17779397 ] Hyukjin Kwon commented on SPARK-45662: -- Can you provide a reproducer please > Pyspark union

[jira] [Updated] (SPARK-45640) Fix flaky ProtobufCatalystDataConversionSuite

[ https://issues.apache.org/jira/browse/SPARK-45640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45640: - Fix Version/s: 3.4.2 3.5.1 > Fix flaky ProtobufCatalystDataConversionSuite >

<    5   6   7   8   9   10   11   12   13   14   >