[jira] [Resolved] (SPARK-45680) ReleaseSession to close Spark Connect session

2023-11-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45680. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43546

[jira] [Resolved] (SPARK-45654) Add Python data source write API

2023-10-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45654. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43516

[jira] [Assigned] (SPARK-45654) Add Python data source write API

2023-10-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45654: Assignee: Allison Wang > Add Python data source write API >

[jira] [Assigned] (SPARK-45739) Catch IOException instead of EOFException alone for faulthandler

2023-10-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45739: Assignee: Hyukjin Kwon > Catch IOException instead of EOFException alone for

[jira] [Resolved] (SPARK-45739) Catch IOException instead of EOFException alone for faulthandler

2023-10-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45739. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43600

[jira] [Resolved] (SPARK-45732) Upgrade commons-text to 1.11.0

2023-10-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45732. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43590

[jira] [Assigned] (SPARK-45732) Upgrade commons-text to 1.11.0

2023-10-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45732: Assignee: BingKun Pan > Upgrade commons-text to 1.11.0 > --

[jira] [Created] (SPARK-45739) Catch IOException instead of EOFException alone for faulthandler

2023-10-31 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45739: Summary: Catch IOException instead of EOFException alone for faulthandler Key: SPARK-45739 URL: https://issues.apache.org/jira/browse/SPARK-45739 Project: Spark

[jira] [Assigned] (SPARK-45735) Reenable CatalogTests without Spark Connect

2023-10-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45735: Assignee: Hyukjin Kwon > Reenable CatalogTests without Spark Connect >

[jira] [Resolved] (SPARK-45735) Reenable CatalogTests without Spark Connect

2023-10-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45735. -- Fix Version/s: 3.5.1 4.0.0 3.4.2 Resolution:

[jira] [Created] (SPARK-45735) Reenable CatalogTests without Spark Connect

2023-10-30 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45735: Summary: Reenable CatalogTests without Spark Connect Key: SPARK-45735 URL: https://issues.apache.org/jira/browse/SPARK-45735 Project: Spark Issue Type: New

[jira] [Resolved] (SPARK-45729) Fix PySpark testing guide links

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45729. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43587

[jira] [Assigned] (SPARK-45729) Fix PySpark testing guide links

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45729: Assignee: Amanda Liu > Fix PySpark testing guide links > ---

[jira] [Resolved] (SPARK-45245) PythonWorkerFactory create gets stuck in case of worker failures

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45245. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43023

[jira] [Assigned] (SPARK-45245) PythonWorkerFactory create gets stuck in case of worker failures

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45245: Assignee: Raghu Angadi > PythonWorkerFactory create gets stuck in case of worker

[jira] [Assigned] (SPARK-45506) Support ivy URIs in SparkConnect addArtifact

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45506: Assignee: Vsevolod Stepanov > Support ivy URIs in SparkConnect addArtifact >

[jira] [Resolved] (SPARK-45506) Support ivy URIs in SparkConnect addArtifact

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45506. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43354

[jira] [Assigned] (SPARK-45723) Catalog methods avoid pandas conversion

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45723: Assignee: Ruifeng Zheng > Catalog methods avoid pandas conversion >

[jira] [Resolved] (SPARK-45723) Catalog methods avoid pandas conversion

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45723. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43583

[jira] [Resolved] (SPARK-44790) XML: to_xml

2023-10-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44790. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43503

[jira] [Assigned] (SPARK-44790) XML: to_xml

2023-10-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44790: Assignee: Sandip Agarwala > XML: to_xml > --- > > Key:

[jira] [Resolved] (SPARK-45554) Introduce flexible parameter to assertSchemaEqual

2023-10-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45554. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43450

[jira] [Assigned] (SPARK-45552) Introduce flexible parameters to assertDataFrameEqual

2023-10-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45552: Assignee: Haejoon Lee > Introduce flexible parameters to assertDataFrameEqual >

[jira] [Resolved] (SPARK-45552) Introduce flexible parameters to assertDataFrameEqual

2023-10-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45552. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43433

[jira] [Resolved] (SPARK-45674) Improve error message for JVM-dependent attributes on Spark Connect.

2023-10-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45674. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43537

[jira] [Resolved] (SPARK-45706) Makes entire Binder build fails fast during setting up

2023-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45706. -- Fix Version/s: 4.0.0 3.5.1 Assignee: Hyukjin Kwon

[jira] [Created] (SPARK-45706) Makes entire Binder build fails fast during setting up

2023-10-27 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45706: Summary: Makes entire Binder build fails fast during setting up Key: SPARK-45706 URL: https://issues.apache.org/jira/browse/SPARK-45706 Project: Spark Issue

[jira] [Assigned] (SPARK-40820) Creating StructType from Json

2023-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40820: Assignee: Anthony Wainer Cachay Guivin > Creating StructType from Json >

[jira] [Resolved] (SPARK-40820) Creating StructType from Json

2023-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40820. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43474

[jira] [Updated] (SPARK-45670) SparkSubmit does not support --total-executor-cores when deploying on K8s

2023-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45670: - Fix Version/s: 3.4.2 3.5.1 > SparkSubmit does not support

[jira] [Resolved] (SPARK-45670) SparkSubmit does not support --total-executor-cores when deploying on K8s

2023-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45670. -- Fix Version/s: 3.3.4 Resolution: Fixed Issue resolved by pull request 43548

[jira] [Assigned] (SPARK-45670) SparkSubmit does not support --total-executor-cores when deploying on K8s

2023-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45670: Assignee: Cheng Pan > SparkSubmit does not support --total-executor-cores when deploying

[jira] [Resolved] (SPARK-45679) Add clusterBy in DataFrame API

2023-10-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45679. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43544

[jira] [Assigned] (SPARK-45679) Add clusterBy in DataFrame API

2023-10-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45679: Assignee: Zhen Li > Add clusterBy in DataFrame API > -- > >

[jira] [Reopened] (SPARK-45651) Snapshots of some packages are not published any more

2023-10-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-45651: -- Reverted in https://github.com/apache/spark/commit/df0262f29969fe40f53dee070a150f2bfe98484c >

[jira] [Resolved] (SPARK-45651) Snapshots of some packages are not published any more

2023-10-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45651. -- Fix Version/s: (was: 4.0.0) Assignee: (was: Enrico Minack) Resolution:

[jira] [Comment Edited] (SPARK-45651) Snapshots of some packages are not published any more

2023-10-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780127#comment-17780127 ] Hyukjin Kwon edited comment on SPARK-45651 at 10/27/23 12:48 AM: -

[jira] [Reopened] (SPARK-45651) Snapshots of some packages are not published any more

2023-10-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-45651: -- > Snapshots of some packages are not published any more >

[jira] [Assigned] (SPARK-45635) Cleanup unused import for PySpark testing

2023-10-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45635: Assignee: Haejoon Lee > Cleanup unused import for PySpark testing >

[jira] [Resolved] (SPARK-45635) Cleanup unused import for PySpark testing

2023-10-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45635. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43489

[jira] [Resolved] (SPARK-45634) Remove `get_dtype_counts` from Pandas API on Spark

2023-10-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45634. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43488

[jira] [Assigned] (SPARK-45634) Remove `get_dtype_counts` from Pandas API on Spark

2023-10-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45634: Assignee: Haejoon Lee > Remove `get_dtype_counts` from Pandas API on Spark >

[jira] [Assigned] (SPARK-45661) Add toNullable in StructType, MapType and ArrayType

2023-10-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45661: Assignee: Hyukjin Kwon > Add toNullable in StructType, MapType and ArrayType >

[jira] [Resolved] (SPARK-45661) Add toNullable in StructType, MapType and ArrayType

2023-10-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45661. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43523

[jira] [Assigned] (SPARK-45656) Fix observation when named observations with the same name on different datasets.

2023-10-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45656: Assignee: Takuya Ueshin > Fix observation when named observations with the same name on

[jira] [Resolved] (SPARK-45656) Fix observation when named observations with the same name on different datasets.

2023-10-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45656. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43519

[jira] [Commented] (SPARK-45662) Pyspark union method throw 'pyspark.sql.utils.IllegalArgumentException: requirement failed'

2023-10-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779397#comment-17779397 ] Hyukjin Kwon commented on SPARK-45662: -- Can you provide a reproducer please > Pyspark union

[jira] [Updated] (SPARK-45640) Fix flaky ProtobufCatalystDataConversionSuite

2023-10-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45640: - Fix Version/s: 3.4.2 3.5.1 > Fix flaky ProtobufCatalystDataConversionSuite >

[jira] [Updated] (SPARK-45588) Minor scaladoc improvement in StreamingForeachBatchHelper

2023-10-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45588: - Fix Version/s: 3.4.2 3.5.1 > Minor scaladoc improvement in

[jira] [Created] (SPARK-45661) Add toNullable in StructType, MapType and ArrayType

2023-10-25 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45661: Summary: Add toNullable in StructType, MapType and ArrayType Key: SPARK-45661 URL: https://issues.apache.org/jira/browse/SPARK-45661 Project: Spark Issue

[jira] [Assigned] (SPARK-45648) Add sql/api and common/utils to modules.py

2023-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45648: Assignee: Ruifeng Zheng > Add sql/api and common/utils to modules.py >

[jira] [Resolved] (SPARK-45648) Add sql/api and common/utils to modules.py

2023-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45648. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43501

[jira] [Resolved] (SPARK-45622) java -target should use java.version instead of 17

2023-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45622. -- Resolution: Invalid > java -target should use java.version instead of 17 >

[jira] [Assigned] (SPARK-45651) Snapshots of some packages are not published any more

2023-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45651: Assignee: Enrico Minack > Snapshots of some packages are not published any more >

[jira] [Resolved] (SPARK-45651) Snapshots of some packages are not published any more

2023-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45651. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43512

[jira] [Assigned] (SPARK-45640) Fix flaky ProtobufCatalystDataConversionSuite

2023-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45640: Assignee: BingKun Pan > Fix flaky ProtobufCatalystDataConversionSuite >

[jira] [Resolved] (SPARK-45640) Fix flaky ProtobufCatalystDataConversionSuite

2023-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45640. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43493

[jira] [Resolved] (SPARK-44752) XML: Update Spark Docs

2023-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44752. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43350

[jira] [Assigned] (SPARK-44752) XML: Update Spark Docs

2023-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44752: Assignee: tangjiafu > XML: Update Spark Docs > -- > >

[jira] [Assigned] (SPARK-45619) Apply the observed metrics to Observation object.

2023-10-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45619: Assignee: Takuya Ueshin > Apply the observed metrics to Observation object. >

[jira] [Resolved] (SPARK-45619) Apply the observed metrics to Observation object.

2023-10-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45619. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43469

[jira] [Assigned] (SPARK-45633) Make SQL test group depend on `analyze_udtf`

2023-10-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45633: Assignee: Ruifeng Zheng > Make SQL test group depend on `analyze_udtf` >

[jira] [Resolved] (SPARK-45633) Make SQL test group depend on `analyze_udtf`

2023-10-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45633. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43486

[jira] [Resolved] (SPARK-45628) improve vector_to_array for .mllib.linalg.SparseVector

2023-10-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45628. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43480

[jira] [Assigned] (SPARK-45628) improve vector_to_array for .mllib.linalg.SparseVector

2023-10-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45628: Assignee: Ruifeng Zheng > improve vector_to_array for .mllib.linalg.SparseVector >

[jira] [Assigned] (SPARK-45620) Fix user-facing APIs related to Python UDTF to use camelCase.

2023-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45620: Assignee: Takuya Ueshin > Fix user-facing APIs related to Python UDTF to use camelCase.

[jira] [Resolved] (SPARK-45620) Fix user-facing APIs related to Python UDTF to use camelCase.

2023-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45620. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43470

[jira] [Resolved] (SPARK-44753) XML: Add Python and sparkR binding including Spark Connect

2023-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44753. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43462

[jira] [Assigned] (SPARK-44753) XML: Add Python and sparkR binding including Spark Connect

2023-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44753: Assignee: Sandip Agarwala > XML: Add Python and sparkR binding including Spark Connect >

[jira] [Assigned] (SPARK-45624) Use `AccessibleObject#canAccess` instead of `AccessibleObject#isAccessible`

2023-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45624: Assignee: Yang Jie > Use `AccessibleObject#canAccess` instead of

[jira] [Resolved] (SPARK-45624) Use `AccessibleObject#canAccess` instead of `AccessibleObject#isAccessible`

2023-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45624. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43477

[jira] [Resolved] (SPARK-45609) Include SqlState in SparkThrowable proto message

2023-10-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45609. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43457

[jira] [Assigned] (SPARK-45609) Include SqlState in SparkThrowable proto message

2023-10-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45609: Assignee: Yihong He > Include SqlState in SparkThrowable proto message >

[jira] [Resolved] (SPARK-45613) Expose DeterministicLevel as a DeveloperApi

2023-10-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45613. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43461

[jira] [Assigned] (SPARK-45613) Expose DeterministicLevel as a DeveloperApi

2023-10-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45613: Assignee: Mridul Muralidharan > Expose DeterministicLevel as a DeveloperApi >

[jira] [Resolved] (SPARK-45611) spark.python.pyspark.sql.functions Typo at date_format Function

2023-10-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45611. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43442

[jira] [Assigned] (SPARK-45611) spark.python.pyspark.sql.functions Typo at date_format Function

2023-10-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45611: Assignee: Mete Can Akar > spark.python.pyspark.sql.functions Typo at date_format

[jira] [Resolved] (SPARK-45428) Add Matomo analytics to all released docs pages

2023-10-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45428. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43454

[jira] [Resolved] (SPARK-45220) Refine docstring of `DataFrame.join`

2023-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45220. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43039

[jira] [Assigned] (SPARK-45220) Refine docstring of `DataFrame.join`

2023-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45220: Assignee: Allison Wang > Refine docstring of `DataFrame.join` >

[jira] [Resolved] (SPARK-45589) Supplementary exception class

2023-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45589. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43427

[jira] [Assigned] (SPARK-45589) Supplementary exception class

2023-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45589: Assignee: BingKun Pan > Supplementary exception class > - >

[jira] [Assigned] (SPARK-45553) Deprecate assertPandasOnSparkEqual

2023-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45553: Assignee: Haejoon Lee > Deprecate assertPandasOnSparkEqual >

[jira] [Resolved] (SPARK-45553) Deprecate assertPandasOnSparkEqual

2023-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45553. -- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-45546) Make publish-snapshot support package first then deploy

2023-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45546: - Fix Version/s: (was: 4.0.0) > Make publish-snapshot support package first then deploy >

[jira] [Resolved] (SPARK-45546) Make publish-snapshot support package first then deploy

2023-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45546. -- Resolution: Invalid > Make publish-snapshot support package first then deploy >

[jira] [Assigned] (SPARK-45546) Make publish-snapshot support package first then deploy

2023-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45546: Assignee: (was: Yang Jie) > Make publish-snapshot support package first then deploy

[jira] [Reopened] (SPARK-45546) Make publish-snapshot support package first then deploy

2023-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-45546: -- Reverted at https://github.com/apache/spark/commit/706872d4de2374d1faf84d8706611a092c0b6e76 and

[jira] [Resolved] (SPARK-45370) Fix python test when ansi mode enabled

2023-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45370. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43168

[jira] [Assigned] (SPARK-45370) Fix python test when ansi mode enabled

2023-10-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45370: Assignee: BingKun Pan > Fix python test when ansi mode enabled >

[jira] [Assigned] (SPARK-45566) Introduce Pandas-like testing utils for Pandas API on Spark

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45566: Assignee: Haejoon Lee > Introduce Pandas-like testing utils for Pandas API on Spark >

[jira] [Resolved] (SPARK-45566) Introduce Pandas-like testing utils for Pandas API on Spark

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45566. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43398

[jira] [Assigned] (SPARK-45572) Enable doctest of Frame.transpose

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45572: Assignee: Ruifeng Zheng > Enable doctest of Frame.transpose >

[jira] [Resolved] (SPARK-45572) Enable doctest of Frame.transpose

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45572. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43399

[jira] [Resolved] (SPARK-45562) XML: Make 'rowTag' a required option

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45562. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43389

[jira] [Assigned] (SPARK-45562) XML: Make 'rowTag' a required option

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45562: Assignee: Sandip Agarwala > XML: Make 'rowTag' a required option >

[jira] [Assigned] (SPARK-45567) Remove redundant if in org.apache.spark.sql.connect.execution.ExecuteGrpcResponseSender#run

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45567: Assignee: Min Zhao > Remove redundant if in >

[jira] [Resolved] (SPARK-45567) Remove redundant if in org.apache.spark.sql.connect.execution.ExecuteGrpcResponseSender#run

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45567. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43395

[jira] [Assigned] (SPARK-45517) Expand more exception constructors to support error framework parameters

2023-10-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45517: Assignee: Yihong He > Expand more exception constructors to support error framework

[jira] [Resolved] (SPARK-45517) Expand more exception constructors to support error framework parameters

2023-10-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45517. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43368

<    7   8   9   10   11   12   13   14   15   16   >