[jira] [Assigned] (SPARK-47824) Nondeterminism in pyspark.pandas.series.asof

[ https://issues.apache.org/jira/browse/SPARK-47824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47824: Assignee: Mark Jarvin > Nondeterminism in pyspark.pandas.series.asof >

[jira] [Assigned] (SPARK-47826) Add VariantVal for PySpark

[ https://issues.apache.org/jira/browse/SPARK-47826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47826: Assignee: Gene Pang > Add VariantVal for PySpark > -- > >

[jira] [Resolved] (SPARK-47826) Add VariantVal for PySpark

[ https://issues.apache.org/jira/browse/SPARK-47826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47826. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/45826 > Add VariantVal for

[jira] [Resolved] (SPARK-47811) Run ML tests for pyspark-connect package

[ https://issues.apache.org/jira/browse/SPARK-47811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47811. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45941

[jira] [Assigned] (SPARK-47811) Run ML tests for pyspark-connect package

[ https://issues.apache.org/jira/browse/SPARK-47811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47811: Assignee: Hyukjin Kwon > Run ML tests for pyspark-connect package >

[jira] [Created] (SPARK-47811) Run ML tests for pyspark-connect package

Hyukjin Kwon created SPARK-47811: Summary: Run ML tests for pyspark-connect package Key: SPARK-47811 URL: https://issues.apache.org/jira/browse/SPARK-47811 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47807) Make pyspark.ml compatible witbh pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47807. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45995

[jira] [Assigned] (SPARK-47704) JSON parsing fails with "java.lang.ClassCastException: org.apache.spark.sql.catalyst.util.ArrayBasedMapData cannot be cast to org.apache.spark.sql.catalyst.util.ArrayDa

[ https://issues.apache.org/jira/browse/SPARK-47704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47704: Assignee: Ivan Sadikov > JSON parsing fails with "java.lang.ClassCastException: >

[jira] [Resolved] (SPARK-47704) JSON parsing fails with "java.lang.ClassCastException: org.apache.spark.sql.catalyst.util.ArrayBasedMapData cannot be cast to org.apache.spark.sql.catalyst.util.ArrayDa

[ https://issues.apache.org/jira/browse/SPARK-47704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47704. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45833

[jira] [Resolved] (SPARK-41811) Implement SparkSession.sql's string formatter

[ https://issues.apache.org/jira/browse/SPARK-41811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41811. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45614

[jira] [Assigned] (SPARK-41811) Implement SparkSession.sql's string formatter

[ https://issues.apache.org/jira/browse/SPARK-41811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41811: Assignee: Ruifeng Zheng > Implement SparkSession.sql's string formatter >

[jira] [Created] (SPARK-47763) Reeanble Protobuf function doctests

Hyukjin Kwon created SPARK-47763: Summary: Reeanble Protobuf function doctests Key: SPARK-47763 URL: https://issues.apache.org/jira/browse/SPARK-47763 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47762) Add pyspark.sql.connect.protobuf into setup.py

[ https://issues.apache.org/jira/browse/SPARK-47762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47762. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45924

[jira] [Updated] (SPARK-47762) Add pyspark.sql.connect.protobuf into setup.py

[ https://issues.apache.org/jira/browse/SPARK-47762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47762: - Fix Version/s: 3.5.2 > Add pyspark.sql.connect.protobuf into setup.py >

[jira] [Created] (SPARK-47762) Add pyspark.sql.connect.protobuf into setup.py

Hyukjin Kwon created SPARK-47762: Summary: Add pyspark.sql.connect.protobuf into setup.py Key: SPARK-47762 URL: https://issues.apache.org/jira/browse/SPARK-47762 Project: Spark Issue Type:

[jira] [Created] (SPARK-47760) Reeanble Avro function doctests

Hyukjin Kwon created SPARK-47760: Summary: Reeanble Avro function doctests Key: SPARK-47760 URL: https://issues.apache.org/jira/browse/SPARK-47760 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47756) Reeanble UDFProfilerParityTests for pyspark-connect

Hyukjin Kwon created SPARK-47756: Summary: Reeanble UDFProfilerParityTests for pyspark-connect Key: SPARK-47756 URL: https://issues.apache.org/jira/browse/SPARK-47756 Project: Spark Issue

[jira] [Created] (SPARK-47757) Reeanble ResourceProfileTests for pyspark-connect

Hyukjin Kwon created SPARK-47757: Summary: Reeanble ResourceProfileTests for pyspark-connect Key: SPARK-47757 URL: https://issues.apache.org/jira/browse/SPARK-47757 Project: Spark Issue

[jira] [Resolved] (SPARK-47755) Pivot should fail when the number of distinct values is too large

[ https://issues.apache.org/jira/browse/SPARK-47755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47755. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45918

[jira] [Resolved] (SPARK-47752) Make pyspark.pandas compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47752. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45915

[jira] [Assigned] (SPARK-47753) Make pyspark.testing compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47753: Assignee: Hyukjin Kwon > Make pyspark.testing compatible with pyspark-connect >

[jira] [Resolved] (SPARK-47753) Make pyspark.testing compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47753. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45916

[jira] [Created] (SPARK-47753) Make pyspark.testing compatible with pyspark-connect

Hyukjin Kwon created SPARK-47753: Summary: Make pyspark.testing compatible with pyspark-connect Key: SPARK-47753 URL: https://issues.apache.org/jira/browse/SPARK-47753 Project: Spark Issue

[jira] [Created] (SPARK-47735) Make pyspark.testing.connectutils compatible with pyspark-connect

Hyukjin Kwon created SPARK-47735: Summary: Make pyspark.testing.connectutils compatible with pyspark-connect Key: SPARK-47735 URL: https://issues.apache.org/jira/browse/SPARK-47735 Project: Spark

[jira] [Resolved] (SPARK-47734) Fix flaky pyspark.sql.dataframe.DataFrame.writeStream doctest by stopping streaming query

[ https://issues.apache.org/jira/browse/SPARK-47734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47734. -- Fix Version/s: 4.0.0 3.5.2 Resolution: Fixed Fixed in

[jira] [Resolved] (SPARK-47565) PySpark workers dying in daemon mode idle queue fail query

[ https://issues.apache.org/jira/browse/SPARK-47565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47565. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45635

[jira] [Assigned] (SPARK-47565) PySpark workers dying in daemon mode idle queue fail query

[ https://issues.apache.org/jira/browse/SPARK-47565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47565: Assignee: Nikita Awasthi > PySpark workers dying in daemon mode idle queue fail query >

[jira] [Created] (SPARK-47727) Make SparkConf to root level to for both SparkSession and SparkContext

Hyukjin Kwon created SPARK-47727: Summary: Make SparkConf to root level to for both SparkSession and SparkContext Key: SPARK-47727 URL: https://issues.apache.org/jira/browse/SPARK-47727 Project:

[jira] [Created] (SPARK-47725) Set up the CI for pyspark-connect package

Hyukjin Kwon created SPARK-47725: Summary: Set up the CI for pyspark-connect package Key: SPARK-47725 URL: https://issues.apache.org/jira/browse/SPARK-47725 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47724) Add an environment variable for testing remote pure Python library

[ https://issues.apache.org/jira/browse/SPARK-47724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47724. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45868

[jira] [Assigned] (SPARK-47724) Add an environment variable for testing remote pure Python library

[ https://issues.apache.org/jira/browse/SPARK-47724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47724: Assignee: Hyukjin Kwon > Add an environment variable for testing remote pure Python

[jira] [Created] (SPARK-47724) Add an environment variable for testing remote pure Python library

Hyukjin Kwon created SPARK-47724: Summary: Add an environment variable for testing remote pure Python library Key: SPARK-47724 URL: https://issues.apache.org/jira/browse/SPARK-47724 Project: Spark

[jira] [Resolved] (SPARK-47683) Separate pure Python packaging

[ https://issues.apache.org/jira/browse/SPARK-47683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47683. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45053

[jira] [Assigned] (SPARK-47683) Separate pure Python packaging

[ https://issues.apache.org/jira/browse/SPARK-47683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47683: Assignee: Hyukjin Kwon > Separate pure Python packaging > --

[jira] [Resolved] (SPARK-47708) Do not log the gRPC exception to stderr in PySpark

[ https://issues.apache.org/jira/browse/SPARK-47708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47708. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45840

[jira] [Resolved] (SPARK-47721) Guidelines for the Structured Logging Framework

[ https://issues.apache.org/jira/browse/SPARK-47721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47721. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45862

[jira] [Assigned] (SPARK-47722) Wait until RocksDB background work finish before closing

[ https://issues.apache.org/jira/browse/SPARK-47722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47722: Assignee: Wei Liu > Wait until RocksDB background work finish before closing >

[jira] [Resolved] (SPARK-47722) Wait until RocksDB background work finish before closing

[ https://issues.apache.org/jira/browse/SPARK-47722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47722. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45863

[jira] [Assigned] (SPARK-47700) Fix formatting of error messages with treeNode

[ https://issues.apache.org/jira/browse/SPARK-47700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47700: Assignee: Jack Chen > Fix formatting of error messages with treeNode >

[jira] [Resolved] (SPARK-47700) Fix formatting of error messages with treeNode

[ https://issues.apache.org/jira/browse/SPARK-47700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47700. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45825

[jira] [Created] (SPARK-47683) Separate pure Python packaging

Hyukjin Kwon created SPARK-47683: Summary: Separate pure Python packaging Key: SPARK-47683 URL: https://issues.apache.org/jira/browse/SPARK-47683 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47643) Add pyspark test for python streaming data source

[ https://issues.apache.org/jira/browse/SPARK-47643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47643. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45768

[jira] [Assigned] (SPARK-47664) Validate the column name with cached schema

[ https://issues.apache.org/jira/browse/SPARK-47664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47664: Assignee: Ruifeng Zheng > Validate the column name with cached schema >

[jira] [Resolved] (SPARK-47664) Validate the column name with cached schema

[ https://issues.apache.org/jira/browse/SPARK-47664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47664. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45788

[jira] [Updated] (SPARK-47540) SPIP: Pure Python Package (Spark Connect)

[ https://issues.apache.org/jira/browse/SPARK-47540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47540: - Description: *Q1. What are you trying to do? Articulate your objectives using absolutely no

[jira] [Updated] (SPARK-47540) SPIP: Pure Python Package (Spark Connect)

[ https://issues.apache.org/jira/browse/SPARK-47540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47540: - Description: *Q1. What are you trying to do? Articulate your objectives using absolutely no

[jira] [Updated] (SPARK-47646) try_to_number fails with NPE for malformed input

[ https://issues.apache.org/jira/browse/SPARK-47646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47646: - Fix Version/s: 3.4.3 > try_to_number fails with NPE for malformed input >

[jira] [Assigned] (SPARK-47646) try_to_number fails with NPE for malformed input

[ https://issues.apache.org/jira/browse/SPARK-47646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47646: Assignee: Hyukjin Kwon > try_to_number fails with NPE for malformed input >

[jira] [Resolved] (SPARK-47646) try_to_number fails with NPE for malformed input

[ https://issues.apache.org/jira/browse/SPARK-47646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47646. -- Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-47644) Refine docstrings of try_*

[ https://issues.apache.org/jira/browse/SPARK-47644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47644: Assignee: Hyukjin Kwon > Refine docstrings of try_* > -- > >

[jira] [Resolved] (SPARK-47644) Refine docstrings of try_*

[ https://issues.apache.org/jira/browse/SPARK-47644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47644. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45769

[jira] [Created] (SPARK-47646) try_to_number fails with NPE for malformed input

Hyukjin Kwon created SPARK-47646: Summary: try_to_number fails with NPE for malformed input Key: SPARK-47646 URL: https://issues.apache.org/jira/browse/SPARK-47646 Project: Spark Issue Type:

[jira] [Created] (SPARK-47644) Improve docstrings of try_*

Hyukjin Kwon created SPARK-47644: Summary: Improve docstrings of try_* Key: SPARK-47644 URL: https://issues.apache.org/jira/browse/SPARK-47644 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47644) Refine docstrings of try_*

[ https://issues.apache.org/jira/browse/SPARK-47644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47644: - Summary: Refine docstrings of try_* (was: Improve docstrings of try_*) > Refine docstrings of

[jira] [Resolved] (SPARK-47623) Use `QuietTest` in parity tests

[ https://issues.apache.org/jira/browse/SPARK-47623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47623. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45747

[jira] [Resolved] (SPARK-47631) Remove unused `SQLConf.parquetOutputCommitterClass` method

[ https://issues.apache.org/jira/browse/SPARK-47631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47631. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45757

[jira] [Assigned] (SPARK-47631) Remove unused `SQLConf.parquetOutputCommitterClass` method

[ https://issues.apache.org/jira/browse/SPARK-47631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47631: Assignee: Dongjoon Hyun > Remove unused `SQLConf.parquetOutputCommitterClass` method >

[jira] [Created] (SPARK-47621) Refine docstring of `try_sum`, `try_avg`, `avg`, `sum`, `mean`

Hyukjin Kwon created SPARK-47621: Summary: Refine docstring of `try_sum`, `try_avg`, `avg`, `sum`, `mean` Key: SPARK-47621 URL: https://issues.apache.org/jira/browse/SPARK-47621 Project: Spark

[jira] [Resolved] (SPARK-47619) Refine docstring of `to_json/from_json`

[ https://issues.apache.org/jira/browse/SPARK-47619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47619. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45742

[jira] [Created] (SPARK-47619) Refine docstring of `to_json/from_json`

Hyukjin Kwon created SPARK-47619: Summary: Refine docstring of `to_json/from_json` Key: SPARK-47619 URL: https://issues.apache.org/jira/browse/SPARK-47619 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47543) Inferring `dict` as `MapType` from Pandas DataFrame to allow DataFrame creation.

[ https://issues.apache.org/jira/browse/SPARK-47543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47543. -- Assignee: Haejoon Lee Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-47543) Inferring `dict` as `MapType` from Pandas DataFrame to allow DataFrame creation.

[ https://issues.apache.org/jira/browse/SPARK-47543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47543: - Fix Version/s: 4.0.0 > Inferring `dict` as `MapType` from Pandas DataFrame to allow DataFrame

[jira] [Assigned] (SPARK-47367) Support Python data source API with Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-47367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47367: Assignee: Allison Wang > Support Python data source API with Spark Connect >

[jira] [Resolved] (SPARK-47367) Support Python data source API with Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-47367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47367. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45486

[jira] [Resolved] (SPARK-47450) Use R 4.3.3 in `windows` R GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-47450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47450. -- Fix Version/s: 4.0.0 Assignee: Dongjoon Hyun Resolution: Fixed Reverted the

[jira] [Updated] (SPARK-47450) Use R 4.3.3 in `windows` R GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-47450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47450: - Fix Version/s: (was: 4.0.0) > Use R 4.3.3 in `windows` R GitHub Action job >

[jira] [Resolved] (SPARK-47554) Upgrade `sbt-assembly` to `2.2.0` and `sbt-protoc` to `1.0.7`

[ https://issues.apache.org/jira/browse/SPARK-47554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47554. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45696

[jira] [Assigned] (SPARK-47549) Remove Spark 3.0~3.2 pyspark/version.py workaround from release scripts

[ https://issues.apache.org/jira/browse/SPARK-47549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47549: Assignee: Dongjoon Hyun > Remove Spark 3.0~3.2 pyspark/version.py workaround from

[jira] [Resolved] (SPARK-47549) Remove Spark 3.0~3.2 pyspark/version.py workaround from release scripts

[ https://issues.apache.org/jira/browse/SPARK-47549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47549. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45706

[jira] [Assigned] (SPARK-47539) Make the return value of method `castToString` be `Any => UTF8String`

[ https://issues.apache.org/jira/browse/SPARK-47539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47539: Assignee: BingKun Pan > Make the return value of method `castToString` be `Any =>

[jira] [Resolved] (SPARK-47539) Make the return value of method `castToString` be `Any => UTF8String`

[ https://issues.apache.org/jira/browse/SPARK-47539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47539. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45688

[jira] [Created] (SPARK-47540) SPIP: Pure Python Package (Spark Connect)

Hyukjin Kwon created SPARK-47540: Summary: SPIP: Pure Python Package (Spark Connect) Key: SPARK-47540 URL: https://issues.apache.org/jira/browse/SPARK-47540 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`

[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47516: Assignee: BingKun Pan > Move `remove unused installation package logic` from `each test

[jira] [Resolved] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`

[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47516. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45659

[jira] [Assigned] (SPARK-44708) Migrate test_reset_index assert_eq to use assertDataFrameEqual

[ https://issues.apache.org/jira/browse/SPARK-44708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44708: Assignee: Amanda Liu > Migrate test_reset_index assert_eq to use assertDataFrameEqual >

[jira] [Resolved] (SPARK-44708) Migrate test_reset_index assert_eq to use assertDataFrameEqual

[ https://issues.apache.org/jira/browse/SPARK-44708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44708. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45629

[jira] [Assigned] (SPARK-47500) Factor column name handling out of `plan.py`

[ https://issues.apache.org/jira/browse/SPARK-47500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47500: Assignee: Ruifeng Zheng > Factor column name handling out of `plan.py` >

[jira] [Resolved] (SPARK-47500) Factor column name handling out of `plan.py`

[ https://issues.apache.org/jira/browse/SPARK-47500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47500. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45636

[jira] [Resolved] (SPARK-47478) Improve test coverage for mysql bool synonyms

[ https://issues.apache.org/jira/browse/SPARK-47478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47478. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45604

[jira] [Assigned] (SPARK-47478) Improve test coverage for mysql bool synonyms

[ https://issues.apache.org/jira/browse/SPARK-47478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47478: Assignee: Kent Yao > Improve test coverage for mysql bool synonyms >

[jira] [Resolved] (SPARK-47480) Enable doctest for `createDataFrame`

[ https://issues.apache.org/jira/browse/SPARK-47480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47480. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45606

[jira] [Resolved] (SPARK-41625) Feature parity: Streaming support

[ https://issues.apache.org/jira/browse/SPARK-41625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41625. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45603

[jira] [Resolved] (SPARK-47330) XML: Add XmlExpressionsSuite

[ https://issues.apache.org/jira/browse/SPARK-47330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47330. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45445

[jira] [Assigned] (SPARK-47330) XML: Add XmlExpressionsSuite

[ https://issues.apache.org/jira/browse/SPARK-47330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47330: Assignee: Yousof Hosny > XML: Add XmlExpressionsSuite > - >

[jira] [Resolved] (SPARK-47454) Split `pyspark.sql.tests.test_dataframe`

[ https://issues.apache.org/jira/browse/SPARK-47454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47454. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45580

[jira] [Assigned] (SPARK-47437) Correct the error class for `DataFrame.sort`

[ https://issues.apache.org/jira/browse/SPARK-47437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47437: Assignee: Ruifeng Zheng > Correct the error class for `DataFrame.sort` >

[jira] [Resolved] (SPARK-47437) Correct the error class for `DataFrame.sort`

[ https://issues.apache.org/jira/browse/SPARK-47437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47437. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45559

[jira] [Resolved] (SPARK-43435) re-enable doctest `pyspark.sql.connect.dataframe.DataFrame.writeStream`

[ https://issues.apache.org/jira/browse/SPARK-43435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43435. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45560

[jira] [Resolved] (SPARK-47439) Document Python Data Source API in API reference page

[ https://issues.apache.org/jira/browse/SPARK-47439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47439. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45561

[jira] [Assigned] (SPARK-47439) Document Python Data Source API in API reference page

[ https://issues.apache.org/jira/browse/SPARK-47439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47439: Assignee: Hyukjin Kwon > Document Python Data Source API in API reference page >

[jira] [Updated] (SPARK-47439) Document Python Data Source API in API reference page

[ https://issues.apache.org/jira/browse/SPARK-47439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47439: - Summary: Document Python Data Source API in API reference page (was: Document Python Data

[jira] [Created] (SPARK-47439) Document Python Data Source API

Hyukjin Kwon created SPARK-47439: Summary: Document Python Data Source API Key: SPARK-47439 URL: https://issues.apache.org/jira/browse/SPARK-47439 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47436) Fix docstring links and type hints in Python Data Source

Hyukjin Kwon created SPARK-47436: Summary: Fix docstring links and type hints in Python Data Source Key: SPARK-47436 URL: https://issues.apache.org/jira/browse/SPARK-47436 Project: Spark

[jira] [Resolved] (SPARK-47374) Fix connect-repl `usage prompt` & `docs link`

[ https://issues.apache.org/jira/browse/SPARK-47374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47374. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45494

[jira] [Assigned] (SPARK-47374) Fix connect-repl `usage prompt` & `docs link`

[ https://issues.apache.org/jira/browse/SPARK-47374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47374: Assignee: BingKun Pan > Fix connect-repl `usage prompt` & `docs link` >

[jira] [Assigned] (SPARK-47377) Factor out tests from `SparkConnectSQLTestCase`

[ https://issues.apache.org/jira/browse/SPARK-47377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47377: Assignee: Ruifeng Zheng > Factor out tests from `SparkConnectSQLTestCase` >

[jira] [Resolved] (SPARK-47377) Factor out tests from `SparkConnectSQLTestCase`

[ https://issues.apache.org/jira/browse/SPARK-47377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47377. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45497

[jira] [Assigned] (SPARK-46761) quoted strings in a JSON path should support ? characters

[ https://issues.apache.org/jira/browse/SPARK-46761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46761: Assignee: Robert Joseph Evans > quoted strings in a JSON path should support ?

[jira] [Resolved] (SPARK-46761) quoted strings in a JSON path should support ? characters

[ https://issues.apache.org/jira/browse/SPARK-46761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46761. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45420

[jira] [Resolved] (SPARK-47348) Align the version of the ubuntu host machine where the GitHub workflow runs on

[ https://issues.apache.org/jira/browse/SPARK-47348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47348. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45416

<    1   2   3   4   5   6   7   8   9   10   >