[jira] [Resolved] (SPARK-47993) Drop Python 3.8 support

[ https://issues.apache.org/jira/browse/SPARK-47993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47993. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46228

[jira] [Updated] (SPARK-47993) Drop Python 3.8 support

[ https://issues.apache.org/jira/browse/SPARK-47993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47993: - Labels: release-notes (was: release-note) > Drop Python 3.8 support > ---

[jira] [Resolved] (SPARK-47962) Improve doc test in pyspark dataframe

[ https://issues.apache.org/jira/browse/SPARK-47962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47962. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46189

[jira] [Resolved] (SPARK-47965) Avoid orNull in TypedConfigBuilder and OptionalConfigEntry

[ https://issues.apache.org/jira/browse/SPARK-47965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47965. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46197

[jira] [Assigned] (SPARK-47965) Avoid orNull in TypedConfigBuilder and OptionalConfigEntry

[ https://issues.apache.org/jira/browse/SPARK-47965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47965: Assignee: Hyukjin Kwon > Avoid orNull in TypedConfigBuilder and OptionalConfigEntry >

[jira] [Resolved] (SPARK-47964) Hide SQLContext and HiveContext

[ https://issues.apache.org/jira/browse/SPARK-47964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47964. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46194

[jira] [Updated] (SPARK-47965) Avoid orNull in TypedConfigBuilder

[ https://issues.apache.org/jira/browse/SPARK-47965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47965: - Issue Type: Improvement (was: Bug) > Avoid orNull in TypedConfigBuilder >

[jira] [Updated] (SPARK-47965) Avoid orNull in TypedConfigBuilder and OptionalConfigEntry

[ https://issues.apache.org/jira/browse/SPARK-47965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47965: - Summary: Avoid orNull in TypedConfigBuilder and OptionalConfigEntry (was: Avoid orNull in

[jira] [Updated] (SPARK-47965) Avoid orNull in TypedConfigBuilder

[ https://issues.apache.org/jira/browse/SPARK-47965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47965: - Priority: Minor (was: Major) > Avoid orNull in TypedConfigBuilder >

[jira] [Created] (SPARK-47965) Avoid orNull in TypedConfigBuilder

Hyukjin Kwon created SPARK-47965: Summary: Avoid orNull in TypedConfigBuilder Key: SPARK-47965 URL: https://issues.apache.org/jira/browse/SPARK-47965 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-47933) Parent Column class for Spark Connect and Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-47933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47933: Assignee: Hyukjin Kwon > Parent Column class for Spark Connect and Spark Classic >

[jira] [Resolved] (SPARK-47933) Parent Column class for Spark Connect and Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-47933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47933. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46155

[jira] [Resolved] (SPARK-47903) Add remaining scalar types to the Python variant library

[ https://issues.apache.org/jira/browse/SPARK-47903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47903. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46122

[jira] [Assigned] (SPARK-47903) Add remaining scalar types to the Python variant library

[ https://issues.apache.org/jira/browse/SPARK-47903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47903: Assignee: Harsh Motwani > Add remaining scalar types to the Python variant library >

[jira] [Resolved] (SPARK-47890) Add python and scala dataframe variant expression aliases.

[ https://issues.apache.org/jira/browse/SPARK-47890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47890. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46123

[jira] [Created] (SPARK-47933) Parent Column class for Spark Connect and Spark Classic

Hyukjin Kwon created SPARK-47933: Summary: Parent Column class for Spark Connect and Spark Classic Key: SPARK-47933 URL: https://issues.apache.org/jira/browse/SPARK-47933 Project: Spark

[jira] [Commented] (SPARK-47909) Parent DataFrame class for Spark Connect and Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-47909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839436#comment-17839436 ] Hyukjin Kwon commented on SPARK-47909: -- Yes, I am working on it today :-). > Parent DataFrame

[jira] [Resolved] (SPARK-47909) Parent DataFrame class for Spark Connect and Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-47909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47909. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46129

[jira] [Assigned] (SPARK-47909) Parent DataFrame class for Spark Connect and Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-47909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47909: Assignee: Hyukjin Kwon > Parent DataFrame class for Spark Connect and Spark Classic >

[jira] [Created] (SPARK-47909) Parent DataFrame class for Spark Connect and Spark Classic

Hyukjin Kwon created SPARK-47909: Summary: Parent DataFrame class for Spark Connect and Spark Classic Key: SPARK-47909 URL: https://issues.apache.org/jira/browse/SPARK-47909 Project: Spark

[jira] [Assigned] (SPARK-47767) Show offset value in TakeOrderedAndProjectExec

[ https://issues.apache.org/jira/browse/SPARK-47767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47767: Assignee: guihuawen > Show offset value in TakeOrderedAndProjectExec >

[jira] [Resolved] (SPARK-47767) Show offset value in TakeOrderedAndProjectExec

[ https://issues.apache.org/jira/browse/SPARK-47767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47767. -- Resolution: Fixed Issue resolved by pull request 45931

[jira] [Assigned] (SPARK-47852) Support DataFrameQueryContext for reverse operations

[ https://issues.apache.org/jira/browse/SPARK-47852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47852: Assignee: Haejoon Lee > Support DataFrameQueryContext for reverse operations >

[jira] [Resolved] (SPARK-47858) Refactoring the structure for DataFrame error context

[ https://issues.apache.org/jira/browse/SPARK-47858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47858. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46063

[jira] [Resolved] (SPARK-47852) Support DataFrameQueryContext for reverse operations

[ https://issues.apache.org/jira/browse/SPARK-47852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47852. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46063

[jira] [Assigned] (SPARK-47858) Refactoring the structure for DataFrame error context

[ https://issues.apache.org/jira/browse/SPARK-47858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47858: Assignee: Haejoon Lee > Refactoring the structure for DataFrame error context >

[jira] [Resolved] (SPARK-47864) Enhance "Installation" page to cover all installable options

[ https://issues.apache.org/jira/browse/SPARK-47864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47864. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46096

[jira] [Assigned] (SPARK-47864) Enhance "Installation" page to cover all installable options

[ https://issues.apache.org/jira/browse/SPARK-47864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47864: Assignee: Haejoon Lee > Enhance "Installation" page to cover all installable options >

[jira] [Resolved] (SPARK-47891) Improve docstring of mapInPandas

[ https://issues.apache.org/jira/browse/SPARK-47891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47891. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46108

[jira] [Resolved] (SPARK-47830) Reeanble ResourceProfileTests for pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47830. -- Fix Version/s: 4.0.0 Assignee: Hyukjin Kwon Resolution: Fixed fixed in

[jira] [Resolved] (SPARK-47885) Make pyspark.resource compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47885. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46100

[jira] [Resolved] (SPARK-47540) SPIP: Pure Python Package (Spark Connect)

[ https://issues.apache.org/jira/browse/SPARK-47540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47540. -- Fix Version/s: 4.0.0 Assignee: Hyukjin Kwon Resolution: Done > SPIP: Pure

[jira] [Resolved] (SPARK-47884) Switch ANSI SQL CI job to NON-ANSI SQL CI job

[ https://issues.apache.org/jira/browse/SPARK-47884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47884. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46099

[jira] [Updated] (SPARK-47807) Make pyspark.ml compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47807: - Summary: Make pyspark.ml compatible with pyspark-connect (was: Make pyspark.ml compatible

[jira] [Created] (SPARK-47885) Make pyspark.resource compatible with pyspark-connect

Hyukjin Kwon created SPARK-47885: Summary: Make pyspark.resource compatible with pyspark-connect Key: SPARK-47885 URL: https://issues.apache.org/jira/browse/SPARK-47885 Project: Spark Issue

[jira] [Resolved] (SPARK-46375) Add documentation for Python data source API

[ https://issues.apache.org/jira/browse/SPARK-46375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46375. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46089

[jira] [Assigned] (SPARK-46375) Add documentation for Python data source API

[ https://issues.apache.org/jira/browse/SPARK-46375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46375: Assignee: Allison Wang > Add documentation for Python data source API >

[jira] [Resolved] (SPARK-47877) Speed up test_parity_listener

[ https://issues.apache.org/jira/browse/SPARK-47877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47877. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46072

[jira] [Resolved] (SPARK-47760) Reeanble Avro function doctests

[ https://issues.apache.org/jira/browse/SPARK-47760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47760. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46055

[jira] [Resolved] (SPARK-47763) Reeanble Protobuf function doctests

[ https://issues.apache.org/jira/browse/SPARK-47763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47763. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46055

[jira] [Assigned] (SPARK-47818) Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests

[ https://issues.apache.org/jira/browse/SPARK-47818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47818: Assignee: Xi Lyu > Introduce plan cache in SparkConnectPlanner to improve performance of

[jira] [Resolved] (SPARK-47818) Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests

[ https://issues.apache.org/jira/browse/SPARK-47818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47818. -- Resolution: Fixed Issue resolved by pull request 46012

[jira] [Resolved] (SPARK-47862) Connect generated proots can't be pickled

[ https://issues.apache.org/jira/browse/SPARK-47862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47862. -- Resolution: Fixed Issue resolved by pull request 46068

[jira] [Assigned] (SPARK-47862) Connect generated proots can't be pickled

[ https://issues.apache.org/jira/browse/SPARK-47862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47862: Assignee: Martin Grund > Connect generated proots can't be pickled >

[jira] [Assigned] (SPARK-47371) XML: Ignore row tags in CDATA Tokenizer

[ https://issues.apache.org/jira/browse/SPARK-47371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47371: Assignee: Yousof Hosny > XML: Ignore row tags in CDATA Tokenizer >

[jira] [Resolved] (SPARK-47371) XML: Ignore row tags in CDATA Tokenizer

[ https://issues.apache.org/jira/browse/SPARK-47371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47371. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45487

[jira] [Resolved] (SPARK-47866) Deflaky PythonForeachWriterSuite

[ https://issues.apache.org/jira/browse/SPARK-47866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47866. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46070

[jira] [Assigned] (SPARK-47866) Deflaky PythonForeachWriterSuite

[ https://issues.apache.org/jira/browse/SPARK-47866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47866: Assignee: Dongjoon Hyun > Deflaky PythonForeachWriterSuite >

[jira] [Resolved] (SPARK-47851) Document pyspark-connect package

[ https://issues.apache.org/jira/browse/SPARK-47851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47851. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46054

[jira] [Assigned] (SPARK-47851) Document pyspark-connect package

[ https://issues.apache.org/jira/browse/SPARK-47851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47851: Assignee: Hyukjin Kwon > Document pyspark-connect package >

[jira] [Created] (SPARK-47851) Document pyspark-connect package

Hyukjin Kwon created SPARK-47851: Summary: Document pyspark-connect package Key: SPARK-47851 URL: https://issues.apache.org/jira/browse/SPARK-47851 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47757) Reeanble MemoryProfilerParityTests for pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47757: - Summary: Reeanble MemoryProfilerParityTests for pyspark-connect (was: Reeanble

[jira] [Updated] (SPARK-47830) Reeanble ResourceProfileTests for pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47830: - Summary: Reeanble ResourceProfileTests for pyspark-connect (was: Reeanble

[jira] [Resolved] (SPARK-47849) Change release script to release pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47849. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46049

[jira] [Assigned] (SPARK-47849) Change release script to release pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47849: Assignee: Hyukjin Kwon > Change release script to release pyspark-connect >

[jira] [Resolved] (SPARK-47757) Reeanble ResourceProfileTests for pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47757. -- Fix Version/s: 4.0.0 Assignee: Hyukjin Kwon Resolution: Fixed Fixed in

[jira] [Resolved] (SPARK-47756) Reeanble UDFProfilerParityTests for pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47756. -- Fix Version/s: 4.0.0 Assignee: Hyukjin Kwon Resolution: Fixed Fixed in

[jira] [Created] (SPARK-47849) Change release script to release pyspark-connect

Hyukjin Kwon created SPARK-47849: Summary: Change release script to release pyspark-connect Key: SPARK-47849 URL: https://issues.apache.org/jira/browse/SPARK-47849 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47812) Support Serializing Spark Sessions in ForEachBAtch

[ https://issues.apache.org/jira/browse/SPARK-47812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47812. -- Resolution: Fixed Issue resolved by pull request 46002

[jira] [Assigned] (SPARK-47812) Support Serializing Spark Sessions in ForEachBAtch

[ https://issues.apache.org/jira/browse/SPARK-47812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47812: Assignee: Martin Grund > Support Serializing Spark Sessions in ForEachBAtch >

[jira] [Resolved] (SPARK-47831) Run Pandas API on Spark for pyspark-connect package

[ https://issues.apache.org/jira/browse/SPARK-47831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47831. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46001

[jira] [Created] (SPARK-47831) Run Pandas API on Spark for pyspark-connect package

Hyukjin Kwon created SPARK-47831: Summary: Run Pandas API on Spark for pyspark-connect package Key: SPARK-47831 URL: https://issues.apache.org/jira/browse/SPARK-47831 Project: Spark Issue

[jira] [Created] (SPARK-47830) Reeanble MemoryProfilerParityTests for pyspark-connect

Hyukjin Kwon created SPARK-47830: Summary: Reeanble MemoryProfilerParityTests for pyspark-connect Key: SPARK-47830 URL: https://issues.apache.org/jira/browse/SPARK-47830 Project: Spark Issue

[jira] [Resolved] (SPARK-47827) Missing warnings for deprecated features

[ https://issues.apache.org/jira/browse/SPARK-47827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47827. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46021

[jira] [Assigned] (SPARK-47827) Missing warnings for deprecated features

[ https://issues.apache.org/jira/browse/SPARK-47827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47827: Assignee: Haejoon Lee > Missing warnings for deprecated features >

[jira] [Resolved] (SPARK-47174) Client Side Listener - Server side implementation

[ https://issues.apache.org/jira/browse/SPARK-47174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47174. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45988

[jira] [Assigned] (SPARK-47174) Client Side Listener - Server side implementation

[ https://issues.apache.org/jira/browse/SPARK-47174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47174: Assignee: Wei Liu > Client Side Listener - Server side implementation >

[jira] [Resolved] (SPARK-47824) Nondeterminism in pyspark.pandas.series.asof

[ https://issues.apache.org/jira/browse/SPARK-47824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47824. -- Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution:

[jira] [Assigned] (SPARK-47824) Nondeterminism in pyspark.pandas.series.asof

[ https://issues.apache.org/jira/browse/SPARK-47824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47824: Assignee: Mark Jarvin > Nondeterminism in pyspark.pandas.series.asof >

[jira] [Assigned] (SPARK-47826) Add VariantVal for PySpark

[ https://issues.apache.org/jira/browse/SPARK-47826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47826: Assignee: Gene Pang > Add VariantVal for PySpark > -- > >

[jira] [Resolved] (SPARK-47826) Add VariantVal for PySpark

[ https://issues.apache.org/jira/browse/SPARK-47826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47826. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/45826 > Add VariantVal for

[jira] [Resolved] (SPARK-47811) Run ML tests for pyspark-connect package

[ https://issues.apache.org/jira/browse/SPARK-47811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47811. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45941

[jira] [Assigned] (SPARK-47811) Run ML tests for pyspark-connect package

[ https://issues.apache.org/jira/browse/SPARK-47811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47811: Assignee: Hyukjin Kwon > Run ML tests for pyspark-connect package >

[jira] [Created] (SPARK-47811) Run ML tests for pyspark-connect package

Hyukjin Kwon created SPARK-47811: Summary: Run ML tests for pyspark-connect package Key: SPARK-47811 URL: https://issues.apache.org/jira/browse/SPARK-47811 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47807) Make pyspark.ml compatible witbh pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47807. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45995

[jira] [Assigned] (SPARK-47704) JSON parsing fails with "java.lang.ClassCastException: org.apache.spark.sql.catalyst.util.ArrayBasedMapData cannot be cast to org.apache.spark.sql.catalyst.util.ArrayDa

[ https://issues.apache.org/jira/browse/SPARK-47704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47704: Assignee: Ivan Sadikov > JSON parsing fails with "java.lang.ClassCastException: >

[jira] [Resolved] (SPARK-47704) JSON parsing fails with "java.lang.ClassCastException: org.apache.spark.sql.catalyst.util.ArrayBasedMapData cannot be cast to org.apache.spark.sql.catalyst.util.ArrayDa

[ https://issues.apache.org/jira/browse/SPARK-47704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47704. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45833

[jira] [Resolved] (SPARK-41811) Implement SparkSession.sql's string formatter

[ https://issues.apache.org/jira/browse/SPARK-41811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41811. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45614

[jira] [Assigned] (SPARK-41811) Implement SparkSession.sql's string formatter

[ https://issues.apache.org/jira/browse/SPARK-41811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41811: Assignee: Ruifeng Zheng > Implement SparkSession.sql's string formatter >

[jira] [Created] (SPARK-47763) Reeanble Protobuf function doctests

Hyukjin Kwon created SPARK-47763: Summary: Reeanble Protobuf function doctests Key: SPARK-47763 URL: https://issues.apache.org/jira/browse/SPARK-47763 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47762) Add pyspark.sql.connect.protobuf into setup.py

[ https://issues.apache.org/jira/browse/SPARK-47762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47762. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45924

[jira] [Updated] (SPARK-47762) Add pyspark.sql.connect.protobuf into setup.py

[ https://issues.apache.org/jira/browse/SPARK-47762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47762: - Fix Version/s: 3.5.2 > Add pyspark.sql.connect.protobuf into setup.py >

[jira] [Created] (SPARK-47762) Add pyspark.sql.connect.protobuf into setup.py

Hyukjin Kwon created SPARK-47762: Summary: Add pyspark.sql.connect.protobuf into setup.py Key: SPARK-47762 URL: https://issues.apache.org/jira/browse/SPARK-47762 Project: Spark Issue Type:

[jira] [Created] (SPARK-47760) Reeanble Avro function doctests

Hyukjin Kwon created SPARK-47760: Summary: Reeanble Avro function doctests Key: SPARK-47760 URL: https://issues.apache.org/jira/browse/SPARK-47760 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47756) Reeanble UDFProfilerParityTests for pyspark-connect

Hyukjin Kwon created SPARK-47756: Summary: Reeanble UDFProfilerParityTests for pyspark-connect Key: SPARK-47756 URL: https://issues.apache.org/jira/browse/SPARK-47756 Project: Spark Issue

[jira] [Created] (SPARK-47757) Reeanble ResourceProfileTests for pyspark-connect

Hyukjin Kwon created SPARK-47757: Summary: Reeanble ResourceProfileTests for pyspark-connect Key: SPARK-47757 URL: https://issues.apache.org/jira/browse/SPARK-47757 Project: Spark Issue

[jira] [Resolved] (SPARK-47755) Pivot should fail when the number of distinct values is too large

[ https://issues.apache.org/jira/browse/SPARK-47755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47755. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45918

[jira] [Resolved] (SPARK-47752) Make pyspark.pandas compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47752. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45915

[jira] [Assigned] (SPARK-47753) Make pyspark.testing compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47753: Assignee: Hyukjin Kwon > Make pyspark.testing compatible with pyspark-connect >

[jira] [Resolved] (SPARK-47753) Make pyspark.testing compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47753. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45916

[jira] [Created] (SPARK-47753) Make pyspark.testing compatible with pyspark-connect

Hyukjin Kwon created SPARK-47753: Summary: Make pyspark.testing compatible with pyspark-connect Key: SPARK-47753 URL: https://issues.apache.org/jira/browse/SPARK-47753 Project: Spark Issue

[jira] [Created] (SPARK-47735) Make pyspark.testing.connectutils compatible with pyspark-connect

Hyukjin Kwon created SPARK-47735: Summary: Make pyspark.testing.connectutils compatible with pyspark-connect Key: SPARK-47735 URL: https://issues.apache.org/jira/browse/SPARK-47735 Project: Spark

[jira] [Resolved] (SPARK-47734) Fix flaky pyspark.sql.dataframe.DataFrame.writeStream doctest by stopping streaming query

[ https://issues.apache.org/jira/browse/SPARK-47734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47734. -- Fix Version/s: 4.0.0 3.5.2 Resolution: Fixed Fixed in

[jira] [Resolved] (SPARK-47565) PySpark workers dying in daemon mode idle queue fail query

[ https://issues.apache.org/jira/browse/SPARK-47565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47565. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45635

[jira] [Assigned] (SPARK-47565) PySpark workers dying in daemon mode idle queue fail query

[ https://issues.apache.org/jira/browse/SPARK-47565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47565: Assignee: Nikita Awasthi > PySpark workers dying in daemon mode idle queue fail query >

[jira] [Created] (SPARK-47727) Make SparkConf to root level to for both SparkSession and SparkContext

Hyukjin Kwon created SPARK-47727: Summary: Make SparkConf to root level to for both SparkSession and SparkContext Key: SPARK-47727 URL: https://issues.apache.org/jira/browse/SPARK-47727 Project:

[jira] [Created] (SPARK-47725) Set up the CI for pyspark-connect package

Hyukjin Kwon created SPARK-47725: Summary: Set up the CI for pyspark-connect package Key: SPARK-47725 URL: https://issues.apache.org/jira/browse/SPARK-47725 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47724) Add an environment variable for testing remote pure Python library

[ https://issues.apache.org/jira/browse/SPARK-47724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47724. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45868

[jira] [Assigned] (SPARK-47724) Add an environment variable for testing remote pure Python library

[ https://issues.apache.org/jira/browse/SPARK-47724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47724: Assignee: Hyukjin Kwon > Add an environment variable for testing remote pure Python

[jira] [Created] (SPARK-47724) Add an environment variable for testing remote pure Python library

Hyukjin Kwon created SPARK-47724: Summary: Add an environment variable for testing remote pure Python library Key: SPARK-47724 URL: https://issues.apache.org/jira/browse/SPARK-47724 Project: Spark

  1   2   3   4   5   6   7   8   9   10   >