[jira] [Resolved] (SPARK-46027) Add `Python 3.12` to the Daily Python Github Action job

2023-11-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46027. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43929

[jira] [Created] (SPARK-46027) Add `Python 3.12` to the Daily Python Github Action job

2023-11-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46027: Summary: Add `Python 3.12` to the Daily Python Github Action job Key: SPARK-46027 URL: https://issues.apache.org/jira/browse/SPARK-46027 Project: Spark

[jira] [Assigned] (SPARK-46004) Refine docstring of `DataFrame.dropna/fillna/replace`

2023-11-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46004: Assignee: BingKun Pan > Refine docstring of `DataFrame.dropna/fillna/replace` >

[jira] [Resolved] (SPARK-46004) Refine docstring of `DataFrame.dropna/fillna/replace`

2023-11-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46004. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43907

[jira] [Created] (SPARK-46026) Refine docstring of UDTF

2023-11-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46026: Summary: Refine docstring of UDTF Key: SPARK-46026 URL: https://issues.apache.org/jira/browse/SPARK-46026 Project: Spark Issue Type: Sub-task

[jira] [Deleted] (SPARK-46025) Support Python 3.12 in PySpark

2023-11-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-46025: - > Support Python 3.12 in PySpark > -- > > Key:

[jira] [Updated] (SPARK-46025) Support Python 3.12 in PySpark

2023-11-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46025: - Issue Type: Improvement (was: Bug) > Support Python 3.12 in PySpark >

[jira] [Created] (SPARK-46025) Support Python 3.12 in PySpark

2023-11-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46025: Summary: Support Python 3.12 in PySpark Key: SPARK-46025 URL: https://issues.apache.org/jira/browse/SPARK-46025 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-46024) Document parameters and examples for RuntimeConf get, set and unset

2023-11-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46024: Summary: Document parameters and examples for RuntimeConf get, set and unset Key: SPARK-46024 URL: https://issues.apache.org/jira/browse/SPARK-46024 Project: Spark

[jira] [Created] (SPARK-46023) Annotate parameters at docstrings in pyspark.sql module

2023-11-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46023: Summary: Annotate parameters at docstrings in pyspark.sql module Key: SPARK-46023 URL: https://issues.apache.org/jira/browse/SPARK-46023 Project: Spark

[jira] [Assigned] (SPARK-46015) Fix broken link for Koalas issues

2023-11-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46015: Assignee: Haejoon Lee > Fix broken link for Koalas issues >

[jira] [Resolved] (SPARK-46015) Fix broken link for Koalas issues

2023-11-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46015. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43918

[jira] [Resolved] (SPARK-44867) Refactor Spark Connect Docs to incorporate Scala setup

2023-11-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44867. -- Fix Version/s: 3.5.0 Assignee: Venkata Sai Akhil Gudesa Resolution: Fixed

[jira] [Resolved] (SPARK-45929) support grouping set operation in dataframe api

2023-11-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45929. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43813

[jira] [Assigned] (SPARK-45929) support grouping set operation in dataframe api

2023-11-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45929: Assignee: JacobZheng > support grouping set operation in dataframe api >

[jira] [Resolved] (SPARK-45856) Move ArtifactManager from Spark Connect into SparkSession (sql/core)

2023-11-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45856. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43735

[jira] [Assigned] (SPARK-45996) Show proper dependency requirement messages for Spark Connect

2023-11-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45996: Assignee: Hyukjin Kwon > Show proper dependency requirement messages for Spark Connect >

[jira] [Resolved] (SPARK-45996) Show proper dependency requirement messages for Spark Connect

2023-11-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45996. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43894

[jira] [Assigned] (SPARK-45942) Only do the thread interruption check for putIterator on executors

2023-11-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45942: Assignee: Huanli Wang > Only do the thread interruption check for putIterator on

[jira] [Resolved] (SPARK-45942) Only do the thread interruption check for putIterator on executors

2023-11-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45942. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43823

[jira] [Assigned] (SPARK-45986) Fix `pyspark.ml.torch.tests.test_distributor` in Python 3.11

2023-11-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45986: Assignee: Hyukjin Kwon (was: Dongjoon Hyun) > Fix

[jira] [Created] (SPARK-45996) Show proper dependency requirement messages for Spark Connect

2023-11-19 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45996: Summary: Show proper dependency requirement messages for Spark Connect Key: SPARK-45996 URL: https://issues.apache.org/jira/browse/SPARK-45996 Project: Spark

[jira] [Assigned] (SPARK-45994) Change description-file to description_file

2023-11-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45994: Assignee: Bjørn Jørgensen > Change description-file to description_file >

[jira] [Resolved] (SPARK-45994) Change description-file to description_file

2023-11-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45994. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43891

[jira] [Created] (SPARK-45995) Upgrade R version from 4.3.1 to 4.3.2 in AppVeyor

2023-11-19 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45995: Summary: Upgrade R version from 4.3.1 to 4.3.2 in AppVeyor Key: SPARK-45995 URL: https://issues.apache.org/jira/browse/SPARK-45995 Project: Spark Issue

[jira] [Resolved] (SPARK-45988) Fix `pyspark.pandas.tests.computation.test_apply_func` in Python 3.11

2023-11-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45988. -- Fix Version/s: 4.0.0 Resolution: Fixed Fixed in

[jira] [Resolved] (SPARK-45989) Fix `pyspark.pandas.tests.connect.computation.test_parity_apply_func` in Python 3.11

2023-11-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45989. -- Fix Version/s: 4.0.0 Resolution: Fixed Fixed in

[jira] [Resolved] (SPARK-45965) Move DSv2 partitioning expressions into functions.partitioning

2023-11-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45965. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43858

[jira] [Created] (SPARK-45985) Refine docstring of `DataFrame.intersect`

2023-11-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45985: Summary: Refine docstring of `DataFrame.intersect` Key: SPARK-45985 URL: https://issues.apache.org/jira/browse/SPARK-45985 Project: Spark Issue Type:

[jira] [Created] (SPARK-45984) Refine docstring of `DataFrame.intersectAll`

2023-11-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45984: Summary: Refine docstring of `DataFrame.intersectAll` Key: SPARK-45984 URL: https://issues.apache.org/jira/browse/SPARK-45984 Project: Spark Issue Type:

[jira] [Created] (SPARK-45983) Refine docstring of `DataFrame.substract`

2023-11-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45983: Summary: Refine docstring of `DataFrame.substract` Key: SPARK-45983 URL: https://issues.apache.org/jira/browse/SPARK-45983 Project: Spark Issue Type:

[jira] [Created] (SPARK-45970) Provide partitioning expressions in Java as same as Scala

2023-11-16 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45970: Summary: Provide partitioning expressions in Java as same as Scala Key: SPARK-45970 URL: https://issues.apache.org/jira/browse/SPARK-45970 Project: Spark

[jira] [Assigned] (SPARK-45952) Use built-in math constant in math functions

2023-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45952: Assignee: Ruifeng Zheng > Use built-in math constant in math functions >

[jira] [Resolved] (SPARK-45952) Use built-in math constant in math functions

2023-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45952. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43837

[jira] [Assigned] (SPARK-45912) Enhancement of XSDToSchema API: Change to HDFS API for cloud storage accessibility

2023-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45912: Assignee: Shujing Yang > Enhancement of XSDToSchema API: Change to HDFS API for cloud

[jira] [Resolved] (SPARK-45912) Enhancement of XSDToSchema API: Change to HDFS API for cloud storage accessibility

2023-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45912. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43789

[jira] [Created] (SPARK-45964) Remove private[sql] in XML and JSON package under catalyst package

2023-11-16 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45964: Summary: Remove private[sql] in XML and JSON package under catalyst package Key: SPARK-45964 URL: https://issues.apache.org/jira/browse/SPARK-45964 Project: Spark

[jira] [Created] (SPARK-45963) Restore documentation for DSv2 API

2023-11-16 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45963: Summary: Restore documentation for DSv2 API Key: SPARK-45963 URL: https://issues.apache.org/jira/browse/SPARK-45963 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-45950) Fix IvyTestUtils#createIvyDescriptor function and make common-utils module can run tests on GitHub Action

2023-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45950: Assignee: Yang Jie > Fix IvyTestUtils#createIvyDescriptor function and make common-utils

[jira] [Resolved] (SPARK-45950) Fix IvyTestUtils#createIvyDescriptor function and make common-utils module can run tests on GitHub Action

2023-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45950. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43834

[jira] [Resolved] (SPARK-45960) Add Python 3.10 to the Daily Python Github Action job

2023-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45960. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43847

[jira] [Resolved] (SPARK-45851) (Scala) Support different retry policies for connect client

2023-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45851. -- Fix Version/s: 4.0.0 Assignee: Alice Sayutina Resolution: Fixed Fixed in

[jira] [Assigned] (SPARK-45935) Fix RST files link substitutions error

2023-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45935: Assignee: BingKun Pan > Fix RST files link substitutions error >

[jira] [Resolved] (SPARK-45935) Fix RST files link substitutions error

2023-11-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45935. -- Fix Version/s: 3.3.4 3.5.1 4.0.0

[jira] [Resolved] (SPARK-45930) Allow non-deterministic Python UDFs in MapInPandas/MapInArrow

2023-11-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45930. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43810

[jira] [Assigned] (SPARK-45930) Allow non-deterministic Python UDFs in MapInPandas/MapInArrow

2023-11-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45930: Assignee: Allison Wang > Allow non-deterministic Python UDFs in MapInPandas/MapInArrow >

[jira] [Resolved] (SPARK-45931) Refine docstring of `mapInPandas`

2023-11-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45931. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43811

[jira] [Assigned] (SPARK-45931) Refine docstring of `mapInPandas`

2023-11-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45931: Assignee: Allison Wang > Refine docstring of `mapInPandas` >

[jira] [Assigned] (SPARK-45936) Optimize `Index.symmetric_difference`

2023-11-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45936: Assignee: Ruifeng Zheng > Optimize `Index.symmetric_difference` >

[jira] [Resolved] (SPARK-45936) Optimize `Index.symmetric_difference`

2023-11-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45936. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43816

[jira] [Resolved] (SPARK-45764) Make code block copyable

2023-11-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45764. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43799

[jira] [Assigned] (SPARK-45764) Make code block copyable

2023-11-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45764: Assignee: BingKun Pan > Make code block copyable > > >

[jira] [Resolved] (SPARK-45918) Optimize `MultiIndex.symmetric_difference`

2023-11-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45918. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43795

[jira] [Resolved] (SPARK-45913) Make the internal attributes private from PySpark errors.

2023-11-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45913. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43790

[jira] [Assigned] (SPARK-45913) Make the internal attributes private from PySpark errors.

2023-11-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45913: Assignee: Haejoon Lee > Make the internal attributes private from PySpark errors. >

[jira] [Resolved] (SPARK-45813) Return the observed metrics from commands

2023-11-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45813. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43690

[jira] [Assigned] (SPARK-45813) Return the observed metrics from commands

2023-11-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45813: Assignee: Takuya Ueshin > Return the observed metrics from commands >

[jira] [Resolved] (SPARK-45844) Implement case insensitivity for XML

2023-11-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45844. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43722

[jira] [Assigned] (SPARK-45844) Implement case insensitivity for XML

2023-11-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45844: Assignee: Shujing Yang > Implement case insensitivity for XML >

[jira] [Resolved] (SPARK-45827) Add Variant data type in Spark

2023-11-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45827. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43707

[jira] [Updated] (SPARK-45917) Statically register Python Data Source

2023-11-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45917: - Summary: Statically register Python Data Source (was: Statically register Data Source) >

[jira] [Created] (SPARK-45917) Statically register Data Source

2023-11-13 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45917: Summary: Statically register Data Source Key: SPARK-45917 URL: https://issues.apache.org/jira/browse/SPARK-45917 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-45916) Investigate runtime registration and feasibility of overwriting the datasource

2023-11-13 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45916: Summary: Investigate runtime registration and feasibility of overwriting the datasource Key: SPARK-45916 URL: https://issues.apache.org/jira/browse/SPARK-45916

[jira] [Assigned] (SPARK-45783) Improve exception message when no remote url is set

2023-11-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45783: Assignee: Allison Wang > Improve exception message when no remote url is set >

[jira] [Resolved] (SPARK-45783) Improve exception message when no remote url is set

2023-11-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45783. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43653

[jira] [Assigned] (SPARK-45859) Make UDF objects in ml.functions lazy

2023-11-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45859: Assignee: Ruifeng Zheng > Make UDF objects in ml.functions lazy >

[jira] [Resolved] (SPARK-45859) Make UDF objects in ml.functions lazy

2023-11-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45859. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43739

[jira] [Resolved] (SPARK-45733) (Python) Support different retry policies for connect client

2023-11-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45733. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43591

[jira] [Assigned] (SPARK-45733) (Python) Support different retry policies for connect client

2023-11-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45733: Assignee: Alice Sayutina > (Python) Support different retry policies for connect client

[jira] [Resolved] (SPARK-45899) Set errorClass in errorInfoToThrowable

2023-11-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45899. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43772

[jira] [Assigned] (SPARK-45899) Set errorClass in errorInfoToThrowable

2023-11-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45899: Assignee: Yihong He > Set errorClass in errorInfoToThrowable >

[jira] [Assigned] (SPARK-45837) Report underlying error in scala client

2023-11-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45837: Assignee: Alice Sayutina > Report underlying error in scala client >

[jira] [Resolved] (SPARK-45837) Report underlying error in scala client

2023-11-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45837. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43719

[jira] [Resolved] (SPARK-45852) Gracefully deal with recursion exception during Spark Connect logging

2023-11-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45852. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43732

[jira] [Assigned] (SPARK-45798) Assert server-side session ID in Spark Connect

2023-11-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45798: Assignee: Martin Grund > Assert server-side session ID in Spark Connect >

[jira] [Resolved] (SPARK-45798) Assert server-side session ID in Spark Connect

2023-11-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45798. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43664

[jira] [Resolved] (SPARK-45639) Support loading Python data sources in DataFrameReader

2023-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45639. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43630

[jira] [Assigned] (SPARK-45639) Support loading Python data sources in DataFrameReader

2023-11-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45639: Assignee: Allison Wang > Support loading Python data sources in DataFrameReader >

[jira] [Assigned] (SPARK-45555) Returning a debuggable object for failed assertion

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-4: Assignee: Haejoon Lee > Returning a debuggable object for failed assertion >

[jira] [Resolved] (SPARK-45555) Returning a debuggable object for failed assertion

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-4. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43444

[jira] [Resolved] (SPARK-45223) Refine docstring of `Column.when`

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45223. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43688

[jira] [Assigned] (SPARK-45223) Refine docstring of `Column.when`

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45223: Assignee: Hyukjin Kwon > Refine docstring of `Column.when` >

[jira] [Resolved] (SPARK-45808) Improve error details for Spark Connect Client in Python

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45808. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43667

[jira] [Assigned] (SPARK-45808) Improve error details for Spark Connect Client in Python

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45808: Assignee: Martin Grund > Improve error details for Spark Connect Client in Python >

[jira] [Resolved] (SPARK-45186) XML: Refine docstring of schema_of_xml

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45186. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43681

[jira] [Assigned] (SPARK-45186) XML: Refine docstring of schema_of_xml

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45186: Assignee: Hyukjin Kwon > XML: Refine docstring of schema_of_xml >

[jira] [Assigned] (SPARK-45811) XML: Refine docstring of from_xml

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45811: Assignee: Hyukjin Kwon > XML: Refine docstring of from_xml >

[jira] [Resolved] (SPARK-45811) XML: Refine docstring of from_xml

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45811. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43680

[jira] [Assigned] (SPARK-45222) Refine docstring of `DataFrameReader.json`

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45222: Assignee: Hyukjin Kwon > Refine docstring of `DataFrameReader.json` >

[jira] [Resolved] (SPARK-45809) Refine docstring of `lit`

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45809. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43679

[jira] [Assigned] (SPARK-45809) Refine docstring of `lit`

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45809: Assignee: Hyukjin Kwon > Refine docstring of `lit` > - > >

[jira] [Resolved] (SPARK-45222) Refine docstring of `DataFrameReader.json`

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45222. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43687

[jira] [Assigned] (SPARK-45260) Refine docstring of count_distinct

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45260: Assignee: Allison Wang > Refine docstring of count_distinct >

[jira] [Resolved] (SPARK-45260) Refine docstring of count_distinct

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45260. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43686

[jira] [Resolved] (SPARK-45259) Refine docstring of `count`

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45259. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43685

[jira] [Assigned] (SPARK-45259) Refine docstring of `count`

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45259: Assignee: Hyukjin Kwon > Refine docstring of `count` > --- > >

[jira] [Resolved] (SPARK-45258) Refine docstring of `sum`

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45258. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43684

[jira] [Assigned] (SPARK-45258) Refine docstring of `sum`

2023-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45258: Assignee: Hyukjin Kwon > Refine docstring of `sum` > - > >

[jira] [Updated] (SPARK-44728) Improve PySpark documentations

2023-11-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-44728: - Fix Version/s: (was: 4.0.0) > Improve PySpark documentations >

[jira] [Updated] (SPARK-45186) XML: Refine docstring of schema_of_xml

2023-11-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45186: - Summary: XML: Refine docstring of schema_of_xml (was: XML: Refine docstring of from_xml,

<    5   6   7   8   9   10   11   12   13   14   >