[jira] [Updated] (SPARK-43967) Support Python UDTFs with empty return values

2023-06-04 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-43967: - Description: Support UDTFs with empty returns, for example: {code:java} @udtf(returnType="a:

[jira] [Created] (SPARK-43967) Support Python UDTFs with empty return values

2023-06-04 Thread Allison Wang (Jira)
Allison Wang created SPARK-43967: Summary: Support Python UDTFs with empty return values Key: SPARK-43967 URL: https://issues.apache.org/jira/browse/SPARK-43967 Project: Spark Issue Type:

[jira] [Created] (SPARK-43966) Support non-deterministic Python UDTFs

2023-06-04 Thread Allison Wang (Jira)
Allison Wang created SPARK-43966: Summary: Support non-deterministic Python UDTFs Key: SPARK-43966 URL: https://issues.apache.org/jira/browse/SPARK-43966 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43965) Support Python UDTFs in Spark Connect

2023-06-04 Thread Allison Wang (Jira)
Allison Wang created SPARK-43965: Summary: Support Python UDTFs in Spark Connect Key: SPARK-43965 URL: https://issues.apache.org/jira/browse/SPARK-43965 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43964) Support arrow-optimized Python UDTFs

2023-06-04 Thread Allison Wang (Jira)
Allison Wang created SPARK-43964: Summary: Support arrow-optimized Python UDTFs Key: SPARK-43964 URL: https://issues.apache.org/jira/browse/SPARK-43964 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43963) DataSource V2: Handle MERGE commands for group-based sources

2023-06-04 Thread Anton Okolnychyi (Jira)
Anton Okolnychyi created SPARK-43963: Summary: DataSource V2: Handle MERGE commands for group-based sources Key: SPARK-43963 URL: https://issues.apache.org/jira/browse/SPARK-43963 Project: Spark

[jira] [Created] (SPARK-43962) Improve error messages: CANNOT_DECODE_URL, CANNOT_MERGE_INCOMPATIBLE_DATA_TYPE, CANNOT_PARSE_DECIMAL, CANNOT_READ_FILE_FOOTER, CANNOT_RECOGNIZE_HIVE_TYPE.

2023-06-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-43962: --- Summary: Improve error messages: CANNOT_DECODE_URL, CANNOT_MERGE_INCOMPATIBLE_DATA_TYPE, CANNOT_PARSE_DECIMAL, CANNOT_READ_FILE_FOOTER, CANNOT_RECOGNIZE_HIVE_TYPE. Key: SPARK-43962

[jira] [Created] (SPARK-43961) Add optional pattern for Catalog.listTables

2023-06-04 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43961: -- Summary: Add optional pattern for Catalog.listTables Key: SPARK-43961 URL: https://issues.apache.org/jira/browse/SPARK-43961 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-43291) Match behavior for DataFrame.cov on string DataFrame

2023-06-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17729145#comment-17729145 ] Haejoon Lee commented on SPARK-43291: - Yeah, I will be sharing with the community how to handle

[jira] [Resolved] (SPARK-43960) DataFrameConversionTestsMixin is not tested properly.

2023-06-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43960. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41450

[jira] [Assigned] (SPARK-43960) DataFrameConversionTestsMixin is not tested properly.

2023-06-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43960: Assignee: Haejoon Lee > DataFrameConversionTestsMixin is not tested properly. >

[jira] [Assigned] (SPARK-43881) Add optional pattern for Catalog.listDatabases

2023-06-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43881: Assignee: jiaan.geng > Add optional pattern for Catalog.listDatabases >

[jira] [Resolved] (SPARK-43881) Add optional pattern for Catalog.listDatabases

2023-06-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43881. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41421

[jira] [Commented] (SPARK-43291) Match behavior for DataFrame.cov on string DataFrame

2023-06-04 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-43291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17729109#comment-17729109 ] Bjørn Jørgensen commented on SPARK-43291: - Changed in version 2.0.0: The default value of

[jira] [Updated] (SPARK-43955) Upgrade `scalafmt` from 3.7.3 to 3.7.4

2023-06-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-43955: - Priority: Trivial (was: Minor) > Upgrade `scalafmt` from 3.7.3 to 3.7.4 >

[jira] [Assigned] (SPARK-43955) Upgrade `scalafmt` from 3.7.3 to 3.7.4

2023-06-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-43955: Assignee: BingKun Pan > Upgrade `scalafmt` from 3.7.3 to 3.7.4 >

[jira] [Resolved] (SPARK-43955) Upgrade `scalafmt` from 3.7.3 to 3.7.4

2023-06-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-43955. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41442

[jira] [Updated] (SPARK-43948) Assign names to the error class _LEGACY_ERROR_TEMP_[0050|0057|0058|0059]

2023-06-04 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-43948: Description: _LEGACY_ERROR_TEMP_0050 => LOCAL_MUST_WITH_SCHEMA_FILE _LEGACY_ERROR_TEMP_0057 =>

[jira] [Updated] (SPARK-43948) Assign names to the error class _LEGACY_ERROR_TEMP_[0050|0057|0058|0059]

2023-06-04 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-43948: Summary: Assign names to the error class _LEGACY_ERROR_TEMP_[0050|0057|0058|0059] (was: Assign

[jira] [Assigned] (SPARK-43958) Channel Builder for Golang client

2023-06-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43958: Assignee: Martin Grund > Channel Builder for Golang client >

[jira] [Resolved] (SPARK-43958) Channel Builder for Golang client

2023-06-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43958. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 8

[jira] [Updated] (SPARK-43958) Channel Builder for Golang client

2023-06-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-43958: - Fix Version/s: (was: 3.5.0) > Channel Builder for Golang client >

[jira] [Created] (SPARK-43960) DataFrameConversionTestsMixin is not tested properly.

2023-06-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-43960: --- Summary: DataFrameConversionTestsMixin is not tested properly. Key: SPARK-43960 URL: https://issues.apache.org/jira/browse/SPARK-43960 Project: Spark Issue

[jira] [Assigned] (SPARK-43911) Use toSet to deduplicate the iterator data to prevent the creation of large Array

2023-06-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-43911: --- Assignee: mcdull_zhang > Use toSet to deduplicate the iterator data to prevent the

[jira] [Resolved] (SPARK-43911) Use toSet to deduplicate the iterator data to prevent the creation of large Array

2023-06-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43911. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-43917) Upgrade pandas to 2.0.2

2023-06-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43917. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41437

[jira] [Assigned] (SPARK-43917) Upgrade pandas to 2.0.2

2023-06-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43917: - Assignee: Bjørn Jørgensen > Upgrade pandas to 2.0.2 > --- > >

[jira] [Resolved] (SPARK-43953) Remove pass

2023-06-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43953. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41438

[jira] [Assigned] (SPARK-43953) Remove pass

2023-06-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43953: - Assignee: Bjørn Jørgensen > Remove pass > --- > > Key: