[jira] [Resolved] (SPARK-43979) CollectedMetrics should be treated as the same one for self-join

2023-06-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43979. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41475 [https://gith

[jira] [Resolved] (SPARK-43717) Scala Client Dataset#reduce failed to handle null partitions for scala primitive types

2023-06-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-43717. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41264 [https://github.com

[jira] [Assigned] (SPARK-43717) Scala Client Dataset#reduce failed to handle null partitions for scala primitive types

2023-06-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-43717: Assignee: Zhen Li > Scala Client Dataset#reduce failed to handle null partitions for scala > pri

[jira] [Created] (SPARK-43989) Add maven testing GA task for connect server module

2023-06-06 Thread Yang Jie (Jira)
Yang Jie created SPARK-43989: Summary: Add maven testing GA task for connect server module Key: SPARK-43989 URL: https://issues.apache.org/jira/browse/SPARK-43989 Project: Spark Issue Type: Impro

[jira] [Updated] (SPARK-43988) Add maven testing GA task for connect client module

2023-06-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-43988: - Summary: Add maven testing GA task for connect client module (was: Add independent maven testing GA tas

[jira] [Created] (SPARK-43988) Add independent maven testing GA task for connect client module

2023-06-06 Thread Yang Jie (Jira)
Yang Jie created SPARK-43988: Summary: Add independent maven testing GA task for connect client module Key: SPARK-43988 URL: https://issues.apache.org/jira/browse/SPARK-43988 Project: Spark Issu

[jira] [Created] (SPARK-43987) Separate finalizeShuffleMerge Processing to Dedicated Thread Pools

2023-06-06 Thread SHU WANG (Jira)
SHU WANG created SPARK-43987: Summary: Separate finalizeShuffleMerge Processing to Dedicated Thread Pools Key: SPARK-43987 URL: https://issues.apache.org/jira/browse/SPARK-43987 Project: Spark I

[jira] [Resolved] (SPARK-43669) Fix BinaryOps.lt to work with Spark Connect Column.

2023-06-06 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43669. - Fix Version/s: 3.5.0 Resolution: Fixed Fixed in [https://github.com/apache/spark/pull/413

[jira] [Resolved] (SPARK-43668) Fix BinaryOps.le to work with Spark Connect Column.

2023-06-06 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43668. - Fix Version/s: 3.5.0 Resolution: Fixed Fixed in [https://github.com/apache/spark/pull/413

[jira] [Resolved] (SPARK-43672) Enable CategoricalOps.gt to work with Spark Connect.

2023-06-06 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43672. - Fix Version/s: 3.5.0 Resolution: Fixed > Enable CategoricalOps.gt to work with Spark Conn

[jira] [Updated] (SPARK-43673) Enable CategoricalOps.le to work with Spark Connect.

2023-06-06 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43673: Fix Version/s: 3.5.0 > Enable CategoricalOps.le to work with Spark Connect. >

[jira] [Updated] (SPARK-43674) Enable CategoricalOps.lt to work with Spark Connect.

2023-06-06 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43674: Fix Version/s: 3.5.0 > Enable CategoricalOps.lt to work with Spark Connect. >

[jira] [Reopened] (SPARK-43672) Enable CategoricalOps.gt to work with Spark Connect.

2023-06-06 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee reopened SPARK-43672: - > Enable CategoricalOps.gt to work with Spark Connect. > ---

[jira] [Resolved] (SPARK-43667) Fix BinaryOps.gt to work with Spark Connect Column.

2023-06-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43667. -- Fix Version/s: 3.5.0 Assignee: Haejoon Lee Resolution: Fixed Fixed in https://

[jira] [Resolved] (SPARK-43674) Enable CategoricalOps.lt to work with Spark Connect.

2023-06-06 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43674. - Resolution: Fixed This is resolved from https://github.com/apache/spark/pull/41310. > Enable Ca

[jira] [Resolved] (SPARK-43673) Enable CategoricalOps.le to work with Spark Connect.

2023-06-06 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43673. - Resolution: Fixed This is resolved from https://github.com/apache/spark/pull/41310. > Enable Ca

[jira] [Resolved] (SPARK-43672) Enable CategoricalOps.gt to work with Spark Connect.

2023-06-06 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-43672. - Resolution: Fixed This is resolved from https://github.com/apache/spark/pull/41310. > Enable Ca

[jira] [Resolved] (SPARK-43985) Spark protobuf enums.as.ints raises exception on repeated enum types

2023-06-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43985. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41481 [https://gi

[jira] [Resolved] (SPARK-43901) Avro to Support custom decimal type backed by Long

2023-06-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43901. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41409 [https://

[jira] [Assigned] (SPARK-43901) Avro to Support custom decimal type backed by Long

2023-06-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43901: - Assignee: Siying Dong > Avro to Support custom decimal type backed by Long > --

[jira] [Resolved] (SPARK-42750) Support INSERT INTO by name

2023-06-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42750. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40908 [https://gith

[jira] [Assigned] (SPARK-43615) Enable DataFrameSlowParityTests.test_eval

2023-06-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43615: Assignee: Haejoon Lee > Enable DataFrameSlowParityTests.test_eval > -

[jira] [Resolved] (SPARK-43615) Enable DataFrameSlowParityTests.test_eval

2023-06-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43615. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41471 [https://gi

[jira] [Assigned] (SPARK-43930) Add unix_* functions to Scala and Python

2023-06-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43930: - Assignee: BingKun Pan > Add unix_* functions to Scala and Python >

[jira] [Resolved] (SPARK-43930) Add unix_* functions to Scala and Python

2023-06-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43930. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41463 [https://

[jira] [Assigned] (SPARK-43356) Migrate deprecated createOrReplace to serverSideApply

2023-06-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43356: - Assignee: Cheng Pan > Migrate deprecated createOrReplace to serverSideApply > -

[jira] [Resolved] (SPARK-43356) Migrate deprecated createOrReplace to serverSideApply

2023-06-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43356. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41136 [https://

[jira] [Resolved] (SPARK-43906) Implement the file support in SparkSession.addArtifacts

2023-06-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43906. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41415 [https://gi

[jira] [Assigned] (SPARK-43906) Implement the file support in SparkSession.addArtifacts

2023-06-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43906: Assignee: Hyukjin Kwon > Implement the file support in SparkSession.addArtifacts > --

[jira] [Assigned] (SPARK-43970) Hide unsupported dataframe methods from auto-completion

2023-06-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43970: - Assignee: Ruifeng Zheng > Hide unsupported dataframe methods from auto-completion > ---

[jira] [Resolved] (SPARK-43970) Hide unsupported dataframe methods from auto-completion

2023-06-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43970. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41462 [https://

[jira] [Created] (SPARK-43986) Add error classes for HyperLogLog functions

2023-06-06 Thread Daniel (Jira)
Daniel created SPARK-43986: -- Summary: Add error classes for HyperLogLog functions Key: SPARK-43986 URL: https://issues.apache.org/jira/browse/SPARK-43986 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-43893) StructType input/output support in Arrow-optimized Python UDF

2023-06-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-43893: Assignee: Xinrong Meng > StructType input/output support in Arrow-optimized Python UDF >

[jira] [Resolved] (SPARK-43893) StructType input/output support in Arrow-optimized Python UDF

2023-06-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-43893. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41321 [https://gi

[jira] [Comment Edited] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2023-06-06 Thread Zach Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17729825#comment-17729825 ] Zach Liu edited comment on SPARK-36277 at 6/6/23 6:55 PM: -- I se

[jira] [Comment Edited] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2023-06-06 Thread Zach Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17729825#comment-17729825 ] Zach Liu edited comment on SPARK-36277 at 6/6/23 6:44 PM: -- I se

[jira] [Comment Edited] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2023-06-06 Thread Zach Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17729825#comment-17729825 ] Zach Liu edited comment on SPARK-36277 at 6/6/23 6:41 PM: -- I se

[jira] [Commented] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2023-06-06 Thread Zach Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17729825#comment-17729825 ] Zach Liu commented on SPARK-36277: -- I see the same behavior on Spark 3.3.1. I have to c

[jira] [Assigned] (SPARK-43959) Make RowLevelOperationSuiteBase and AlignAssignmentsSuite abstract

2023-06-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43959: - Assignee: Anton Okolnychyi > Make RowLevelOperationSuiteBase and AlignAssignmentsSuite

[jira] [Resolved] (SPARK-43959) Make RowLevelOperationSuiteBase and AlignAssignmentsSuite abstract

2023-06-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43959. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41449 [https://

[jira] [Assigned] (SPARK-43976) Handle the case where modifiedConfigs doesn't exist in event logs

2023-06-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43976: - Assignee: Dongjoon Hyun > Handle the case where modifiedConfigs doesn't exist in event

[jira] [Resolved] (SPARK-43976) Handle the case where modifiedConfigs doesn't exist in event logs

2023-06-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43976. --- Fix Version/s: 3.3.3 3.5.0 3.4.1 Resolution: Fix

[jira] [Resolved] (SPARK-43919) Extract JSON functionality out of Row

2023-06-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-43919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-43919. --- Fix Version/s: 3.5.0 Resolution: Fixed > Extract JSON functionality out of R

[jira] [Created] (SPARK-43984) Change to use foreach when map doesn't produce results

2023-06-06 Thread Yang Jie (Jira)
Yang Jie created SPARK-43984: Summary: Change to use foreach when map doesn't produce results Key: SPARK-43984 URL: https://issues.apache.org/jira/browse/SPARK-43984 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-43980) Add support for EXCEPT in select clause, similar to what databricks provides

2023-06-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17729773#comment-17729773 ] Yuming Wang commented on SPARK-43980: - Spark SQL current supports regex column speci

[jira] [Assigned] (SPARK-43977) bad case of connect-jvm-client-mima-check

2023-06-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-43977: Assignee: Yang Jie > bad case of connect-jvm-client-mima-check >

[jira] [Resolved] (SPARK-43977) bad case of connect-jvm-client-mima-check

2023-06-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-43977. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41473 [https://github.com

[jira] [Commented] (SPARK-43939) Add try_* functions to Scala and Python

2023-06-06 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17729752#comment-17729752 ] BingKun Pan commented on SPARK-43939: - I work on it. > Add try_* functions to Scala

[jira] [Resolved] (SPARK-43097) Implement pyspark ML logistic regression estimator on top of torch distributor

2023-06-06 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-43097. Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41383 [https://github

[jira] [Resolved] (SPARK-43510) Spark application hangs when YarnAllocator adds running executors after processing completed containers

2023-06-06 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-43510. --- Fix Version/s: 3.4.1 3.5.0 Assignee: Manu Zhang Resolution

[jira] [Commented] (SPARK-43907) Add SQL functions into Scala, Python and R API

2023-06-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17729735#comment-17729735 ] Yang Jie commented on SPARK-43907: -- [~ivoson] feel free to pick up some ones which you

[jira] [Assigned] (SPARK-43982) Implement pipeline estimator

2023-06-06 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-43982: -- Assignee: Weichen Xu > Implement pipeline estimator > > >

[jira] [Created] (SPARK-43982) Implement pipeline estimator

2023-06-06 Thread Weichen Xu (Jira)
Weichen Xu created SPARK-43982: -- Summary: Implement pipeline estimator Key: SPARK-43982 URL: https://issues.apache.org/jira/browse/SPARK-43982 Project: Spark Issue Type: Sub-task Compo

[jira] [Assigned] (SPARK-43983) Implement cross validator estimator

2023-06-06 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-43983: -- Assignee: Weichen Xu > Implement cross validator estimator >

[jira] [Created] (SPARK-43983) Implement cross validator estimator

2023-06-06 Thread Weichen Xu (Jira)
Weichen Xu created SPARK-43983: -- Summary: Implement cross validator estimator Key: SPARK-43983 URL: https://issues.apache.org/jira/browse/SPARK-43983 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-43981) Basic saving / loading implementation

2023-06-06 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-43981: --- Description: Support saving/loading  for estimator / transformer / evaluator / model. We have some

[jira] [Created] (SPARK-43981) Basic saving / loading implementation

2023-06-06 Thread Weichen Xu (Jira)
Weichen Xu created SPARK-43981: -- Summary: Basic saving / loading implementation Key: SPARK-43981 URL: https://issues.apache.org/jira/browse/SPARK-43981 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-43981) Basic saving / loading implementation

2023-06-06 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-43981: -- Assignee: Weichen Xu > Basic saving / loading implementation > --

[jira] [Updated] (SPARK-43981) Basic saving / loading implementation

2023-06-06 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-43981: --- Component/s: Connect ML > Basic saving / loading implementation > -

[jira] [Created] (SPARK-43980) Add support for EXCEPT in select clause, similar to what databricks provides

2023-06-06 Thread Yash Kothari (Jira)
Yash Kothari created SPARK-43980: Summary: Add support for EXCEPT in select clause, similar to what databricks provides Key: SPARK-43980 URL: https://issues.apache.org/jira/browse/SPARK-43980 Project:

[jira] [Updated] (SPARK-43914) Assign names to the error class _LEGACY_ERROR_TEMP_[2433-2437]

2023-06-06 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-43914: --- Summary: Assign names to the error class _LEGACY_ERROR_TEMP_[2433-2437] (was: Assign a name to the

[jira] [Resolved] (SPARK-43715) Add spark DataFrame binary file format writer

2023-06-06 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-43715. Resolution: Won't Do > Add spark DataFrame binary file format writer > ---

[jira] [Resolved] (SPARK-43913) Assign names to the error class _LEGACY_ERROR_TEMP_[2426-2432]

2023-06-06 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-43913. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41424 [https://github.com

[jira] [Assigned] (SPARK-43913) Assign names to the error class _LEGACY_ERROR_TEMP_[2426-2432]

2023-06-06 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-43913: Assignee: jiaan.geng > Assign names to the error class _LEGACY_ERROR_TEMP_[2426-2432] > -

[jira] [Resolved] (SPARK-43962) Improve error messages: CANNOT_DECODE_URL, CANNOT_MERGE_INCOMPATIBLE_DATA_TYPE, CANNOT_PARSE_DECIMAL, CANNOT_READ_FILE_FOOTER, CANNOT_RECOGNIZE_HIVE_TYPE.

2023-06-06 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-43962. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41455 [https://github.com

[jira] [Assigned] (SPARK-43962) Improve error messages: CANNOT_DECODE_URL, CANNOT_MERGE_INCOMPATIBLE_DATA_TYPE, CANNOT_PARSE_DECIMAL, CANNOT_READ_FILE_FOOTER, CANNOT_RECOGNIZE_HIVE_TYPE.

2023-06-06 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-43962: Assignee: Haejoon Lee > Improve error messages: CANNOT_DECODE_URL, > CANNOT_MERGE_INCOMPATIBLE_D

[jira] [Assigned] (SPARK-43948) Assign names to the error class _LEGACY_ERROR_TEMP_[0050|0057|0058|0059]

2023-06-06 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-43948: Assignee: BingKun Pan > Assign names to the error class _LEGACY_ERROR_TEMP_[0050|0057|0058|0059]

[jira] [Resolved] (SPARK-43948) Assign names to the error class _LEGACY_ERROR_TEMP_[0050|0057|0058|0059]

2023-06-06 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-43948. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41451 [https://github.com

[jira] [Updated] (SPARK-43378) SerializerHelper.deserializeFromChunkedBuffer leaks deserialization streams

2023-06-06 Thread Emil Ejbyfeldt (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Ejbyfeldt updated SPARK-43378: --- Summary: SerializerHelper.deserializeFromChunkedBuffer leaks deserialization streams (was: