[jira] [Created] (SPARK-41713) Make CTAS hold a nested execution for data writing

2022-12-25 Thread XiDuo You (Jira)
XiDuo You created SPARK-41713: - Summary: Make CTAS hold a nested execution for data writing Key: SPARK-41713 URL: https://issues.apache.org/jira/browse/SPARK-41713 Project: Spark Issue Type:

[jira] [Created] (SPARK-41712) Migrate the Spark Connect errors into error classes.

2022-12-25 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-41712: --- Summary: Migrate the Spark Connect errors into error classes. Key: SPARK-41712 URL: https://issues.apache.org/jira/browse/SPARK-41712 Project: Spark Issue

[jira] [Assigned] (SPARK-41711) Upgrade protobuf-java to 3.21.12

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41711: Assignee: Apache Spark > Upgrade protobuf-java to 3.21.12 >

[jira] [Assigned] (SPARK-41711) Upgrade protobuf-java to 3.21.12

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41711: Assignee: (was: Apache Spark) > Upgrade protobuf-java to 3.21.12 >

[jira] [Commented] (SPARK-41711) Upgrade protobuf-java to 3.21.12

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651945#comment-17651945 ] Apache Spark commented on SPARK-41711: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-41711) Upgrade protobuf-java to 3.21.12

2022-12-25 Thread Yang Jie (Jira)
Yang Jie created SPARK-41711: Summary: Upgrade protobuf-java to 3.21.12 Key: SPARK-41711 URL: https://issues.apache.org/jira/browse/SPARK-41711 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-41710) Implement `Column.between`

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651943#comment-17651943 ] Apache Spark commented on SPARK-41710: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41710) Implement `Column.between`

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41710: Assignee: (was: Apache Spark) > Implement `Column.between` >

[jira] [Assigned] (SPARK-41710) Implement `Column.between`

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41710: Assignee: Apache Spark > Implement `Column.between` > -- > >

[jira] [Created] (SPARK-41710) Implement `Column.between`

2022-12-25 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41710: - Summary: Implement `Column.between` Key: SPARK-41710 URL: https://issues.apache.org/jira/browse/SPARK-41710 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-41709) Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651940#comment-17651940 ] Apache Spark commented on SPARK-41709: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41709) Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41709: Assignee: Apache Spark > Explicitly define `Seq` as `collection.Seq` to reduce `toSeq`

[jira] [Assigned] (SPARK-41709) Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41709: Assignee: (was: Apache Spark) > Explicitly define `Seq` as `collection.Seq` to

[jira] [Commented] (SPARK-41709) Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651939#comment-17651939 ] Apache Spark commented on SPARK-41709: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-41709) Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13

2022-12-25 Thread Yang Jie (Jira)
Yang Jie created SPARK-41709: Summary: Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13 Key: SPARK-41709 URL:

[jira] [Created] (SPARK-41708) Pull v1write information to write file node

2022-12-25 Thread XiDuo You (Jira)
XiDuo You created SPARK-41708: - Summary: Pull v1write information to write file node Key: SPARK-41708 URL: https://issues.apache.org/jira/browse/SPARK-41708 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41707) Implement initial Catalog.* API

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651929#comment-17651929 ] Apache Spark commented on SPARK-41707: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-41707) Implement initial Catalog.* API

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41707: Assignee: (was: Apache Spark) > Implement initial Catalog.* API >

[jira] [Assigned] (SPARK-41707) Implement initial Catalog.* API

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41707: Assignee: Apache Spark > Implement initial Catalog.* API >

[jira] [Commented] (SPARK-41707) Implement initial Catalog.* API

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651928#comment-17651928 ] Apache Spark commented on SPARK-41707: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-41707) Implement initial Catalog.* API

2022-12-25 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41707: Summary: Implement initial Catalog.* API Key: SPARK-41707 URL: https://issues.apache.org/jira/browse/SPARK-41707 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-41706) pyspark_types_to_proto_types should supports MapType

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651925#comment-17651925 ] Apache Spark commented on SPARK-41706: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-41706) pyspark_types_to_proto_types should supports MapType

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651924#comment-17651924 ] Apache Spark commented on SPARK-41706: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41706) pyspark_types_to_proto_types should supports MapType

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41706: Assignee: Apache Spark > pyspark_types_to_proto_types should supports MapType >

[jira] [Assigned] (SPARK-41706) pyspark_types_to_proto_types should supports MapType

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41706: Assignee: (was: Apache Spark) > pyspark_types_to_proto_types should supports MapType

[jira] [Created] (SPARK-41706) pyspark_types_to_proto_types should supports MapType

2022-12-25 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-41706: -- Summary: pyspark_types_to_proto_types should supports MapType Key: SPARK-41706 URL: https://issues.apache.org/jira/browse/SPARK-41706 Project: Spark Issue Type:

[jira] (SPARK-41464) Implement DataFrame.to

2022-12-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41464 ] jiaan.geng deleted comment on SPARK-41464: was (Author: beliefer): OK > Implement DataFrame.to > -- > > Key: SPARK-41464 > URL:

[jira] [Commented] (SPARK-41705) Move generate_protos.sh to dev/

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651900#comment-17651900 ] Apache Spark commented on SPARK-41705: -- User 'tedyu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41705) Move generate_protos.sh to dev/

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41705: Assignee: (was: Apache Spark) > Move generate_protos.sh to dev/ >

[jira] [Assigned] (SPARK-41705) Move generate_protos.sh to dev/

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41705: Assignee: Apache Spark > Move generate_protos.sh to dev/ >

[jira] [Created] (SPARK-41705) Move generate_protos.sh to dev/

2022-12-25 Thread Ted Yu (Jira)
Ted Yu created SPARK-41705: -- Summary: Move generate_protos.sh to dev/ Key: SPARK-41705 URL: https://issues.apache.org/jira/browse/SPARK-41705 Project: Spark Issue Type: Task Components:

[jira] [Commented] (SPARK-41533) GRPC Errors on the client should be cleaned up

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651898#comment-17651898 ] Apache Spark commented on SPARK-41533: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-41533) GRPC Errors on the client should be cleaned up

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41533: Assignee: Apache Spark > GRPC Errors on the client should be cleaned up >

[jira] [Assigned] (SPARK-41533) GRPC Errors on the client should be cleaned up

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41533: Assignee: (was: Apache Spark) > GRPC Errors on the client should be cleaned up >

[jira] [Commented] (SPARK-41533) GRPC Errors on the client should be cleaned up

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651897#comment-17651897 ] Apache Spark commented on SPARK-41533: -- User 'grundprinzip' has created a pull request for this

[jira] [Commented] (SPARK-41277) Save and leverage shuffle key in tblproperties

2022-12-25 Thread Ohad Raviv (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651877#comment-17651877 ] Ohad Raviv commented on SPARK-41277: I managed to do some quick-and-dirty solution, just to be able

[jira] [Assigned] (SPARK-41704) Upgrade `sbt-assembly` from 2.0.0 to 2.1.0

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41704: Assignee: (was: Apache Spark) > Upgrade `sbt-assembly` from 2.0.0 to 2.1.0 >

[jira] [Commented] (SPARK-41704) Upgrade `sbt-assembly` from 2.0.0 to 2.1.0

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651874#comment-17651874 ] Apache Spark commented on SPARK-41704: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-41704) Upgrade `sbt-assembly` from 2.0.0 to 2.1.0

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41704: Assignee: Apache Spark > Upgrade `sbt-assembly` from 2.0.0 to 2.1.0 >

[jira] [Created] (SPARK-41704) Upgrade `sbt-assembly` from 2.0.0 to 2.1.0

2022-12-25 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-41704: --- Summary: Upgrade `sbt-assembly` from 2.0.0 to 2.1.0 Key: SPARK-41704 URL: https://issues.apache.org/jira/browse/SPARK-41704 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-41702) Add invalid ops

2022-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41702. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39206

[jira] [Resolved] (SPARK-41701) Make column op support `decimal`

2022-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41701. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39205

[jira] [Assigned] (SPARK-41701) Make column op support `decimal`

2022-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41701: Assignee: Ruifeng Zheng > Make column op support `decimal` >

[jira] [Assigned] (SPARK-41702) Add invalid ops

2022-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41702: Assignee: Ruifeng Zheng > Add invalid ops > --- > > Key:

[jira] [Assigned] (SPARK-41703) Combine NullType and typed_null

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41703: Assignee: Apache Spark > Combine NullType and typed_null >

[jira] [Assigned] (SPARK-41703) Combine NullType and typed_null

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41703: Assignee: (was: Apache Spark) > Combine NullType and typed_null >

[jira] [Commented] (SPARK-41703) Combine NullType and typed_null

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651870#comment-17651870 ] Apache Spark commented on SPARK-41703: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-41703) Combine NullType and typed_null

2022-12-25 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41703: - Summary: Combine NullType and typed_null Key: SPARK-41703 URL: https://issues.apache.org/jira/browse/SPARK-41703 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-41334) move SortField from relations.proto to expressions.proto

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651868#comment-17651868 ] Apache Spark commented on SPARK-41334: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-41334) move SortField from relations.proto to expressions.proto

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651867#comment-17651867 ] Apache Spark commented on SPARK-41334: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-41111) Implement `DataFrame.show`

2022-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651865#comment-17651865 ] Apache Spark commented on SPARK-4: -- User 'zhengruifeng' has created a pull request for this