[jira] [Created] (SPARK-51216) Remove the useless bigtop-dist profile and the related outdated files

2025-02-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-51216: Summary: Remove the useless bigtop-dist profile and the related outdated files Key: SPARK-51216 URL: https://issues.apache.org/jira/browse/SPARK-51216 Project: Spark

[jira] [Resolved] (SPARK-51186) Add StreamingPythonRunnerInitializationException to PySpark base exception

2025-02-13 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-51186. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49917 [https://gith

[jira] [Assigned] (SPARK-51186) Add StreamingPythonRunnerInitializationException to PySpark base exception

2025-02-13 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee reassigned SPARK-51186: --- Assignee: Haejoon Lee > Add StreamingPythonRunnerInitializationException to PySpark base ex

[jira] [Updated] (SPARK-51216) Remove the useless bigtop-dist profile and the related outdated files

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51216: --- Labels: pull-request-available (was: ) > Remove the useless bigtop-dist profile and the rel

[jira] [Updated] (SPARK-51207) SPIP: Constraints in DSv2

2025-02-13 Thread Anton Okolnychyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Okolnychyi updated SPARK-51207: - Description: This SPIP suggests extending the DSv2 API to let users define, modify, and

[jira] [Updated] (SPARK-51215) Add a helper function to invoke helper model attr

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51215: --- Labels: pull-request-available (was: ) > Add a helper function to invoke helper model attr

[jira] [Created] (SPARK-51215) Add a helper function to invoke helper model attr

2025-02-13 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-51215: - Summary: Add a helper function to invoke helper model attr Key: SPARK-51215 URL: https://issues.apache.org/jira/browse/SPARK-51215 Project: Spark Issue Typ

[jira] [Updated] (SPARK-51207) SPIP: Constraints in DSv2

2025-02-13 Thread Anton Okolnychyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Okolnychyi updated SPARK-51207: - Shepherd: Wenchen Fan > SPIP: Constraints in DSv2 > - > >

[jira] [Updated] (SPARK-37196) NPE in org.apache.spark.sql.hive.HiveShim$.toCatalystDecimal(HiveShim.scala:106)

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-37196: --- Labels: pull-request-available (was: ) > NPE in > org.apache.spark.sql.hive.HiveShim$.toCa

[jira] [Resolved] (SPARK-51204) Upgrade `sbt-assembly` to 2.3.1

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51204. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49939 [https://

[jira] [Updated] (SPARK-51213) Keep Expression class info for hint parameters

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51213: --- Labels: pull-request-available (was: ) > Keep Expression class info for hint parameters > -

[jira] [Updated] (SPARK-51213) Keep Expression class info for hint parameters

2025-02-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-51213: - Summary: Keep Expression class info for hint parameters (was: Keep class info for hint parameters) > K

[jira] [Created] (SPARK-51213) Keep class info for hint parameters

2025-02-13 Thread Kent Yao (Jira)
Kent Yao created SPARK-51213: Summary: Keep class info for hint parameters Key: SPARK-51213 URL: https://issues.apache.org/jira/browse/SPARK-51213 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-51201) Make Partitioning Hints support byte and short values

2025-02-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-51201. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49933 [https://github.com

[jira] [Assigned] (SPARK-51201) Make Partitioning Hints support byte and short values

2025-02-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-51201: Assignee: Kent Yao > Make Partitioning Hints support byte and short values >

[jira] [Assigned] (SPARK-51177) Add InvalidCommandInput to Spark Connect Python client

2025-02-13 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee reassigned SPARK-51177: --- Assignee: Haejoon Lee > Add InvalidCommandInput to Spark Connect Python client > --

[jira] [Resolved] (SPARK-51177) Add InvalidCommandInput to Spark Connect Python client

2025-02-13 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-51177. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49916 [https://gith

[jira] [Updated] (SPARK-51212) Add a separated PySpark package for Spark Connect by default.

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51212: --- Labels: pull-request-available (was: ) > Add a separated PySpark package for Spark Connect

[jira] [Created] (SPARK-51212) Add a separated PySpark package for Spark Connect by default.

2025-02-13 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-51212: - Summary: Add a separated PySpark package for Spark Connect by default. Key: SPARK-51212 URL: https://issues.apache.org/jira/browse/SPARK-51212 Project: Spark

[jira] [Resolved] (SPARK-51210) Add `--enable-native-access=ALL-UNNAMED` to Java options for Java 24+

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51210. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49944 [https://

[jira] [Resolved] (SPARK-51209) Improve `getCurrentUserName` to handle Java 24+

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51209. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49943 [https://

[jira] [Assigned] (SPARK-51210) Add `--enable-native-access=ALL-UNNAMED` to Java options for Java 24+

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51210: - Assignee: Dongjoon Hyun > Add `--enable-native-access=ALL-UNNAMED` to Java options for

[jira] [Resolved] (SPARK-51208) ColumnDefinition.toV1Column should preserve EXISTS_DEFAULT resolution

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51208. --- Fix Version/s: 4.0.0 Assignee: Szehon Ho Resolution: Fixed This is resolved

[jira] [Updated] (SPARK-51210) Add `--enable-native-access=ALL-UNNAMED` to Java options for Java 24+

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51210: -- Summary: Add `--enable-native-access=ALL-UNNAMED` to Java options for Java 24+ (was: Add `--e

[jira] [Updated] (SPARK-51210) Add `--enable-native-access=ALL-UNNAMED` to Java options

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51210: --- Labels: pull-request-available (was: ) > Add `--enable-native-access=ALL-UNNAMED` to Java o

[jira] [Created] (SPARK-51211) Rename the option of readChangeFeed to readChangeLog in state store reader

2025-02-13 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-51211: Summary: Rename the option of readChangeFeed to readChangeLog in state store reader Key: SPARK-51211 URL: https://issues.apache.org/jira/browse/SPARK-51211 Project: S

[jira] [Created] (SPARK-51210) Add `--enable-native-access=ALL-UNNAMED` to Java options

2025-02-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51210: - Summary: Add `--enable-native-access=ALL-UNNAMED` to Java options Key: SPARK-51210 URL: https://issues.apache.org/jira/browse/SPARK-51210 Project: Spark Is

[jira] [Assigned] (SPARK-51209) Improve `getCurrentUserName` to handle Java 24+

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51209: - Assignee: Dongjoon Hyun > Improve `getCurrentUserName` to handle Java 24+ > ---

[jira] [Updated] (SPARK-51209) Improve `getCurrentUserName` to handle Java 24+

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51209: --- Labels: pull-request-available (was: ) > Improve `getCurrentUserName` to handle Java 24+ >

[jira] [Created] (SPARK-51209) Improve `getCurrentUserName` to handle Java 24+

2025-02-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51209: - Summary: Improve `getCurrentUserName` to handle Java 24+ Key: SPARK-51209 URL: https://issues.apache.org/jira/browse/SPARK-51209 Project: Spark Issue Type:

[jira] [Updated] (SPARK-51208) ColumnDefinition.toV1Column should preserve EXISTS_DEFAULT resolution

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51208: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > ColumnDefinition.toV1Column sho

[jira] [Commented] (SPARK-51123) Fix Spark 3.5.1 doc site

2025-02-13 Thread Sakthi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17926936#comment-17926936 ] Sakthi commented on SPARK-51123: WIP: https://github.com/apache/spark-website/pull/585

[jira] [Resolved] (SPARK-51205) Upgrade `bytebuddy` to 1.17.0 to support Java 25

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51205. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49940 [https://

[jira] [Updated] (SPARK-51208) ColumnDefinition.toV1Column should preserve EXISTS_DEFAULT resolution

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51208: --- Labels: pull-request-available (was: ) > ColumnDefinition.toV1Column should preserve EXISTS

[jira] [Created] (SPARK-51208) ColumnDefinition.toV1Column should preserve EXISTS_DEFAULT resolution

2025-02-13 Thread Szehon Ho (Jira)
Szehon Ho created SPARK-51208: - Summary: ColumnDefinition.toV1Column should preserve EXISTS_DEFAULT resolution Key: SPARK-51208 URL: https://issues.apache.org/jira/browse/SPARK-51208 Project: Spark

[jira] [Updated] (SPARK-51206) Python Data Sources incorrectly imports from Spark Connect

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51206: --- Labels: pull-request-available (was: ) > Python Data Sources incorrectly imports from Spark

[jira] [Updated] (SPARK-50855) Spark Connect Support for TransformWithState In Scala

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50855: -- Parent Issue: SPARK-51166 (was: SPARK-44111) > Spark Connect Support for TransformWithState I

[jira] [Resolved] (SPARK-51185) Revert simplifications to PartitionedFileUtil API due to increased risk of OOM

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51185. --- Fix Version/s: 4.0.0 Resolution: Fixed This is resolved via https://github.com/apache

[jira] [Created] (SPARK-51207) SPIP: Constraints in DSv2

2025-02-13 Thread Anton Okolnychyi (Jira)
Anton Okolnychyi created SPARK-51207: Summary: SPIP: Constraints in DSv2 Key: SPARK-51207 URL: https://issues.apache.org/jira/browse/SPARK-51207 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-51113) Correctness issue with UNION/EXCEPT/INTERSECT inside a view or EXECUTE IMMEDIATE

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51113. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49937 [https://

[jira] [Assigned] (SPARK-51113) Correctness issue with UNION/EXCEPT/INTERSECT inside a view or EXECUTE IMMEDIATE

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51113: - Assignee: Vladimir Golubev > Correctness issue with UNION/EXCEPT/INTERSECT inside a vie

[jira] [Created] (SPARK-51206) Python Data Sources incorrectly imports from Spark Connect

2025-02-13 Thread Haoyu Weng (Jira)
Haoyu Weng created SPARK-51206: -- Summary: Python Data Sources incorrectly imports from Spark Connect Key: SPARK-51206 URL: https://issues.apache.org/jira/browse/SPARK-51206 Project: Spark Issue

[jira] [Assigned] (SPARK-51205) Upgrade `bytebuddy` to 1.17.0 to support Java 25

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51205: - Assignee: Dongjoon Hyun > Upgrade `bytebuddy` to 1.17.0 to support Java 25 > --

[jira] [Updated] (SPARK-51205) Upgrade `bytebuddy` to 1.17.0 to support Java 25

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51205: -- Component/s: Build > Upgrade `bytebuddy` to 1.17.0 to support Java 25 > --

[jira] [Updated] (SPARK-51205) Upgrade `bytebuddy` to 1.17.0 to support Java 25

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51205: --- Labels: pull-request-available (was: ) > Upgrade `bytebuddy` to 1.17.0 to support Java 25 >

[jira] [Created] (SPARK-51205) Upgrade `bytebuddy` to 1.17.0 to support Java 25

2025-02-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51205: - Summary: Upgrade `bytebuddy` to 1.17.0 to support Java 25 Key: SPARK-51205 URL: https://issues.apache.org/jira/browse/SPARK-51205 Project: Spark Issue Type

[jira] [Created] (SPARK-51204) Upgrade `sbt-assembly` to 2.3.1

2025-02-13 Thread Wei Guo (Jira)
Wei Guo created SPARK-51204: --- Summary: Upgrade `sbt-assembly` to 2.3.1 Key: SPARK-51204 URL: https://issues.apache.org/jira/browse/SPARK-51204 Project: Spark Issue Type: Improvement Compo

[jira] [Updated] (SPARK-51046) `SubExprEliminationBenchmark` fails at `CodeGenerator`

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51046: --- Labels: pull-request-available (was: ) > `SubExprEliminationBenchmark` fails at `CodeGenera

[jira] [Updated] (SPARK-51067) Revert session level collation for DML queries and apply object level collation for DDL queries

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51067: -- Epic Link: (was: SPARK-46830) > Revert session level collation for DML queries and apply o

[jira] [Updated] (SPARK-51067) Revert session level collation for DML queries and apply object level collation for DDL queries

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51067: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Revert session level co

[jira] [Resolved] (SPARK-51067) Revert session level collation for DML queries and apply object level collation for DDL queries

2025-02-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51067. - Resolution: Fixed Issue resolved by pull request 49772 [https://github.com/apache/spark/pull/497

[jira] [Updated] (SPARK-51181) Enforce determinism when pulling out non deterministic expressions from logical plan

2025-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51181: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Improvement) > Enforce determinism whe

[jira] [Assigned] (SPARK-51181) Enforce determinism when pulling out non deterministic expressions from logical plan

2025-02-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51181: --- Assignee: Mihailo Aleksic > Enforce determinism when pulling out non deterministic expressi

[jira] [Resolved] (SPARK-51181) Enforce determinism when pulling out non deterministic expressions from logical plan

2025-02-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51181. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49935 [https://gith

[jira] [Updated] (SPARK-51203) ForceOptimizeSkewedJoin does not take effect for child aggregations in skewed join

2025-02-13 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Wang updated SPARK-51203: -- Description: ForceOptimizeSkewedJoin allows optimizing skewed join even if introduce extra shuffle, bu

[jira] [Updated] (SPARK-51203) ForceOptimizeSkewedJoin does not take effect for child aggregations in skewed join

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51203: --- Labels: pull-request-available (was: ) > ForceOptimizeSkewedJoin does not take effect for c

[jira] [Created] (SPARK-51203) ForceOptimizeSkewedJoin does not take effect for child aggregations in skewed join

2025-02-13 Thread Zhen Wang (Jira)
Zhen Wang created SPARK-51203: - Summary: ForceOptimizeSkewedJoin does not take effect for child aggregations in skewed join Key: SPARK-51203 URL: https://issues.apache.org/jira/browse/SPARK-51203 Project:

[jira] [Resolved] (SPARK-49872) Spark History UI -- StreamConstraintsException: String length (20054016) exceeds the maximum length (20000000)

2025-02-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-49872. - Resolution: Duplicate > Spark History UI -- StreamConstraintsException: String length (20054016)

[jira] [Updated] (SPARK-51181) Enforce determinism when pulling out non deterministic expressions from logical plan

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51181: --- Labels: pull-request-available (was: ) > Enforce determinism when pulling out non determini

[jira] [Resolved] (SPARK-51200) Add SparkR deprecation info to `README.md` and `make-distribution.sh` help

2025-02-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-51200. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49931 [https://github.com

[jira] [Resolved] (SPARK-51198) Revise `defaultMinPartitions` function description

2025-02-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-51198. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49929 [https://github.com

[jira] [Updated] (SPARK-51201) Make Partitioning Hints support byte and short values

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51201: --- Labels: pull-request-available (was: ) > Make Partitioning Hints support byte and short val

[jira] [Updated] (SPARK-51202) Pass the session in meta algorithm python writers

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51202: --- Labels: pull-request-available (was: ) > Pass the session in meta algorithm python writers

[jira] [Created] (SPARK-51202) Pass the session in meta algorithm python writers

2025-02-13 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-51202: - Summary: Pass the session in meta algorithm python writers Key: SPARK-51202 URL: https://issues.apache.org/jira/browse/SPARK-51202 Project: Spark Issue Typ

[jira] [Updated] (SPARK-7101) Spark SQL should support java.sql.Time

2025-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-7101: -- Labels: pull-request-available (was: ) > Spark SQL should support java.sql.Time >