[jira] [Updated] (SPARK-34023) Updated to Kryo 5.0.3

2025-04-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34023: - Affects Version/s: 3.5.5 4.0.0 4.1.0 > Updated to Kryo 5.0

[jira] [Resolved] (SPARK-51788) Add a PySpark daily test using the Ubuntu Arm Runner

2025-04-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-51788. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50574 [https://

[jira] [Created] (SPARK-51791) ImputerModel stores coefficients with arrays instead of dataframe

2025-04-13 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-51791: - Summary: ImputerModel stores coefficients with arrays instead of dataframe Key: SPARK-51791 URL: https://issues.apache.org/jira/browse/SPARK-51791 Project: Spark

[jira] [Updated] (SPARK-51789) Respect spark.api.mode and spark.remote properly when parsing arguments in Spark Submission

2025-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-51789: - Component/s: Spark Core (was: PySpark) > Respect spark.api.mode and spark.r

[jira] [Resolved] (SPARK-51785) Support `addTag/removeTag/getTags/clearTags` in `SparkSession`

2025-04-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51785. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 5

[jira] [Resolved] (SPARK-51789) Respect spark.api.mode and spark.remote properly when parsing arguments in Spark Submission

2025-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51789. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50575 [https://gi

[jira] [Updated] (SPARK-51790) Register UTF8String to KryoSerializer

2025-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51790: --- Labels: pull-request-available (was: ) > Register UTF8String to KryoSerializer > --

[jira] [Assigned] (SPARK-51780) Implement Describe Procedure

2025-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51780: --- Assignee: Szehon Ho > Implement Describe Procedure > > >

[jira] [Resolved] (SPARK-51780) Implement Describe Procedure

2025-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51780. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50569 [https://gith

[jira] [Assigned] (SPARK-51789) Respect spark.api.mode and spark.remote properly when parsing arguments in Spark Submission

2025-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51789: Assignee: Hyukjin Kwon > Respect spark.api.mode and spark.remote properly when parsing ar

[jira] [Assigned] (SPARK-51513) Fix RewriteMergeIntoTable rule produces unresolved plan

2025-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51513: Assignee: Yuming Wang > Fix RewriteMergeIntoTable rule produces unresolved plan > ---

[jira] [Resolved] (SPARK-51513) Fix RewriteMergeIntoTable rule produces unresolved plan

2025-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51513. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50281 [https://gi

[jira] [Updated] (SPARK-51789) Respect spark.api.mode and spark.remote properly when parsing arguments in Spark Submission

2025-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51789: --- Labels: pull-request-available (was: ) > Respect spark.api.mode and spark.remote properly w

[jira] [Created] (SPARK-51790) Register UTF8String to KryoSerializer

2025-04-13 Thread Kent Yao (Jira)
Kent Yao created SPARK-51790: Summary: Register UTF8String to KryoSerializer Key: SPARK-51790 URL: https://issues.apache.org/jira/browse/SPARK-51790 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-51789) Respect spark.api.mode and spark.remote properly when parsing arguments in Spark Submission

2025-04-13 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-51789: Summary: Respect spark.api.mode and spark.remote properly when parsing arguments in Spark Submission Key: SPARK-51789 URL: https://issues.apache.org/jira/browse/SPARK-51789

[jira] [Updated] (SPARK-51789) Respect spark.api.mode and spark.remote properly when parsing arguments in Spark Submission

2025-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-51789: - Issue Type: Bug (was: Improvement) > Respect spark.api.mode and spark.remote properly when pars

[jira] [Resolved] (SPARK-51776) Fix logging in single-pass Analyzer

2025-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51776. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50565 [https://gith

[jira] [Assigned] (SPARK-51776) Fix logging in single-pass Analyzer

2025-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51776: --- Assignee: Vladimir Golubev > Fix logging in single-pass Analyzer >

[jira] [Assigned] (SPARK-51787) Remove `sessionID` parameter from `getExecutePlanRequest`

2025-04-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51787: - Assignee: Dongjoon Hyun > Remove `sessionID` parameter from `getExecutePlanRequest` > -

[jira] [Created] (SPARK-51788) Add a PySpark daily test using the Ubuntu Arm Runner

2025-04-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-51788: Summary: Add a PySpark daily test using the Ubuntu Arm Runner Key: SPARK-51788 URL: https://issues.apache.org/jira/browse/SPARK-51788 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-51788) Add a PySpark daily test using the Ubuntu Arm Runner

2025-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51788: --- Labels: pull-request-available (was: ) > Add a PySpark daily test using the Ubuntu Arm Runn

[jira] [Resolved] (SPARK-51787) Remove `sessionID` parameter from `getExecutePlanRequest`

2025-04-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51787. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 5

[jira] [Updated] (SPARK-51701) Move test objects to a separate file.

2025-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-51701: - Affects Version/s: 3.5.5 4.0.0 > Move test objects to a separate file. >

[jira] [Updated] (SPARK-51787) Remove `sessionID` parameter from `getExecutePlanRequest`

2025-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51787: --- Labels: pull-request-available (was: ) > Remove `sessionID` parameter from `getExecutePlanR

[jira] [Created] (SPARK-51787) Remove `sessionID` parameter from `getExecutePlanRequest`

2025-04-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51787: - Summary: Remove `sessionID` parameter from `getExecutePlanRequest` Key: SPARK-51787 URL: https://issues.apache.org/jira/browse/SPARK-51787 Project: Spark I

[jira] [Updated] (SPARK-51785) Support `addTag/removeTag/getTags/clearTags` in `SparkSession`

2025-04-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51785: -- Parent: SPARK-51448 Issue Type: Sub-task (was: Improvement) > Support `addTag/removeT

[jira] [Assigned] (SPARK-51785) Support `addTag/removeTag/getTags/clearTags` in `SparkSession`

2025-04-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51785: - Assignee: Dongjoon Hyun > Support `addTag/removeTag/getTags/clearTags` in `SparkSession

[jira] [Resolved] (SPARK-51739) Validate Arrow schema from mapInArrow & mapInPandas & DataSource

2025-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51739. -- Resolution: Fixed Issue resolved by pull request 50531 [https://github.com/apache/spark/pull/5

[jira] [Assigned] (SPARK-51739) Validate Arrow schema from mapInArrow & mapInPandas & DataSource

2025-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51739: Assignee: Haoyu Weng > Validate Arrow schema from mapInArrow & mapInPandas & DataSource >

[jira] [Resolved] (SPARK-51774) Add GRPC Status code to Python Connect GRPC Exception

2025-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51774. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50564 [https://gi

[jira] [Assigned] (SPARK-51774) Add GRPC Status code to Python Connect GRPC Exception

2025-04-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51774: Assignee: Yihong He > Add GRPC Status code to Python Connect GRPC Exception > ---

[jira] [Created] (SPARK-51786) Support expression-based column defaults in DSv2

2025-04-13 Thread Anton Okolnychyi (Jira)
Anton Okolnychyi created SPARK-51786: Summary: Support expression-based column defaults in DSv2 Key: SPARK-51786 URL: https://issues.apache.org/jira/browse/SPARK-51786 Project: Spark Issu

[jira] [Assigned] (SPARK-51752) Enable rCTE referencing from within a CTE

2025-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51752: --- Assignee: Pavle Martinović > Enable rCTE referencing from within a CTE > --

[jira] [Resolved] (SPARK-51752) Enable rCTE referencing from within a CTE

2025-04-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51752. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50546 [https://gith

[jira] [Updated] (SPARK-51785) Support `addTag/removeTag/getTags/clearTags` in `SparkSession`

2025-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51785: --- Labels: pull-request-available (was: ) > Support `addTag/removeTag/getTags/clearTags` in `S

[jira] [Updated] (SPARK-51785) Support `addTag/removeTag/getTags/clearTags` in `SparkSession`

2025-04-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51785: -- Summary: Support `addTag/removeTag/getTags/clearTags` in `SparkSession` (was: Support `addTag

[jira] [Created] (SPARK-51785) Support `addTag/removeTag/getTags/clearTags`

2025-04-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51785: - Summary: Support `addTag/removeTag/getTags/clearTags` Key: SPARK-51785 URL: https://issues.apache.org/jira/browse/SPARK-51785 Project: Spark Issue Type: Im