[jira] [Assigned] (SPARK-37627) Add sorted column in BucketTransform

[ https://issues.apache.org/jira/browse/SPARK-37627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37627: Assignee: Apache Spark > Add sorted column in BucketTransform >

[jira] [Assigned] (SPARK-37627) Add sorted column in BucketTransform

[ https://issues.apache.org/jira/browse/SPARK-37627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37627: Assignee: (was: Apache Spark) > Add sorted column in BucketTransform >

[jira] [Commented] (SPARK-37627) Add sorted column in BucketTransform

[ https://issues.apache.org/jira/browse/SPARK-37627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458185#comment-17458185 ] Apache Spark commented on SPARK-37627: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Created] (SPARK-37627) Add sorted column in BucketTransform

Huaxin Gao created SPARK-37627: -- Summary: Add sorted column in BucketTransform Key: SPARK-37627 URL: https://issues.apache.org/jira/browse/SPARK-37627 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-37626) Upgrade libthrift to 0.15.0

[ https://issues.apache.org/jira/browse/SPARK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458178#comment-17458178 ] Bo Zhang edited comment on SPARK-37626 at 12/13/21, 7:26 AM: - 0.16.0 is not

[jira] [Assigned] (SPARK-37626) Upgrade libthrift to 0.15.0

[ https://issues.apache.org/jira/browse/SPARK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37626: Assignee: Apache Spark > Upgrade libthrift to 0.15.0 > --- > >

[jira] [Assigned] (SPARK-37626) Upgrade libthrift to 0.15.0

[ https://issues.apache.org/jira/browse/SPARK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37626: Assignee: (was: Apache Spark) > Upgrade libthrift to 0.15.0 >

[jira] [Commented] (SPARK-37626) Upgrade libthrift to 0.15.0

[ https://issues.apache.org/jira/browse/SPARK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458178#comment-17458178 ] Bo Zhang commented on SPARK-37626: -- 0.16.0 is not release yet. Could we upgrade to 0.15.0 first? Here

[jira] [Commented] (SPARK-37626) Upgrade libthrift to 0.15.0

[ https://issues.apache.org/jira/browse/SPARK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458177#comment-17458177 ] Apache Spark commented on SPARK-37626: -- User 'bozhang2820' has created a pull request for this

[jira] [Updated] (SPARK-37626) Upgrade libthrift to 0.15.0

[ https://issues.apache.org/jira/browse/SPARK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Zhang updated SPARK-37626: - Summary: Upgrade libthrift to 0.15.0 (was: Upgrade libthrift to 1.15.0) > Upgrade libthrift to 0.15.0

[jira] [Commented] (SPARK-37626) Upgrade libthrift to 1.15.0

[ https://issues.apache.org/jira/browse/SPARK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458173#comment-17458173 ] Yuming Wang commented on SPARK-37626: - We need to upgrade to 0.16.0 because we need [this

[jira] [Updated] (SPARK-37577) ClassCastException: ArrayType cannot be cast to StructType

[ https://issues.apache.org/jira/browse/SPARK-37577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37577: -- Environment: (was: Py: 3.9) > ClassCastException: ArrayType cannot be cast to StructType

[jira] [Resolved] (SPARK-37577) ClassCastException: ArrayType cannot be cast to StructType

[ https://issues.apache.org/jira/browse/SPARK-37577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37577. --- Fix Version/s: 3.3.0 Assignee: L. C. Hsieh Resolution: Fixed This is

[jira] [Created] (SPARK-37626) Upgrade libthrift to 1.15.0

Bo Zhang created SPARK-37626: Summary: Upgrade libthrift to 1.15.0 Key: SPARK-37626 URL: https://issues.apache.org/jira/browse/SPARK-37626 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-37625) update log4j to 2.15

[ https://issues.apache.org/jira/browse/SPARK-37625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458164#comment-17458164 ] Apache Spark commented on SPARK-37625: -- User 'qwe' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37625) update log4j to 2.15

[ https://issues.apache.org/jira/browse/SPARK-37625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37625: Assignee: Apache Spark > update log4j to 2.15 > - > >

[jira] [Commented] (SPARK-37625) update log4j to 2.15

[ https://issues.apache.org/jira/browse/SPARK-37625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458163#comment-17458163 ] Apache Spark commented on SPARK-37625: -- User 'qwe' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37625) update log4j to 2.15

[ https://issues.apache.org/jira/browse/SPARK-37625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37625: Assignee: (was: Apache Spark) > update log4j to 2.15 > - > >

[jira] [Created] (SPARK-37625) update log4j to 2.15

weifeng zhang created SPARK-37625: - Summary: update log4j to 2.15 Key: SPARK-37625 URL: https://issues.apache.org/jira/browse/SPARK-37625 Project: Spark Issue Type: Improvement

[jira] [Reopened] (SPARK-36571) Optimized FileOutputCommitter with StagingDir

[ https://issues.apache.org/jira/browse/SPARK-36571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu reopened SPARK-36571: --- > Optimized FileOutputCommitter with StagingDir > - > >

[jira] [Resolved] (SPARK-36995) Add new SQLFileCommitProtocol

[ https://issues.apache.org/jira/browse/SPARK-36995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-36995. --- Resolution: Duplicate > Add new SQLFileCommitProtocol > - > >

[jira] [Resolved] (SPARK-36571) Optimized FileOutputCommitter with StagingDir

[ https://issues.apache.org/jira/browse/SPARK-36571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-36571. --- Resolution: Duplicate > Optimized FileOutputCommitter with StagingDir >

[jira] [Assigned] (SPARK-37624) Suppress warnings for live pandas-on-Spark quickstart notebooks

[ https://issues.apache.org/jira/browse/SPARK-37624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37624: Assignee: (was: Apache Spark) > Suppress warnings for live pandas-on-Spark

[jira] [Commented] (SPARK-37624) Suppress warnings for live pandas-on-Spark quickstart notebooks

[ https://issues.apache.org/jira/browse/SPARK-37624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458153#comment-17458153 ] Apache Spark commented on SPARK-37624: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-37624) Suppress warnings for live pandas-on-Spark quickstart notebooks

[ https://issues.apache.org/jira/browse/SPARK-37624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37624: Assignee: Apache Spark > Suppress warnings for live pandas-on-Spark quickstart notebooks

[jira] [Updated] (SPARK-37624) Suppress warnings for live pandas-on-Spark quickstart notebooks

[ https://issues.apache.org/jira/browse/SPARK-37624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37624: - Summary: Suppress warnings for live pandas-on-Spark quickstart notebooks (was: Surppress

[jira] [Updated] (SPARK-37623) Support ANSI Aggregate Function: regr_slope & regr_intercept

[ https://issues.apache.org/jira/browse/SPARK-37623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37623: --- Summary: Support ANSI Aggregate Function: regr_slope & regr_intercept (was: Support ANSI Aggregate

[jira] [Updated] (SPARK-37624) Surppress warnings for live pandas-on-Spark quickstart notebooks

[ https://issues.apache.org/jira/browse/SPARK-37624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37624: - Attachment: Screen Shot 2021-12-13 at 2.02.25 PM.png > Surppress warnings for live

[jira] [Updated] (SPARK-37624) Surppress warnings for live pandas-on-Spark quickstart notebooks

[ https://issues.apache.org/jira/browse/SPARK-37624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37624: - Attachment: Screen Shot 2021-12-13 at 1.32.05 PM.png > Surppress warnings for live

[jira] [Updated] (SPARK-37624) Surppress warnings for live pandas-on-Spark quickstart notebooks

[ https://issues.apache.org/jira/browse/SPARK-37624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37624: - Attachment: Screen Shot 2021-12-13 at 2.02.45 PM.png > Surppress warnings for live

[jira] [Updated] (SPARK-37624) Surppress warnings for live pandas-on-Spark quickstart notebooks

[ https://issues.apache.org/jira/browse/SPARK-37624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37624: - Priority: Minor (was: Major) > Surppress warnings for live pandas-on-Spark quickstart

[jira] [Updated] (SPARK-37624) Surppress warnings for live pandas-on-Spark quickstart notebooks

[ https://issues.apache.org/jira/browse/SPARK-37624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37624: - Attachment: Screen Shot 2021-12-13 at 2.02.20 PM.png > Surppress warnings for live

[jira] [Created] (SPARK-37624) Surppress warnings for live pandas-on-Spark quickstart notebooks

Hyukjin Kwon created SPARK-37624: Summary: Surppress warnings for live pandas-on-Spark quickstart notebooks Key: SPARK-37624 URL: https://issues.apache.org/jira/browse/SPARK-37624 Project: Spark

[jira] [Resolved] (SPARK-37569) View Analysis incorrectly marks nested fields as nullable

[ https://issues.apache.org/jira/browse/SPARK-37569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37569. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34839

[jira] [Assigned] (SPARK-37569) View Analysis incorrectly marks nested fields as nullable

[ https://issues.apache.org/jira/browse/SPARK-37569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37569: --- Assignee: Shardul Mahadik > View Analysis incorrectly marks nested fields as nullable >

[jira] [Resolved] (SPARK-37590) Unify v1 and v2 ALTER NAMESPACE ... SET PROPERTIES tests

[ https://issues.apache.org/jira/browse/SPARK-37590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37590. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34842

[jira] [Assigned] (SPARK-37590) Unify v1 and v2 ALTER NAMESPACE ... SET PROPERTIES tests

[ https://issues.apache.org/jira/browse/SPARK-37590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37590: --- Assignee: Terry Kim > Unify v1 and v2 ALTER NAMESPACE ... SET PROPERTIES tests >

[jira] [Resolved] (SPARK-37300) TaskSchedulerImpl should ignore task finished event if its task was already finished state

[ https://issues.apache.org/jira/browse/SPARK-37300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-37300. -- Fix Version/s: 3.3.0 Assignee: hujiahua Resolution: Fixed Issue resolved by

[jira] [Commented] (SPARK-37623) Support ANSI Aggregate Function: regr_slope

[ https://issues.apache.org/jira/browse/SPARK-37623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458132#comment-17458132 ] jiaan.geng commented on SPARK-37623: I'm working on. > Support ANSI Aggregate Function: regr_slope

[jira] [Created] (SPARK-37623) Support ANSI Aggregate Function: regr_slope

jiaan.geng created SPARK-37623: -- Summary: Support ANSI Aggregate Function: regr_slope Key: SPARK-37623 URL: https://issues.apache.org/jira/browse/SPARK-37623 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-37623) Support ANSI Aggregate Function: regr_slope

[ https://issues.apache.org/jira/browse/SPARK-37623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37623: --- Description: REGR_SLOPE is an ANSI aggregate functions. many database support it. > Support ANSI

[jira] [Commented] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting

[ https://issues.apache.org/jira/browse/SPARK-37481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458131#comment-17458131 ] wuyi commented on SPARK-37481: -- Backport fix to 3.1/3.0 is still in progress. > Disappearance of skipped

[jira] [Resolved] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting

[ https://issues.apache.org/jira/browse/SPARK-37481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-37481. -- Fix Version/s: 3.3.0 3.2.0 Assignee: Kent Yao Resolution: Fixed Issue

[jira] [Commented] (SPARK-37620) Use more precise types for SparkContext Optional fields (i.e. _gateway, _jvm)

[ https://issues.apache.org/jira/browse/SPARK-37620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458128#comment-17458128 ] Byron Hsu commented on SPARK-37620: --- i will work on it > Use more precise types for SparkContext

[jira] [Resolved] (SPARK-37369) Avoid redundant ColumnarToRow transistion on InMemoryTableScan

[ https://issues.apache.org/jira/browse/SPARK-37369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-37369. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34642

[jira] [Assigned] (SPARK-37369) Avoid redundant ColumnarToRow transistion on InMemoryTableScan

[ https://issues.apache.org/jira/browse/SPARK-37369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-37369: --- Assignee: L. C. Hsieh > Avoid redundant ColumnarToRow transistion on InMemoryTableScan >

[jira] [Commented] (SPARK-37622) Support K8s executor rolling policy

[ https://issues.apache.org/jira/browse/SPARK-37622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458116#comment-17458116 ] Apache Spark commented on SPARK-37622: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37622) Support K8s executor rolling policy

[ https://issues.apache.org/jira/browse/SPARK-37622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37622: Assignee: (was: Apache Spark) > Support K8s executor rolling policy >

[jira] [Assigned] (SPARK-37622) Support K8s executor rolling policy

[ https://issues.apache.org/jira/browse/SPARK-37622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37622: Assignee: Apache Spark > Support K8s executor rolling policy >

[jira] [Commented] (SPARK-37622) Support K8s executor rolling policy

[ https://issues.apache.org/jira/browse/SPARK-37622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458115#comment-17458115 ] Apache Spark commented on SPARK-37622: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Resolved] (SPARK-36038) Basic speculation metrics at stage level

[ https://issues.apache.org/jira/browse/SPARK-36038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36038. Assignee: Thejdeep Gudivada Resolution: Fixed Issue resolved in

[jira] [Created] (SPARK-37622) Support K8s executor rolling policy

Dongjoon Hyun created SPARK-37622: - Summary: Support K8s executor rolling policy Key: SPARK-37622 URL: https://issues.apache.org/jira/browse/SPARK-37622 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-37619) Upgrade Maven to 3.8.4

[ https://issues.apache.org/jira/browse/SPARK-37619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37619: Assignee: Dongjoon Hyun > Upgrade Maven to 3.8.4 > -- > >

[jira] [Resolved] (SPARK-37619) Upgrade Maven to 3.8.4

[ https://issues.apache.org/jira/browse/SPARK-37619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37619. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34873

[jira] [Resolved] (SPARK-37603) org.apache.spark.sql.catalyst.expressions.ListQuery; no valid constructor

[ https://issues.apache.org/jira/browse/SPARK-37603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37603. -- Resolution: Cannot Reproduce > org.apache.spark.sql.catalyst.expressions.ListQuery; no valid

[jira] [Commented] (SPARK-37607) Refactor antlr4 syntax file

[ https://issues.apache.org/jira/browse/SPARK-37607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458105#comment-17458105 ] Hyukjin Kwon commented on SPARK-37607: -- [~melin] can you double check the link? it shows no page

[jira] [Resolved] (SPARK-37608) Can anyone help me to compile a scala file

[ https://issues.apache.org/jira/browse/SPARK-37608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37608. -- Resolution: Invalid > Can anyone help me to compile a scala file >

[jira] [Updated] (SPARK-37607) Refactor antlr4 syntax file

[ https://issues.apache.org/jira/browse/SPARK-37607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37607: - Summary: Refactor antlr4 syntax file (was: Optimized antlr4 syntax file) > Refactor antlr4

[jira] [Commented] (SPARK-37608) Can anyone help me to compile a scala file

[ https://issues.apache.org/jira/browse/SPARK-37608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458104#comment-17458104 ] Hyukjin Kwon commented on SPARK-37608: -- For questions, let's discuss in Spark mailing list instead

[jira] [Commented] (SPARK-37609) Transient StackOverflowError on DataFrame from Catalyst QueryPlan

[ https://issues.apache.org/jira/browse/SPARK-37609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458103#comment-17458103 ] Hyukjin Kwon commented on SPARK-37609: -- [~ravwojdyla] I don;t think people will dare to reproduce

[jira] [Commented] (SPARK-37610) Anonymized/obfuscated query plan?

[ https://issues.apache.org/jira/browse/SPARK-37610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458102#comment-17458102 ] Hyukjin Kwon commented on SPARK-37610: -- I think it's better to have workload specific script to

[jira] [Updated] (SPARK-37610) Anonymized/obfuscated query plan

[ https://issues.apache.org/jira/browse/SPARK-37610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37610: - Summary: Anonymized/obfuscated query plan (was: Anonymized/obfuscated query plan?) >

[jira] [Commented] (SPARK-37621) ClassCastException when trying to persist the result of a join between two Iceberg tables

[ https://issues.apache.org/jira/browse/SPARK-37621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458101#comment-17458101 ] Hyukjin Kwon commented on SPARK-37621: -- Is this an issue specific to icebug? or other sources in

[jira] [Updated] (SPARK-37617) In CTAS,replace alias to normal column that satisfy parquet schema

[ https://issues.apache.org/jira/browse/SPARK-37617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiahong.li updated SPARK-37617: --- Description: In CTAS, Replace name columns that have not alias. Mostly, columns without alias

[jira] [Assigned] (SPARK-37598) Pyspark's newAPIHadoopRDD() method fails with ShortWritables

[ https://issues.apache.org/jira/browse/SPARK-37598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37598: Assignee: Keith Massey > Pyspark's newAPIHadoopRDD() method fails with ShortWritables >

[jira] [Resolved] (SPARK-37598) Pyspark's newAPIHadoopRDD() method fails with ShortWritables

[ https://issues.apache.org/jira/browse/SPARK-37598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37598. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34838

[jira] [Created] (SPARK-37621) ClassCastException when trying to persist the result of a join between two Iceberg tables

Ciprian Gerea created SPARK-37621: - Summary: ClassCastException when trying to persist the result of a join between two Iceberg tables Key: SPARK-37621 URL: https://issues.apache.org/jira/browse/SPARK-37621

[jira] [Commented] (SPARK-37620) Use more precise types for SparkContext Optional fields (i.e. _gateway, _jvm)

[ https://issues.apache.org/jira/browse/SPARK-37620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458050#comment-17458050 ] Maciej Szymkiewicz commented on SPARK-37620: FYI [~ueshin] [~itholic] [~XinrongM]

[jira] [Created] (SPARK-37620) Use more precise types for SparkContext Optional fields (i.e. _gateway, _jvm)

Maciej Szymkiewicz created SPARK-37620: -- Summary: Use more precise types for SparkContext Optional fields (i.e. _gateway, _jvm) Key: SPARK-37620 URL: https://issues.apache.org/jira/browse/SPARK-37620

[jira] [Resolved] (SPARK-37152) Inline type hints for python/pyspark/context.py

[ https://issues.apache.org/jira/browse/SPARK-37152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37152. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-37152) Inline type hints for python/pyspark/context.py

[ https://issues.apache.org/jira/browse/SPARK-37152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37152: -- Assignee: Byron Hsu > Inline type hints for python/pyspark/context.py >

[jira] [Assigned] (SPARK-37619) Upgrade Maven to 3.8.4

[ https://issues.apache.org/jira/browse/SPARK-37619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37619: Assignee: (was: Apache Spark) > Upgrade Maven to 3.8.4 > -- > >

[jira] [Commented] (SPARK-37619) Upgrade Maven to 3.8.4

[ https://issues.apache.org/jira/browse/SPARK-37619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458019#comment-17458019 ] Apache Spark commented on SPARK-37619: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37619) Upgrade Maven to 3.8.4

[ https://issues.apache.org/jira/browse/SPARK-37619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37619: Assignee: Apache Spark > Upgrade Maven to 3.8.4 > -- > >

[jira] [Created] (SPARK-37619) Upgrade Maven to 3.8.4

Dongjoon Hyun created SPARK-37619: - Summary: Upgrade Maven to 3.8.4 Key: SPARK-37619 URL: https://issues.apache.org/jira/browse/SPARK-37619 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-37618) Support cleaning up shuffle blocks from external shuffle service

Adam Binford created SPARK-37618: Summary: Support cleaning up shuffle blocks from external shuffle service Key: SPARK-37618 URL: https://issues.apache.org/jira/browse/SPARK-37618 Project: Spark

[jira] [Assigned] (SPARK-37617) In CTAS,replace alias to normal column that satisfy parquet schema

[ https://issues.apache.org/jira/browse/SPARK-37617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37617: Assignee: Apache Spark > In CTAS,replace alias to normal column that satisfy parquet

[jira] [Assigned] (SPARK-37617) In CTAS,replace alias to normal column that satisfy parquet schema

[ https://issues.apache.org/jira/browse/SPARK-37617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37617: Assignee: (was: Apache Spark) > In CTAS,replace alias to normal column that satisfy

[jira] [Commented] (SPARK-37617) In CTAS,replace alias to normal column that satisfy parquet schema

[ https://issues.apache.org/jira/browse/SPARK-37617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457977#comment-17457977 ] Apache Spark commented on SPARK-37617: -- User 'monkeyboy123' has created a pull request for this

[jira] [Created] (SPARK-37617) In CTAS,replace alias to normal column that satisfy parquet schema

jiahong.li created SPARK-37617: -- Summary: In CTAS,replace alias to normal column that satisfy parquet schema Key: SPARK-37617 URL: https://issues.apache.org/jira/browse/SPARK-37617 Project: Spark

[jira] [Updated] (SPARK-37575) null values should be saved as nothing rather than quoted empty Strings "" by default settings

[ https://issues.apache.org/jira/browse/SPARK-37575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guo Wei updated SPARK-37575: Summary: null values should be saved as nothing rather than quoted empty Strings "" by default settings

[jira] [Assigned] (SPARK-37616) Support pushing down a dynamic partition pruning from one join to other joins

[ https://issues.apache.org/jira/browse/SPARK-37616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37616: Assignee: (was: Apache Spark) > Support pushing down a dynamic partition pruning

[jira] [Assigned] (SPARK-37616) Support pushing down a dynamic partition pruning from one join to other joins

[ https://issues.apache.org/jira/browse/SPARK-37616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37616: Assignee: Apache Spark > Support pushing down a dynamic partition pruning from one join

[jira] [Commented] (SPARK-37616) Support pushing down a dynamic partition pruning from one join to other joins

[ https://issues.apache.org/jira/browse/SPARK-37616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457928#comment-17457928 ] Apache Spark commented on SPARK-37616: -- User 'weixiuli' has created a pull request for this issue:

[jira] [Commented] (SPARK-37616) Support pushing down a dynamic partition pruning from one join to other joins

[ https://issues.apache.org/jira/browse/SPARK-37616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457929#comment-17457929 ] Apache Spark commented on SPARK-37616: -- User 'weixiuli' has created a pull request for this issue:

[jira] [Created] (SPARK-37616) Support pushing down a dynamic partition pruning from one join to other joins

weixiuli created SPARK-37616: Summary: Support pushing down a dynamic partition pruning from one join to other joins Key: SPARK-37616 URL: https://issues.apache.org/jira/browse/SPARK-37616 Project: Spark