[jira] [Resolved] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-8582. Fix Version/s: 3.3.0 Target Version/s: (was: ) Resolution: Fixed Issue resolved

[jira] [Resolved] (SPARK-37733) Change log level of tests to WARN

[ https://issues.apache.org/jira/browse/SPARK-37733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-37733. - Resolution: Won't Fix > Change log level of tests to WARN > - >

[jira] [Commented] (SPARK-37733) Change log level of tests to WARN

[ https://issues.apache.org/jira/browse/SPARK-37733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469096#comment-17469096 ] L. C. Hsieh commented on SPARK-37733: - I think this is not necessary now. So closing it. Feel free

[jira] [Resolved] (SPARK-33701) Adaptive shuffle merge finalization for push-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-33701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-33701. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-33701) Adaptive shuffle merge finalization for push-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-33701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-33701: --- Assignee: Venkata krishnan Sowrirajan > Adaptive shuffle merge

[jira] [Assigned] (SPARK-37807) Fix a typo in HttpAuthenticationException message

[ https://issues.apache.org/jira/browse/SPARK-37807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37807: - Assignee: ramakrishna chilaka > Fix a typo in HttpAuthenticationException message >

[jira] [Updated] (SPARK-37807) Fix a typo in HttpAuthenticationException message

[ https://issues.apache.org/jira/browse/SPARK-37807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37807: -- Priority: Trivial (was: Major) > Fix a typo in HttpAuthenticationException message >

[jira] [Resolved] (SPARK-37807) Hivethriftserver2 send proper exception message

[ https://issues.apache.org/jira/browse/SPARK-37807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37807. --- Fix Version/s: 3.3.0 3.2.1 3.1.3 Resolution:

[jira] [Updated] (SPARK-37807) Fix a typo in HttpAuthenticationException message

[ https://issues.apache.org/jira/browse/SPARK-37807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37807: -- Summary: Fix a typo in HttpAuthenticationException message (was: Hivethriftserver2 send

[jira] [Updated] (SPARK-37808) Invalid call to nullable on unresolved object, tree: 'corp_name

[ https://issues.apache.org/jira/browse/SPARK-37808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jerryMa updated SPARK-37808: Description: i use spark-sql run a sql file,but also ocurrs error like below : 

[jira] [Assigned] (SPARK-37813) ORC read benchmark should enable vectorization for nested column

[ https://issues.apache.org/jira/browse/SPARK-37813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37813: - Assignee: Cheng Su > ORC read benchmark should enable vectorization for nested column

[jira] [Resolved] (SPARK-37813) ORC read benchmark should enable vectorization for nested column

[ https://issues.apache.org/jira/browse/SPARK-37813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37813. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35102

[jira] [Resolved] (SPARK-37786) StreamingQueryListener should also support SQLConf

[ https://issues.apache.org/jira/browse/SPARK-37786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37786. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35092

[jira] [Updated] (SPARK-37808) Invalid call to nullable on unresolved object, tree: 'corp_name

[ https://issues.apache.org/jira/browse/SPARK-37808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jerryMa updated SPARK-37808: Description: i use spark-sql run a sql file,but also ocurrs error like below : 

[jira] [Assigned] (SPARK-37786) StreamingQueryListener should also support SQLConf

[ https://issues.apache.org/jira/browse/SPARK-37786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37786: Assignee: angerszhu > StreamingQueryListener should also support SQLConf >

[jira] [Commented] (SPARK-37808) Invalid call to nullable on unresolved object, tree: 'corp_name

[ https://issues.apache.org/jira/browse/SPARK-37808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469037#comment-17469037 ] jerryMa commented on SPARK-37808: - [~hyukjin.kwon] Thanks,i'll give the example to test for you  alter

[jira] [Comment Edited] (SPARK-37808) Invalid call to nullable on unresolved object, tree: 'corp_name

[ https://issues.apache.org/jira/browse/SPARK-37808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469037#comment-17469037 ] jerryMa edited comment on SPARK-37808 at 1/5/22, 6:28 AM: -- [~hyukjin.kwon]

[jira] [Updated] (SPARK-37808) Invalid call to nullable on unresolved object, tree: 'corp_name

[ https://issues.apache.org/jira/browse/SPARK-37808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jerryMa updated SPARK-37808: Description: i use spark-sql run a sql file,but also ocurrs error like below : 

[jira] [Resolved] (SPARK-37808) Invalid call to nullable on unresolved object, tree: 'corp_name

[ https://issues.apache.org/jira/browse/SPARK-37808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37808. -- Resolution: Invalid > Invalid call to nullable on unresolved object, tree: 'corp_name >

[jira] [Commented] (SPARK-37808) Invalid call to nullable on unresolved object, tree: 'corp_name

[ https://issues.apache.org/jira/browse/SPARK-37808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469017#comment-17469017 ] Hyukjin Kwon commented on SPARK-37808: -- Sounds more like a question. Let's ask user mailing list

[jira] [Commented] (SPARK-37814) Migrating from log4j 1 to log4j 2

[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469015#comment-17469015 ] L. C. Hsieh commented on SPARK-37814: - Thanks [~hyukjin.kwon][~dongjoon]. > Migrating from log4j 1

[jira] [Comment Edited] (SPARK-37814) Migrating from log4j 1 to log4j 2

[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469015#comment-17469015 ] L. C. Hsieh edited comment on SPARK-37814 at 1/5/22, 4:37 AM: -- Thanks

[jira] [Commented] (SPARK-37814) Migrating from log4j 1 to log4j 2

[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469014#comment-17469014 ] Dongjoon Hyun commented on SPARK-37814: --- Thank you, [~hyukjin.kwon]! > Migrating from log4j 1 to

[jira] [Updated] (SPARK-37805) Refactor TestUtils#configTestLog4j method to use log4j2 api

[ https://issues.apache.org/jira/browse/SPARK-37805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-37805: Parent: SPARK-37814 Issue Type: Sub-task (was: Improvement) > Refactor

[jira] [Commented] (SPARK-37814) Migrating from log4j 1 to log4j 2

[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469013#comment-17469013 ] Hyukjin Kwon commented on SPARK-37814: -- Sounds good! > Migrating from log4j 1 to log4j 2 >

[jira] [Updated] (SPARK-37814) Migrating from log4j 1 to log4j 2

[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37814: -- Target Version/s: 3.3.0 > Migrating from log4j 1 to log4j 2 >

[jira] [Resolved] (SPARK-37814) Migrating from log4j 1 to log4j 2

[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37814. --- Fix Version/s: 3.3.0 Resolution: Fixed I resolve this issue because it's working now

[jira] [Updated] (SPARK-37814) Migrating from log4j 1 to log4j 2

[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37814: -- Labels: releasenotes (was: ) > Migrating from log4j 1 to log4j 2 >

[jira] [Commented] (SPARK-37814) Migrating from log4j 1 to log4j 2

[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469012#comment-17469012 ] Hyukjin Kwon commented on SPARK-37814: -- I added SPARK-37727 as a link for now .. because

[jira] [Updated] (SPARK-37795) Add a scalastyle rule to ban `org.apache.log4j`

[ https://issues.apache.org/jira/browse/SPARK-37795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-37795: Parent: SPARK-37814 Issue Type: Sub-task (was: Improvement) > Add a scalastyle rule to

[jira] [Commented] (SPARK-37814) Migrating from log4j 1 to log4j 2

[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469009#comment-17469009 ] Dongjoon Hyun commented on SPARK-37814: --- Thank you for collecting this, [~viirya]. cc [~dbtsai],

[jira] [Assigned] (SPARK-37814) Migrating from log4j 1 to log4j 2

[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37814: - Assignee: L. C. Hsieh > Migrating from log4j 1 to log4j 2 >

[jira] [Updated] (SPARK-37814) Migrating from log4j 1 to log4j 2

[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-37814: Description: This is umbrella ticket for all tasks related to migrating to log4j2. > Migrating

[jira] [Updated] (SPARK-37685) Make log event immutable for LogAppender

[ https://issues.apache.org/jira/browse/SPARK-37685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-37685: Parent: SPARK-37814 Issue Type: Sub-task (was: Test) > Make log event immutable for

[jira] [Updated] (SPARK-37684) Upgrade log4j to 2.17

[ https://issues.apache.org/jira/browse/SPARK-37684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-37684: Parent: SPARK-37814 Issue Type: Sub-task (was: Improvement) > Upgrade log4j to 2.17 >

[jira] [Updated] (SPARK-37699) Fix failed K8S integration test in SparkConfPropagateSuite

[ https://issues.apache.org/jira/browse/SPARK-37699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-37699: Parent: SPARK-37814 Issue Type: Sub-task (was: Test) > Fix failed K8S integration test

[jira] [Updated] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-6305: --- Parent: SPARK-37814 Issue Type: Sub-task (was: Improvement) > Add support for log4j 2.x to

[jira] [Updated] (SPARK-37729) SparkSession.setLogLevel not working in Spark Shell

[ https://issues.apache.org/jira/browse/SPARK-37729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-37729: Parent: SPARK-37814 Issue Type: Sub-task (was: Bug) > SparkSession.setLogLevel not

[jira] [Updated] (SPARK-37746) log4j2-defaults.properties is not working since log4j 2 is always initialized by default

[ https://issues.apache.org/jira/browse/SPARK-37746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-37746: Parent: SPARK-37814 Issue Type: Sub-task (was: Bug) > log4j2-defaults.properties is not

[jira] [Updated] (SPARK-37774) Upgrade log4j from 2.17 to 2.17.1

[ https://issues.apache.org/jira/browse/SPARK-37774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-37774: Parent: SPARK-37814 Issue Type: Sub-task (was: Improvement) > Upgrade log4j from 2.17 to

[jira] [Updated] (SPARK-37791) Use log4j2 in examples.

[ https://issues.apache.org/jira/browse/SPARK-37791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-37791: Parent: SPARK-37814 Issue Type: Sub-task (was: Improvement) > Use log4j2 in examples. >

[jira] [Updated] (SPARK-37794) Remove log4j bridge api usage

[ https://issues.apache.org/jira/browse/SPARK-37794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-37794: Parent: SPARK-37814 Issue Type: Sub-task (was: Improvement) > Remove log4j bridge api

[jira] [Updated] (SPARK-37792) Spark shell sets log level to INFO by default

[ https://issues.apache.org/jira/browse/SPARK-37792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-37792: Parent: SPARK-37814 Issue Type: Sub-task (was: Bug) > Spark shell sets log level to INFO

[jira] [Created] (SPARK-37814) Migrating from log4j 1 to log4j 2

L. C. Hsieh created SPARK-37814: --- Summary: Migrating from log4j 1 to log4j 2 Key: SPARK-37814 URL: https://issues.apache.org/jira/browse/SPARK-37814 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-35242) Support change catalog default database for spark

[ https://issues.apache.org/jira/browse/SPARK-35242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468968#comment-17468968 ] Shawn Guo commented on SPARK-35242: --- any update?   > Support change catalog default database for

[jira] [Assigned] (SPARK-37813) ORC read benchmark should enable vectorization for nested column

[ https://issues.apache.org/jira/browse/SPARK-37813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37813: Assignee: (was: Apache Spark) > ORC read benchmark should enable vectorization for

[jira] [Assigned] (SPARK-37813) ORC read benchmark should enable vectorization for nested column

[ https://issues.apache.org/jira/browse/SPARK-37813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37813: Assignee: Apache Spark > ORC read benchmark should enable vectorization for nested

[jira] [Commented] (SPARK-37813) ORC read benchmark should enable vectorization for nested column

[ https://issues.apache.org/jira/browse/SPARK-37813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468933#comment-17468933 ] Apache Spark commented on SPARK-37813: -- User 'c21' has created a pull request for this issue:

[jira] [Created] (SPARK-37813) ORC read benchmark should enable vectorization for nested column

Cheng Su created SPARK-37813: Summary: ORC read benchmark should enable vectorization for nested column Key: SPARK-37813 URL: https://issues.apache.org/jira/browse/SPARK-37813 Project: Spark

[jira] [Commented] (SPARK-37527) Translate more standard aggregate functions for pushdown

[ https://issues.apache.org/jira/browse/SPARK-37527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468929#comment-17468929 ] Apache Spark commented on SPARK-37527: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-37527) Translate more standard aggregate functions for pushdown

[ https://issues.apache.org/jira/browse/SPARK-37527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468930#comment-17468930 ] Apache Spark commented on SPARK-37527: -- User 'beliefer' has created a pull request for this issue:

[jira] [Resolved] (SPARK-37792) Spark shell sets log level to INFO by default

[ https://issues.apache.org/jira/browse/SPARK-37792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-37792. Fix Version/s: 3.3.0 Assignee: L. C. Hsieh (was: Apache Spark)

[jira] [Assigned] (SPARK-37812) When deserializing an Orc struct, reuse the result row when possible

[ https://issues.apache.org/jira/browse/SPARK-37812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37812: Assignee: (was: Apache Spark) > When deserializing an Orc struct, reuse the result

[jira] [Assigned] (SPARK-37812) When deserializing an Orc struct, reuse the result row when possible

[ https://issues.apache.org/jira/browse/SPARK-37812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37812: Assignee: Apache Spark > When deserializing an Orc struct, reuse the result row when

[jira] [Commented] (SPARK-37812) When deserializing an Orc struct, reuse the result row when possible

[ https://issues.apache.org/jira/browse/SPARK-37812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468924#comment-17468924 ] Apache Spark commented on SPARK-37812: -- User 'bersprockets' has created a pull request for this

[jira] [Updated] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-37803: -- Description: Create new benchmarks for struct deserializer improvement. (was: For each Orc

[jira] [Updated] (SPARK-37803) Create new benchmarks for struct deserializer improvement.

[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-37803: -- Description: Create new benchmarks for struct deserializer improvement (SPARK-37812) (was:

[jira] [Updated] (SPARK-37803) Create new benchmarks for struct deserializer improvement.

[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-37803: -- Summary: Create new benchmarks for struct deserializer improvement. (was: When deserializing

[jira] [Created] (SPARK-37812) When deserializing an Orc struct, reuse the result row when possible

Bruce Robbins created SPARK-37812: - Summary: When deserializing an Orc struct, reuse the result row when possible Key: SPARK-37812 URL: https://issues.apache.org/jira/browse/SPARK-37812 Project:

[jira] [Resolved] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37803. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35100

[jira] [Assigned] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37803: - Assignee: Bruce Robbins > When deserializing an Orc struct, reuse the result row when

[jira] [Commented] (SPARK-37803) When deserializing an Orc struct, reuse the result row when possible

[ https://issues.apache.org/jira/browse/SPARK-37803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468884#comment-17468884 ] Apache Spark commented on SPARK-37803: -- User 'bersprockets' has created a pull request for this

[jira] [Updated] (SPARK-37811) Broadcast Join throws HintErrorLogger for joins with multiple tables

[ https://issues.apache.org/jira/browse/SPARK-37811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tsarangi updated SPARK-37811: - Description: Following query throws HintErrorLogger Warnings in v3.1.2.    {code:java} // code

[jira] [Updated] (SPARK-37811) Broadcast Join throws HintErrorLogger for joins with multiple tables

[ https://issues.apache.org/jira/browse/SPARK-37811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tsarangi updated SPARK-37811: - Description: Following query throws HintLoggerError Warnings in v3.1.2.    {code:java} // code

[jira] [Created] (SPARK-37811) Broadcast Join throws HintErrorLogger for joins with multiple tables

Tapas created SPARK-37811: - Summary: Broadcast Join throws HintErrorLogger for joins with multiple tables Key: SPARK-37811 URL: https://issues.apache.org/jira/browse/SPARK-37811 Project: Spark

[jira] [Updated] (SPARK-37509) Improve Fallback Storage upload speed by avoiding S3 rate limiter

[ https://issues.apache.org/jira/browse/SPARK-37509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37509: -- Parent: SPARK-37810 Issue Type: Sub-task (was: Improvement) > Improve Fallback

[jira] [Updated] (SPARK-37810) Executor Rolling in Kubernetes environment

[ https://issues.apache.org/jira/browse/SPARK-37810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37810: -- Summary: Executor Rolling in Kubernetes environment (was: Executor Rolling) > Executor

[jira] [Assigned] (SPARK-37810) Executor Rolling

[ https://issues.apache.org/jira/browse/SPARK-37810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37810: - Assignee: Dongjoon Hyun > Executor Rolling > > > Key:

[jira] [Resolved] (SPARK-37810) Executor Rolling

[ https://issues.apache.org/jira/browse/SPARK-37810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37810. --- Fix Version/s: 3.3.0 Resolution: Fixed > Executor Rolling > > >

[jira] [Updated] (SPARK-37576) Support built-in K8s executor roll plugin

[ https://issues.apache.org/jira/browse/SPARK-37576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37576: -- Parent: SPARK-37810 Issue Type: Sub-task (was: New Feature) > Support built-in K8s

[jira] [Updated] (SPARK-37622) Support K8s executor rolling policy

[ https://issues.apache.org/jira/browse/SPARK-37622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37622: -- Parent: SPARK-37810 Issue Type: Sub-task (was: New Feature) > Support K8s executor

[jira] [Updated] (SPARK-37679) Add a new executor roll policy, FAILED_TASKS

[ https://issues.apache.org/jira/browse/SPARK-37679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37679: -- Parent: SPARK-37810 Issue Type: Sub-task (was: Improvement) > Add a new executor

[jira] [Updated] (SPARK-37709) Add AVERAGE_DURATION executor roll policy

[ https://issues.apache.org/jira/browse/SPARK-37709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37709: -- Parent: SPARK-37810 Issue Type: Sub-task (was: Improvement) > Add AVERAGE_DURATION

[jira] [Updated] (SPARK-37806) Support minimum number of tasks per executor before being rolling

[ https://issues.apache.org/jira/browse/SPARK-37806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37806: -- Parent: SPARK-37810 Issue Type: Sub-task (was: Improvement) > Support minimum number

[jira] [Created] (SPARK-37810) Executor Rolling

Dongjoon Hyun created SPARK-37810: - Summary: Executor Rolling Key: SPARK-37810 URL: https://issues.apache.org/jira/browse/SPARK-37810 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-37806) Support minimum number of tasks per executor before being rolling

[ https://issues.apache.org/jira/browse/SPARK-37806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37806: -- Summary: Support minimum number of tasks per executor before being rolling (was: Support

[jira] [Resolved] (SPARK-37806) Support minimum number of tasks per executor before rolling

[ https://issues.apache.org/jira/browse/SPARK-37806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37806. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35096

[jira] [Assigned] (SPARK-37806) Support minimum number of tasks per executor before rolling

[ https://issues.apache.org/jira/browse/SPARK-37806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37806: - Assignee: Dongjoon Hyun > Support minimum number of tasks per executor before rolling

[jira] [Resolved] (SPARK-37784) CodeGenerator.addBufferedState() does not properly handle UDTs

[ https://issues.apache.org/jira/browse/SPARK-37784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-37784. Fix Version/s: 3.3.0 3.0.4 3.2.1 3.1.3

[jira] [Updated] (SPARK-37728) reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-37728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37728: -- Fix Version/s: 3.2.1 > reading nested columns with ORC vectorized reader can cause >

[jira] [Created] (SPARK-37809) Add yunikorn feature step

Weiwei Yang created SPARK-37809: --- Summary: Add yunikorn feature step Key: SPARK-37809 URL: https://issues.apache.org/jira/browse/SPARK-37809 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-37750) ANSI mode: optionally return null result if element not exists in array/map

[ https://issues.apache.org/jira/browse/SPARK-37750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468736#comment-17468736 ] Apache Spark commented on SPARK-37750: -- User 'tedyu' has created a pull request for this issue:

[jira] [Updated] (SPARK-37807) Hivethriftserver2 send proper exception message

[ https://issues.apache.org/jira/browse/SPARK-37807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-37807: Fix Version/s: (was: 3.3.0) > Hivethriftserver2 send proper exception message >

[jira] [Commented] (SPARK-37425) Inline type hints for python/pyspark/mllib/recommendation.py

[ https://issues.apache.org/jira/browse/SPARK-37425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468609#comment-17468609 ] Maciej Szymkiewicz commented on SPARK-37425: Hi [~amirkdv]. For the whole {{pyspark.mllib}}

[jira] [Updated] (SPARK-37750) ANSI mode: optionally return null result if element not exists in array/map

[ https://issues.apache.org/jira/browse/SPARK-37750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-37750: --- Description: Add a new configuration `spark.sql.ansi.failOnElementNotExists` which controls

[jira] [Resolved] (SPARK-37750) ANSI mode: optionally return null result if element not exists in array/map

[ https://issues.apache.org/jira/browse/SPARK-37750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-37750. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35031

[jira] [Created] (SPARK-37808) Invalid call to nullable on unresolved object, tree: 'corp_name

jerryMa created SPARK-37808: --- Summary: Invalid call to nullable on unresolved object, tree: 'corp_name Key: SPARK-37808 URL: https://issues.apache.org/jira/browse/SPARK-37808 Project: Spark Issue

[jira] [Commented] (SPARK-33084) Add jar support ivy path

[ https://issues.apache.org/jira/browse/SPARK-33084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468564#comment-17468564 ] Apache Spark commented on SPARK-33084: -- User 'gengliangwang' has created a pull request for this

[jira] [Updated] (SPARK-37807) Hivethriftserver2 send proper exception message

[ https://issues.apache.org/jira/browse/SPARK-37807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramakrishna chilaka updated SPARK-37807: Fix Version/s: (was: 3.2.1) > Hivethriftserver2 send proper exception message

[jira] [Assigned] (SPARK-37807) Hivethriftserver2 send proper exception message

[ https://issues.apache.org/jira/browse/SPARK-37807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37807: Assignee: (was: Apache Spark) > Hivethriftserver2 send proper exception message >

[jira] [Assigned] (SPARK-37807) Hivethriftserver2 send proper exception message

[ https://issues.apache.org/jira/browse/SPARK-37807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37807: Assignee: Apache Spark > Hivethriftserver2 send proper exception message >

[jira] [Commented] (SPARK-37807) Hivethriftserver2 send proper exception message

[ https://issues.apache.org/jira/browse/SPARK-37807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468533#comment-17468533 ] Apache Spark commented on SPARK-37807: -- User 'RamakrishnaChilaka' has created a pull request for

[jira] [Updated] (SPARK-37807) Hivethriftserver2 send proper exception message

[ https://issues.apache.org/jira/browse/SPARK-37807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramakrishna chilaka updated SPARK-37807: Description: Please find the PR (https://github.com/apache/spark/pull/35097) >

[jira] [Created] (SPARK-37807) Hivethriftserver2 send proper exception message

ramakrishna chilaka created SPARK-37807: --- Summary: Hivethriftserver2 send proper exception message Key: SPARK-37807 URL: https://issues.apache.org/jira/browse/SPARK-37807 Project: Spark

[jira] [Commented] (SPARK-37806) Support minimum number of tasks per executor before rolling

[ https://issues.apache.org/jira/browse/SPARK-37806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468530#comment-17468530 ] Apache Spark commented on SPARK-37806: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37806) Support minimum number of tasks per executor before rolling

[ https://issues.apache.org/jira/browse/SPARK-37806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37806: Assignee: (was: Apache Spark) > Support minimum number of tasks per executor before

[jira] [Commented] (SPARK-37806) Support minimum number of tasks per executor before rolling

[ https://issues.apache.org/jira/browse/SPARK-37806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468529#comment-17468529 ] Apache Spark commented on SPARK-37806: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37806) Support minimum number of tasks per executor before rolling

[ https://issues.apache.org/jira/browse/SPARK-37806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37806: Assignee: Apache Spark > Support minimum number of tasks per executor before rolling >

[jira] [Created] (SPARK-37806) Support minimum number of tasks per executor before rolling

Dongjoon Hyun created SPARK-37806: - Summary: Support minimum number of tasks per executor before rolling Key: SPARK-37806 URL: https://issues.apache.org/jira/browse/SPARK-37806 Project: Spark

[jira] [Commented] (SPARK-37805) Refactor TestUtils#configTestLog4j method to use log4j2 api

[ https://issues.apache.org/jira/browse/SPARK-37805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468502#comment-17468502 ] Apache Spark commented on SPARK-37805: -- User 'LuciferYang' has created a pull request for this

  1   2   >