[jira] [Assigned] (SPARK-39966) Use V2 Filter in SupportsDelete

[ https://issues.apache.org/jira/browse/SPARK-39966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39966: Assignee: Apache Spark > Use V2 Filter in SupportsDelete > --

[jira] [Assigned] (SPARK-39966) Use V2 Filter in SupportsDelete

[ https://issues.apache.org/jira/browse/SPARK-39966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39966: Assignee: (was: Apache Spark) > Use V2 Filter in SupportsDelete > ---

[jira] [Commented] (SPARK-39966) Use V2 Filter in SupportsDelete

[ https://issues.apache.org/jira/browse/SPARK-39966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574532#comment-17574532 ] Apache Spark commented on SPARK-39966: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-39966) Use V2 Filter in SupportsDelete

[ https://issues.apache.org/jira/browse/SPARK-39966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574531#comment-17574531 ] Apache Spark commented on SPARK-39966: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-39966) Use V2 Filter in SupportsDelete

[ https://issues.apache.org/jira/browse/SPARK-39966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39966: Assignee: Apache Spark > Use V2 Filter in SupportsDelete > --

[jira] [Resolved] (SPARK-39960) Upgrade mysql-connector-java to 8.0.30

[ https://issues.apache.org/jira/browse/SPARK-39960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-39960. -- Resolution: Fixed Issue resolved by pull request 37387 [https://github.com/apache/spark/pull/37387] >

[jira] [Assigned] (SPARK-39960) Upgrade mysql-connector-java to 8.0.30

[ https://issues.apache.org/jira/browse/SPARK-39960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-39960: Assignee: BingKun Pan > Upgrade mysql-connector-java to 8.0.30 >

[jira] [Created] (SPARK-39966) Use V2 Filter in SupportsDelete

Huaxin Gao created SPARK-39966: -- Summary: Use V2 Filter in SupportsDelete Key: SPARK-39966 URL: https://issues.apache.org/jira/browse/SPARK-39966 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-39965) Spark on K8s delete pvc even though it's not being used.

[ https://issues.apache.org/jira/browse/SPARK-39965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pralabhkumar updated SPARK-39965: - Description: >From Spark32 . as a part of [https://github.com/apache/spark/pull/32288] , >funct

[jira] [Updated] (SPARK-39965) Spark on K8s delete pvc even though it's not being used.

[ https://issues.apache.org/jira/browse/SPARK-39965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pralabhkumar updated SPARK-39965: - Description: >From Spark32 . as a part of [https://github.com/apache/spark/pull/32288] , >funct

[jira] [Commented] (SPARK-39965) Spark on K8s delete pvc even though it's not being used.

[ https://issues.apache.org/jira/browse/SPARK-39965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574494#comment-17574494 ] pralabhkumar commented on SPARK-39965: -- Gentle ping @[dongjoon-hyun .|https://githu

[jira] [Updated] (SPARK-39965) Spark on K8s delete pvc even though it's not being used.

[ https://issues.apache.org/jira/browse/SPARK-39965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pralabhkumar updated SPARK-39965: - Description: >From Spark32 . as a part of [https://github.com/apache/spark/pull/32288] , >funct

[jira] [Updated] (SPARK-39965) Spark on K8s delete pvc even though it's not being used.

[ https://issues.apache.org/jira/browse/SPARK-39965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pralabhkumar updated SPARK-39965: - Component/s: (was: Spark Core) > Spark on K8s delete pvc even though it's not being used. >

[jira] [Created] (SPARK-39965) Spark on K8s delete pvc even though it's not being used.

pralabhkumar created SPARK-39965: Summary: Spark on K8s delete pvc even though it's not being used. Key: SPARK-39965 URL: https://issues.apache.org/jira/browse/SPARK-39965 Project: Spark Issu

[jira] [Commented] (SPARK-39964) DS V2 pushdown should unify the translate path

[ https://issues.apache.org/jira/browse/SPARK-39964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574486#comment-17574486 ] Apache Spark commented on SPARK-39964: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-39964) DS V2 pushdown should unify the translate path

[ https://issues.apache.org/jira/browse/SPARK-39964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574487#comment-17574487 ] Apache Spark commented on SPARK-39964: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-39964) DS V2 pushdown should unify the translate path

[ https://issues.apache.org/jira/browse/SPARK-39964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39964: Assignee: (was: Apache Spark) > DS V2 pushdown should unify the translate path >

[jira] [Assigned] (SPARK-39964) DS V2 pushdown should unify the translate path

[ https://issues.apache.org/jira/browse/SPARK-39964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39964: Assignee: Apache Spark > DS V2 pushdown should unify the translate path > ---

[jira] [Updated] (SPARK-39964) DS V2 pushdown should unify the translate path

[ https://issues.apache.org/jira/browse/SPARK-39964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39964: --- Summary: DS V2 pushdown should unify the translate path (was: DS V2 pushdown should unify the trans

[jira] [Created] (SPARK-39964) DS V2 pushdown should unify the translate API

jiaan.geng created SPARK-39964: -- Summary: DS V2 pushdown should unify the translate API Key: SPARK-39964 URL: https://issues.apache.org/jira/browse/SPARK-39964 Project: Spark Issue Type: Sub-tas

[jira] [Assigned] (SPARK-39962) Global aggregation against pandas aggregate UDF does not take the column order into account

[ https://issues.apache.org/jira/browse/SPARK-39962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39962: Assignee: (was: Apache Spark) > Global aggregation against pandas aggregate UDF does

[jira] [Commented] (SPARK-39962) Global aggregation against pandas aggregate UDF does not take the column order into account

[ https://issues.apache.org/jira/browse/SPARK-39962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574481#comment-17574481 ] Apache Spark commented on SPARK-39962: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-39962) Global aggregation against pandas aggregate UDF does not take the column order into account

[ https://issues.apache.org/jira/browse/SPARK-39962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39962: Assignee: Apache Spark > Global aggregation against pandas aggregate UDF does not take th

[jira] [Assigned] (SPARK-39904) Rename inferDate to preferDate and fix an issue when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-39904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39904: Assignee: Ivan Sadikov > Rename inferDate to preferDate and fix an issue when inferring s

[jira] [Resolved] (SPARK-39904) Rename inferDate to preferDate and fix an issue when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-39904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39904. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37327 [https://gi

[jira] [Updated] (SPARK-39962) Global aggregation against pandas aggregate UDF does not take the column order into account

[ https://issues.apache.org/jira/browse/SPARK-39962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39962: - Affects Version/s: 3.2.2 3.3.0 3.1.3 > Global aggr

[jira] [Resolved] (SPARK-39867) Global limit should not inherit OrderPreservingUnaryNode

[ https://issues.apache.org/jira/browse/SPARK-39867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39867. - Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull re

[jira] [Commented] (SPARK-39963) Simplify the implementation of SimplifyCasts

[ https://issues.apache.org/jira/browse/SPARK-39963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574476#comment-17574476 ] Apache Spark commented on SPARK-39963: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-39963) Simplify the implementation of SimplifyCasts

[ https://issues.apache.org/jira/browse/SPARK-39963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574475#comment-17574475 ] Apache Spark commented on SPARK-39963: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-39963) Simplify the implementation of SimplifyCasts

[ https://issues.apache.org/jira/browse/SPARK-39963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39963: Assignee: (was: Apache Spark) > Simplify the implementation of SimplifyCasts > --

[jira] [Assigned] (SPARK-39963) Simplify the implementation of SimplifyCasts

[ https://issues.apache.org/jira/browse/SPARK-39963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39963: Assignee: Apache Spark > Simplify the implementation of SimplifyCasts > -

[jira] [Updated] (SPARK-39963) Simplify the implementation of SimplifyCasts

[ https://issues.apache.org/jira/browse/SPARK-39963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39963: --- Summary: Simplify the implementation of SimplifyCasts (was: Improve the implementation of SimplifyC

[jira] [Created] (SPARK-39963) Improve the implementation of SimplifyCasts

jiaan.geng created SPARK-39963: -- Summary: Improve the implementation of SimplifyCasts Key: SPARK-39963 URL: https://issues.apache.org/jira/browse/SPARK-39963 Project: Spark Issue Type: Improveme

[jira] [Commented] (SPARK-39961) DS V2 push-down translate Cast if the cast is safe

[ https://issues.apache.org/jira/browse/SPARK-39961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574471#comment-17574471 ] Apache Spark commented on SPARK-39961: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-39961) DS V2 push-down translate Cast if the cast is safe

[ https://issues.apache.org/jira/browse/SPARK-39961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574470#comment-17574470 ] Apache Spark commented on SPARK-39961: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-39961) DS V2 push-down translate Cast if the cast is safe

[ https://issues.apache.org/jira/browse/SPARK-39961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39961: Assignee: (was: Apache Spark) > DS V2 push-down translate Cast if the cast is safe >

[jira] [Assigned] (SPARK-39961) DS V2 push-down translate Cast if the cast is safe

[ https://issues.apache.org/jira/browse/SPARK-39961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39961: Assignee: Apache Spark > DS V2 push-down translate Cast if the cast is safe > ---

[jira] [Updated] (SPARK-39835) Fix EliminateSorts remove global sort below the local sort

[ https://issues.apache.org/jira/browse/SPARK-39835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-39835: Fix Version/s: 3.1.4 3.2.3 > Fix EliminateSorts remove global sort below the lo

[jira] [Created] (SPARK-39962) Global aggregation against pandas aggregate UDF does not take the column order into account

Hyukjin Kwon created SPARK-39962: Summary: Global aggregation against pandas aggregate UDF does not take the column order into account Key: SPARK-39962 URL: https://issues.apache.org/jira/browse/SPARK-39962

[jira] [Created] (SPARK-39961) DS V2 push-down translate Cast if the cast is safe

jiaan.geng created SPARK-39961: -- Summary: DS V2 push-down translate Cast if the cast is safe Key: SPARK-39961 URL: https://issues.apache.org/jira/browse/SPARK-39961 Project: Spark Issue Type: Su

[jira] [Commented] (SPARK-39960) Upgrade mysql-connector-java to 8.0.30

[ https://issues.apache.org/jira/browse/SPARK-39960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574457#comment-17574457 ] Apache Spark commented on SPARK-39960: -- User 'panbingkun' has created a pull reques

[jira] [Commented] (SPARK-39960) Upgrade mysql-connector-java to 8.0.30

[ https://issues.apache.org/jira/browse/SPARK-39960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574460#comment-17574460 ] Apache Spark commented on SPARK-39960: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-39960) Upgrade mysql-connector-java to 8.0.30

[ https://issues.apache.org/jira/browse/SPARK-39960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39960: Assignee: Apache Spark > Upgrade mysql-connector-java to 8.0.30 > ---

[jira] [Assigned] (SPARK-39960) Upgrade mysql-connector-java to 8.0.30

[ https://issues.apache.org/jira/browse/SPARK-39960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39960: Assignee: (was: Apache Spark) > Upgrade mysql-connector-java to 8.0.30 >

[jira] [Commented] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574454#comment-17574454 ] melin commented on SPARK-38200: --- Yes, not standard syntax, can it be supported? > [SQL] S

[jira] [Created] (SPARK-39960) Upgrade mysql-connector-java to 8.0.30

BingKun Pan created SPARK-39960: --- Summary: Upgrade mysql-connector-java to 8.0.30 Key: SPARK-39960 URL: https://issues.apache.org/jira/browse/SPARK-39960 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

[ https://issues.apache.org/jira/browse/SPARK-39959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574453#comment-17574453 ] Hyukjin Kwon commented on SPARK-39959: -- cc [~zero323] too FYI > Recover SparkR CRA

[jira] [Commented] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

[ https://issues.apache.org/jira/browse/SPARK-39959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574452#comment-17574452 ] Hyukjin Kwon commented on SPARK-39959: -- cc [~yikunkero] FYI > Recover SparkR CRAN

[jira] [Created] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

Hyukjin Kwon created SPARK-39959: Summary: Recover SparkR CRAN check in GitHub Actions CI Key: SPARK-39959 URL: https://issues.apache.org/jira/browse/SPARK-39959 Project: Spark Issue Type: Te

[jira] [Updated] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

[ https://issues.apache.org/jira/browse/SPARK-39959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39959: - Description: {code} cd R ./install-dev.sh ./check-cran.sh {code} fails (I think with latest de

[jira] [Updated] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

[ https://issues.apache.org/jira/browse/SPARK-39959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39959: - Environment: (was: {code} cd R ./install-dev.sh ./check-cran.sh {code} fails (I think with

[jira] [Resolved] (SPARK-39954) Upgrade ASM to 9.3

[ https://issues.apache.org/jira/browse/SPARK-39954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-39954. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37382 [https://gith

[jira] [Assigned] (SPARK-39954) Upgrade ASM to 9.3

[ https://issues.apache.org/jira/browse/SPARK-39954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-39954: --- Assignee: Dongjoon Hyun > Upgrade ASM to 9.3 > -- > > Key:

[jira] [Commented] (SPARK-39958) Add warning log when unable to load custom metric object

[ https://issues.apache.org/jira/browse/SPARK-39958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574449#comment-17574449 ] Apache Spark commented on SPARK-39958: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-39958) Add warning log when unable to load custom metric object

[ https://issues.apache.org/jira/browse/SPARK-39958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39958: Assignee: (was: Apache Spark) > Add warning log when unable to load custom metric obj

[jira] [Commented] (SPARK-33782) Place spark.files, spark.jars and spark.files under the current working directory on the driver in K8S cluster mode

[ https://issues.apache.org/jira/browse/SPARK-33782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574448#comment-17574448 ] Hyukjin Kwon commented on SPARK-33782: -- Please go for it! > Place spark.files, spa

[jira] [Assigned] (SPARK-39958) Add warning log when unable to load custom metric object

[ https://issues.apache.org/jira/browse/SPARK-39958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39958: Assignee: Apache Spark > Add warning log when unable to load custom metric object > -

[jira] [Created] (SPARK-39958) Add warning log when unable to load custom metric object

L. C. Hsieh created SPARK-39958: --- Summary: Add warning log when unable to load custom metric object Key: SPARK-39958 URL: https://issues.apache.org/jira/browse/SPARK-39958 Project: Spark Issue

[jira] [Created] (SPARK-39957) Delay onDisconnected to enable Driver receives ExecutorExitCode

Kai-Hsun Chen created SPARK-39957: - Summary: Delay onDisconnected to enable Driver receives ExecutorExitCode Key: SPARK-39957 URL: https://issues.apache.org/jira/browse/SPARK-39957 Project: Spark

[jira] [Assigned] (SPARK-39956) Determine task failures based on ExecutorExitCode

[ https://issues.apache.org/jira/browse/SPARK-39956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39956: Assignee: (was: Apache Spark) > Determine task failures based on ExecutorExitCode > -

[jira] [Assigned] (SPARK-39956) Determine task failures based on ExecutorExitCode

[ https://issues.apache.org/jira/browse/SPARK-39956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39956: Assignee: Apache Spark > Determine task failures based on ExecutorExitCode >

[jira] [Commented] (SPARK-39956) Determine task failures based on ExecutorExitCode

[ https://issues.apache.org/jira/browse/SPARK-39956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574438#comment-17574438 ] Apache Spark commented on SPARK-39956: -- User 'kevin85421' has created a pull reques

[jira] [Created] (SPARK-39956) Determine task failures based on ExecutorExitCode

Kai-Hsun Chen created SPARK-39956: - Summary: Determine task failures based on ExecutorExitCode Key: SPARK-39956 URL: https://issues.apache.org/jira/browse/SPARK-39956 Project: Spark Issue Typ

[jira] [Commented] (SPARK-39955) Improve LaunchTask process to avoid Stage failures caused by fail-to-send LaunchTask messages

[ https://issues.apache.org/jira/browse/SPARK-39955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574432#comment-17574432 ] Apache Spark commented on SPARK-39955: -- User 'kevin85421' has created a pull reques

[jira] [Assigned] (SPARK-39955) Improve LaunchTask process to avoid Stage failures caused by fail-to-send LaunchTask messages

[ https://issues.apache.org/jira/browse/SPARK-39955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39955: Assignee: (was: Apache Spark) > Improve LaunchTask process to avoid Stage failures ca

[jira] [Assigned] (SPARK-39955) Improve LaunchTask process to avoid Stage failures caused by fail-to-send LaunchTask messages

[ https://issues.apache.org/jira/browse/SPARK-39955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39955: Assignee: Apache Spark > Improve LaunchTask process to avoid Stage failures caused by fai

[jira] [Updated] (SPARK-39951) Support columnar batches with nested fields in Parquet V2

[ https://issues.apache.org/jira/browse/SPARK-39951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-39951: - Fix Version/s: 3.3.1 > Support columnar batches with nested fields in Parquet V2 > -

[jira] [Resolved] (SPARK-39951) Support columnar batches with nested fields in Parquet V2

[ https://issues.apache.org/jira/browse/SPARK-39951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-39951. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37379 [https://github.com

[jira] [Commented] (SPARK-24914) totalSize is not a good estimate for broadcast joins

[ https://issues.apache.org/jira/browse/SPARK-24914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574429#comment-17574429 ] Bruce Robbins commented on SPARK-24914: --- I think it's "in progress" only because t

[jira] [Commented] (SPARK-24914) totalSize is not a good estimate for broadcast joins

[ https://issues.apache.org/jira/browse/SPARK-24914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574414#comment-17574414 ] Igor Uchôa commented on SPARK-24914: Since it is still in progress, I was wondering

[jira] [Comment Edited] (SPARK-24914) totalSize is not a good estimate for broadcast joins

[ https://issues.apache.org/jira/browse/SPARK-24914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574412#comment-17574412 ] Bruce Robbins edited comment on SPARK-24914 at 8/2/22 10:02 PM: --

[jira] [Commented] (SPARK-24914) totalSize is not a good estimate for broadcast joins

[ https://issues.apache.org/jira/browse/SPARK-24914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574412#comment-17574412 ] Bruce Robbins commented on SPARK-24914: --- [~cabral1888] I think there already is a

[jira] [Commented] (SPARK-24914) totalSize is not a good estimate for broadcast joins

[ https://issues.apache.org/jira/browse/SPARK-24914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574409#comment-17574409 ] Igor Uchôa commented on SPARK-24914: Hi [~bersprockets], I just wanted to know if y

[jira] [Created] (SPARK-39955) Improve LaunchTask process to avoid Stage failures caused by fail-to-send LaunchTask messages

Kai-Hsun Chen created SPARK-39955: - Summary: Improve LaunchTask process to avoid Stage failures caused by fail-to-send LaunchTask messages Key: SPARK-39955 URL: https://issues.apache.org/jira/browse/SPARK-39955

[jira] [Commented] (SPARK-39926) Fix bug in existence DEFAULT value lookups for non-vectorized Parquet scans

[ https://issues.apache.org/jira/browse/SPARK-39926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574390#comment-17574390 ] Daniel commented on SPARK-39926: To fix this, we likely need to obtain information per-r

[jira] [Commented] (SPARK-39865) Show proper error messages on the overflow errors of table insert

[ https://issues.apache.org/jira/browse/SPARK-39865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574385#comment-17574385 ] Apache Spark commented on SPARK-39865: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-39865) Show proper error messages on the overflow errors of table insert

[ https://issues.apache.org/jira/browse/SPARK-39865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574384#comment-17574384 ] Apache Spark commented on SPARK-39865: -- User 'gengliangwang' has created a pull req

[jira] [Resolved] (SPARK-39917) Use different error classes for numeric/interval arithmetic overflow

[ https://issues.apache.org/jira/browse/SPARK-39917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39917. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37374 [https:

[jira] [Assigned] (SPARK-39917) Use different error classes for numeric/interval arithmetic overflow

[ https://issues.apache.org/jira/browse/SPARK-39917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39917: -- Assignee: Gengliang Wang > Use different error classes for numeric/interval arithmeti

[jira] [Commented] (SPARK-39954) Upgrade ASM to 9.3

[ https://issues.apache.org/jira/browse/SPARK-39954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574372#comment-17574372 ] Apache Spark commented on SPARK-39954: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-39954) Upgrade ASM to 9.3

[ https://issues.apache.org/jira/browse/SPARK-39954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39954: Assignee: (was: Apache Spark) > Upgrade ASM to 9.3 > -- > >

[jira] [Assigned] (SPARK-39954) Upgrade ASM to 9.3

[ https://issues.apache.org/jira/browse/SPARK-39954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39954: Assignee: Apache Spark > Upgrade ASM to 9.3 > -- > > Key:

[jira] [Created] (SPARK-39954) Upgrade ASM to 9.3

Dongjoon Hyun created SPARK-39954: - Summary: Upgrade ASM to 9.3 Key: SPARK-39954 URL: https://issues.apache.org/jira/browse/SPARK-39954 Project: Spark Issue Type: Improvement Compon

[jira] [Commented] (SPARK-39953) Hudi spark-submits from EMR 5.33 to EMR 6.5

[ https://issues.apache.org/jira/browse/SPARK-39953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574356#comment-17574356 ] lava commented on SPARK-39953: -- we tried to add below configurations and still it fails.  

[jira] [Created] (SPARK-39953) Hudi spark-submits from EMR 5.33 to EMR 6.5

lava created SPARK-39953: Summary: Hudi spark-submits from EMR 5.33 to EMR 6.5 Key: SPARK-39953 URL: https://issues.apache.org/jira/browse/SPARK-39953 Project: Spark Issue Type: Question

[jira] [Commented] (SPARK-33782) Place spark.files, spark.jars and spark.files under the current working directory on the driver in K8S cluster mode

[ https://issues.apache.org/jira/browse/SPARK-33782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574314#comment-17574314 ] pralabhkumar commented on SPARK-33782: -- [~hyukjin.kwon] I would like to work on thi

[jira] [Commented] (SPARK-39952) SaveIntoDataSourceCommand should recache result relation

[ https://issues.apache.org/jira/browse/SPARK-39952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574292#comment-17574292 ] Apache Spark commented on SPARK-39952: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-39952) SaveIntoDataSourceCommand should recache result relation

[ https://issues.apache.org/jira/browse/SPARK-39952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39952: Assignee: Apache Spark > SaveIntoDataSourceCommand should recache result relation > -

[jira] [Assigned] (SPARK-39952) SaveIntoDataSourceCommand should recache result relation

[ https://issues.apache.org/jira/browse/SPARK-39952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39952: Assignee: (was: Apache Spark) > SaveIntoDataSourceCommand should recache result relat

[jira] [Commented] (SPARK-39952) SaveIntoDataSourceCommand should recache result relation

[ https://issues.apache.org/jira/browse/SPARK-39952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574293#comment-17574293 ] Apache Spark commented on SPARK-39952: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-39900) Issue with querying dataframe produced by 'binaryFile' format using 'not' operator

[ https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574288#comment-17574288 ] Benoit Roy commented on SPARK-39900: This is much appreciated! ;) > Issue with quer

[jira] [Created] (SPARK-39952) SaveIntoDataSourceCommand should recache result relation

XiDuo You created SPARK-39952: - Summary: SaveIntoDataSourceCommand should recache result relation Key: SPARK-39952 URL: https://issues.apache.org/jira/browse/SPARK-39952 Project: Spark Issue Type

[jira] [Assigned] (SPARK-39951) Support columnar batches with nested fields in Parquet V2

[ https://issues.apache.org/jira/browse/SPARK-39951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39951: Assignee: (was: Apache Spark) > Support columnar batches with nested fields in Parque

[jira] [Commented] (SPARK-39951) Support columnar batches with nested fields in Parquet V2

[ https://issues.apache.org/jira/browse/SPARK-39951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574209#comment-17574209 ] Apache Spark commented on SPARK-39951: -- User 'Kimahriman' has created a pull reques

[jira] [Assigned] (SPARK-39951) Support columnar batches with nested fields in Parquet V2

[ https://issues.apache.org/jira/browse/SPARK-39951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39951: Assignee: Apache Spark > Support columnar batches with nested fields in Parquet V2 >

[jira] [Commented] (SPARK-39951) Support columnar batches with nested fields in Parquet V2

[ https://issues.apache.org/jira/browse/SPARK-39951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574210#comment-17574210 ] Apache Spark commented on SPARK-39951: -- User 'Kimahriman' has created a pull reques

[jira] [Assigned] (SPARK-39951) Support columnar batches with nested fields in Parquet V2

[ https://issues.apache.org/jira/browse/SPARK-39951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39951: Assignee: Apache Spark > Support columnar batches with nested fields in Parquet V2 >

[jira] [Created] (SPARK-39951) Support columnar batches with nested fields in Parquet V2

Adam Binford created SPARK-39951: Summary: Support columnar batches with nested fields in Parquet V2 Key: SPARK-39951 URL: https://issues.apache.org/jira/browse/SPARK-39951 Project: Spark Iss

[jira] [Assigned] (SPARK-39950) It's necessary to materialize BroadcastQueryStage first, because the BroadcastQueryStage does not timeout in AQE.

[ https://issues.apache.org/jira/browse/SPARK-39950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39950: Assignee: (was: Apache Spark) > It's necessary to materialize BroadcastQueryStage fir

[jira] [Assigned] (SPARK-39950) It's necessary to materialize BroadcastQueryStage first, because the BroadcastQueryStage does not timeout in AQE.

[ https://issues.apache.org/jira/browse/SPARK-39950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39950: Assignee: Apache Spark > It's necessary to materialize BroadcastQueryStage first, because

  1   2   >