[jira] [Updated] (SPARK-40355) Improve pushdown for orc & parquet when cast scenario

[ https://issues.apache.org/jira/browse/SPARK-40355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-40355: Description: Table Schema: | a| b| part| | int|string  | string|   SQL: select * from table

[jira] [Commented] (SPARK-40365) Bump ANTLR runtime version from 4.8 to 4.11.1

[ https://issues.apache.org/jira/browse/SPARK-40365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601139#comment-17601139 ] Apache Spark commented on SPARK-40365: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40365) Bump ANTLR runtime version from 4.8 to 4.11.1

[ https://issues.apache.org/jira/browse/SPARK-40365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40365: Assignee: (was: Apache Spark) > Bump ANTLR runtime version from 4.8 to 4.11.1 >

[jira] [Commented] (SPARK-40365) Bump ANTLR runtime version from 4.8 to 4.11.1

[ https://issues.apache.org/jira/browse/SPARK-40365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601138#comment-17601138 ] Apache Spark commented on SPARK-40365: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40365) Bump ANTLR runtime version from 4.8 to 4.11.1

[ https://issues.apache.org/jira/browse/SPARK-40365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40365: Assignee: Apache Spark > Bump ANTLR runtime version from 4.8 to 4.11.1 >

[jira] [Created] (SPARK-40365) Bump ANTLR runtime version from 4.8 to 4.11.1

BingKun Pan created SPARK-40365: --- Summary: Bump ANTLR runtime version from 4.8 to 4.11.1 Key: SPARK-40365 URL: https://issues.apache.org/jira/browse/SPARK-40365 Project: Spark Issue Type:

[jira] [Updated] (SPARK-40355) Improve pushdown for orc & parquet when cast scenario

[ https://issues.apache.org/jira/browse/SPARK-40355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-40355: Description: Table Schema: | a| b| part| | | int|string  | string| |   SQL: select * from table

[jira] [Created] (SPARK-40364) Unify `initDB` method in `DBProvider`

Yang Jie created SPARK-40364: Summary: Unify `initDB` method in `DBProvider` Key: SPARK-40364 URL: https://issues.apache.org/jira/browse/SPARK-40364 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-40364) Unify `initDB` method in `DBProvider`

[ https://issues.apache.org/jira/browse/SPARK-40364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40364: - Description: There are 2 `initDB` in `DBProvider` # DB initDB(DBBackend dbBackend, File dbFile,

[jira] [Resolved] (SPARK-40363) Add SQL misc function to assert/check column value

[ https://issues.apache.org/jira/browse/SPARK-40363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40363. -- Resolution: Won't Fix > Add SQL misc function to assert/check column value >

[jira] [Commented] (SPARK-40363) Add SQL misc function to assert/check column value

[ https://issues.apache.org/jira/browse/SPARK-40363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601090#comment-17601090 ] Rafal Wojdyla commented on SPARK-40363: --- Hey [~hyukjin.kwon] yea, the implementation is simple,

[jira] [Assigned] (SPARK-40356) Upgrade pandas to 1.4.4

[ https://issues.apache.org/jira/browse/SPARK-40356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40356: Assignee: Yikun Jiang > Upgrade pandas to 1.4.4 > --- > >

[jira] [Resolved] (SPARK-40356) Upgrade pandas to 1.4.4

[ https://issues.apache.org/jira/browse/SPARK-40356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40356. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37810

[jira] [Commented] (SPARK-40228) Don't simplify multiLike if child is not attribute

[ https://issues.apache.org/jira/browse/SPARK-40228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601078#comment-17601078 ] Apache Spark commented on SPARK-40228: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-40228) Don't simplify multiLike if child is not attribute

[ https://issues.apache.org/jira/browse/SPARK-40228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601077#comment-17601077 ] Apache Spark commented on SPARK-40228: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-40363) Add SQL misc function to assert/check column value

[ https://issues.apache.org/jira/browse/SPARK-40363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601074#comment-17601074 ] Hyukjin Kwon commented on SPARK-40363: -- So basically this is: {code} F.when(~cond,

[jira] [Commented] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601067#comment-17601067 ] Asif commented on SPARK-40362: -- will be generating a PR tomorrow.. > Bug in Canonicalization of

[jira] [Comment Edited] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601066#comment-17601066 ] Asif edited comment on SPARK-40362 at 9/7/22 12:43 AM: --- I have added locally test

[jira] [Comment Edited] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601066#comment-17601066 ] Asif edited comment on SPARK-40362 at 9/7/22 12:42 AM: --- I have added locally test

[jira] [Comment Edited] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601066#comment-17601066 ] Asif edited comment on SPARK-40362 at 9/7/22 12:42 AM: --- I have added locally test

[jira] [Commented] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601066#comment-17601066 ] Asif commented on SPARK-40362: -- I have added locally test for  &&, ||, &, | and *  and they all fail for

[jira] [Updated] (SPARK-33605) Add gcs-connector to hadoop-cloud module

[ https://issues.apache.org/jira/browse/SPARK-33605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33605: -- Affects Version/s: 3.4.0 (was: 3.0.1) > Add gcs-connector to

[jira] [Updated] (SPARK-33605) Add gcs-connector to hadoop-cloud module

[ https://issues.apache.org/jira/browse/SPARK-33605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33605: -- Component/s: Build (was: PySpark) (was: Spark Core)

[jira] [Assigned] (SPARK-33605) Add GCS FS/connector config (dependencies?) akin to S3

[ https://issues.apache.org/jira/browse/SPARK-33605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33605: - Assignee: Dongjoon Hyun > Add GCS FS/connector config (dependencies?) akin to S3 >

[jira] [Resolved] (SPARK-33605) Add GCS FS/connector config (dependencies?) akin to S3

[ https://issues.apache.org/jira/browse/SPARK-33605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33605. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37745

[jira] [Updated] (SPARK-33605) Add gcs-connector to hadoop-cloud module

[ https://issues.apache.org/jira/browse/SPARK-33605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33605: -- Summary: Add gcs-connector to hadoop-cloud module (was: Add GCS FS/connector config

[jira] [Created] (SPARK-40363) Add SQL misc function to assert/check column value

Rafal Wojdyla created SPARK-40363: - Summary: Add SQL misc function to assert/check column value Key: SPARK-40363 URL: https://issues.apache.org/jira/browse/SPARK-40363 Project: Spark Issue

[jira] [Created] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

Asif created SPARK-40362: Summary: Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators Key: SPARK-40362 URL: https://issues.apache.org/jira/browse/SPARK-40362 Project: Spark

[jira] [Comment Edited] (SPARK-36901) ERROR exchange.BroadcastExchangeExec: Could not execute broadcast in 300 secs

[ https://issues.apache.org/jira/browse/SPARK-36901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601030#comment-17601030 ] Igor Uchôa edited comment on SPARK-36901 at 9/6/22 10:06 PM: - I'm facing

[jira] [Commented] (SPARK-36901) ERROR exchange.BroadcastExchangeExec: Could not execute broadcast in 300 secs

[ https://issues.apache.org/jira/browse/SPARK-36901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601030#comment-17601030 ] Igor Uchôa commented on SPARK-36901: I'm facing this too. In my case, we have a shared cluster where

[jira] [Commented] (SPARK-40262) Expensive UDF evaluation pushed down past a join leads to performance issues

[ https://issues.apache.org/jira/browse/SPARK-40262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601021#comment-17601021 ] Shardul Mahadik commented on SPARK-40262: - [~cloud_fan] [~viirya] [~joshrosen] Gentle ping on

[jira] [Assigned] (SPARK-40360) Convert some DDL exception to new error framework

[ https://issues.apache.org/jira/browse/SPARK-40360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40360: Assignee: (was: Apache Spark) > Convert some DDL exception to new error framework >

[jira] [Assigned] (SPARK-40360) Convert some DDL exception to new error framework

[ https://issues.apache.org/jira/browse/SPARK-40360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40360: Assignee: Apache Spark > Convert some DDL exception to new error framework >

[jira] [Commented] (SPARK-40360) Convert some DDL exception to new error framework

[ https://issues.apache.org/jira/browse/SPARK-40360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601003#comment-17601003 ] Apache Spark commented on SPARK-40360: -- User 'srielau' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40360) Convert some DDL exception to new error framework

[ https://issues.apache.org/jira/browse/SPARK-40360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40360: Assignee: Apache Spark > Convert some DDL exception to new error framework >

[jira] [Commented] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600948#comment-17600948 ] Pankaj Nagla commented on SPARK-40149: -- Thank you for sharing the information. [Vlocity

[jira] [Resolved] (SPARK-40318) try_avg() should throw the exceptions from its child

[ https://issues.apache.org/jira/browse/SPARK-40318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40318. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37775

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600894#comment-17600894 ] Nikhil Sharma edited comment on SPARK-22588 at 9/6/22 5:03 PM: --- Thank you

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600894#comment-17600894 ] Nikhil Sharma edited comment on SPARK-22588 at 9/6/22 5:01 PM: --- Thank you

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600894#comment-17600894 ] Nikhil Sharma edited comment on SPARK-22588 at 9/6/22 5:00 PM: --- Thank you

[jira] [Updated] (SPARK-40361) Migrate arithmetic type check failures onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40361: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in arithmetic expressions: 1.

[jira] [Created] (SPARK-40361) Migrate arithmetic type check failures onto error classes

Max Gekk created SPARK-40361: Summary: Migrate arithmetic type check failures onto error classes Key: SPARK-40361 URL: https://issues.apache.org/jira/browse/SPARK-40361 Project: Spark Issue

[jira] [Commented] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600894#comment-17600894 ] Nikhil Sharma commented on SPARK-22588: --- Thank you for sharing the information. [React Native

[jira] [Updated] (SPARK-40357) Migrate window type check failures onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40357: - Summary: Migrate window type check failures onto error classes (was: Migrate window type checks onto

[jira] [Updated] (SPARK-40358) Migrate collection type check failures onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40358: - Summary: Migrate collection type check failures onto error classes (was: Migrate collection type

[jira] [Updated] (SPARK-40359) Migrate JSON type check failures onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40359: - Summary: Migrate JSON type check failures onto error classes (was: Migrate JSON type checks onto error

[jira] [Updated] (SPARK-40359) Migrate JSON type checks onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40359: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in JSON expressions: 1.

[jira] [Created] (SPARK-40360) Convert some DDL exception to new error framework

Serge Rielau created SPARK-40360: Summary: Convert some DDL exception to new error framework Key: SPARK-40360 URL: https://issues.apache.org/jira/browse/SPARK-40360 Project: Spark Issue

[jira] [Updated] (SPARK-40358) Migrate collection type checks onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40358: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in collection expressions: 1.

[jira] [Created] (SPARK-40359) Migrate JSON type checks onto error classes

Max Gekk created SPARK-40359: Summary: Migrate JSON type checks onto error classes Key: SPARK-40359 URL: https://issues.apache.org/jira/browse/SPARK-40359 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40358) Migrate collection type checks onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40358: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in window expressions: 1.

[jira] [Created] (SPARK-40358) Migrate collection type checks onto error classes

Max Gekk created SPARK-40358: Summary: Migrate collection type checks onto error classes Key: SPARK-40358 URL: https://issues.apache.org/jira/browse/SPARK-40358 Project: Spark Issue Type:

[jira] [Created] (SPARK-40357) Migrate window type checks onto error classes

Max Gekk created SPARK-40357: Summary: Migrate window type checks onto error classes Key: SPARK-40357 URL: https://issues.apache.org/jira/browse/SPARK-40357 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600777#comment-17600777 ] wuyi commented on SPARK-40320: -- > Actually the  `CoarseGrainedExecutorBackend` JVM process  is active but

[jira] [Assigned] (SPARK-40315) Non-deterministic hashCode() calculations for ArrayBasedMapData on equal objects

[ https://issues.apache.org/jira/browse/SPARK-40315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40315: --- Assignee: Carmen Kwan > Non-deterministic hashCode() calculations for ArrayBasedMapData on

[jira] [Resolved] (SPARK-40315) Non-deterministic hashCode() calculations for ArrayBasedMapData on equal objects

[ https://issues.apache.org/jira/browse/SPARK-40315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40315. - Fix Version/s: 3.3.1 3.1.4 3.2.3 3.4.0

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600766#comment-17600766 ] Jayita Panda commented on SPARK-38330: -- Can someone elaborate the resolution here?Facing the same

[jira] [Resolved] (SPARK-40352) Add function aliases: len, datepart, dateadd, date_diff and curdate

[ https://issues.apache.org/jira/browse/SPARK-40352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40352. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37804

[jira] [Commented] (SPARK-40327) Increase pandas API coverage for pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600756#comment-17600756 ] Yikun Jiang commented on SPARK-40327: - [~podongfeng] Thanks, will work on it! > Increase pandas API

[jira] [Commented] (SPARK-40332) Implement `GroupBy.quantile`.

[ https://issues.apache.org/jira/browse/SPARK-40332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600755#comment-17600755 ] Yikun Jiang commented on SPARK-40332: - working on this > Implement `GroupBy.quantile`. >

[jira] [Commented] (SPARK-40356) Upgrade pandas to 1.4.4

[ https://issues.apache.org/jira/browse/SPARK-40356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600754#comment-17600754 ] Apache Spark commented on SPARK-40356: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40356) Upgrade pandas to 1.4.4

[ https://issues.apache.org/jira/browse/SPARK-40356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40356: Assignee: Apache Spark > Upgrade pandas to 1.4.4 > --- > >

[jira] [Assigned] (SPARK-40356) Upgrade pandas to 1.4.4

[ https://issues.apache.org/jira/browse/SPARK-40356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40356: Assignee: (was: Apache Spark) > Upgrade pandas to 1.4.4 > --- >

[jira] [Commented] (SPARK-40356) Upgrade pandas to 1.4.4

[ https://issues.apache.org/jira/browse/SPARK-40356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600753#comment-17600753 ] Apache Spark commented on SPARK-40356: -- User 'Yikun' has created a pull request for this issue:

[jira] [Created] (SPARK-40356) Upgrade pandas to 1.4.4

Yikun Jiang created SPARK-40356: --- Summary: Upgrade pandas to 1.4.4 Key: SPARK-40356 URL: https://issues.apache.org/jira/browse/SPARK-40356 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40355) Improve pushdown for orc & parquet when cast scenario

[ https://issues.apache.org/jira/browse/SPARK-40355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-40355: Description: Table Schema: | a| b| part| | | int|string  | string| |   SQL: select * from table

[jira] [Updated] (SPARK-40355) Improve pushdown for orc & parquet when cast scenario

[ https://issues.apache.org/jira/browse/SPARK-40355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-40355: Description: Table Schema: |  a |  b |  part | |---|---|---| |  int | string   |  string | 

[jira] [Commented] (SPARK-40355) Improve pushdown for orc & parquet when cast scenario

[ https://issues.apache.org/jira/browse/SPARK-40355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600737#comment-17600737 ] Apache Spark commented on SPARK-40355: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40355) Improve pushdown for orc & parquet when cast scenario

[ https://issues.apache.org/jira/browse/SPARK-40355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40355: Assignee: Apache Spark > Improve pushdown for orc & parquet when cast scenario >

[jira] [Commented] (SPARK-40355) Improve pushdown for orc & parquet when cast scenario

[ https://issues.apache.org/jira/browse/SPARK-40355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600736#comment-17600736 ] Apache Spark commented on SPARK-40355: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40355) Improve pushdown for orc & parquet when cast scenario

[ https://issues.apache.org/jira/browse/SPARK-40355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40355: Assignee: (was: Apache Spark) > Improve pushdown for orc & parquet when cast

[jira] [Created] (SPARK-40355) Improve pushdown for orc & parquet when cast scenario

BingKun Pan created SPARK-40355: --- Summary: Improve pushdown for orc & parquet when cast scenario Key: SPARK-40355 URL: https://issues.apache.org/jira/browse/SPARK-40355 Project: Spark Issue

[jira] [Commented] (SPARK-39830) Add a test case to read ORC table that requires type promotion

[ https://issues.apache.org/jira/browse/SPARK-39830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600731#comment-17600731 ] Apache Spark commented on SPARK-39830: -- User 'cxzl25' has created a pull request for this issue:

[jira] [Commented] (SPARK-40315) Non-deterministic hashCode() calculations for ArrayBasedMapData on equal objects

[ https://issues.apache.org/jira/browse/SPARK-40315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600708#comment-17600708 ] Apache Spark commented on SPARK-40315: -- User 'c27kwan' has created a pull request for this issue:

[jira] [Updated] (SPARK-40354) Support eliminate dynamic partition for v1 writes

[ https://issues.apache.org/jira/browse/SPARK-40354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-40354: -- Description: v1 writes will add an extra sort for dynamic columns, e.g. {code:java} INSERT INTO TABLE

[jira] [Created] (SPARK-40354) Support eliminate dynamic partition for v1 writes

XiDuo You created SPARK-40354: - Summary: Support eliminate dynamic partition for v1 writes Key: SPARK-40354 URL: https://issues.apache.org/jira/browse/SPARK-40354 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-40324) Provide a query context of ParseException

[ https://issues.apache.org/jira/browse/SPARK-40324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40324. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37794

[jira] [Resolved] (SPARK-40300) Migrate onto the DATATYPE_MISMATCH error classes

[ https://issues.apache.org/jira/browse/SPARK-40300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40300. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37744

[jira] [Commented] (SPARK-39546) Respect port defininitions on K8S pod templates for both driver and executor

[ https://issues.apache.org/jira/browse/SPARK-39546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600669#comment-17600669 ] Oliver Koeth commented on SPARK-39546: -- Yes, looks like this should do it. Thank you > Respect

[jira] [Commented] (SPARK-40298) shuffle data recovery on the reused PVCs no effect

[ https://issues.apache.org/jira/browse/SPARK-40298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600631#comment-17600631 ] Dongjoon Hyun commented on SPARK-40298: --- Thank you for trying Apache Spark feature, [~todd5167] ,