[jira] [Commented] (SPARK-34714) collect_list(struct()) fails when used with GROUP BY

[ https://issues.apache.org/jira/browse/SPARK-34714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450236#comment-17450236 ] Manu Zhang commented on SPARK-34714: FYI, this was resolved by https://issues.apache

[jira] [Created] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check'

dch nguyen created SPARK-37482: -- Summary: Skip check monotonic increasing for Series.asof with 'compute.eager_check' Key: SPARK-37482 URL: https://issues.apache.org/jira/browse/SPARK-37482 Project: Spark

[jira] [Resolved] (SPARK-37447) Cache LogicalPlan.isStreaming() in a lazy val

[ https://issues.apache.org/jira/browse/SPARK-37447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37447. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34691 [https://gith

[jira] [Commented] (SPARK-34248) Allow implicit casting string literal to other data types under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-34248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450295#comment-17450295 ] 王俊博 commented on SPARK-34248: - {{where is the issue links?I found some issue with }}{{implic

[jira] [Comment Edited] (SPARK-34248) Allow implicit casting string literal to other data types under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-34248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450295#comment-17450295 ] 王俊博 edited comment on SPARK-34248 at 11/29/21, 9:16 AM: {{where

[jira] [Commented] (SPARK-33354) New explicit cast syntax rules in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-33354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450301#comment-17450301 ] 王俊博 commented on SPARK-33354: - cast StringType=>NumericType， Is there some issue? String =>

[jira] [Assigned] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

[ https://issues.apache.org/jira/browse/SPARK-37452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-37452: Assignee: Kent Yao > Char and Varchar breaks backward compatibility between v3 and v2 > -

[jira] [Resolved] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

[ https://issues.apache.org/jira/browse/SPARK-37452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-37452. -- Fix Version/s: 3.2.1 3.3.0 Resolution: Fixed Issue resolved by https://githu

[jira] [Commented] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

[ https://issues.apache.org/jira/browse/SPARK-37452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450308#comment-17450308 ] Apache Spark commented on SPARK-37452: -- User 'yaooqinn' has created a pull request

[jira] [Created] (SPARK-37483) Support pushdown down top N to JDBC data source V2

jiaan.geng created SPARK-37483: -- Summary: Support pushdown down top N to JDBC data source V2 Key: SPARK-37483 URL: https://issues.apache.org/jira/browse/SPARK-37483 Project: Spark Issue Type: Ne

[jira] [Assigned] (SPARK-37464) SCHEMA and DATABASE should simply be aliases of NAMESPACE

[ https://issues.apache.org/jira/browse/SPARK-37464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37464: --- Assignee: Wenchen Fan > SCHEMA and DATABASE should simply be aliases of NAMESPACE > ---

[jira] [Resolved] (SPARK-37464) SCHEMA and DATABASE should simply be aliases of NAMESPACE

[ https://issues.apache.org/jira/browse/SPARK-37464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37464. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34713 [https://gith

[jira] [Commented] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check'

[ https://issues.apache.org/jira/browse/SPARK-37482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450313#comment-17450313 ] Apache Spark commented on SPARK-37482: -- User 'dchvn' has created a pull request for

[jira] [Assigned] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check'

[ https://issues.apache.org/jira/browse/SPARK-37482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37482: Assignee: (was: Apache Spark) > Skip check monotonic increasing for Series.asof with

[jira] [Assigned] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check'

[ https://issues.apache.org/jira/browse/SPARK-37482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37482: Assignee: Apache Spark > Skip check monotonic increasing for Series.asof with 'compute.ea

[jira] [Commented] (SPARK-37483) Support pushdown down top N to JDBC data source V2

[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450314#comment-17450314 ] Apache Spark commented on SPARK-37483: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-37483) Support pushdown down top N to JDBC data source V2

[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37483: Assignee: Apache Spark > Support pushdown down top N to JDBC data source V2 > ---

[jira] [Assigned] (SPARK-37483) Support pushdown down top N to JDBC data source V2

[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37483: Assignee: (was: Apache Spark) > Support pushdown down top N to JDBC data source V2 >

[jira] [Commented] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check'

[ https://issues.apache.org/jira/browse/SPARK-37482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450315#comment-17450315 ] Apache Spark commented on SPARK-37482: -- User 'dchvn' has created a pull request for

[jira] [Commented] (SPARK-37483) Support pushdown down top N to JDBC data source V2

[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450316#comment-17450316 ] Apache Spark commented on SPARK-37483: -- User 'beliefer' has created a pull request

[jira] [Created] (SPARK-37484) Replace Get and getOrElse with getOrElse

Yang Jie created SPARK-37484: Summary: Replace Get and getOrElse with getOrElse Key: SPARK-37484 URL: https://issues.apache.org/jira/browse/SPARK-37484 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-37484) Replace Get and getOrElse with getOrElse

[ https://issues.apache.org/jira/browse/SPARK-37484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37484: Assignee: Apache Spark > Replace Get and getOrElse with getOrElse > -

[jira] [Commented] (SPARK-37484) Replace Get and getOrElse with getOrElse

[ https://issues.apache.org/jira/browse/SPARK-37484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450375#comment-17450375 ] Apache Spark commented on SPARK-37484: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-37484) Replace Get and getOrElse with getOrElse

[ https://issues.apache.org/jira/browse/SPARK-37484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37484: Assignee: (was: Apache Spark) > Replace Get and getOrElse with getOrElse > --

[jira] [Created] (SPARK-37485) Replace map with expressions which produce no result with foreach

Yang Jie created SPARK-37485: Summary: Replace map with expressions which produce no result with foreach Key: SPARK-37485 URL: https://issues.apache.org/jira/browse/SPARK-37485 Project: Spark I

[jira] [Commented] (SPARK-37485) Replace map with expressions which produce no result with foreach

[ https://issues.apache.org/jira/browse/SPARK-37485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450390#comment-17450390 ] Apache Spark commented on SPARK-37485: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-37485) Replace map with expressions which produce no result with foreach

[ https://issues.apache.org/jira/browse/SPARK-37485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37485: Assignee: Apache Spark > Replace map with expressions which produce no result with foreac

[jira] [Assigned] (SPARK-37485) Replace map with expressions which produce no result with foreach

[ https://issues.apache.org/jira/browse/SPARK-37485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37485: Assignee: (was: Apache Spark) > Replace map with expressions which produce no result

[jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz to Orc uses UTC timestamp

[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37463: --- Summary: Read/Write Timestamp ntz to Orc uses UTC timestamp (was: Read/Write Timestamp ntz or ltz t

[jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC timestamp

[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37463: --- Summary: Read/Write Timestamp ntz from/to Orc uses UTC timestamp (was: Read/Write Timestamp ntz to

[jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC time zone

[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37463: --- Summary: Read/Write Timestamp ntz from/to Orc uses UTC time zone (was: Read/Write Timestamp ntz fro

[jira] [Commented] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC time zone

[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450395#comment-17450395 ] Apache Spark commented on SPARK-37463: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC time zone

[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450396#comment-17450396 ] Apache Spark commented on SPARK-37463: -- User 'beliefer' has created a pull request

[jira] [Created] (SPARK-37487) CollectMetrics is executed twice if it is followed by an sort

Tanel Kiis created SPARK-37487: -- Summary: CollectMetrics is executed twice if it is followed by an sort Key: SPARK-37487 URL: https://issues.apache.org/jira/browse/SPARK-37487 Project: Spark Is

[jira] [Updated] (SPARK-37487) CollectMetrics is executed twice if it is followed by an sort

[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-37487: --- Description: It is best examplified by this new UT in DataFrameCallbackSuite: {code} test("SPARK-X

[jira] [Updated] (SPARK-37487) CollectMetrics is executed twice if it is followed by an sort

[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-37487: --- Description: It is best examplified by this new UT in DataFrameCallbackSuite: {code} test("SPARK-X

[jira] [Updated] (SPARK-37487) CollectMetrics is executed twice if it is followed by an sort

[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-37487: --- Description: It is best examplified by this new UT in DataFrameCallbackSuite: {code} test("SPARK-X

[jira] [Commented] (SPARK-37487) CollectMetrics is executed twice if it is followed by an sort

[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450452#comment-17450452 ] Tanel Kiis commented on SPARK-37487: [~cloud_fan] and [~sarutak], you helped with th

[jira] [Updated] (SPARK-37487) CollectMetrics is executed twice if it is followed by a sort

[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-37487: --- Summary: CollectMetrics is executed twice if it is followed by a sort (was: CollectMetrics is execu

[jira] [Created] (SPARK-37488) With enough resources, the task may still be permanently pending

logic can be simplified as follows SparkSession testApp = SparkSession.builder() .master("local[*]") .appName("test app") .enableHiveSupport() .getOrCreate(); Dataset dataset = testApp.sql("select * from default.test where dt = '20

[jira] [Assigned] (SPARK-37488) With enough resources, the task may still be permanently pending

> the code logic can be simplified as follows > SparkSession testApp = SparkSession.builder() > .master("local[*]") > .appName("test app") > .enableHiveSupport() > .getOrCreate(); > Dataset dataset = tes

[jira] [Assigned] (SPARK-37488) With enough resources, the task may still be permanently pending

data imported to tidb, > the code logic can be simplified as follows > SparkSession testApp = SparkSession.builder() > .master("local[*]") > .appName("test app") > .enableHiveSupport() > .getOrCreate(); &

[jira] [Commented] (SPARK-37488) With enough resources, the task may still be permanently pending

quot;test app") > .enableHiveSupport() > .getOrCreate(); > Dataset dataset = testApp.sql("select * from default.test where dt = > '20211129'"); > dataset.persist(StorageLevel.MEMORY_AND_DISK()); > dataset.count(); > {code} &g

[jira] [Updated] (SPARK-37485) Replace map with expressions which produce no result with foreach

[ https://issues.apache.org/jira/browse/SPARK-37485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37485: - Priority: Trivial (was: Minor) > Replace map with expressions which produce no result with fore

[jira] [Updated] (SPARK-37484) Replace Get and getOrElse with getOrElse

[ https://issues.apache.org/jira/browse/SPARK-37484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37484: - Priority: Trivial (was: Minor) > Replace Get and getOrElse with getOrElse > ---

[jira] [Commented] (SPARK-37259) JDBC read is always going to wrap the query in a select statement

[ https://issues.apache.org/jira/browse/SPARK-37259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450525#comment-17450525 ] Kevin Appel commented on SPARK-37259: - [~petertoth] [~akhalymon] Thank you both for

[jira] [Commented] (SPARK-37454) support expressions in time travel timestamp

[ https://issues.apache.org/jira/browse/SPARK-37454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450552#comment-17450552 ] Apache Spark commented on SPARK-37454: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-37454) support expressions in time travel timestamp

[ https://issues.apache.org/jira/browse/SPARK-37454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450553#comment-17450553 ] Apache Spark commented on SPARK-37454: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-37489) Skip hasnans check in numops if eager_check disable

Yikun Jiang created SPARK-37489: --- Summary: Skip hasnans check in numops if eager_check disable Key: SPARK-37489 URL: https://issues.apache.org/jira/browse/SPARK-37489 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450559#comment-17450559 ] Apache Spark commented on SPARK-37391: -- User 'tdg5' has created a pull request for

[jira] [Assigned] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37391: Assignee: (was: Apache Spark) > SIGNIFICANT bottleneck introduced by fix for SPARK-32

[jira] [Assigned] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37391: Assignee: Apache Spark > SIGNIFICANT bottleneck introduced by fix for SPARK-32001 > -

[jira] [Commented] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450560#comment-17450560 ] Apache Spark commented on SPARK-37391: -- User 'tdg5' has created a pull request for

[jira] [Assigned] (SPARK-37489) Skip hasnans check in numops if eager_check disable

[ https://issues.apache.org/jira/browse/SPARK-37489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37489: Assignee: Apache Spark > Skip hasnans check in numops if eager_check disable > --

[jira] [Assigned] (SPARK-37489) Skip hasnans check in numops if eager_check disable

[ https://issues.apache.org/jira/browse/SPARK-37489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37489: Assignee: (was: Apache Spark) > Skip hasnans check in numops if eager_check disable >

[jira] [Commented] (SPARK-37489) Skip hasnans check in numops if eager_check disable

[ https://issues.apache.org/jira/browse/SPARK-37489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450567#comment-17450567 ] Apache Spark commented on SPARK-37489: -- User 'Yikun' has created a pull request for

[jira] [Commented] (SPARK-37489) Skip hasnans check in numops if eager_check disable

[ https://issues.apache.org/jira/browse/SPARK-37489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450569#comment-17450569 ] Apache Spark commented on SPARK-37489: -- User 'Yikun' has created a pull request for

[jira] [Created] (SPARK-37490) Show hint if analyzer fails due to ANSI type coercion

Gengliang Wang created SPARK-37490: -- Summary: Show hint if analyzer fails due to ANSI type coercion Key: SPARK-37490 URL: https://issues.apache.org/jira/browse/SPARK-37490 Project: Spark Iss

[jira] [Assigned] (SPARK-37490) Show hint if analyzer fails due to ANSI type coercion

[ https://issues.apache.org/jira/browse/SPARK-37490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37490: Assignee: Apache Spark (was: Gengliang Wang) > Show hint if analyzer fails due to ANSI t

[jira] [Commented] (SPARK-37490) Show hint if analyzer fails due to ANSI type coercion

[ https://issues.apache.org/jira/browse/SPARK-37490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450593#comment-17450593 ] Apache Spark commented on SPARK-37490: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-37490) Show hint if analyzer fails due to ANSI type coercion

[ https://issues.apache.org/jira/browse/SPARK-37490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37490: Assignee: Gengliang Wang (was: Apache Spark) > Show hint if analyzer fails due to ANSI t

[jira] [Updated] (SPARK-37487) CollectMetrics is executed twice if it is followed by a sort

[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-37487: --- Labels: correctness (was: ) > CollectMetrics is executed twice if it is followed by a sort > --

[jira] [Resolved] (SPARK-37468) Support ANSI intervals and TimestampNTZ for UnionEstimation

[ https://issues.apache.org/jira/browse/SPARK-37468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-37468. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34716 [https://github.com

[jira] [Created] (SPARK-37491) Fix Series.asof when values of the series is not sorted

dch nguyen created SPARK-37491: -- Summary: Fix Series.asof when values of the series is not sorted Key: SPARK-37491 URL: https://issues.apache.org/jira/browse/SPARK-37491 Project: Spark Issue Typ

[jira] [Created] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

jiaan.geng created SPARK-37492: -- Summary: Optimize Orc test code with withAllNativeOrcReaders Key: SPARK-37492 URL: https://issues.apache.org/jira/browse/SPARK-37492 Project: Spark Issue Type: N

[jira] [Assigned] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

[ https://issues.apache.org/jira/browse/SPARK-37492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37492: Assignee: (was: Apache Spark) > Optimize Orc test code with withAllNativeOrcReaders >

[jira] [Commented] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

[ https://issues.apache.org/jira/browse/SPARK-37492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450794#comment-17450794 ] Apache Spark commented on SPARK-37492: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

[ https://issues.apache.org/jira/browse/SPARK-37492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37492: Assignee: Apache Spark > Optimize Orc test code with withAllNativeOrcReaders > --

[jira] [Commented] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

[ https://issues.apache.org/jira/browse/SPARK-37492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450795#comment-17450795 ] Apache Spark commented on SPARK-37492: -- User 'beliefer' has created a pull request

[jira] [Created] (SPARK-37493) expose driver gc time

zhoubin created SPARK-37493: --- Summary: expose driver gc time Key: SPARK-37493 URL: https://issues.apache.org/jira/browse/SPARK-37493 Project: Spark Issue Type: Improvement Components: Spa

[jira] [Created] (SPARK-37494) Unify v1 and v2 option output of `SHOW CREATE TABLE` command

PengLei created SPARK-37494: --- Summary: Unify v1 and v2 option output of `SHOW CREATE TABLE` command Key: SPARK-37494 URL: https://issues.apache.org/jira/browse/SPARK-37494 Project: Spark Issue Typ

[jira] [Updated] (SPARK-37493) expose driver gc time and duration time

[ https://issues.apache.org/jira/browse/SPARK-37493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoubin updated SPARK-37493: Summary: expose driver gc time and duration time (was: expose driver gc time) > expose driver gc time an

[jira] [Updated] (SPARK-37483) Support push down top N to JDBC data source V2

[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37483: --- Summary: Support push down top N to JDBC data source V2 (was: Support pushdown down top N to JDBC d

[jira] [Updated] (SPARK-37494) Unify v1 and v2 options output of `SHOW CREATE TABLE` command

[ https://issues.apache.org/jira/browse/SPARK-37494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PengLei updated SPARK-37494: Summary: Unify v1 and v2 options output of `SHOW CREATE TABLE` command (was: Unify v1 and v2 option outpu

[jira] [Assigned] (SPARK-37485) Replace map with expressions which produce no result with foreach

[ https://issues.apache.org/jira/browse/SPARK-37485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37485: Assignee: Yang Jie > Replace map with expressions which produce no result with foreach >

[jira] [Resolved] (SPARK-37485) Replace map with expressions which produce no result with foreach

[ https://issues.apache.org/jira/browse/SPARK-37485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37485. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34740 [https://gi

[jira] [Resolved] (SPARK-37484) Replace Get and getOrElse with getOrElse

[ https://issues.apache.org/jira/browse/SPARK-37484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37484. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34739 [https://gi

[jira] [Assigned] (SPARK-37484) Replace Get and getOrElse with getOrElse

[ https://issues.apache.org/jira/browse/SPARK-37484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37484: Assignee: Yang Jie > Replace Get and getOrElse with getOrElse > -

[jira] [Resolved] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check'

[ https://issues.apache.org/jira/browse/SPARK-37482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37482. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34737 [https://gi

[jira] [Assigned] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check'

[ https://issues.apache.org/jira/browse/SPARK-37482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37482: Assignee: dch nguyen > Skip check monotonic increasing for Series.asof with 'compute.eage

[jira] [Commented] (SPARK-37493) expose driver gc time and duration time

[ https://issues.apache.org/jira/browse/SPARK-37493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450819#comment-17450819 ] Apache Spark commented on SPARK-37493: -- User 'summaryzb' has created a pull request

[jira] [Assigned] (SPARK-37493) expose driver gc time and duration time

[ https://issues.apache.org/jira/browse/SPARK-37493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37493: Assignee: Apache Spark > expose driver gc time and duration time > --

[jira] [Assigned] (SPARK-37493) expose driver gc time and duration time

[ https://issues.apache.org/jira/browse/SPARK-37493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37493: Assignee: (was: Apache Spark) > expose driver gc time and duration time > ---

[jira] [Commented] (SPARK-37486) an error occurred while using the udf jars located in the lakefs, a inner filesystem in Tencent Cloud DLC.

[ https://issues.apache.org/jira/browse/SPARK-37486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450820#comment-17450820 ] Apache Spark commented on SPARK-37486: -- User 'kevincmchen' has created a pull reque

[jira] [Commented] (SPARK-37493) expose driver gc time and duration time

[ https://issues.apache.org/jira/browse/SPARK-37493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450822#comment-17450822 ] zhoubin commented on SPARK-37493: - Issue resolved by pull request 34749 https://github.

[jira] [Resolved] (SPARK-35867) Enable vectorized read for VectorizedPlainValuesReader.readBooleans

[ https://issues.apache.org/jira/browse/SPARK-35867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-35867. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34611 [https://github.com

[jira] [Assigned] (SPARK-35867) Enable vectorized read for VectorizedPlainValuesReader.readBooleans

[ https://issues.apache.org/jira/browse/SPARK-35867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-35867: Assignee: Kazuyuki Tanimura > Enable vectorized read for VectorizedPlainValuesReader.readBooleans

[jira] [Updated] (SPARK-37472) Missing functionality in spark.pandas

[ https://issues.apache.org/jira/browse/SPARK-37472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37472: - Parent: SPARK-36394 Issue Type: Sub-task (was: New Feature) > Missing functionality in

[jira] [Updated] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

[ https://issues.apache.org/jira/browse/SPARK-37452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37452: -- Fix Version/s: 3.1.3 > Char and Varchar breaks backward compatibility between v3 and v2 >

[jira] [Assigned] (SPARK-36850) Migrate CreateTableStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36850: --- Assignee: Huaxin Gao > Migrate CreateTableStatement to v2 command framework > -

[jira] [Resolved] (SPARK-36850) Migrate CreateTableStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36850. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34060 [https://gith

[jira] [Resolved] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

[ https://issues.apache.org/jira/browse/SPARK-37492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37492. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34723 [https://

[jira] [Assigned] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

[ https://issues.apache.org/jira/browse/SPARK-37492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37492: - Assignee: jiaan.geng > Optimize Orc test code with withAllNativeOrcReaders > --

[jira] [Created] (SPARK-37495) Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled

dch nguyen created SPARK-37495: -- Summary: Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled Key: SPARK-37495 URL: https://issues.apache.org/jira/browse/SPARK-37495

[jira] [Assigned] (SPARK-37465) PySpark tests failing on Pandas 0.23

[ https://issues.apache.org/jira/browse/SPARK-37465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37465: Assignee: Hyukjin Kwon > PySpark tests failing on Pandas 0.23 > -

[jira] [Assigned] (SPARK-37465) PySpark tests failing on Pandas 0.23

[ https://issues.apache.org/jira/browse/SPARK-37465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37465: Assignee: Yikun Jiang (was: Hyukjin Kwon) > PySpark tests failing on Pandas 0.23 > -

[jira] [Resolved] (SPARK-37465) PySpark tests failing on Pandas 0.23

[ https://issues.apache.org/jira/browse/SPARK-37465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37465. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34717 [https://gi

[jira] [Updated] (SPARK-37487) CollectMetrics is executed twice if it is followed by a sort

[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-37487: --- Description: It is best examplified by this new UT in DataFrameCallbackSuite: {code} test("SPARK-3

[jira] [Created] (SPARK-37496) Migrate ReplaceTableAsSelectStatement to v2 command

Huaxin Gao created SPARK-37496: -- Summary: Migrate ReplaceTableAsSelectStatement to v2 command Key: SPARK-37496 URL: https://issues.apache.org/jira/browse/SPARK-37496 Project: Spark Issue Type: S

[jira] [Commented] (SPARK-37495) Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled

[ https://issues.apache.org/jira/browse/SPARK-37495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450875#comment-17450875 ] Apache Spark commented on SPARK-37495: -- User 'dchvn' has created a pull request for

  1   2   >