[jira] [Resolved] (SPARK-37499) Close HiveClientImpl.sessionState when shutdown

[ https://issues.apache.org/jira/browse/SPARK-37499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-37499. --- Resolution: Not A Problem > Close HiveClientImpl.sessionState when shutdown >

[jira] [Commented] (SPARK-37494) Unify v1 and v2 options output of `SHOW CREATE TABLE` command

[ https://issues.apache.org/jira/browse/SPARK-37494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450909#comment-17450909 ] Apache Spark commented on SPARK-37494: -- User 'Peng-Lei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37494) Unify v1 and v2 options output of `SHOW CREATE TABLE` command

[ https://issues.apache.org/jira/browse/SPARK-37494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37494: Assignee: (was: Apache Spark) > Unify v1 and v2 options output of `SHOW CREATE

[jira] [Assigned] (SPARK-37494) Unify v1 and v2 options output of `SHOW CREATE TABLE` command

[ https://issues.apache.org/jira/browse/SPARK-37494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37494: Assignee: Apache Spark > Unify v1 and v2 options output of `SHOW CREATE TABLE` command >

[jira] [Resolved] (SPARK-36396) Implement DataFrame.cov

[ https://issues.apache.org/jira/browse/SPARK-36396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36396. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34213

[jira] [Assigned] (SPARK-36396) Implement DataFrame.cov

[ https://issues.apache.org/jira/browse/SPARK-36396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36396: Assignee: Xinrong Meng > Implement DataFrame.cov > --- > >

[jira] [Assigned] (SPARK-37489) Skip hasnans check in numops if eager_check disable

[ https://issues.apache.org/jira/browse/SPARK-37489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37489: Assignee: Yikun Jiang > Skip hasnans check in numops if eager_check disable >

[jira] [Resolved] (SPARK-37489) Skip hasnans check in numops if eager_check disable

[ https://issues.apache.org/jira/browse/SPARK-37489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37489. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34746

[jira] [Commented] (SPARK-37499) Close HiveClientImpl.sessionState when shutdown

[ https://issues.apache.org/jira/browse/SPARK-37499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450884#comment-17450884 ] angerszhu commented on SPARK-37499: --- Raise PR soon > Close HiveClientImpl.sessionState when shutdown

[jira] [Created] (SPARK-37499) Close HiveClientImpl.sessionState when shutdown

angerszhu created SPARK-37499: - Summary: Close HiveClientImpl.sessionState when shutdown Key: SPARK-37499 URL: https://issues.apache.org/jira/browse/SPARK-37499 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-37497) Promote ExecutorPods[PollingSnapshot|WatchSnapshot]Source to DeveloperApi

[ https://issues.apache.org/jira/browse/SPARK-37497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450883#comment-17450883 ] Apache Spark commented on SPARK-37497: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37497) Promote ExecutorPods[PollingSnapshot|WatchSnapshot]Source to DeveloperApi

[ https://issues.apache.org/jira/browse/SPARK-37497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37497: Assignee: (was: Apache Spark) > Promote

[jira] [Commented] (SPARK-37497) Promote ExecutorPods[PollingSnapshot|WatchSnapshot]Source to DeveloperApi

[ https://issues.apache.org/jira/browse/SPARK-37497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450882#comment-17450882 ] Apache Spark commented on SPARK-37497: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37497) Promote ExecutorPods[PollingSnapshot|WatchSnapshot]Source to DeveloperApi

[ https://issues.apache.org/jira/browse/SPARK-37497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37497: Assignee: Apache Spark > Promote ExecutorPods[PollingSnapshot|WatchSnapshot]Source to

[jira] [Created] (SPARK-37498) test_reuse_worker_of_parallelize_range is flaky

Yikun Jiang created SPARK-37498: --- Summary: test_reuse_worker_of_parallelize_range is flaky Key: SPARK-37498 URL: https://issues.apache.org/jira/browse/SPARK-37498 Project: Spark Issue Type:

[jira] [Created] (SPARK-37497) Promote ExecutorPods[PollingSnapshot|WatchSnapshot]Source to DeveloperApi

Dongjoon Hyun created SPARK-37497: - Summary: Promote ExecutorPods[PollingSnapshot|WatchSnapshot]Source to DeveloperApi Key: SPARK-37497 URL: https://issues.apache.org/jira/browse/SPARK-37497 Project:

[jira] [Assigned] (SPARK-37495) Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled

[ https://issues.apache.org/jira/browse/SPARK-37495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37495: Assignee: Apache Spark > Skip identical index checking of Series.compare when config >

[jira] [Assigned] (SPARK-37495) Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled

[ https://issues.apache.org/jira/browse/SPARK-37495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37495: Assignee: (was: Apache Spark) > Skip identical index checking of Series.compare when

[jira] [Commented] (SPARK-37495) Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled

[ https://issues.apache.org/jira/browse/SPARK-37495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450875#comment-17450875 ] Apache Spark commented on SPARK-37495: -- User 'dchvn' has created a pull request for this issue:

[jira] [Created] (SPARK-37496) Migrate ReplaceTableAsSelectStatement to v2 command

Huaxin Gao created SPARK-37496: -- Summary: Migrate ReplaceTableAsSelectStatement to v2 command Key: SPARK-37496 URL: https://issues.apache.org/jira/browse/SPARK-37496 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37487) CollectMetrics is executed twice if it is followed by a sort

[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-37487: --- Description: It is best examplified by this new UT in DataFrameCallbackSuite: {code}

[jira] [Resolved] (SPARK-37465) PySpark tests failing on Pandas 0.23

[ https://issues.apache.org/jira/browse/SPARK-37465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37465. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34717

[jira] [Assigned] (SPARK-37465) PySpark tests failing on Pandas 0.23

[ https://issues.apache.org/jira/browse/SPARK-37465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37465: Assignee: Yikun Jiang (was: Hyukjin Kwon) > PySpark tests failing on Pandas 0.23 >

[jira] [Assigned] (SPARK-37465) PySpark tests failing on Pandas 0.23

[ https://issues.apache.org/jira/browse/SPARK-37465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37465: Assignee: Hyukjin Kwon > PySpark tests failing on Pandas 0.23 >

[jira] [Created] (SPARK-37495) Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled

dch nguyen created SPARK-37495: -- Summary: Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled Key: SPARK-37495 URL: https://issues.apache.org/jira/browse/SPARK-37495

[jira] [Assigned] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

[ https://issues.apache.org/jira/browse/SPARK-37492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37492: - Assignee: jiaan.geng > Optimize Orc test code with withAllNativeOrcReaders >

[jira] [Resolved] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

[ https://issues.apache.org/jira/browse/SPARK-37492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37492. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34723

[jira] [Resolved] (SPARK-36850) Migrate CreateTableStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36850. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34060

[jira] [Assigned] (SPARK-36850) Migrate CreateTableStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36850: --- Assignee: Huaxin Gao > Migrate CreateTableStatement to v2 command framework >

[jira] [Updated] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

[ https://issues.apache.org/jira/browse/SPARK-37452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37452: -- Fix Version/s: 3.1.3 > Char and Varchar breaks backward compatibility between v3 and v2 >

[jira] [Updated] (SPARK-37472) Missing functionality in spark.pandas

[ https://issues.apache.org/jira/browse/SPARK-37472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37472: - Parent: SPARK-36394 Issue Type: Sub-task (was: New Feature) > Missing functionality in

[jira] [Resolved] (SPARK-35867) Enable vectorized read for VectorizedPlainValuesReader.readBooleans

[ https://issues.apache.org/jira/browse/SPARK-35867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-35867. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34611

[jira] [Assigned] (SPARK-35867) Enable vectorized read for VectorizedPlainValuesReader.readBooleans

[ https://issues.apache.org/jira/browse/SPARK-35867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-35867: Assignee: Kazuyuki Tanimura > Enable vectorized read for

[jira] [Commented] (SPARK-37493) expose driver gc time and duration time

[ https://issues.apache.org/jira/browse/SPARK-37493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450822#comment-17450822 ] zhoubin commented on SPARK-37493: - Issue resolved by pull request 34749

[jira] [Commented] (SPARK-37486) an error occurred while using the udf jars located in the lakefs, a inner filesystem in Tencent Cloud DLC.

[ https://issues.apache.org/jira/browse/SPARK-37486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450820#comment-17450820 ] Apache Spark commented on SPARK-37486: -- User 'kevincmchen' has created a pull request for this

[jira] [Assigned] (SPARK-37493) expose driver gc time and duration time

[ https://issues.apache.org/jira/browse/SPARK-37493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37493: Assignee: (was: Apache Spark) > expose driver gc time and duration time >

[jira] [Assigned] (SPARK-37493) expose driver gc time and duration time

[ https://issues.apache.org/jira/browse/SPARK-37493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37493: Assignee: Apache Spark > expose driver gc time and duration time >

[jira] [Commented] (SPARK-37493) expose driver gc time and duration time

[ https://issues.apache.org/jira/browse/SPARK-37493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450819#comment-17450819 ] Apache Spark commented on SPARK-37493: -- User 'summaryzb' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check'

[ https://issues.apache.org/jira/browse/SPARK-37482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37482: Assignee: dch nguyen > Skip check monotonic increasing for Series.asof with

[jira] [Resolved] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check'

[ https://issues.apache.org/jira/browse/SPARK-37482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37482. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34737

[jira] [Resolved] (SPARK-37484) Replace Get and getOrElse with getOrElse

[ https://issues.apache.org/jira/browse/SPARK-37484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37484. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34739

[jira] [Assigned] (SPARK-37484) Replace Get and getOrElse with getOrElse

[ https://issues.apache.org/jira/browse/SPARK-37484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37484: Assignee: Yang Jie > Replace Get and getOrElse with getOrElse >

[jira] [Resolved] (SPARK-37485) Replace map with expressions which produce no result with foreach

[ https://issues.apache.org/jira/browse/SPARK-37485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37485. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34740

[jira] [Assigned] (SPARK-37485) Replace map with expressions which produce no result with foreach

[ https://issues.apache.org/jira/browse/SPARK-37485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37485: Assignee: Yang Jie > Replace map with expressions which produce no result with foreach

[jira] [Updated] (SPARK-37494) Unify v1 and v2 options output of `SHOW CREATE TABLE` command

[ https://issues.apache.org/jira/browse/SPARK-37494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PengLei updated SPARK-37494: Summary: Unify v1 and v2 options output of `SHOW CREATE TABLE` command (was: Unify v1 and v2 option

[jira] [Updated] (SPARK-37483) Support push down top N to JDBC data source V2

[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37483: --- Summary: Support push down top N to JDBC data source V2 (was: Support pushdown down top N to JDBC

[jira] [Updated] (SPARK-37493) expose driver gc time and duration time

[ https://issues.apache.org/jira/browse/SPARK-37493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoubin updated SPARK-37493: Summary: expose driver gc time and duration time (was: expose driver gc time) > expose driver gc time

[jira] [Created] (SPARK-37494) Unify v1 and v2 option output of `SHOW CREATE TABLE` command

PengLei created SPARK-37494: --- Summary: Unify v1 and v2 option output of `SHOW CREATE TABLE` command Key: SPARK-37494 URL: https://issues.apache.org/jira/browse/SPARK-37494 Project: Spark Issue

[jira] [Created] (SPARK-37493) expose driver gc time

zhoubin created SPARK-37493: --- Summary: expose driver gc time Key: SPARK-37493 URL: https://issues.apache.org/jira/browse/SPARK-37493 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

[ https://issues.apache.org/jira/browse/SPARK-37492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450795#comment-17450795 ] Apache Spark commented on SPARK-37492: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

[ https://issues.apache.org/jira/browse/SPARK-37492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450794#comment-17450794 ] Apache Spark commented on SPARK-37492: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

[ https://issues.apache.org/jira/browse/SPARK-37492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37492: Assignee: Apache Spark > Optimize Orc test code with withAllNativeOrcReaders >

[jira] [Assigned] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

[ https://issues.apache.org/jira/browse/SPARK-37492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37492: Assignee: (was: Apache Spark) > Optimize Orc test code with withAllNativeOrcReaders

[jira] [Created] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

jiaan.geng created SPARK-37492: -- Summary: Optimize Orc test code with withAllNativeOrcReaders Key: SPARK-37492 URL: https://issues.apache.org/jira/browse/SPARK-37492 Project: Spark Issue Type:

[jira] [Created] (SPARK-37491) Fix Series.asof when values of the series is not sorted

dch nguyen created SPARK-37491: -- Summary: Fix Series.asof when values of the series is not sorted Key: SPARK-37491 URL: https://issues.apache.org/jira/browse/SPARK-37491 Project: Spark Issue

[jira] [Resolved] (SPARK-37468) Support ANSI intervals and TimestampNTZ for UnionEstimation

[ https://issues.apache.org/jira/browse/SPARK-37468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-37468. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34716

[jira] [Updated] (SPARK-37487) CollectMetrics is executed twice if it is followed by a sort

[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-37487: --- Labels: correctness (was: ) > CollectMetrics is executed twice if it is followed by a sort >

[jira] [Assigned] (SPARK-37490) Show hint if analyzer fails due to ANSI type coercion

[ https://issues.apache.org/jira/browse/SPARK-37490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37490: Assignee: Gengliang Wang (was: Apache Spark) > Show hint if analyzer fails due to ANSI

[jira] [Commented] (SPARK-37490) Show hint if analyzer fails due to ANSI type coercion

[ https://issues.apache.org/jira/browse/SPARK-37490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450593#comment-17450593 ] Apache Spark commented on SPARK-37490: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-37490) Show hint if analyzer fails due to ANSI type coercion

[ https://issues.apache.org/jira/browse/SPARK-37490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37490: Assignee: Apache Spark (was: Gengliang Wang) > Show hint if analyzer fails due to ANSI

[jira] [Created] (SPARK-37490) Show hint if analyzer fails due to ANSI type coercion

Gengliang Wang created SPARK-37490: -- Summary: Show hint if analyzer fails due to ANSI type coercion Key: SPARK-37490 URL: https://issues.apache.org/jira/browse/SPARK-37490 Project: Spark

[jira] [Commented] (SPARK-37489) Skip hasnans check in numops if eager_check disable

[ https://issues.apache.org/jira/browse/SPARK-37489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450569#comment-17450569 ] Apache Spark commented on SPARK-37489: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-37489) Skip hasnans check in numops if eager_check disable

[ https://issues.apache.org/jira/browse/SPARK-37489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450567#comment-17450567 ] Apache Spark commented on SPARK-37489: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37489) Skip hasnans check in numops if eager_check disable

[ https://issues.apache.org/jira/browse/SPARK-37489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37489: Assignee: (was: Apache Spark) > Skip hasnans check in numops if eager_check disable

[jira] [Assigned] (SPARK-37489) Skip hasnans check in numops if eager_check disable

[ https://issues.apache.org/jira/browse/SPARK-37489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37489: Assignee: Apache Spark > Skip hasnans check in numops if eager_check disable >

[jira] [Commented] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450560#comment-17450560 ] Apache Spark commented on SPARK-37391: -- User 'tdg5' has created a pull request for this issue:

[jira] [Commented] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450559#comment-17450559 ] Apache Spark commented on SPARK-37391: -- User 'tdg5' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37391: Assignee: Apache Spark > SIGNIFICANT bottleneck introduced by fix for SPARK-32001 >

[jira] [Assigned] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37391: Assignee: (was: Apache Spark) > SIGNIFICANT bottleneck introduced by fix for

[jira] [Created] (SPARK-37489) Skip hasnans check in numops if eager_check disable

Yikun Jiang created SPARK-37489: --- Summary: Skip hasnans check in numops if eager_check disable Key: SPARK-37489 URL: https://issues.apache.org/jira/browse/SPARK-37489 Project: Spark Issue

[jira] [Commented] (SPARK-37454) support expressions in time travel timestamp

[ https://issues.apache.org/jira/browse/SPARK-37454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450553#comment-17450553 ] Apache Spark commented on SPARK-37454: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-37454) support expressions in time travel timestamp

[ https://issues.apache.org/jira/browse/SPARK-37454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450552#comment-17450552 ] Apache Spark commented on SPARK-37454: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-37259) JDBC read is always going to wrap the query in a select statement

[ https://issues.apache.org/jira/browse/SPARK-37259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450525#comment-17450525 ] Kevin Appel commented on SPARK-37259: - [~petertoth] [~akhalymon] Thank you both for working on these

[jira] [Updated] (SPARK-37484) Replace Get and getOrElse with getOrElse

[ https://issues.apache.org/jira/browse/SPARK-37484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37484: - Priority: Trivial (was: Minor) > Replace Get and getOrElse with getOrElse >

[jira] [Updated] (SPARK-37485) Replace map with expressions which produce no result with foreach

[ https://issues.apache.org/jira/browse/SPARK-37485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37485: - Priority: Trivial (was: Minor) > Replace map with expressions which produce no result with

[jira] [Commented] (SPARK-37488) With enough resources, the task may still be permanently pending

gt; .enableHiveSupport() > .getOrCreate(); > Dataset dataset = testApp.sql("select * from default.test where dt = > '20211129'"); > dataset.persist(StorageLevel.MEMORY_AND_DISK()); > dataset.count(); > {code} > I have observed that tasks are perma

[jira] [Assigned] (SPARK-37488) With enough resources, the task may still be permanently pending

> the code logic can be simplified as follows > SparkSession testApp = SparkSession.builder() > .master("local[*]") > .appName("test app") > .enableHiveSupport() > .getOrCreate(); > Dataset dataset = tes

[jira] [Assigned] (SPARK-37488) With enough resources, the task may still be permanently pending

ion data imported to tidb, > the code logic can be simplified as follows > SparkSession testApp = SparkSession.builder() > .master("local[*]") > .appName("test app") > .enableHiveSupport() > .getOrCreate(); &

[jira] [Created] (SPARK-37488) With enough resources, the task may still be permanently pending

logic can be simplified as follows SparkSession testApp = SparkSession.builder() .master("local[*]") .appName("test app") .enableHiveSupport() .getOrCreate(); Dataset dataset = testApp.sql("select * from default.test where dt = '2021112

[jira] [Updated] (SPARK-37487) CollectMetrics is executed twice if it is followed by a sort

[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-37487: --- Summary: CollectMetrics is executed twice if it is followed by a sort (was: CollectMetrics is

[jira] [Commented] (SPARK-37487) CollectMetrics is executed twice if it is followed by an sort

[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450452#comment-17450452 ] Tanel Kiis commented on SPARK-37487: [~cloud_fan] and [~sarutak], you helped with the last

[jira] [Updated] (SPARK-37487) CollectMetrics is executed twice if it is followed by an sort

[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-37487: --- Description: It is best examplified by this new UT in DataFrameCallbackSuite: {code}

[jira] [Updated] (SPARK-37487) CollectMetrics is executed twice if it is followed by an sort

[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-37487: --- Description: It is best examplified by this new UT in DataFrameCallbackSuite: {code}

[jira] [Updated] (SPARK-37487) CollectMetrics is executed twice if it is followed by an sort

[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-37487: --- Description: It is best examplified by this new UT in DataFrameCallbackSuite: {code}

[jira] [Created] (SPARK-37487) CollectMetrics is executed twice if it is followed by an sort

Tanel Kiis created SPARK-37487: -- Summary: CollectMetrics is executed twice if it is followed by an sort Key: SPARK-37487 URL: https://issues.apache.org/jira/browse/SPARK-37487 Project: Spark

[jira] [Commented] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC time zone

[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450396#comment-17450396 ] Apache Spark commented on SPARK-37463: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC time zone

[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450395#comment-17450395 ] Apache Spark commented on SPARK-37463: -- User 'beliefer' has created a pull request for this issue:

[jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC timestamp

[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37463: --- Summary: Read/Write Timestamp ntz from/to Orc uses UTC timestamp (was: Read/Write Timestamp ntz to

[jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC time zone

[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37463: --- Summary: Read/Write Timestamp ntz from/to Orc uses UTC time zone (was: Read/Write Timestamp ntz

[jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz to Orc uses UTC timestamp

[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37463: --- Summary: Read/Write Timestamp ntz to Orc uses UTC timestamp (was: Read/Write Timestamp ntz or ltz

[jira] [Assigned] (SPARK-37485) Replace map with expressions which produce no result with foreach

[ https://issues.apache.org/jira/browse/SPARK-37485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37485: Assignee: (was: Apache Spark) > Replace map with expressions which produce no result

[jira] [Commented] (SPARK-37485) Replace map with expressions which produce no result with foreach

[ https://issues.apache.org/jira/browse/SPARK-37485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450390#comment-17450390 ] Apache Spark commented on SPARK-37485: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-37485) Replace map with expressions which produce no result with foreach

[ https://issues.apache.org/jira/browse/SPARK-37485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37485: Assignee: Apache Spark > Replace map with expressions which produce no result with

[jira] [Created] (SPARK-37485) Replace map with expressions which produce no result with foreach

Yang Jie created SPARK-37485: Summary: Replace map with expressions which produce no result with foreach Key: SPARK-37485 URL: https://issues.apache.org/jira/browse/SPARK-37485 Project: Spark

[jira] [Assigned] (SPARK-37484) Replace Get and getOrElse with getOrElse

[ https://issues.apache.org/jira/browse/SPARK-37484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37484: Assignee: (was: Apache Spark) > Replace Get and getOrElse with getOrElse >

[jira] [Commented] (SPARK-37484) Replace Get and getOrElse with getOrElse

[ https://issues.apache.org/jira/browse/SPARK-37484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450375#comment-17450375 ] Apache Spark commented on SPARK-37484: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-37484) Replace Get and getOrElse with getOrElse

[ https://issues.apache.org/jira/browse/SPARK-37484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37484: Assignee: Apache Spark > Replace Get and getOrElse with getOrElse >

[jira] [Created] (SPARK-37484) Replace Get and getOrElse with getOrElse

Yang Jie created SPARK-37484: Summary: Replace Get and getOrElse with getOrElse Key: SPARK-37484 URL: https://issues.apache.org/jira/browse/SPARK-37484 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-37483) Support pushdown down top N to JDBC data source V2

[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450316#comment-17450316 ] Apache Spark commented on SPARK-37483: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-37482) Skip check monotonic increasing for Series.asof with 'compute.eager_check'

[ https://issues.apache.org/jira/browse/SPARK-37482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450315#comment-17450315 ] Apache Spark commented on SPARK-37482: -- User 'dchvn' has created a pull request for this issue:

  1   2   >