[jira] [Commented] (SPARK-38552) Implement `keep` parameter of `frame.nlargest/nsmallest` to decide how to resolve ties

[ https://issues.apache.org/jira/browse/SPARK-38552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506710#comment-17506710 ] Apache Spark commented on SPARK-38552: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-38552) Implement `keep` parameter of `frame.nlargest/nsmallest` to decide how to resolve ties

[ https://issues.apache.org/jira/browse/SPARK-38552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38552: Assignee: (was: Apache Spark) > Implement `keep` parameter of

[jira] [Commented] (SPARK-38552) Implement `keep` parameter of `frame.nlargest/nsmallest` to decide how to resolve ties

[ https://issues.apache.org/jira/browse/SPARK-38552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506709#comment-17506709 ] Apache Spark commented on SPARK-38552: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-38552) Implement `keep` parameter of `frame.nlargest/nsmallest` to decide how to resolve ties

[ https://issues.apache.org/jira/browse/SPARK-38552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38552: Assignee: Apache Spark > Implement `keep` parameter of `frame.nlargest/nsmallest` to

[jira] [Commented] (SPARK-38448) Sending Available Resources in Yarn Cluster Information to Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-38448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506706#comment-17506706 ] Apache Spark commented on SPARK-38448: -- User 'abhishekd0907' has created a pull request for this

[jira] [Created] (SPARK-38552) Implement `keep` parameter of `frame.nlargest/nsmallest` to decide how to resolve ties

Xinrong Meng created SPARK-38552: Summary: Implement `keep` parameter of `frame.nlargest/nsmallest` to decide how to resolve ties Key: SPARK-38552 URL: https://issues.apache.org/jira/browse/SPARK-38552

[jira] [Assigned] (SPARK-38448) Sending Available Resources in Yarn Cluster Information to Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-38448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38448: Assignee: Apache Spark > Sending Available Resources in Yarn Cluster Information to

[jira] [Assigned] (SPARK-38448) Sending Available Resources in Yarn Cluster Information to Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-38448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38448: Assignee: (was: Apache Spark) > Sending Available Resources in Yarn Cluster

[jira] [Commented] (SPARK-38448) Sending Available Resources in Yarn Cluster Information to Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-38448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506705#comment-17506705 ] Apache Spark commented on SPARK-38448: -- User 'abhishekd0907' has created a pull request for this

[jira] [Commented] (SPARK-38513) Move custom scheduler-specific configs to under `spark.kubernetes.scheduler.NAME` prefix

[ https://issues.apache.org/jira/browse/SPARK-38513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506702#comment-17506702 ] Apache Spark commented on SPARK-38513: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-38513) Move custom scheduler-specific configs to under `spark.kubernetes.scheduler.NAME` prefix

[ https://issues.apache.org/jira/browse/SPARK-38513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506701#comment-17506701 ] Apache Spark commented on SPARK-38513: -- User 'Yikun' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-38551) Cleanup executor podgroup yaml

[ https://issues.apache.org/jira/browse/SPARK-38551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506700#comment-17506700 ] Yikun Jiang edited comment on SPARK-38551 at 3/15/22, 4:47 AM: --- to be a

[jira] [Commented] (SPARK-38551) Cleanup executor podgroup yaml

[ https://issues.apache.org/jira/browse/SPARK-38551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506700#comment-17506700 ] Yikun Jiang commented on SPARK-38551: - to be a followup on [SPARK-38513][K8S][TESTS][FOLLWUP] >

[jira] [Resolved] (SPARK-38551) Cleanup executor podgroup yaml

[ https://issues.apache.org/jira/browse/SPARK-38551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-38551. - Resolution: Invalid > Cleanup executor podgroup yaml > -- > >

[jira] [Commented] (SPARK-38551) Cleanup executor podgroup yaml

[ https://issues.apache.org/jira/browse/SPARK-38551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506699#comment-17506699 ] Apache Spark commented on SPARK-38551: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38551) Cleanup executor podgroup yaml

[ https://issues.apache.org/jira/browse/SPARK-38551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38551: Assignee: Apache Spark > Cleanup executor podgroup yaml > --

[jira] [Assigned] (SPARK-38551) Cleanup executor podgroup yaml

[ https://issues.apache.org/jira/browse/SPARK-38551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38551: Assignee: (was: Apache Spark) > Cleanup executor podgroup yaml >

[jira] [Commented] (SPARK-38536) Spark 3 can not read mixed format partitions

[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506698#comment-17506698 ] Huicheng Song commented on SPARK-38536: --- The issue is in Spark3, when reading an ORC partition

[jira] [Created] (SPARK-38551) Cleanup executor podgroup yaml

Yikun Jiang created SPARK-38551: --- Summary: Cleanup executor podgroup yaml Key: SPARK-38551 URL: https://issues.apache.org/jira/browse/SPARK-38551 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-38503) Add warn for getAdditionalPreKubernetesResources in executor side

[ https://issues.apache.org/jira/browse/SPARK-38503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38503: Summary: Add warn for getAdditionalPreKubernetesResources in executor side (was: Add driver

[jira] [Resolved] (SPARK-38549) SessionWindowStateStoreRestoreExec should provide numRowsDroppedByWatermark metric

[ https://issues.apache.org/jira/browse/SPARK-38549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-38549. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35854

[jira] [Assigned] (SPARK-38549) SessionWindowStateStoreRestoreExec should provide numRowsDroppedByWatermark metric

[ https://issues.apache.org/jira/browse/SPARK-38549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-38549: --- Assignee: L. C. Hsieh > SessionWindowStateStoreRestoreExec should provide

[jira] [Commented] (SPARK-38536) Spark 3 can not read mixed format partitions

[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506678#comment-17506678 ] Deegue commented on SPARK-38536: Thanks [~hyukjin.kwon], [~songhuicheng] I don't think this pr would

[jira] [Updated] (SPARK-32079) PySpark <> Beam pickling issues for collections.namedtuple

[ https://issues.apache.org/jira/browse/SPARK-32079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32079: - Labels: release-notes (was: ) > PySpark <> Beam pickling issues for collections.namedtuple >

[jira] [Updated] (SPARK-36953) Expose SQL state and error class in PySpark exceptions

[ https://issues.apache.org/jira/browse/SPARK-36953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36953: - Labels: release-notes (was: ) > Expose SQL state and error class in PySpark exceptions >

[jira] [Updated] (SPARK-37516) Uses Python's standard string formatter for SQL API in PySpark

[ https://issues.apache.org/jira/browse/SPARK-37516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37516: - Labels: release-notes (was: ) > Uses Python's standard string formatter for SQL API in PySpark

[jira] [Updated] (SPARK-36707) Support to specify index type and name in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-36707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36707: - Labels: release-notes (was: ) > Support to specify index type and name in pandas API on Spark

[jira] [Updated] (SPARK-37649) Switch default index to distributed-sequence by default in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37649: - Labels: release-notes (was: ) > Switch default index to distributed-sequence by default in

[jira] [Updated] (SPARK-37228) Implement DataFrame.mapInArrow in Python

[ https://issues.apache.org/jira/browse/SPARK-37228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37228: - Labels: release-notes (was: ) > Implement DataFrame.mapInArrow in Python >

[jira] [Updated] (SPARK-37275) Support ANSI intervals in PySpark

[ https://issues.apache.org/jira/browse/SPARK-37275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37275: - Labels: release-notes (was: ) > Support ANSI intervals in PySpark >

[jira] [Updated] (SPARK-37525) Support TimedeltaIndex in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37525: - Labels: release-notes (was: ) > Support TimedeltaIndex in pandas API on Spark >

[jira] [Updated] (SPARK-37443) Provide a profiler for Python/Pandas UDFs

[ https://issues.apache.org/jira/browse/SPARK-37443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37443: - Labels: release-notes (was: ) > Provide a profiler for Python/Pandas UDFs >

[jira] [Commented] (SPARK-38550) Use a disk-based store to save more information in live UI to help debug

[ https://issues.apache.org/jira/browse/SPARK-38550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506677#comment-17506677 ] Apache Spark commented on SPARK-38550: -- User 'linhongliu-db' has created a pull request for this

[jira] [Assigned] (SPARK-38550) Use a disk-based store to save more information in live UI to help debug

[ https://issues.apache.org/jira/browse/SPARK-38550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38550: Assignee: (was: Apache Spark) > Use a disk-based store to save more information in

[jira] [Assigned] (SPARK-38550) Use a disk-based store to save more information in live UI to help debug

[ https://issues.apache.org/jira/browse/SPARK-38550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38550: Assignee: Apache Spark > Use a disk-based store to save more information in live UI to

[jira] [Commented] (SPARK-38550) Use a disk-based store to save more information in live UI to help debug

[ https://issues.apache.org/jira/browse/SPARK-38550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506674#comment-17506674 ] Apache Spark commented on SPARK-38550: -- User 'linhongliu-db' has created a pull request for this

[jira] [Commented] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting

[ https://issues.apache.org/jira/browse/SPARK-37481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506673#comment-17506673 ] wuyi commented on SPARK-37481: -- Backport fix to 3.1/3.0 also done.   > Disappearance of skipped stages

[jira] [Created] (SPARK-38550) Use a disk-based store to save more information in live UI to help debug

Linhong Liu created SPARK-38550: --- Summary: Use a disk-based store to save more information in live UI to help debug Key: SPARK-38550 URL: https://issues.apache.org/jira/browse/SPARK-38550 Project:

[jira] [Assigned] (SPARK-38521) Throw Exception if overwriting hive partition table with dynamic and staticPartitionOverwriteMode

[ https://issues.apache.org/jira/browse/SPARK-38521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38521: - Assignee: Jackey Lee > Throw Exception if overwriting hive partition table with

[jira] [Resolved] (SPARK-38521) Throw Exception if overwriting hive partition table with dynamic and staticPartitionOverwriteMode

[ https://issues.apache.org/jira/browse/SPARK-38521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38521. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35843

[jira] [Updated] (SPARK-38432) Refactor framework so as JDBC dialect could compile filter by self way

[ https://issues.apache.org/jira/browse/SPARK-38432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38432: --- Summary: Refactor framework so as JDBC dialect could compile filter by self way (was: Reactor

[jira] [Updated] (SPARK-37224) Optimize write path on RocksDB state store provider

[ https://issues.apache.org/jira/browse/SPARK-37224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-37224: - Labels: releasenotes (was: ) > Optimize write path on RocksDB state store provider >

[jira] [Commented] (SPARK-38336) Catalyst changes for DEFAULT column support

[ https://issues.apache.org/jira/browse/SPARK-38336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506638#comment-17506638 ] Apache Spark commented on SPARK-38336: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38336) Catalyst changes for DEFAULT column support

[ https://issues.apache.org/jira/browse/SPARK-38336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38336: Assignee: Apache Spark > Catalyst changes for DEFAULT column support >

[jira] [Assigned] (SPARK-38336) Catalyst changes for DEFAULT column support

[ https://issues.apache.org/jira/browse/SPARK-38336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38336: Assignee: (was: Apache Spark) > Catalyst changes for DEFAULT column support >

[jira] [Updated] (SPARK-36533) Allow streaming queries with Trigger.Once run in multiple batches

[ https://issues.apache.org/jira/browse/SPARK-36533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-36533: - Labels: releasenotes (was: release-notes) > Allow streaming queries with Trigger.Once run in

[jira] [Commented] (SPARK-38549) SessionWindowStateStoreRestoreExec should provide numRowsDroppedByWatermark metric

[ https://issues.apache.org/jira/browse/SPARK-38549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506632#comment-17506632 ] Apache Spark commented on SPARK-38549: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38549) SessionWindowStateStoreRestoreExec should provide numRowsDroppedByWatermark metric

[ https://issues.apache.org/jira/browse/SPARK-38549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38549: Assignee: (was: Apache Spark) > SessionWindowStateStoreRestoreExec should provide

[jira] [Commented] (SPARK-38549) SessionWindowStateStoreRestoreExec should provide numRowsDroppedByWatermark metric

[ https://issues.apache.org/jira/browse/SPARK-38549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506631#comment-17506631 ] Apache Spark commented on SPARK-38549: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-36533) Allow streaming queries with Trigger.Once run in multiple batches

[ https://issues.apache.org/jira/browse/SPARK-36533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-36533: - Labels: release-notes (was: ) > Allow streaming queries with Trigger.Once run in multiple

[jira] [Assigned] (SPARK-38549) SessionWindowStateStoreRestoreExec should provide numRowsDroppedByWatermark metric

[ https://issues.apache.org/jira/browse/SPARK-38549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38549: Assignee: Apache Spark > SessionWindowStateStoreRestoreExec should provide

[jira] [Assigned] (SPARK-36649) Support Trigger.AvailableNow on Kafka data source

[ https://issues.apache.org/jira/browse/SPARK-36649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-36649: Assignee: Boyang Jerry Peng > Support Trigger.AvailableNow on Kafka data source >

[jira] [Created] (SPARK-38549) SessionWindowStateStoreRestoreExec should provide numRowsDroppedByWatermark metric

L. C. Hsieh created SPARK-38549: --- Summary: SessionWindowStateStoreRestoreExec should provide numRowsDroppedByWatermark metric Key: SPARK-38549 URL: https://issues.apache.org/jira/browse/SPARK-38549

[jira] [Commented] (SPARK-27998) Column alias should support double quote string

[ https://issues.apache.org/jira/browse/SPARK-27998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506597#comment-17506597 ] Apache Spark commented on SPARK-27998: -- User 'andygrove' has created a pull request for this issue:

[jira] [Updated] (SPARK-38544) Upgrade log4j2 to 2.17.2

[ https://issues.apache.org/jira/browse/SPARK-38544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38544: -- Parent: SPARK-37814 Issue Type: Sub-task (was: Improvement) > Upgrade log4j2 to

[jira] [Assigned] (SPARK-38544) Upgrade log4j2 to 2.17.2

[ https://issues.apache.org/jira/browse/SPARK-38544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38544: - Assignee: Yang Jie > Upgrade log4j2 to 2.17.2 > > >

[jira] [Resolved] (SPARK-38544) Upgrade log4j2 to 2.17.2

[ https://issues.apache.org/jira/browse/SPARK-38544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38544. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35839

[jira] [Commented] (SPARK-37995) TPCDS 1TB q72 fails when spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly is false

[ https://issues.apache.org/jira/browse/SPARK-37995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506494#comment-17506494 ] Dongjoon Hyun commented on SPARK-37995: --- I converted this issue into a subtask of SPARK-37063

[jira] [Updated] (SPARK-37995) TPCDS 1TB q72 fails when spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly is false

[ https://issues.apache.org/jira/browse/SPARK-37995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37995: -- Parent: SPARK-37063 Issue Type: Sub-task (was: Bug) > TPCDS 1TB q72 fails when >

[jira] [Commented] (SPARK-38510) Failure fetching JSON representation of Spark plans with Hive UDFs

[ https://issues.apache.org/jira/browse/SPARK-38510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506416#comment-17506416 ] Apache Spark commented on SPARK-38510: -- User 'shardulm94' has created a pull request for this

[jira] [Assigned] (SPARK-38510) Failure fetching JSON representation of Spark plans with Hive UDFs

[ https://issues.apache.org/jira/browse/SPARK-38510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38510: Assignee: (was: Apache Spark) > Failure fetching JSON representation of Spark plans

[jira] [Assigned] (SPARK-38510) Failure fetching JSON representation of Spark plans with Hive UDFs

[ https://issues.apache.org/jira/browse/SPARK-38510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38510: Assignee: Apache Spark > Failure fetching JSON representation of Spark plans with Hive

[jira] [Commented] (SPARK-38510) Failure fetching JSON representation of Spark plans with Hive UDFs

[ https://issues.apache.org/jira/browse/SPARK-38510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506413#comment-17506413 ] Apache Spark commented on SPARK-38510: -- User 'shardulm94' has created a pull request for this

[jira] [Resolved] (SPARK-37491) Fix Series.asof when values of the series is not sorted

[ https://issues.apache.org/jira/browse/SPARK-37491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-37491. --- Assignee: pralabhkumar Resolution: Fixed Issue resolved by pull request 35191

[jira] [Commented] (SPARK-38528) NullPointerException when selecting a generator in a Stream of aggregate expressions

[ https://issues.apache.org/jira/browse/SPARK-38528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506356#comment-17506356 ] Apache Spark commented on SPARK-38528: -- User 'bersprockets' has created a pull request for this

[jira] [Commented] (SPARK-38529) GeneratorNestedColumnAliasing works incorrectly for non-Explode generators

[ https://issues.apache.org/jira/browse/SPARK-38529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506353#comment-17506353 ] Apache Spark commented on SPARK-38529: -- User 'minyyy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38529) GeneratorNestedColumnAliasing works incorrectly for non-Explode generators

[ https://issues.apache.org/jira/browse/SPARK-38529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38529: Assignee: (was: Apache Spark) > GeneratorNestedColumnAliasing works incorrectly for

[jira] [Assigned] (SPARK-38529) GeneratorNestedColumnAliasing works incorrectly for non-Explode generators

[ https://issues.apache.org/jira/browse/SPARK-38529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38529: Assignee: Apache Spark > GeneratorNestedColumnAliasing works incorrectly for non-Explode

[jira] [Updated] (SPARK-38538) Fix driver environment verification in BasicDriverFeatureStepSuite

[ https://issues.apache.org/jira/browse/SPARK-38538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38538: -- Parent: SPARK-38396 Issue Type: Sub-task (was: Bug) > Fix driver environment

[jira] [Updated] (SPARK-38537) Unify Statefulset* to StatefulSet*

[ https://issues.apache.org/jira/browse/SPARK-38537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38537: -- Parent: SPARK-36057 Issue Type: Sub-task (was: Improvement) > Unify Statefulset* to

[jira] [Commented] (SPARK-38529) GeneratorNestedColumnAliasing works incorrectly for non-Explode generators

[ https://issues.apache.org/jira/browse/SPARK-38529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506306#comment-17506306 ] Min Yang commented on SPARK-38529: -- This is only reproducible in a test since

[jira] [Commented] (SPARK-38530) GeneratorNestedColumnAliasing does not work correctly for some expressions

[ https://issues.apache.org/jira/browse/SPARK-38530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506304#comment-17506304 ] Min Yang commented on SPARK-38530: -- I have a fix for it, will put the test in the PR. >

[jira] [Commented] (SPARK-38531) "Prune unrequired child index" branch of ColumnPruning has wrong condition

[ https://issues.apache.org/jira/browse/SPARK-38531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506303#comment-17506303 ] Min Yang commented on SPARK-38531: -- Yea, I have a fix for it. > "Prune unrequired child index" branch

[jira] [Assigned] (SPARK-37995) TPCDS 1TB q72 fails when spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly is false

[ https://issues.apache.org/jira/browse/SPARK-37995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37995: Assignee: Apache Spark > TPCDS 1TB q72 fails when >

[jira] [Commented] (SPARK-37995) TPCDS 1TB q72 fails when spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly is false

[ https://issues.apache.org/jira/browse/SPARK-37995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506286#comment-17506286 ] Apache Spark commented on SPARK-37995: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-37995) TPCDS 1TB q72 fails when spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly is false

[ https://issues.apache.org/jira/browse/SPARK-37995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506287#comment-17506287 ] Apache Spark commented on SPARK-37995: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-37995) TPCDS 1TB q72 fails when spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly is false

[ https://issues.apache.org/jira/browse/SPARK-37995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37995: Assignee: (was: Apache Spark) > TPCDS 1TB q72 fails when >

[jira] [Commented] (SPARK-38548) New SQL function: try_sum

[ https://issues.apache.org/jira/browse/SPARK-38548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506273#comment-17506273 ] Apache Spark commented on SPARK-38548: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-38548) New SQL function: try_sum

[ https://issues.apache.org/jira/browse/SPARK-38548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38548: Assignee: Apache Spark (was: Gengliang Wang) > New SQL function: try_sum >

[jira] [Assigned] (SPARK-38548) New SQL function: try_sum

[ https://issues.apache.org/jira/browse/SPARK-38548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38548: Assignee: Gengliang Wang (was: Apache Spark) > New SQL function: try_sum >

[jira] [Commented] (SPARK-38548) New SQL function: try_sum

[ https://issues.apache.org/jira/browse/SPARK-38548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506272#comment-17506272 ] Apache Spark commented on SPARK-38548: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-38548) New SQL function: try_sum

Gengliang Wang created SPARK-38548: -- Summary: New SQL function: try_sum Key: SPARK-38548 URL: https://issues.apache.org/jira/browse/SPARK-38548 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-37997) Allow query parameters to be passed into spark.read

[ https://issues.apache.org/jira/browse/SPARK-37997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506251#comment-17506251 ] Imram commented on SPARK-37997: --- Spark, when will this bug be fixed? > Allow query parameters to be

[jira] [Updated] (SPARK-36194) Add a logical plan visitor to propagate the distinct attributes

[ https://issues.apache.org/jira/browse/SPARK-36194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-36194: Summary: Add a logical plan visitor to propagate the distinct attributes (was: Remove the

[jira] [Resolved] (SPARK-36194) Remove the aggregation from left semi/anti join if the same aggregation has already been done on left side

[ https://issues.apache.org/jira/browse/SPARK-36194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-36194. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35779

[jira] [Assigned] (SPARK-36194) Remove the aggregation from left semi/anti join if the same aggregation has already been done on left side

[ https://issues.apache.org/jira/browse/SPARK-36194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-36194: --- Assignee: Yuming Wang > Remove the aggregation from left semi/anti join if the same

[jira] [Commented] (SPARK-28254) Use More Generic Netty Interfaces to Support Fabric Network in Spark

[ https://issues.apache.org/jira/browse/SPARK-28254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506220#comment-17506220 ] Yang Jie commented on SPARK-28254: -- Because it is hard to solve this issue all in one , I file a new

[jira] [Updated] (SPARK-38547) Use more generic Channel type to initialize Netty BootStrap

[ https://issues.apache.org/jira/browse/SPARK-38547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38547: - Description: Spark use {{SocketChannel}} type to initialize {{BootStrap}} now, but there is no need to

[jira] [Updated] (SPARK-38547) Use more generic Channel type to initialize Netty BootStrap

[ https://issues.apache.org/jira/browse/SPARK-38547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38547: - Summary: Use more generic Channel type to initialize Netty BootStrap (was: Change Generic Type use to

[jira] [Commented] (SPARK-38547) Change Generic Type use to define `Bootstrap.childHandler` from `SocketChannel` to `Channel`

[ https://issues.apache.org/jira/browse/SPARK-38547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506206#comment-17506206 ] Apache Spark commented on SPARK-38547: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38547) Change Generic Type use to define `Bootstrap.childHandler` from `SocketChannel` to `Channel`

[ https://issues.apache.org/jira/browse/SPARK-38547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38547: Assignee: Apache Spark > Change Generic Type use to define `Bootstrap.childHandler` from

[jira] [Assigned] (SPARK-38547) Change Generic Type use to define `Bootstrap.childHandler` from `SocketChannel` to `Channel`

[ https://issues.apache.org/jira/browse/SPARK-38547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38547: Assignee: (was: Apache Spark) > Change Generic Type use to define

[jira] [Commented] (SPARK-38547) Change Generic Type use to define `Bootstrap.childHandler` from `SocketChannel` to `Channel`

[ https://issues.apache.org/jira/browse/SPARK-38547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506205#comment-17506205 ] Apache Spark commented on SPARK-38547: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-38547) Change Generic Type use to define `Bootstrap.childHandler` from `SocketChannel` to `Channel`

Yang Jie created SPARK-38547: Summary: Change Generic Type use to define `Bootstrap.childHandler` from `SocketChannel` to `Channel` Key: SPARK-38547 URL: https://issues.apache.org/jira/browse/SPARK-38547

[jira] [Assigned] (SPARK-38546) replace deprecated ChiSqSelector with UnivariateFeatureSelector

[ https://issues.apache.org/jira/browse/SPARK-38546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38546: Assignee: Apache Spark > replace deprecated ChiSqSelector with UnivariateFeatureSelector

[jira] [Assigned] (SPARK-38546) replace deprecated ChiSqSelector with UnivariateFeatureSelector

[ https://issues.apache.org/jira/browse/SPARK-38546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38546: Assignee: (was: Apache Spark) > replace deprecated ChiSqSelector with

[jira] [Commented] (SPARK-38546) replace deprecated ChiSqSelector with UnivariateFeatureSelector

[ https://issues.apache.org/jira/browse/SPARK-38546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506195#comment-17506195 ] Apache Spark commented on SPARK-38546: -- User 'dcoliversun' has created a pull request for this

[jira] [Created] (SPARK-38546) replace deprecated ChiSqSelector with UnivariateFeatureSelector

qian created SPARK-38546: Summary: replace deprecated ChiSqSelector with UnivariateFeatureSelector Key: SPARK-38546 URL: https://issues.apache.org/jira/browse/SPARK-38546 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38391) Datasource v2 supports partial topN push-down

[ https://issues.apache.org/jira/browse/SPARK-38391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38391: --- Summary: Datasource v2 supports partial topN push-down (was: Datasource v2 supports complete

[jira] [Assigned] (SPARK-38400) Enable Series.rename to change index labels

[ https://issues.apache.org/jira/browse/SPARK-38400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38400: Assignee: Xinrong Meng > Enable Series.rename to change index labels >

  1   2   >