[jira] [Assigned] (SPARK-44843) flaky test: RocksDBStateStoreStreamingAggregationSuite

[ https://issues.apache.org/jira/browse/SPARK-44843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-44843: Assignee: Kent Yao (was: Yang Jie) > flaky test: RocksDBStateStoreStreamingAggregationSuite >

[jira] [Resolved] (SPARK-45785) Support `spark.deploy.appNumberModulo` to rotate app number

[ https://issues.apache.org/jira/browse/SPARK-45785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45785. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43654

[jira] [Assigned] (SPARK-45785) Support `spark.deploy.appNumberModulo` to rotate app number

[ https://issues.apache.org/jira/browse/SPARK-45785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45785: - Assignee: Dongjoon Hyun > Support `spark.deploy.appNumberModulo` to rotate app number

[jira] [Created] (SPARK-45789) Support DESCRIBE TABLE for clustering columns

Terry Kim created SPARK-45789: - Summary: Support DESCRIBE TABLE for clustering columns Key: SPARK-45789 URL: https://issues.apache.org/jira/browse/SPARK-45789 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-45788) Support SHOW CREATE TABLE for clustering columns

Terry Kim created SPARK-45788: - Summary: Support SHOW CREATE TABLE for clustering columns Key: SPARK-45788 URL: https://issues.apache.org/jira/browse/SPARK-45788 Project: Spark Issue Type:

[jira] [Created] (SPARK-45787) Support Catalog.listColumns() for clustering columns

Terry Kim created SPARK-45787: - Summary: Support Catalog.listColumns() for clustering columns Key: SPARK-45787 URL: https://issues.apache.org/jira/browse/SPARK-45787 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45786) Inaccurate Decimal multiplication and division results

[ https://issues.apache.org/jira/browse/SPARK-45786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuyuki Tanimura updated SPARK-45786: -- Affects Version/s: 4.0.0 > Inaccurate Decimal multiplication and division results >

[jira] [Assigned] (SPARK-45780) Propagate all Spark Connect client threadlocal in InheritableThread

[ https://issues.apache.org/jira/browse/SPARK-45780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45780: Assignee: Juliusz Sompolski > Propagate all Spark Connect client threadlocal in

[jira] [Resolved] (SPARK-45780) Propagate all Spark Connect client threadlocal in InheritableThread

[ https://issues.apache.org/jira/browse/SPARK-45780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45780. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43649

[jira] [Created] (SPARK-45786) Inaccurate Decimal multiplication and division results

Kazuyuki Tanimura created SPARK-45786: - Summary: Inaccurate Decimal multiplication and division results Key: SPARK-45786 URL: https://issues.apache.org/jira/browse/SPARK-45786 Project: Spark

[jira] [Updated] (SPARK-44317) Define the computing logic through PartitionEvaluator API and use it in ShuffledHashJoinExec

[ https://issues.apache.org/jira/browse/SPARK-44317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44317: --- Labels: pull-request-available (was: ) > Define the computing logic through

[jira] [Updated] (SPARK-44483) When using Spark to read the hive table, the number of file partitions cannot be set using Spark's configuration settings

[ https://issues.apache.org/jira/browse/SPARK-44483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44483: --- Labels: pull-request-available (was: ) > When using Spark to read the hive table, the

[jira] [Updated] (SPARK-45785) Support `spark.deploy.appNumberModulo` to rotate app number

[ https://issues.apache.org/jira/browse/SPARK-45785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45785: --- Labels: pull-request-available (was: ) > Support `spark.deploy.appNumberModulo` to rotate

[jira] [Created] (SPARK-45785) Support `spark.deploy.appNumberModulo` to rotate app number

Dongjoon Hyun created SPARK-45785: - Summary: Support `spark.deploy.appNumberModulo` to rotate app number Key: SPARK-45785 URL: https://issues.apache.org/jira/browse/SPARK-45785 Project: Spark

[jira] [Updated] (SPARK-44886) Introduce CLUSTER BY SQL clause to CREATE/REPLACE table

[ https://issues.apache.org/jira/browse/SPARK-44886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-44886: -- Summary: Introduce CLUSTER BY SQL clause to CREATE/REPLACE table (was: Introduce CLUSTER BY clause

[jira] [Updated] (SPARK-45784) Introduce clustering mechanism to Spark

[ https://issues.apache.org/jira/browse/SPARK-45784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-45784: -- Description: This proposes to introduce a clustering mechanism such that different data sources

[jira] [Updated] (SPARK-44886) Introduce CLUSTER BY SQL clause to CREATE/REPLACE TABLE

[ https://issues.apache.org/jira/browse/SPARK-44886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-44886: -- Summary: Introduce CLUSTER BY SQL clause to CREATE/REPLACE TABLE (was: Introduce CLUSTER BY SQL

[jira] [Updated] (SPARK-44886) Introduce CLUSTER BY clause to CREATE/REPLACE table

[ https://issues.apache.org/jira/browse/SPARK-44886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-44886: -- Parent: SPARK-45784 Issue Type: Sub-task (was: New Feature) > Introduce CLUSTER BY clause to

[jira] [Created] (SPARK-45784) Introduce clustering mechanism to Spark

Terry Kim created SPARK-45784: - Summary: Introduce clustering mechanism to Spark Key: SPARK-45784 URL: https://issues.apache.org/jira/browse/SPARK-45784 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-45783) Improve exception message when no remote url is set

[ https://issues.apache.org/jira/browse/SPARK-45783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45783: --- Labels: pull-request-available (was: ) > Improve exception message when no remote url is

[jira] [Created] (SPARK-45783) Improve exception message when no remote url is set

Allison Wang created SPARK-45783: Summary: Improve exception message when no remote url is set Key: SPARK-45783 URL: https://issues.apache.org/jira/browse/SPARK-45783 Project: Spark Issue

[jira] [Updated] (SPARK-45782) Add Dataframe API df.explainString()

[ https://issues.apache.org/jira/browse/SPARK-45782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45782: --- Labels: pull-request-available (was: ) > Add Dataframe API df.explainString() >

[jira] [Created] (SPARK-45782) Add Dataframe API df.explainString()

Khalid Mammadov created SPARK-45782: --- Summary: Add Dataframe API df.explainString() Key: SPARK-45782 URL: https://issues.apache.org/jira/browse/SPARK-45782 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-44843) flaky test: RocksDBStateStoreStreamingAggregationSuite

[ https://issues.apache.org/jira/browse/SPARK-44843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-44843. -- Fix Version/s: 3.3.4 3.5.1 4.0.0 3.4.2

[jira] [Assigned] (SPARK-44843) flaky test: RocksDBStateStoreStreamingAggregationSuite

[ https://issues.apache.org/jira/browse/SPARK-44843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-44843: Assignee: Yang Jie > flaky test: RocksDBStateStoreStreamingAggregationSuite >

[jira] [Resolved] (SPARK-45779) Add a check step for jira issue ticket to be resolved

[ https://issues.apache.org/jira/browse/SPARK-45779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45779. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43648

[jira] [Assigned] (SPARK-45779) Add a check step for jira issue ticket to be resolved

[ https://issues.apache.org/jira/browse/SPARK-45779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-45779: Assignee: Kent Yao > Add a check step for jira issue ticket to be resolved >

[jira] [Updated] (SPARK-45781) Upgrade Arrow to 14.0.0

[ https://issues.apache.org/jira/browse/SPARK-45781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45781: --- Labels: pull-request-available (was: ) > Upgrade Arrow to 14.0.0 > ---

[jira] [Created] (SPARK-45781) Upgrade Arrow to 14.0.0

Yang Jie created SPARK-45781: Summary: Upgrade Arrow to 14.0.0 Key: SPARK-45781 URL: https://issues.apache.org/jira/browse/SPARK-45781 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-45688) Clean up the deprecated API usage related to `MapOps`

[ https://issues.apache.org/jira/browse/SPARK-45688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45688. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43578

[jira] [Resolved] (SPARK-45774) Support `spark.master.ui.historyServerUrl` in `ApplicationPage`

[ https://issues.apache.org/jira/browse/SPARK-45774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45774. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43643

[jira] [Updated] (SPARK-45780) Propagate all Spark Connect client threadlocal in InheritableThread

[ https://issues.apache.org/jira/browse/SPARK-45780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45780: --- Labels: pull-request-available (was: ) > Propagate all Spark Connect client threadlocal in

[jira] [Created] (SPARK-45780) Propagate all Spark Connect client threadlocal in InheritableThread

Juliusz Sompolski created SPARK-45780: - Summary: Propagate all Spark Connect client threadlocal in InheritableThread Key: SPARK-45780 URL: https://issues.apache.org/jira/browse/SPARK-45780

[jira] [Updated] (SPARK-45738) client will wait forever if session in spark connect server is evicted

[ https://issues.apache.org/jira/browse/SPARK-45738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xie shuiahu updated SPARK-45738: Labels: pull-request-available query-lifecycle (was: pull-request-available) > client will wait

[jira] [Updated] (SPARK-45779) Add a check step for jira issue ticket to be resolved

[ https://issues.apache.org/jira/browse/SPARK-45779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45779: --- Labels: pull-request-available (was: ) > Add a check step for jira issue ticket to be

[jira] [Created] (SPARK-45779) Add a check step for jira issue ticket to be resolved

Kent Yao created SPARK-45779: Summary: Add a check step for jira issue ticket to be resolved Key: SPARK-45779 URL: https://issues.apache.org/jira/browse/SPARK-45779 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-45776) Remove the defensive null check added in SPARK-39553.

[ https://issues.apache.org/jira/browse/SPARK-45776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45776. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43644

[jira] [Assigned] (SPARK-45776) Remove the defensive null check added in SPARK-39553.

[ https://issues.apache.org/jira/browse/SPARK-45776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-45776: Assignee: Yang Jie > Remove the defensive null check added in SPARK-39553. >

[jira] [Assigned] (SPARK-44843) flaky test: RocksDBStateStoreStreamingAggregationSuite

[ https://issues.apache.org/jira/browse/SPARK-44843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-44843: -- Assignee: (was: Apache Spark) > flaky test:

[jira] [Assigned] (SPARK-44843) flaky test: RocksDBStateStoreStreamingAggregationSuite

[ https://issues.apache.org/jira/browse/SPARK-44843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-44843: -- Assignee: Apache Spark > flaky test: RocksDBStateStoreStreamingAggregationSuite >

[jira] [Updated] (SPARK-44843) flaky test: RocksDBStateStoreStreamingAggregationSuite

[ https://issues.apache.org/jira/browse/SPARK-44843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44843: --- Labels: pull-request-available (was: ) > flaky test:

[jira] [Updated] (SPARK-45778) Get SHS URL from Spark applications

[ https://issues.apache.org/jira/browse/SPARK-45778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45778: -- Description: This is created based on the following review comments

[jira] [Created] (SPARK-45778) Get SHS URL from Spark applications

Dongjoon Hyun created SPARK-45778: - Summary: Get SHS URL from Spark applications Key: SPARK-45778 URL: https://issues.apache.org/jira/browse/SPARK-45778 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45774) Support `spark.master.ui.historyServerUrl` in `ApplicationPage`

[ https://issues.apache.org/jira/browse/SPARK-45774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45774: -- Summary: Support `spark.master.ui.historyServerUrl` in `ApplicationPage` (was: Support

[jira] [Updated] (SPARK-45777) Support `spark.test.appId` in `LocalSchedulerBackend`

[ https://issues.apache.org/jira/browse/SPARK-45777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45777: -- Parent: SPARK-45756 Issue Type: Sub-task (was: Improvement) > Support

[jira] [Assigned] (SPARK-45777) Support `spark.test.appId` in `LocalSchedulerBackend`

[ https://issues.apache.org/jira/browse/SPARK-45777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45777: - Assignee: Dongjoon Hyun > Support `spark.test.appId` in `LocalSchedulerBackend` >

[jira] [Resolved] (SPARK-45777) Support `spark.test.appId` in `LocalSchedulerBackend`

[ https://issues.apache.org/jira/browse/SPARK-45777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45777. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43645