[jira] [Commented] (SPARK-44173) Make Spark an sbt build only project

[ https://issues.apache.org/jira/browse/SPARK-44173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822747#comment-17822747 ] Yang Jie commented on SPARK-44173: -- Hi, [~dongjoon] ~ Sorry, I missed the previous message. This Jira

[jira] [Updated] (SPARK-47148) Avoid to materialize AQE ExchangeQueryStageExec on the cancellation

[ https://issues.apache.org/jira/browse/SPARK-47148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-47148: --- Description: AQE can materialize both *ShuffleQueryStage* and *BroadcastQueryStage*

[jira] [Commented] (SPARK-24815) Structured Streaming should support dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822722#comment-17822722 ] Pavan Kotikalapudi commented on SPARK-24815: Thanks a lot for mentoring and driving this

[jira] [Updated] (SPARK-47251) Block invalid types from the `args` argument for `sql` command

[ https://issues.apache.org/jira/browse/SPARK-47251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47251: --- Labels: pull-request-available (was: ) > Block invalid types from the `args` argument for

[jira] [Updated] (SPARK-47251) Block invalid types from the `args` argument for `sql` command

[ https://issues.apache.org/jira/browse/SPARK-47251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-47251: -- Summary: Block invalid types from the `args` argument for `sql` command (was: Block invalid

[jira] [Assigned] (SPARK-47158) Assign proper name and sqlState to _LEGACY_ERROR_TEMP_2134 & 2231

[ https://issues.apache.org/jira/browse/SPARK-47158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47158: Assignee: Haejoon Lee > Assign proper name and sqlState to _LEGACY_ERROR_TEMP_2134 & 2231 >

[jira] [Created] (SPARK-47251) Block invalid types from the `arg` argument for `sql` command

Takuya Ueshin created SPARK-47251: - Summary: Block invalid types from the `arg` argument for `sql` command Key: SPARK-47251 URL: https://issues.apache.org/jira/browse/SPARK-47251 Project: Spark

[jira] [Resolved] (SPARK-47158) Assign proper name and sqlState to _LEGACY_ERROR_TEMP_2134 & 2231

[ https://issues.apache.org/jira/browse/SPARK-47158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47158. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45244

[jira] [Resolved] (SPARK-47237) Upgrade xmlschema-core to 2.3.1

[ https://issues.apache.org/jira/browse/SPARK-47237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47237. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45347

[jira] [Assigned] (SPARK-47237) Upgrade xmlschema-core to 2.3.1

[ https://issues.apache.org/jira/browse/SPARK-47237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47237: Assignee: BingKun Pan > Upgrade xmlschema-core to 2.3.1 > --- > >

[jira] [Resolved] (SPARK-47216) Refine layout of SQL performance tuning page

[ https://issues.apache.org/jira/browse/SPARK-47216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47216. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45322

[jira] [Assigned] (SPARK-47216) Refine layout of SQL performance tuning page

[ https://issues.apache.org/jira/browse/SPARK-47216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47216: Assignee: Nicholas Chammas > Refine layout of SQL performance tuning page >

[jira] [Updated] (SPARK-47250) Move additional RocksDB errors/exceptions to NERF

[ https://issues.apache.org/jira/browse/SPARK-47250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47250: --- Labels: pull-request-available (was: ) > Move additional RocksDB errors/exceptions to NERF

[jira] [Assigned] (SPARK-47243) Correct the package name of `StateMetadataSource.scala`

[ https://issues.apache.org/jira/browse/SPARK-47243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47243: Assignee: Yang Jie > Correct the package name of `StateMetadataSource.scala` >

[jira] [Resolved] (SPARK-47243) Correct the package name of `StateMetadataSource.scala`

[ https://issues.apache.org/jira/browse/SPARK-47243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47243. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45352

[jira] [Created] (SPARK-47250) Move additional RocksDB errors/exceptions to NERF

Anish Shrigondekar created SPARK-47250: -- Summary: Move additional RocksDB errors/exceptions to NERF Key: SPARK-47250 URL: https://issues.apache.org/jira/browse/SPARK-47250 Project: Spark

[jira] [Commented] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822653#comment-17822653 ] nirav patel commented on SPARK-46762: - just realized I added spark-connect 3.4 example start up

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Description: We are having following `java.lang.ClassCastException` error in spark Executors

[jira] [Updated] (SPARK-44173) Make Spark an sbt build only project

[ https://issues.apache.org/jira/browse/SPARK-44173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44173: -- Parent: (was: SPARK-44111) Issue Type: Improvement (was: Sub-task) > Make Spark

[jira] [Commented] (SPARK-44173) Make Spark an sbt build only project

[ https://issues.apache.org/jira/browse/SPARK-44173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822651#comment-17822651 ] Dongjoon Hyun commented on SPARK-44173: --- Hi, [~LuciferYang] . Given that the difficulty in SBT's

[jira] [Updated] (SPARK-47043) Fix `spark-common-utils` module to have explicit `jackson-core` and `jackson-annotations`dependency

[ https://issues.apache.org/jira/browse/SPARK-47043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47043: -- Parent: (was: SPARK-44111) Issue Type: Improvement (was: Sub-task) > Fix

[jira] [Updated] (SPARK-47042) Fix `spark-common-utils` module to have explicit `commons-lang3` dependency

[ https://issues.apache.org/jira/browse/SPARK-47042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47042: -- Parent: (was: SPARK-44111) Issue Type: Improvement (was: Sub-task) > Fix

[jira] [Updated] (SPARK-41392) Add `bouncy-castle` test dependencies to `sql/core` module for Hadoop 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41392: -- Summary: Add `bouncy-castle` test dependencies to `sql/core` module for Hadoop 3.4.0 (was:

[jira] [Commented] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822649#comment-17822649 ] Dongjoon Hyun commented on SPARK-41392: --- It's a great news. :)  > spark builds against hadoop

[jira] [Updated] (SPARK-47167) Add concrete relation class for JDBC relation made in V1TableScan

[ https://issues.apache.org/jira/browse/SPARK-47167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uros Stankovic updated SPARK-47167: --- Description: JDBCRelation's method toV1TableScan creates v1 anonymous relation that can use

[jira] [Resolved] (SPARK-47167) Add concrete relation class for JDBC relation made in V1TableScan

[ https://issues.apache.org/jira/browse/SPARK-47167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47167. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45259

[jira] [Updated] (SPARK-47167) Add concrete relation class for JDBC relation made in V1TableScan

[ https://issues.apache.org/jira/browse/SPARK-47167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uros Stankovic updated SPARK-47167: --- Summary: Add concrete relation class for JDBC relation made in V1TableScan (was: Add

[jira] [Commented] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822572#comment-17822572 ] Steve Loughran commented on SPARK-41392: expect an official release this week; this pr will

[jira] [Updated] (SPARK-47131) contains, startswith, endswith

[ https://issues.apache.org/jira/browse/SPARK-47131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47131: - Description: Refactored built-in string functions to enable collation support for:

[jira] [Updated] (SPARK-47131) contains, startswith, endswith

[ https://issues.apache.org/jira/browse/SPARK-47131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47131: - Description: Refactored built-in string functions to enable collation support for:

[jira] [Updated] (SPARK-47248) contains (non-binary collations)

[ https://issues.apache.org/jira/browse/SPARK-47248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47248: - Description: Implemented efficient collation-aware in-place substring comparison to enable

[jira] [Updated] (SPARK-47248) contains (non-binary collations)

[ https://issues.apache.org/jira/browse/SPARK-47248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47248: - Description: Implemented efficient collation-aware in-place substring comparison to enable

[jira] [Created] (SPARK-47248) contains

Uroš Bojanić created SPARK-47248: Summary: contains Key: SPARK-47248 URL: https://issues.apache.org/jira/browse/SPARK-47248 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Updated] (SPARK-47131) contains, startswith, endswith

[ https://issues.apache.org/jira/browse/SPARK-47131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47131: - Component/s: SQL (was: Spark Core) > contains, startswith, endswith >

[jira] [Updated] (SPARK-47217) De-duplication of Relations in Joins, can result in plan resolution failure

[ https://issues.apache.org/jira/browse/SPARK-47217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-47217: --- Shepherd: (was: Peter Toth) > De-duplication of Relations in Joins, can result in plan resolution

[jira] [Updated] (SPARK-47247) use smaller target size when coalescing partitions with exploding joins

[ https://issues.apache.org/jira/browse/SPARK-47247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47247: --- Labels: pull-request-available (was: ) > use smaller target size when coalescing

[jira] [Created] (SPARK-47247) use smaller target size when coalescing partitions with exploding joins

Wenchen Fan created SPARK-47247: --- Summary: use smaller target size when coalescing partitions with exploding joins Key: SPARK-47247 URL: https://issues.apache.org/jira/browse/SPARK-47247 Project: Spark

[jira] [Assigned] (SPARK-47131) contains, startswith, endswith

[ https://issues.apache.org/jira/browse/SPARK-47131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47131: -- Assignee: Apache Spark > contains, startswith, endswith >

[jira] [Assigned] (SPARK-47131) contains, startswith, endswith

[ https://issues.apache.org/jira/browse/SPARK-47131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47131: -- Assignee: (was: Apache Spark) > contains, startswith, endswith >

[jira] [Assigned] (SPARK-47188) Add configuration to determine whether to exclude hive statistics properties

[ https://issues.apache.org/jira/browse/SPARK-47188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47188: -- Assignee: (was: Apache Spark) > Add configuration to determine whether to

[jira] [Assigned] (SPARK-47188) Add configuration to determine whether to exclude hive statistics properties

[ https://issues.apache.org/jira/browse/SPARK-47188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47188: -- Assignee: Apache Spark > Add configuration to determine whether to exclude hive

[jira] [Assigned] (SPARK-43255) Assign a name to the error class _LEGACY_ERROR_TEMP_2020

[ https://issues.apache.org/jira/browse/SPARK-43255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-43255: Assignee: Jin Helin > Assign a name to the error class _LEGACY_ERROR_TEMP_2020 >

[jira] [Resolved] (SPARK-43255) Assign a name to the error class _LEGACY_ERROR_TEMP_2020

[ https://issues.apache.org/jira/browse/SPARK-43255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-43255. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45302

[jira] [Assigned] (SPARK-47188) Add configuration to determine whether to exclude hive statistics properties

[ https://issues.apache.org/jira/browse/SPARK-47188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47188: -- Assignee: (was: Apache Spark) > Add configuration to determine whether to

[jira] [Assigned] (SPARK-43255) Assign a name to the error class _LEGACY_ERROR_TEMP_2020

[ https://issues.apache.org/jira/browse/SPARK-43255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43255: -- Assignee: (was: Apache Spark) > Assign a name to the error class

[jira] [Assigned] (SPARK-47188) Add configuration to determine whether to exclude hive statistics properties

[ https://issues.apache.org/jira/browse/SPARK-47188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47188: -- Assignee: Apache Spark > Add configuration to determine whether to exclude hive

[jira] [Assigned] (SPARK-43255) Assign a name to the error class _LEGACY_ERROR_TEMP_2020

[ https://issues.apache.org/jira/browse/SPARK-43255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43255: -- Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_2020 >

[jira] [Commented] (SPARK-43255) Assign a name to the error class _LEGACY_ERROR_TEMP_2020

[ https://issues.apache.org/jira/browse/SPARK-43255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822461#comment-17822461 ] Jin Helin commented on SPARK-43255: --- I will work on this. > Assign a name to the error class

[jira] [Updated] (SPARK-47244) SparkConnectPlanner make internal functions private

[ https://issues.apache.org/jira/browse/SPARK-47244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47244: --- Labels: pull-request-available (was: ) > SparkConnectPlanner make internal functions

[jira] [Created] (SPARK-47244) SparkConnectPlanner make internal functions private

Ruifeng Zheng created SPARK-47244: - Summary: SparkConnectPlanner make internal functions private Key: SPARK-47244 URL: https://issues.apache.org/jira/browse/SPARK-47244 Project: Spark Issue