[jira] [Created] (SPARK-47982) Update code style' plugins to latest version

BingKun Pan created SPARK-47982: --- Summary: Update code style' plugins to latest version Key: SPARK-47982 URL: https://issues.apache.org/jira/browse/SPARK-47982 Project: Spark Issue Type:

[jira] [Commented] (SPARK-46122) Set `spark.sql.legacy.createHiveTableByDefault` to `false` by default

[ https://issues.apache.org/jira/browse/SPARK-46122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840644#comment-17840644 ] Dongjoon Hyun commented on SPARK-46122: --- I sent the discussion thread for this issue. -

[jira] [Closed] (SPARK-44304) Broadcast operation is not required when no parameters are specified

[ https://issues.apache.org/jira/browse/SPARK-44304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 7mming7 closed SPARK-44304. --- > Broadcast operation is not required when no parameters are specified >

[jira] [Updated] (SPARK-46122) Set `spark.sql.legacy.createHiveTableByDefault` to `false` by default

[ https://issues.apache.org/jira/browse/SPARK-46122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46122: -- Summary: Set `spark.sql.legacy.createHiveTableByDefault` to `false` by default (was: Set

[jira] [Updated] (SPARK-46122) Set `spark.sql.legacy.createHiveTableByDefault` to false by default

[ https://issues.apache.org/jira/browse/SPARK-46122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46122: -- Summary: Set `spark.sql.legacy.createHiveTableByDefault` to false by default (was: Disable

[jira] [Resolved] (SPARK-47962) Improve doc test in pyspark dataframe

[ https://issues.apache.org/jira/browse/SPARK-47962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47962. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46189

[jira] [Resolved] (SPARK-47979) Use Hive tables explicitly for Hive table capability tests

[ https://issues.apache.org/jira/browse/SPARK-47979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47979. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46211

[jira] [Resolved] (SPARK-47921) Fix ExecuteJobTag creation in ExecuteHolder

[ https://issues.apache.org/jira/browse/SPARK-47921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-47921. --- Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-47979) Use Hive tables explicitly for Hive table capability tests

[ https://issues.apache.org/jira/browse/SPARK-47979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47979: --- Labels: pull-request-available (was: ) > Use Hive tables explicitly for Hive table

[jira] [Created] (SPARK-47979) Use Hive table explicitly for Hive table capability tests

Dongjoon Hyun created SPARK-47979: - Summary: Use Hive table explicitly for Hive table capability tests Key: SPARK-47979 URL: https://issues.apache.org/jira/browse/SPARK-47979 Project: Spark

[jira] [Updated] (SPARK-47979) Use Hive tables explicitly for Hive table capability tests

[ https://issues.apache.org/jira/browse/SPARK-47979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47979: -- Summary: Use Hive tables explicitly for Hive table capability tests (was: Use Hive table

[jira] [Updated] (SPARK-47977) DateTimeUtils.timestampDiff and DateTimeUtils.timestampAdd should not throw INTERNAL_ERROR exception

[ https://issues.apache.org/jira/browse/SPARK-47977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47977: --- Labels: pull-request-available (was: ) > DateTimeUtils.timestampDiff and

[jira] [Updated] (SPARK-47842) Spark job relying over Hudi are blocked after one or zero commit

[ https://issues.apache.org/jira/browse/SPARK-47842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47842: --- Labels: pull-request-available (was: ) > Spark job relying over Hudi are blocked after one

[jira] [Created] (SPARK-47977) DateTimeUtils.timestampDiff and DateTimeUtils.timestampAdd should not throw INTERNAL_ERROR exception

Vitalii Li created SPARK-47977: -- Summary: DateTimeUtils.timestampDiff and DateTimeUtils.timestampAdd should not throw INTERNAL_ERROR exception Key: SPARK-47977 URL: https://issues.apache.org/jira/browse/SPARK-47977

[jira] [Resolved] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47583. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45969

[jira] [Updated] (SPARK-47939) Parameterized queries fail for DESCRIBE & EXPLAIN w/ UNBOUND_SQL_PARAMETER error

[ https://issues.apache.org/jira/browse/SPARK-47939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47939: --- Labels: pull-request-available (was: ) > Parameterized queries fail for DESCRIBE & EXPLAIN

[jira] [Assigned] (SPARK-45265) Support Hive 4.0 metastore

[ https://issues.apache.org/jira/browse/SPARK-45265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45265: - Assignee: (was: Attila Zsolt Piros) > Support Hive 4.0 metastore >

[jira] [Updated] (SPARK-44677) Drop legacy Hive-based ORC file format

[ https://issues.apache.org/jira/browse/SPARK-44677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44677: -- Parent: (was: SPARK-44111) Issue Type: Task (was: Sub-task) > Drop legacy

[jira] [Commented] (SPARK-47499) Reuse `test_help_command` in Connect

[ https://issues.apache.org/jira/browse/SPARK-47499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840514#comment-17840514 ] Dongjoon Hyun commented on SPARK-47499: --- Thank you for collecting this to the umbrella Jira,

[jira] [Assigned] (SPARK-47633) Cache miss for queries using JOIN LATERAL with join condition

[ https://issues.apache.org/jira/browse/SPARK-47633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47633: - Assignee: Bruce Robbins > Cache miss for queries using JOIN LATERAL with join

[jira] [Resolved] (SPARK-47633) Cache miss for queries using JOIN LATERAL with join condition

[ https://issues.apache.org/jira/browse/SPARK-47633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47633. --- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46190

[jira] [Updated] (SPARK-46841) Language support for collations

[ https://issues.apache.org/jira/browse/SPARK-46841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Mandic updated SPARK-46841: -- Description: Languages and localization for collations are supported by ICU library.

[jira] [Updated] (SPARK-46841) Language support for collations

[ https://issues.apache.org/jira/browse/SPARK-46841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Mandic updated SPARK-46841: -- Description: Languages and localization for collations are supported by ICU library.

[jira] [Updated] (SPARK-46841) Language support for collations

[ https://issues.apache.org/jira/browse/SPARK-46841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Mandic updated SPARK-46841: -- Component/s: SQL Description: Languages and localization for collations are supported by

[jira] [Updated] (SPARK-47974) Remove install_scala from build/mvn

[ https://issues.apache.org/jira/browse/SPARK-47974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47974: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Remove install_scala

[jira] [Resolved] (SPARK-47974) Remove install_scala from build/mvn

[ https://issues.apache.org/jira/browse/SPARK-47974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47974. --- Fix Version/s: 4.0.0 Assignee: Cheng Pan Resolution: Fixed This is resolved

[jira] [Commented] (SPARK-44478) Executor decommission causes stage failure

[ https://issues.apache.org/jira/browse/SPARK-44478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840442#comment-17840442 ] Juha Iso-Sipilä commented on SPARK-44478: - Just a short update. This is clearly related to

[jira] [Updated] (SPARK-47819) Use asynchronous callback for execution cleanup

[ https://issues.apache.org/jira/browse/SPARK-47819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-47819: -- Fix Version/s: 3.5.2 > Use asynchronous callback for execution cleanup >

[jira] [Resolved] (SPARK-47958) Task Scheduler may not know about executor when using LocalSchedulerBackend

[ https://issues.apache.org/jira/browse/SPARK-47958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47958. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46187

[jira] [Resolved] (SPARK-47965) Avoid orNull in TypedConfigBuilder and OptionalConfigEntry

[ https://issues.apache.org/jira/browse/SPARK-47965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47965. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46197

[jira] [Assigned] (SPARK-47965) Avoid orNull in TypedConfigBuilder and OptionalConfigEntry

[ https://issues.apache.org/jira/browse/SPARK-47965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47965: Assignee: Hyukjin Kwon > Avoid orNull in TypedConfigBuilder and OptionalConfigEntry >

[jira] [Updated] (SPARK-47974) Remove install_scala from build/mvn

[ https://issues.apache.org/jira/browse/SPARK-47974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47974: --- Labels: pull-request-available (was: ) > Remove install_scala from build/mvn >

[jira] [Created] (SPARK-47974) Remove install_scala from build/mvn

Cheng Pan created SPARK-47974: - Summary: Remove install_scala from build/mvn Key: SPARK-47974 URL: https://issues.apache.org/jira/browse/SPARK-47974 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47961) CREATE TABLE AS SELECT changes behaviour in SPARK 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-47961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugen Stoianovici updated SPARK-47961: -- Component/s: Spark Core > CREATE TABLE AS SELECT changes behaviour in SPARK 3.4.0 >

[jira] [Updated] (SPARK-47962) Improve doc test in pyspark dataframe

[ https://issues.apache.org/jira/browse/SPARK-47962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47962: --- Labels: pull-request-available (was: ) > Improve doc test in pyspark dataframe >

[jira] [Assigned] (SPARK-47764) Cleanup shuffle dependencies for Spark Connect SQL executions

[ https://issues.apache.org/jira/browse/SPARK-47764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47764: --- Assignee: Bo Zhang > Cleanup shuffle dependencies for Spark Connect SQL executions >

[jira] [Resolved] (SPARK-47764) Cleanup shuffle dependencies for Spark Connect SQL executions

[ https://issues.apache.org/jira/browse/SPARK-47764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47764. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45930

[jira] [Resolved] (SPARK-47418) Optimize string predicate expressions for UTF8_BINARY_LCASE collation

[ https://issues.apache.org/jira/browse/SPARK-47418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47418. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46181

[jira] [Updated] (SPARK-47972) Restrict CAST expression for collations

[ https://issues.apache.org/jira/browse/SPARK-47972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-47972: -- Description: Current state of code allows for calls like CAST(1 AS STRING COLLATE

[jira] [Updated] (SPARK-47927) Nullability after join not respected in UDF

[ https://issues.apache.org/jira/browse/SPARK-47927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Ejbyfeldt updated SPARK-47927: --- Labels: correctness pull-request-available (was: pull-request-available) > Nullability

[jira] [Resolved] (SPARK-47964) Hide SQLContext and HiveContext

[ https://issues.apache.org/jira/browse/SPARK-47964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47964. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46194

[jira] [Updated] (SPARK-47499) Reuse `test_help_command` in Connect

[ https://issues.apache.org/jira/browse/SPARK-47499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-47499: -- Parent: SPARK-47970 Issue Type: Sub-task (was: Test) > Reuse `test_help_command` in

[jira] [Created] (SPARK-47970) Revisit skipped parity tests for PySpark

Ruifeng Zheng created SPARK-47970: - Summary: Revisit skipped parity tests for PySpark Key: SPARK-47970 URL: https://issues.apache.org/jira/browse/SPARK-47970 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47969) Make `test_creation_index` deterministic

[ https://issues.apache.org/jira/browse/SPARK-47969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47969. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46200