[jira] [Updated] (SPARK-46534) Skip initializating an unused hive client in HiveThriftServer2.startWithContext DeveloperApi

[ https://issues.apache.org/jira/browse/SPARK-46534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46534: --- Labels: pull-request-available (was: ) > Skip initializating an unused hive client in > Hi

[jira] [Resolved] (SPARK-46366) Use with expression to avoid duplicating expressions in BETWEEN operation

[ https://issues.apache.org/jira/browse/SPARK-46366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46366. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44299 [https://gith

[jira] [Created] (SPARK-46534) Skip initializating an unused hive client in HiveThriftServer2.startWithContext DeveloperApi

Kent Yao created SPARK-46534: Summary: Skip initializating an unused hive client in HiveThriftServer2.startWithContext DeveloperApi Key: SPARK-46534 URL: https://issues.apache.org/jira/browse/SPARK-46534

[jira] [Updated] (SPARK-46533) Refine docstring of `array_min/array_max/array_size/array_repeat`

[ https://issues.apache.org/jira/browse/SPARK-46533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46533: --- Labels: pull-request-available (was: ) > Refine docstring of `array_min/array_max/array_siz

[jira] [Created] (SPARK-46533) Refine docstring of `array_min/array_max/array_size/array_repeat`

Yang Jie created SPARK-46533: Summary: Refine docstring of `array_min/array_max/array_size/array_repeat` Key: SPARK-46533 URL: https://issues.apache.org/jira/browse/SPARK-46533 Project: Spark Is

[jira] [Updated] (SPARK-46532) Pass message parameters in metadata of ErrorInfo

[ https://issues.apache.org/jira/browse/SPARK-46532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46532: --- Labels: pull-request-available (was: ) > Pass message parameters in metadata of ErrorInfo >

[jira] [Created] (SPARK-46532) Pass message parameters in metadata of ErrorInfo

Max Gekk created SPARK-46532: Summary: Pass message parameters in metadata of ErrorInfo Key: SPARK-46532 URL: https://issues.apache.org/jira/browse/SPARK-46532 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-46531) Move the version management of 'datasketches-java' from 'catalyst' to 'parent'

[ https://issues.apache.org/jira/browse/SPARK-46531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46531: --- Labels: pull-request-available (was: ) > Move the version management of 'datasketches-java'

[jira] [Created] (SPARK-46531) Move the version management of 'datasketches-java' from 'catalyst' to 'parent'

Yang Jie created SPARK-46531: Summary: Move the version management of 'datasketches-java' from 'catalyst' to 'parent' Key: SPARK-46531 URL: https://issues.apache.org/jira/browse/SPARK-46531 Project: Spark

[jira] [Updated] (SPARK-46530) Check Python executable when looking up available Data Sources

[ https://issues.apache.org/jira/browse/SPARK-46530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46530: --- Labels: pull-request-available (was: ) > Check Python executable when looking up available

[jira] [Created] (SPARK-46530) Check Python executable when looking up available Data Sources

Hyukjin Kwon created SPARK-46530: Summary: Check Python executable when looking up available Data Sources Key: SPARK-46530 URL: https://issues.apache.org/jira/browse/SPARK-46530 Project: Spark

[jira] [Resolved] (SPARK-45917) Statically register Python Data Source

[ https://issues.apache.org/jira/browse/SPARK-45917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45917. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44504 [https://gi

[jira] [Assigned] (SPARK-45917) Statically register Python Data Source

[ https://issues.apache.org/jira/browse/SPARK-45917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45917: Assignee: Hyukjin Kwon > Statically register Python Data Source > ---

[jira] [Updated] (SPARK-46514) Fix HiveMetastoreLazyInitializationSuite

[ https://issues.apache.org/jira/browse/SPARK-46514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46514: - Fix Version/s: 3.5.1 3.4.3 > Fix HiveMetastoreLazyInitializationSuite > -

[jira] [Assigned] (SPARK-46514) Fix HiveMetastoreLazyInitializationSuite

[ https://issues.apache.org/jira/browse/SPARK-46514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46514: Assignee: Kent Yao > Fix HiveMetastoreLazyInitializationSuite > -

[jira] [Resolved] (SPARK-46514) Fix HiveMetastoreLazyInitializationSuite

[ https://issues.apache.org/jira/browse/SPARK-46514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46514. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44500 [https://github.com

[jira] [Resolved] (SPARK-46521) Refine docstring of `array_compact/array_distinct/array_remove`

[ https://issues.apache.org/jira/browse/SPARK-46521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46521. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44506 [https://gi

[jira] [Assigned] (SPARK-46521) Refine docstring of `array_compact/array_distinct/array_remove`

[ https://issues.apache.org/jira/browse/SPARK-46521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46521: Assignee: Yang Jie > Refine docstring of `array_compact/array_distinct/array_remove` > --

[jira] [Created] (SPARK-46529) upgrade guava from 18.0 to 19.0 for docker-integration-tests

Kent Yao created SPARK-46529: Summary: upgrade guava from 18.0 to 19.0 for docker-integration-tests Key: SPARK-46529 URL: https://issues.apache.org/jira/browse/SPARK-46529 Project: Spark Issue T

[jira] [Assigned] (SPARK-46528) Upgrade zstd-jni to 1.5.5-11

[ https://issues.apache.org/jira/browse/SPARK-46528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46528: Assignee: Dongjoon Hyun > Upgrade zstd-jni to 1.5.5-11 > > >

[jira] [Resolved] (SPARK-46528) Upgrade zstd-jni to 1.5.5-11

[ https://issues.apache.org/jira/browse/SPARK-46528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46528. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44515 [https://gi

[jira] [Updated] (SPARK-46478) Revert SPARK-43049

[ https://issues.apache.org/jira/browse/SPARK-46478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46478: -- Fix Version/s: 3.5.1 > Revert SPARK-43049 > -- > > Key: SPARK-

[jira] [Created] (SPARK-46527) Verify and unify the code between `In/InSet` and binary comparison

Dongjoon Hyun created SPARK-46527: - Summary: Verify and unify the code between `In/InSet` and binary comparison Key: SPARK-46527 URL: https://issues.apache.org/jira/browse/SPARK-46527 Project: Spark

[jira] [Assigned] (SPARK-46502) Support timestamp types in UnwrapCastInBinaryComparison

[ https://issues.apache.org/jira/browse/SPARK-46502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46502: - Assignee: L. C. Hsieh > Support timestamp types in UnwrapCastInBinaryComparison > -

[jira] [Resolved] (SPARK-46502) Support timestamp types in UnwrapCastInBinaryComparison

[ https://issues.apache.org/jira/browse/SPARK-46502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46502. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44480 [https://

[jira] [Comment Edited] (SPARK-43357) Spark AWS Glue date partition push down broken

[ https://issues.apache.org/jira/browse/SPARK-43357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800846#comment-17800846 ] Nandini edited comment on SPARK-43357 at 12/27/23 6:32 PM: --- He

[jira] [Comment Edited] (SPARK-43357) Spark AWS Glue date partition push down broken

[ https://issues.apache.org/jira/browse/SPARK-43357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800846#comment-17800846 ] Nandini edited comment on SPARK-43357 at 12/27/23 6:31 PM: --- He

[jira] [Commented] (SPARK-43357) Spark AWS Glue date partition push down broken

[ https://issues.apache.org/jira/browse/SPARK-43357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800846#comment-17800846 ] Nandini commented on SPARK-43357: - Hi Team, After this fix, we are facing the issue du

[jira] [Updated] (SPARK-46516) autoBroadcastJoinThreshold compared to project of a plan not a relation size

[ https://issues.apache.org/jira/browse/SPARK-46516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guram Savinov updated SPARK-46516: -- Description: >From the docs: spark.sql.autoBroadcastJoinThreshold - Configures the maximum >s

[jira] [Updated] (SPARK-46516) autoBroadcastJoinThreshold compared to project of a plan not a relation size

[ https://issues.apache.org/jira/browse/SPARK-46516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guram Savinov updated SPARK-46516: -- Description: >From the docs: spark.sql.autoBroadcastJoinThreshold - Configures the maximum >s

[jira] [Updated] (SPARK-46516) autoBroadcastJoinThreshold compared to project of a plan not a relation size

[ https://issues.apache.org/jira/browse/SPARK-46516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guram Savinov updated SPARK-46516: -- Summary: autoBroadcastJoinThreshold compared to project of a plan not a relation size (was: a

[jira] [Updated] (SPARK-46516) autoBroadcastJoinThreshold compared to project of a plan not a relation size

[ https://issues.apache.org/jira/browse/SPARK-46516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guram Savinov updated SPARK-46516: -- Description: >From the docs: spark.sql.autoBroadcastJoinThreshold - Configures the maximum >s

[jira] [Updated] (SPARK-46516) autoBroadcastJoinThreshold compared to plan.statistics not a table size

[ https://issues.apache.org/jira/browse/SPARK-46516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guram Savinov updated SPARK-46516: -- Description: >From the docs: spark.sql.autoBroadcastJoinThreshold - Configures the maximum >s

[jira] [Updated] (SPARK-46516) autoBroadcastJoinThreshold compared to plan.statistics not a table size

[ https://issues.apache.org/jira/browse/SPARK-46516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guram Savinov updated SPARK-46516: -- Description: >From the docs: spark.sql.autoBroadcastJoinThreshold - Configures the maximum >s

[jira] [Assigned] (SPARK-46520) Support overwrite mode for Python data source write

[ https://issues.apache.org/jira/browse/SPARK-46520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46520: Assignee: Allison Wang > Support overwrite mode for Python data source write > --

[jira] [Resolved] (SPARK-46520) Support overwrite mode for Python data source write

[ https://issues.apache.org/jira/browse/SPARK-46520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46520. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44505 [https://gi

[jira] [Updated] (SPARK-46525) Fix docker-integration-tests on Apple Chips

[ https://issues.apache.org/jira/browse/SPARK-46525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46525: --- Labels: pull-request-available (was: ) > Fix docker-integration-tests on Apple Chips >

[jira] [Created] (SPARK-46525) Fix docker-integration-tests on Apple Chips

Kent Yao created SPARK-46525: Summary: Fix docker-integration-tests on Apple Chips Key: SPARK-46525 URL: https://issues.apache.org/jira/browse/SPARK-46525 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-46521) Refine docstring of `array_compact/array_distinct/array_remove`

[ https://issues.apache.org/jira/browse/SPARK-46521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46521: -- Assignee: (was: Apache Spark) > Refine docstring of `array_compact/array_distinct

[jira] [Assigned] (SPARK-46521) Refine docstring of `array_compact/array_distinct/array_remove`

[ https://issues.apache.org/jira/browse/SPARK-46521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46521: -- Assignee: Apache Spark > Refine docstring of `array_compact/array_distinct/array_remo

[jira] [Commented] (SPARK-46523) Single Hive/Datasource table partitioning to multiple storage system- (e.g, S3 and HDFS)

[ https://issues.apache.org/jira/browse/SPARK-46523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800717#comment-17800717 ] zhixingheyi-tian commented on SPARK-46523: -- cc [~cloud_fan] [~ueshin]  Thanks

[jira] [Updated] (SPARK-46523) Single Hive/Datasource table partitioning to multiple storage system- (e.g, S3 and HDFS)

[ https://issues.apache.org/jira/browse/SPARK-46523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhixingheyi-tian updated SPARK-46523: - Description: Single Hive/Datasource table partitioning to multiple storage system- (e.g,

[jira] [Created] (SPARK-46523) Single Hive/Datasource table partitioning to multiple storage system- (e.g, S3 and HDFS)

zhixingheyi-tian created SPARK-46523: Summary: Single Hive/Datasource table partitioning to multiple storage system- (e.g, S3 and HDFS) Key: SPARK-46523 URL: https://issues.apache.org/jira/browse/SPARK-46523

[jira] [Updated] (SPARK-46523) Single Hive/Datasource table partitioning to multiple storage system- (e.g, S3 and HDFS)

[ https://issues.apache.org/jira/browse/SPARK-46523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhixingheyi-tian updated SPARK-46523: - Environment: (was: Single Hive/Datasource table partitioning to multiple storage sys