[jira] [Resolved] (SPARK-47925) Mark `BloomFilterAggregateQuerySuite` as `ExtendedSQLTest`

[ https://issues.apache.org/jira/browse/SPARK-47925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47925. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46145

[jira] [Assigned] (SPARK-47925) Mark `BloomFilterAggregateQuerySuite` as `ExtendedSQLTest`

[ https://issues.apache.org/jira/browse/SPARK-47925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47925: - Assignee: Dongjoon Hyun > Mark `BloomFilterAggregateQuerySuite` as `ExtendedSQLTest` >

[jira] [Resolved] (SPARK-47924) Add a debug log to `DiskStore.moveFileToBlock`

[ https://issues.apache.org/jira/browse/SPARK-47924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47924. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46144

[jira] [Assigned] (SPARK-47924) Add a debug log to `DiskStore.moveFileToBlock`

[ https://issues.apache.org/jira/browse/SPARK-47924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47924: - Assignee: Dongjoon Hyun > Add a debug log to `DiskStore.moveFileToBlock` >

[jira] [Resolved] (SPARK-47923) Upgrade the minimum version of `arrow` R package to 10.0.0

[ https://issues.apache.org/jira/browse/SPARK-47923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47923. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46142

[jira] [Updated] (SPARK-47925) Mark `BloomFilterAggregateQuerySuite` as `ExtendedSQLTest`

[ https://issues.apache.org/jira/browse/SPARK-47925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47925: --- Labels: pull-request-available (was: ) > Mark `BloomFilterAggregateQuerySuite` as

[jira] [Created] (SPARK-47925) Mark `BloomFilterAggregateQuerySuite` as `ExtendedSQLTest`

Dongjoon Hyun created SPARK-47925: - Summary: Mark `BloomFilterAggregateQuerySuite` as `ExtendedSQLTest` Key: SPARK-47925 URL: https://issues.apache.org/jira/browse/SPARK-47925 Project: Spark

[jira] [Updated] (SPARK-47924) Add a debug log to `DiskStore.moveFileToBlock`

[ https://issues.apache.org/jira/browse/SPARK-47924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47924: --- Labels: pull-request-available (was: ) > Add a debug log to `DiskStore.moveFileToBlock` >

[jira] [Created] (SPARK-47924) Add a debug log to `DiskStore.moveFileToBlock`

Dongjoon Hyun created SPARK-47924: - Summary: Add a debug log to `DiskStore.moveFileToBlock` Key: SPARK-47924 URL: https://issues.apache.org/jira/browse/SPARK-47924 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47922) Implement try_parse_json

[ https://issues.apache.org/jira/browse/SPARK-47922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47922: --- Labels: pull-request-available (was: ) > Implement try_parse_json >

[jira] [Updated] (SPARK-47737) Upgrade the minimum version of PyArrow to 10.0.0

[ https://issues.apache.org/jira/browse/SPARK-47737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47737: -- Summary: Upgrade the minimum version of PyArrow to 10.0.0 (was: Bump PyArrow to 10.0.0) >

[jira] [Assigned] (SPARK-47923) Upgrade the minimum version of `arrow` R package to 10.0.0

[ https://issues.apache.org/jira/browse/SPARK-47923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47923: - Assignee: Dongjoon Hyun > Upgrade the minimum version of `arrow` R package to 10.0.0 >

[jira] [Updated] (SPARK-47923) Upgrade the minimum version of `arrow` R package to 10.0.0

[ https://issues.apache.org/jira/browse/SPARK-47923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47923: --- Labels: pull-request-available (was: ) > Upgrade the minimum version of `arrow` R package

[jira] [Created] (SPARK-47923) Upgrade the minimum version of `arrow` R package to 10.0.0

Dongjoon Hyun created SPARK-47923: - Summary: Upgrade the minimum version of `arrow` R package to 10.0.0 Key: SPARK-47923 URL: https://issues.apache.org/jira/browse/SPARK-47923 Project: Spark

[jira] [Commented] (SPARK-33826) InsertIntoHiveTable generate HDFS file with invalid user

[ https://issues.apache.org/jira/browse/SPARK-33826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839136#comment-17839136 ] Shawn Lavelle commented on SPARK-33826: --- [~angerszhuuu] Did you ever get a good reason as to why

[jira] [Created] (SPARK-47922) Implement try_parse_json

Harsh Motwani created SPARK-47922: - Summary: Implement try_parse_json Key: SPARK-47922 URL: https://issues.apache.org/jira/browse/SPARK-47922 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47921) Fix ExecuteJobTag creation in ExecuteHolder

[ https://issues.apache.org/jira/browse/SPARK-47921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47921: --- Labels: pull-request-available (was: ) > Fix ExecuteJobTag creation in ExecuteHolder >

[jira] [Commented] (SPARK-44167) SPIP: Stored Procedures API for Catalogs

[ https://issues.apache.org/jira/browse/SPARK-44167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839118#comment-17839118 ] Anton Okolnychyi commented on SPARK-44167: -- I've added a design doc to the description and will

[jira] [Updated] (SPARK-44167) SPIP: Stored Procedures API for Catalogs

[ https://issues.apache.org/jira/browse/SPARK-44167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Okolnychyi updated SPARK-44167: - Shepherd: L. C. Hsieh Description: Similar to engines like Trino, it would be

[jira] [Created] (SPARK-47921) Fix ExecuteJobTag creation in ExecuteHolder

Allison Wang created SPARK-47921: Summary: Fix ExecuteJobTag creation in ExecuteHolder Key: SPARK-47921 URL: https://issues.apache.org/jira/browse/SPARK-47921 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-47920) Add documentation for python streaming data source

[ https://issues.apache.org/jira/browse/SPARK-47920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47920: --- Labels: pull-request-available (was: ) > Add documentation for python streaming data

[jira] [Created] (SPARK-47920) Add documentation for python streaming data source

Chaoqin Li created SPARK-47920: -- Summary: Add documentation for python streaming data source Key: SPARK-47920 URL: https://issues.apache.org/jira/browse/SPARK-47920 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47907) Put removal of '!' as a synonym for 'NOT' on a keyword level under a config

[ https://issues.apache.org/jira/browse/SPARK-47907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47907: --- Labels: pull-request-available (was: ) > Put removal of '!' as a synonym for 'NOT' on a

[jira] [Updated] (SPARK-47919) credulousTrustStoreManagers should return empty array for accepted issuers

[ https://issues.apache.org/jira/browse/SPARK-47919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-47919: Priority: Minor (was: Major) > credulousTrustStoreManagers should return empty

[jira] [Created] (SPARK-47919) credulousTrustStoreManagers should return empty array for accepted issuers

Mridul Muralidharan created SPARK-47919: --- Summary: credulousTrustStoreManagers should return empty array for accepted issuers Key: SPARK-47919 URL: https://issues.apache.org/jira/browse/SPARK-47919

[jira] [Resolved] (SPARK-47825) Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` deprecated

[ https://issues.apache.org/jira/browse/SPARK-47825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47825. --- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46019

[jira] [Assigned] (SPARK-47825) Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` deprecated

[ https://issues.apache.org/jira/browse/SPARK-47825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47825: - Assignee: BingKun Pan > Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator`

[jira] [Updated] (SPARK-47901) Upgrade commons-text to 1.12.0

[ https://issues.apache.org/jira/browse/SPARK-47901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47901: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade commons-text

[jira] [Updated] (SPARK-47828) DataFrameWriterV2.overwrite fails with invalid plan

[ https://issues.apache.org/jira/browse/SPARK-47828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47828: -- Affects Version/s: 3.4.3 3.4.1 3.4.0 >

[jira] [Updated] (SPARK-47828) DataFrameWriterV2.overwrite fails with invalid plan

[ https://issues.apache.org/jira/browse/SPARK-47828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47828: -- Fix Version/s: 3.4.4 > DataFrameWriterV2.overwrite fails with invalid plan >

[jira] [Updated] (SPARK-47915) Upgrade kubernetes-client to 6.12.1

[ https://issues.apache.org/jira/browse/SPARK-47915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47915: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Dependency upgrade) > Upgrade

[jira] [Resolved] (SPARK-47915) Upgrade kubernetes-client to 6.12.1

[ https://issues.apache.org/jira/browse/SPARK-47915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47915. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46137

[jira] [Assigned] (SPARK-47915) Upgrade kubernetes-client to 6.12.1

[ https://issues.apache.org/jira/browse/SPARK-47915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47915: - Assignee: Bjørn Jørgensen > Upgrade kubernetes-client to 6.12.1 >

[jira] [Resolved] (SPARK-47913) Move `src/test/java/test/*` to `src/test/java/*`

[ https://issues.apache.org/jira/browse/SPARK-47913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan resolved SPARK-47913. - Resolution: Not A Problem > Move `src/test/java/test/*` to `src/test/java/*` >

[jira] [Updated] (SPARK-47913) Move `src/test/java/test/*` to `src/test/java/*`

[ https://issues.apache.org/jira/browse/SPARK-47913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47913: --- Labels: pull-request-available (was: ) > Move `src/test/java/test/*` to `src/test/java/*`

[jira] [Updated] (SPARK-47421) TBD

[ https://issues.apache.org/jira/browse/SPARK-47421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47421: - Summary: TBD (was: Coalesce) > TBD > --- > > Key: SPARK-47421 >

[jira] [Updated] (SPARK-47918) BroadcastExchange does not support the execute() code path

[ https://issues.apache.org/jira/browse/SPARK-47918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lionia Vasilev updated SPARK-47918: --- Description: Hello, hope you are well. We have flaky tests that fail randomly with the

[jira] [Created] (SPARK-47918) BroadcastExchange does not support the execute() code path

Lionia Vasilev created SPARK-47918: -- Summary: BroadcastExchange does not support the execute() code path Key: SPARK-47918 URL: https://issues.apache.org/jira/browse/SPARK-47918 Project: Spark

[jira] [Created] (SPARK-47917) Accounting the impact of failures in spark jobs

Faiz Halde created SPARK-47917: -- Summary: Accounting the impact of failures in spark jobs Key: SPARK-47917 URL: https://issues.apache.org/jira/browse/SPARK-47917 Project: Spark Issue Type:

[jira] [Created] (SPARK-47916) Unused and leaked session hive instance in HiveSessionImplwithUGI

Kent Yao created SPARK-47916: Summary: Unused and leaked session hive instance in HiveSessionImplwithUGI Key: SPARK-47916 URL: https://issues.apache.org/jira/browse/SPARK-47916 Project: Spark

[jira] [Updated] (SPARK-47915) Upgrade kubernetes-client to 6.12.1

[ https://issues.apache.org/jira/browse/SPARK-47915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47915: --- Labels: pull-request-available (was: ) > Upgrade kubernetes-client to 6.12.1 >

[jira] [Created] (SPARK-47915) Upgrade kubernetes-client to 6.12.1

Bjørn Jørgensen created SPARK-47915: --- Summary: Upgrade kubernetes-client to 6.12.1 Key: SPARK-47915 URL: https://issues.apache.org/jira/browse/SPARK-47915 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47906) Fix docstring and type hint of `hll_union_agg`

[ https://issues.apache.org/jira/browse/SPARK-47906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-47906. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46128

[jira] [Assigned] (SPARK-46632) EquivalentExpressions throw IllegalStateException

[ https://issues.apache.org/jira/browse/SPARK-46632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46632: -- Assignee: (was: Apache Spark) > EquivalentExpressions throw

[jira] [Assigned] (SPARK-46632) EquivalentExpressions throw IllegalStateException

[ https://issues.apache.org/jira/browse/SPARK-46632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46632: -- Assignee: Apache Spark > EquivalentExpressions throw IllegalStateException >

[jira] [Updated] (SPARK-47914) Do not display the splits parameter in Rang

[ https://issues.apache.org/jira/browse/SPARK-47914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47914: --- Labels: pull-request-available (was: ) > Do not display the splits parameter in Rang >

[jira] [Updated] (SPARK-47914) Do not display the splits parameter in Rang

[ https://issues.apache.org/jira/browse/SPARK-47914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guihuawen updated SPARK-47914: -- Summary: Do not display the splits parameter in Rang (was: [SPARK-47914][SQL]Do not display the

[jira] [Updated] (SPARK-47914) [SQL]Do not display the splits parameter in Rang

[ https://issues.apache.org/jira/browse/SPARK-47914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guihuawen updated SPARK-47914: -- Description: [SQL] explain extended select * from range(0, 4); plan == Parsed Logical Plan ==

[jira] [Updated] (SPARK-47914) [SPARK-47914][SQL]Do not display the splits parameter in Rang

[ https://issues.apache.org/jira/browse/SPARK-47914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guihuawen updated SPARK-47914: -- Summary: [SPARK-47914][SQL]Do not display the splits parameter in Rang (was: [SQL]Do not display the

[jira] [Created] (SPARK-47914) [SQL]Do not display the splits parameter in Rang

guihuawen created SPARK-47914: - Summary: [SQL]Do not display the splits parameter in Rang Key: SPARK-47914 URL: https://issues.apache.org/jira/browse/SPARK-47914 Project: Spark Issue Type:

[jira] [Created] (SPARK-47913) Move `src/test/java/test/*` to `src/test/java/*`

BingKun Pan created SPARK-47913: --- Summary: Move `src/test/java/test/*` to `src/test/java/*` Key: SPARK-47913 URL: https://issues.apache.org/jira/browse/SPARK-47913 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-47833) Supply caller stackstrace for checkAndGlobPathIfNecessary AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-47833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47833: Assignee: Cheng Pan > Supply caller stackstrace for checkAndGlobPathIfNecessary

[jira] [Resolved] (SPARK-47833) Supply caller stackstrace for checkAndGlobPathIfNecessary AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-47833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47833. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46028

[jira] [Updated] (SPARK-47911) Introduces a universal BinaryFormatter to make binary output consistent

[ https://issues.apache.org/jira/browse/SPARK-47911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47911: --- Labels: pull-request-available (was: ) > Introduces a universal BinaryFormatter to make

[jira] [Updated] (SPARK-47912) File format of insert overwrite dir does not take effect

[ https://issues.apache.org/jira/browse/SPARK-47912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47912: --- Labels: pull-request-available (was: ) > File format of insert overwrite dir does not take

[jira] [Updated] (SPARK-47912) File format of insert overwrite dir does not take effect

[ https://issues.apache.org/jira/browse/SPARK-47912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Wang updated SPARK-47912: -- Description: File format of insert overwrite dir does not take effect.   Reproduce: {code:java} set

[jira] [Created] (SPARK-47912) File format of insert overwrite dir does not take effect

Zhen Wang created SPARK-47912: - Summary: File format of insert overwrite dir does not take effect Key: SPARK-47912 URL: https://issues.apache.org/jira/browse/SPARK-47912 Project: Spark Issue

[jira] [Created] (SPARK-47911) Introduces a universal BinaryFormatter to make binary output consistent

Kent Yao created SPARK-47911: Summary: Introduces a universal BinaryFormatter to make binary output consistent Key: SPARK-47911 URL: https://issues.apache.org/jira/browse/SPARK-47911 Project: Spark

[jira] [Updated] (SPARK-47910) Memory leak when interrupting shuffle write using zstd compression

[ https://issues.apache.org/jira/browse/SPARK-47910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47910: --- Labels: pull-request-available (was: ) > Memory leak when interrupting shuffle write using