[jira] [Created] (SPARK-46486) DataSourceV2: Restore createOrReplaceView

John Zhuge created SPARK-46486: -- Summary: DataSourceV2: Restore createOrReplaceView Key: SPARK-46486 URL: https://issues.apache.org/jira/browse/SPARK-46486 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-46485) V1Write should not add Sort when not needed

[ https://issues.apache.org/jira/browse/SPARK-46485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46485: --- Labels: pull-request-available (was: ) > V1Write should not add Sort when not needed >

[jira] [Created] (SPARK-46485) V1Write should not add Sort when not needed

Wenchen Fan created SPARK-46485: --- Summary: V1Write should not add Sort when not needed Key: SPARK-46485 URL: https://issues.apache.org/jira/browse/SPARK-46485 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-46480) Fix NPE when table cache task attempt

[ https://issues.apache.org/jira/browse/SPARK-46480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46480: Assignee: XiDuo You > Fix NPE when table cache task attempt >

[jira] [Resolved] (SPARK-46480) Fix NPE when table cache task attempt

[ https://issues.apache.org/jira/browse/SPARK-46480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46480. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 5

[jira] [Assigned] (SPARK-46464) Fix the scroll issue of tables when overflow

[ https://issues.apache.org/jira/browse/SPARK-46464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46464: Assignee: Kent Yao > Fix the scroll issue of tables when overflow >

[jira] [Resolved] (SPARK-46464) Fix the scroll issue of tables when overflow

[ https://issues.apache.org/jira/browse/SPARK-46464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46464. -- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Updated] (SPARK-46484) Fix missing `plan_id` in`df.melt.groupby`

[ https://issues.apache.org/jira/browse/SPARK-46484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46484: --- Labels: pull-request-available (was: ) > Fix missing `plan_id` in`df.melt.groupby` >

[jira] [Created] (SPARK-46484) Fix missing `plan_id` in`df.melt.groupby`

Ruifeng Zheng created SPARK-46484: - Summary: Fix missing `plan_id` in`df.melt.groupby` Key: SPARK-46484 URL: https://issues.apache.org/jira/browse/SPARK-46484 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-46483) Exclude `apache-rat-*.jar` from `ScalaUnidoc / unidoc / unidocAllClasspaths`

[ https://issues.apache.org/jira/browse/SPARK-46483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46483: --- Labels: pull-request-available (was: ) > Exclude `apache-rat-*.jar` from `ScalaUnidoc /

[jira] [Created] (SPARK-46483) Exclude `apache-rat-*.jar` from `ScalaUnidoc / unidoc / unidocAllClasspaths`

Yang Jie created SPARK-46483: Summary: Exclude `apache-rat-*.jar` from `ScalaUnidoc / unidoc / unidocAllClasspaths` Key: SPARK-46483 URL: https://issues.apache.org/jira/browse/SPARK-46483 Project: Spark

[jira] [Assigned] (SPARK-46472) Refine docstring of `array_prepend/array_append/array_insert`

[ https://issues.apache.org/jira/browse/SPARK-46472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46472: Assignee: Yang Jie > Refine docstring of `array_prepend/array_append/array_insert` >

[jira] [Resolved] (SPARK-46472) Refine docstring of `array_prepend/array_append/array_insert`

[ https://issues.apache.org/jira/browse/SPARK-46472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46472. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44436

[jira] [Resolved] (SPARK-46443) Decimal precision and scale should decided by JDBC dialect.

[ https://issues.apache.org/jira/browse/SPARK-46443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46443. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-46468) COUNT bug in lateral/exists subqueries

[ https://issues.apache.org/jira/browse/SPARK-46468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46468. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44451

[jira] [Assigned] (SPARK-46468) COUNT bug in lateral/exists subqueries

[ https://issues.apache.org/jira/browse/SPARK-46468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46468: --- Assignee: Andrey Gubichev > COUNT bug in lateral/exists subqueries >

[jira] [Resolved] (SPARK-45525) Initial support for Python data source write API

[ https://issues.apache.org/jira/browse/SPARK-45525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45525. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43791

[jira] [Assigned] (SPARK-45525) Initial support for Python data source write API

[ https://issues.apache.org/jira/browse/SPARK-45525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45525: --- Assignee: Allison Wang > Initial support for Python data source write API >

[jira] [Resolved] (SPARK-46437) Remove unnecessary cruft from SQL built-in functions docs

[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46437. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44393

[jira] [Assigned] (SPARK-46437) Remove unnecessary cruft from SQL built-in functions docs

[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46437: Assignee: Nicholas Chammas > Remove unnecessary cruft from SQL built-in functions docs >

[jira] [Resolved] (SPARK-46482) Revert SPARK-43049 due to performance regression of using CLOB

[ https://issues.apache.org/jira/browse/SPARK-46482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Sadikov resolved SPARK-46482. -- Resolution: Duplicate > Revert SPARK-43049 due to performance regression of using CLOB >

[jira] [Updated] (SPARK-46482) Revert SPARK-43049 due to performance regression of using CLOB

[ https://issues.apache.org/jira/browse/SPARK-46482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Sadikov updated SPARK-46482: - Affects Version/s: (was: 3.4.1) > Revert SPARK-43049 due to performance regression of using

[jira] [Updated] (SPARK-46482) Revert SPARK-43049 due to performance regression of using CLOB

[ https://issues.apache.org/jira/browse/SPARK-46482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46482: --- Labels: pull-request-available (was: ) > Revert SPARK-43049 due to performance regression

[jira] [Updated] (SPARK-46482) Revert SPARK-43049 due to performance regression of using CLOB

[ https://issues.apache.org/jira/browse/SPARK-46482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Sadikov updated SPARK-46482: - Description: SPARK-43049 causes performance regression when writing string fields to an Oracle

[jira] [Updated] (SPARK-46482) Revert SPARK-43049 due to performance regression

[ https://issues.apache.org/jira/browse/SPARK-46482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Sadikov updated SPARK-46482: - Description: SPARK-43049 causes performance regression when writing string fields to an Oracle

[jira] [Updated] (SPARK-46482) Revert SPARK-43049 due to performance regression of using CLOB

[ https://issues.apache.org/jira/browse/SPARK-46482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Sadikov updated SPARK-46482: - Summary: Revert SPARK-43049 due to performance regression of using CLOB (was: Revert

[jira] [Updated] (SPARK-46468) COUNT bug in lateral/exists subqueries

[ https://issues.apache.org/jira/browse/SPARK-46468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46468: --- Labels: pull-request-available (was: ) > COUNT bug in lateral/exists subqueries >

[jira] [Updated] (SPARK-23890) Support DDL for adding nested columns to struct types

[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Otto updated SPARK-23890: Description: As part of SPARK-14118, Spark SQL removed support for sending ALTER TABLE CHANGE

[jira] [Updated] (SPARK-23890) Support DDL for adding nested columns to struct types

[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Otto updated SPARK-23890: Summary: Support DDL for adding nested columns to struct types (was: Hive ALTER TABLE CHANGE

[jira] [Reopened] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Otto reopened SPARK-23890: - This is fixed for DataSource v2 via {{{}alter table add column nested.new_field0{}}}, but

[jira] [Updated] (SPARK-46481) EXECUTE IMMEDIATE does not fold variables when given as parameters

[ https://issues.apache.org/jira/browse/SPARK-46481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46481: --- Labels: pull-request-available (was: ) > EXECUTE IMMEDIATE does not fold variables when

[jira] [Created] (SPARK-46481) EXECUTE IMMEDIATE does not fold variables when given as parameters

Milan Stefanovic created SPARK-46481: Summary: EXECUTE IMMEDIATE does not fold variables when given as parameters Key: SPARK-46481 URL: https://issues.apache.org/jira/browse/SPARK-46481 Project:

[jira] [Updated] (SPARK-46460) The filter of partition including cast function may lead the partition pruning to disable

[ https://issues.apache.org/jira/browse/SPARK-46460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Tong updated SPARK-46460: -- Attachment: (was: SPARK-46460.patch) > The filter of partition including cast function may lead

[jira] [Resolved] (SPARK-46476) Move `IvyTestUtils` back to test dir

[ https://issues.apache.org/jira/browse/SPARK-46476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46476. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 0

[jira] [Assigned] (SPARK-46476) Move `IvyTestUtils` back to test dir

[ https://issues.apache.org/jira/browse/SPARK-46476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46476: Assignee: Yang Jie > Move `IvyTestUtils` back to test dir >

[jira] [Updated] (SPARK-46480) Fix NPE when table cache task attempt

[ https://issues.apache.org/jira/browse/SPARK-46480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46480: --- Labels: pull-request-available (was: ) > Fix NPE when table cache task attempt >

[jira] [Updated] (SPARK-46480) Fix NPE when table cache task attempt

[ https://issues.apache.org/jira/browse/SPARK-46480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-46480: -- Summary: Fix NPE when table cache task attempt (was: Fix NPE when table cache task do attempt) >

[jira] [Updated] (SPARK-46480) Fix NPE when table cache task do attempt

[ https://issues.apache.org/jira/browse/SPARK-46480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-46480: -- Component/s: Spark Core > Fix NPE when table cache task do attempt >

[jira] [Updated] (SPARK-46480) Fix NPE when table cache task do attempt

[ https://issues.apache.org/jira/browse/SPARK-46480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-46480: -- Issue Type: Bug (was: Improvement) > Fix NPE when table cache task do attempt >

[jira] [Created] (SPARK-46480) Fix NPE when table cache task do attempt

XiDuo You created SPARK-46480: - Summary: Fix NPE when table cache task do attempt Key: SPARK-46480 URL: https://issues.apache.org/jira/browse/SPARK-46480 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46479) Change Utils.isJavaVersionAtLeast21 to use the utility method from commons-lang3

[ https://issues.apache.org/jira/browse/SPARK-46479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46479: --- Labels: pull-request-available (was: ) > Change Utils.isJavaVersionAtLeast21 to use the

[jira] [Created] (SPARK-46479) Change Utils.isJavaVersionAtLeast21 to use the utility method from commons-lang3

Yang Jie created SPARK-46479: Summary: Change Utils.isJavaVersionAtLeast21 to use the utility method from commons-lang3 Key: SPARK-46479 URL: https://issues.apache.org/jira/browse/SPARK-46479 Project:

[jira] [Updated] (SPARK-46478) Revert SPARK-43049

[ https://issues.apache.org/jira/browse/SPARK-46478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46478: --- Labels: pull-request-available (was: ) > Revert SPARK-43049 > -- > >

[jira] [Created] (SPARK-46478) Revert SPARK-43049

Kent Yao created SPARK-46478: Summary: Revert SPARK-43049 Key: SPARK-46478 URL: https://issues.apache.org/jira/browse/SPARK-46478 Project: Spark Issue Type: Bug Components: SQL

[jira] [Updated] (SPARK-46477) Hive table (bucketdb.dept_part_buk) is bucketed but partition (location=nk) is not bucketed

[ https://issues.apache.org/jira/browse/SPARK-46477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46477: --- Labels: pull-request-available (was: ) > Hive table (bucketdb.dept_part_buk) is bucketed

[jira] [Updated] (SPARK-46477) Hive table (bucketdb.dept_part_buk) is bucketed but partition (location=nk) is not bucketed

[ https://issues.apache.org/jira/browse/SPARK-46477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Sharma updated SPARK-46477: -- Description: Presto fail to read partition of hive table update by spark sql with following

[jira] [Updated] (SPARK-46477) Hive table (bucketdb.dept_part_buk) is bucketed but partition (location=nk) is not bucketed

[ https://issues.apache.org/jira/browse/SPARK-46477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Sharma updated SPARK-46477: -- Description: Presto fail to read partition of hive table update by spark sql with following

[jira] [Updated] (SPARK-46477) Hive table (bucketdb.dept_part_buk) is bucketed but partition (location=nk) is not bucketed

[ https://issues.apache.org/jira/browse/SPARK-46477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Sharma updated SPARK-46477: -- Description: Presto fail to read partition of hive table update by spark sql with following

[jira] [Updated] (SPARK-46477) Hive table (bucketdb.dept_part_buk) is bucketed but partition (location=nk) is not bucketed

[ https://issues.apache.org/jira/browse/SPARK-46477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Sharma updated SPARK-46477: -- Description: Presto fail to read partition of hive table update by spark sql with following

[jira] [Created] (SPARK-46477) Hive table (bucketdb.dept_part_buk) is bucketed but partition (location=nk) is not bucketed

Ashish Sharma created SPARK-46477: - Summary: Hive table (bucketdb.dept_part_buk) is bucketed but partition (location=nk) is not bucketed Key: SPARK-46477 URL: https://issues.apache.org/jira/browse/SPARK-46477

[jira] [Resolved] (SPARK-46470) Move `test_series_datetime` to `pyspark.pandas.tests.connect.series.*`

[ https://issues.apache.org/jira/browse/SPARK-46470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46470. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44434

[jira] [Resolved] (SPARK-46466) vectorized parquet reader should never do rebase for timestamp ntz

[ https://issues.apache.org/jira/browse/SPARK-46466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46466. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44428

[jira] [Assigned] (SPARK-46466) vectorized parquet reader should never do rebase for timestamp ntz

[ https://issues.apache.org/jira/browse/SPARK-46466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46466: Assignee: Wenchen Fan > vectorized parquet reader should never do rebase for timestamp ntz >

[jira] [Updated] (SPARK-46476) Move `IvyTestUtils` back to test dir

[ https://issues.apache.org/jira/browse/SPARK-46476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46476: --- Labels: pull-request-available (was: ) > Move `IvyTestUtils` back to test dir >

[jira] [Assigned] (SPARK-40876) Spark's Vectorized ParquetReader should support type promotions

[ https://issues.apache.org/jira/browse/SPARK-40876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-40876: -- Assignee: (was: Apache Spark) > Spark's Vectorized ParquetReader should support

[jira] [Assigned] (SPARK-40876) Spark's Vectorized ParquetReader should support type promotions

[ https://issues.apache.org/jira/browse/SPARK-40876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-40876: -- Assignee: (was: Apache Spark) > Spark's Vectorized ParquetReader should support

[jira] [Assigned] (SPARK-40876) Spark's Vectorized ParquetReader should support type promotions

[ https://issues.apache.org/jira/browse/SPARK-40876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-40876: -- Assignee: Apache Spark > Spark's Vectorized ParquetReader should support type

[jira] [Assigned] (SPARK-40876) Spark's Vectorized ParquetReader should support type promotions

[ https://issues.apache.org/jira/browse/SPARK-40876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-40876: -- Assignee: Apache Spark > Spark's Vectorized ParquetReader should support type

[jira] [Created] (SPARK-46476) Move `IvyTestUtils` back to test dir

Yang Jie created SPARK-46476: Summary: Move `IvyTestUtils` back to test dir Key: SPARK-46476 URL: https://issues.apache.org/jira/browse/SPARK-46476 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46475) Upgrade RoaringBitmap to 1.0.1

[ https://issues.apache.org/jira/browse/SPARK-46475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46475: --- Labels: pull-request-available (was: ) > Upgrade RoaringBitmap to 1.0.1 >

[jira] [Resolved] (SPARK-46471) Reorganize `OpsOnDiffFramesEnabledTests`

[ https://issues.apache.org/jira/browse/SPARK-46471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46471. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44435

[jira] [Assigned] (SPARK-46471) Reorganize `OpsOnDiffFramesEnabledTests`

[ https://issues.apache.org/jira/browse/SPARK-46471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46471: - Assignee: Ruifeng Zheng > Reorganize `OpsOnDiffFramesEnabledTests` >

[jira] [Resolved] (SPARK-46380) Replacing current time prior to inline table eval

[ https://issues.apache.org/jira/browse/SPARK-46380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46380. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull