[jira] [Resolved] (SPARK-46507) Split `IndexesSlowTests` into multiple tests

2023-12-25 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46507. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44491

[jira] [Assigned] (SPARK-46507) Split `IndexesSlowTests` into multiple tests

2023-12-25 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46507: - Assignee: Ruifeng Zheng > Split `IndexesSlowTests` into multiple tests >

[jira] [Updated] (SPARK-46510) Spark shell log filter should be applied to all AbstractAppender

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46510: --- Labels: pull-request-available (was: ) > Spark shell log filter should be applied to all

[jira] [Updated] (SPARK-46511) Optimize spark jdbc write speed with Multi-Row Inserts

2023-12-25 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-46511: -- Description: [https://brian.pontarelli.com/2011/06/21/jdbc-batch-vs-multi-row-inserts/] mysql, pg、Oracle

[jira] [Updated] (SPARK-46511) Optimize spark jdbc write speed with Multi-Row Inserts

2023-12-25 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-46511: -- Description: [https://brian.pontarelli.com/2011/06/21/jdbc-batch-vs-multi-row-inserts/] mysql, pg、Oracle

[jira] [Assigned] (SPARK-46444) V2SessionCatalog#createTable should not load the table

2023-12-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46444: --- Assignee: Wenchen Fan > V2SessionCatalog#createTable should not load the table >

[jira] [Resolved] (SPARK-46444) V2SessionCatalog#createTable should not load the table

2023-12-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46444. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44377

[jira] [Created] (SPARK-46511) Optimize spark jdbc write speed with Multi-Row Inserts

2023-12-25 Thread melin (Jira)
melin created SPARK-46511: - Summary: Optimize spark jdbc write speed with Multi-Row Inserts Key: SPARK-46511 URL: https://issues.apache.org/jira/browse/SPARK-46511 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-46510) Spark shell log filter should be applied to all AbstractAppender

2023-12-25 Thread Yi Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Zhu updated SPARK-46510: --- Summary: Spark shell log filter should be applied to all AbstractAppender (was: Spark shell log filter

[jira] [Created] (SPARK-46510) Spark shell log filter should be applied to all AppenderSkeleton

2023-12-25 Thread Yi Zhu (Jira)
Yi Zhu created SPARK-46510: -- Summary: Spark shell log filter should be applied to all AppenderSkeleton Key: SPARK-46510 URL: https://issues.apache.org/jira/browse/SPARK-46510 Project: Spark Issue

[jira] [Updated] (SPARK-46509) Replace `reverse.find` with `findLast`

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46509: --- Labels: pull-request-available (was: ) > Replace `reverse.find` with `findLast` >

[jira] [Updated] (SPARK-46508) Upgrade Jackson to 2.16.1

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46508: --- Labels: pull-request-available (was: ) > Upgrade Jackson to 2.16.1 >

[jira] [Created] (SPARK-46508) Upgrade Jackson to 2.16.1

2023-12-25 Thread Yang Jie (Jira)
Yang Jie created SPARK-46508: Summary: Upgrade Jackson to 2.16.1 Key: SPARK-46508 URL: https://issues.apache.org/jira/browse/SPARK-46508 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46504) Factor slow tests out of `IndexesTests`

2023-12-25 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46504. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44485

[jira] [Assigned] (SPARK-46504) Factor slow tests out of `IndexesTests`

2023-12-25 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46504: - Assignee: Ruifeng Zheng > Factor slow tests out of `IndexesTests` >

[jira] [Updated] (SPARK-46507) Split `IndexesSlowTests` into multiple tests

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46507: --- Labels: pull-request-available (was: ) > Split `IndexesSlowTests` into multiple tests >

[jira] [Created] (SPARK-46507) Split `IndexesSlowTests` into multiple tests

2023-12-25 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46507: - Summary: Split `IndexesSlowTests` into multiple tests Key: SPARK-46507 URL: https://issues.apache.org/jira/browse/SPARK-46507 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46506) Refine docstring of `array_intersect/array_union/array_except`

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46506: --- Labels: pull-request-available (was: ) > Refine docstring of

[jira] [Created] (SPARK-46506) Refine docstring of `array_intersect/array_union/array_except`

2023-12-25 Thread Yang Jie (Jira)
Yang Jie created SPARK-46506: Summary: Refine docstring of `array_intersect/array_union/array_except` Key: SPARK-46506 URL: https://issues.apache.org/jira/browse/SPARK-46506 Project: Spark

[jira] [Resolved] (SPARK-46505) Make bytes threshold configurable in `ProtoUtils.abbreviate`

2023-12-25 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46505. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44486

[jira] [Assigned] (SPARK-46505) Make bytes threshold configurable in `ProtoUtils.abbreviate`

2023-12-25 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46505: - Assignee: Ruifeng Zheng > Make bytes threshold configurable in `ProtoUtils.abbreviate`

[jira] [Updated] (SPARK-46498) Remove an unused local variables from `o.a.spark.util.Utils#getConfiguredLocalDirs`

2023-12-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46498: - Summary: Remove an unused local variables from `o.a.spark.util.Utils#getConfiguredLocalDirs` (was:

[jira] [Resolved] (SPARK-45559) Support spark.read.schema(...) for Python data source API

2023-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45559. -- Resolution: Invalid It is supported, and I see some test cases in `PythonDataSourceSuite` >

[jira] [Updated] (SPARK-46505) Make bytes threshold configurable in `ProtoUtils.abbreviate`

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46505: --- Labels: pull-request-available (was: ) > Make bytes threshold configurable in

[jira] [Updated] (SPARK-46505) Make bytes threshold configurable in `ProtoUtils.abbreviate`

2023-12-25 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-46505: -- Summary: Make bytes threshold configurable in `ProtoUtils.abbreviate` (was: Make the bytes'

[jira] [Created] (SPARK-46505) Make the bytes' threshold configurable in `ProtoUtils.abbreviate`

2023-12-25 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46505: - Summary: Make the bytes' threshold configurable in `ProtoUtils.abbreviate` Key: SPARK-46505 URL: https://issues.apache.org/jira/browse/SPARK-46505 Project: Spark

[jira] [Updated] (SPARK-46504) Factor slow tests out of `IndexesTests`

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46504: --- Labels: pull-request-available (was: ) > Factor slow tests out of `IndexesTests` >

[jira] [Created] (SPARK-46504) Factor slow tests out of `IndexesTests`

2023-12-25 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46504: - Summary: Factor slow tests out of `IndexesTests` Key: SPARK-46504 URL: https://issues.apache.org/jira/browse/SPARK-46504 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46503) Move test_default_index to `pyspark.pandas.tests.indexes.*`

2023-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46503. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44482

[jira] [Assigned] (SPARK-46503) Move test_default_index to `pyspark.pandas.tests.indexes.*`

2023-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46503: Assignee: Ruifeng Zheng > Move test_default_index to `pyspark.pandas.tests.indexes.*` >

[jira] [Resolved] (SPARK-46501) List the python packages with the correct versions

2023-12-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46501. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44479

[jira] [Assigned] (SPARK-46501) List the python packages with the correct versions

2023-12-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46501: - Assignee: Ruifeng Zheng > List the python packages with the correct versions >

[jira] [Resolved] (SPARK-46497) Re-enable the test cases that were ignored in SPARK-45309

2023-12-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46497. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44474

[jira] [Assigned] (SPARK-46497) Re-enable the test cases that were ignored in SPARK-45309

2023-12-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46497: - Assignee: Yang Jie > Re-enable the test cases that were ignored in SPARK-45309 >

[jira] [Resolved] (SPARK-46475) Upgrade RoaringBitmap to 1.0.1

2023-12-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46475. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44439

[jira] [Resolved] (SPARK-46499) Bump sbt-eclipse 6.2.0

2023-12-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46499. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44476

[jira] [Assigned] (SPARK-46499) Bump sbt-eclipse 6.2.0

2023-12-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46499: - Assignee: Cheng Pan > Bump sbt-eclipse 6.2.0 > -- > >

[jira] [Resolved] (SPARK-46488) Skip trimAll call when doing string to timestamp

2023-12-25 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46488. -- Resolution: Fixed Issue resolved by pull request 44463 [https://github.com/apache/spark/pull/44463]

[jira] [Assigned] (SPARK-46488) Skip trimAll call when doing string to timestamp

2023-12-25 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46488: Assignee: Stefan Kandic > Skip trimAll call when doing string to timestamp >

[jira] [Resolved] (SPARK-46481) EXECUTE IMMEDIATE does not fold variables when given as parameters

2023-12-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46481. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44450

[jira] [Updated] (SPARK-46503) Move test_default_index to `pyspark.pandas.tests.indexes.*`

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46503: --- Labels: pull-request-available (was: ) > Move test_default_index to

[jira] [Created] (SPARK-46503) Move test_default_index to `pyspark.pandas.tests.indexes.*`

2023-12-25 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46503: - Summary: Move test_default_index to `pyspark.pandas.tests.indexes.*` Key: SPARK-46503 URL: https://issues.apache.org/jira/browse/SPARK-46503 Project: Spark

[jira] [Updated] (SPARK-46488) Skip trimAll call when doing string to timestamp

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46488: --- Labels: pull-request-available (was: ) > Skip trimAll call when doing string to timestamp

[jira] [Resolved] (SPARK-46500) Reorganize `FrameParityPivotTests`

2023-12-25 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46500. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44478

[jira] [Assigned] (SPARK-46500) Reorganize `FrameParityPivotTests`

2023-12-25 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46500: - Assignee: Ruifeng Zheng > Reorganize `FrameParityPivotTests` >

[jira] [Assigned] (SPARK-46502) Support timestamp types in UnwrapCastInBinaryComparison

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46502: -- Assignee: Apache Spark > Support timestamp types in UnwrapCastInBinaryComparison >

[jira] [Assigned] (SPARK-46502) Support timestamp types in UnwrapCastInBinaryComparison

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46502: -- Assignee: (was: Apache Spark) > Support timestamp types in

[jira] [Assigned] (SPARK-46502) Support timestamp types in UnwrapCastInBinaryComparison

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46502: -- Assignee: (was: Apache Spark) > Support timestamp types in

[jira] [Assigned] (SPARK-46502) Support timestamp types in UnwrapCastInBinaryComparison

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46502: -- Assignee: Apache Spark > Support timestamp types in UnwrapCastInBinaryComparison >

[jira] [Updated] (SPARK-46502) Support timestamp types in UnwrapCastInBinaryComparison

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46502: --- Labels: pull-request-available (was: ) > Support timestamp types in

[jira] [Created] (SPARK-46502) Support timestamp types in UnwrapCastInBinaryComparison

2023-12-25 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-46502: --- Summary: Support timestamp types in UnwrapCastInBinaryComparison Key: SPARK-46502 URL: https://issues.apache.org/jira/browse/SPARK-46502 Project: Spark Issue

[jira] [Assigned] (SPARK-46487) Push down part of filter through aggregate with nondeterministic field

2023-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46487: -- Assignee: (was: Apache Spark) > Push down part of filter through aggregate with