[jira] [Assigned] (SPARK-47814) Remove the `KinesisTestUtils` from `main` to `test`

[ https://issues.apache.org/jira/browse/SPARK-47814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47814: - Assignee: BingKun Pan > Remove the `KinesisTestUtils` from `main` to `test` >

[jira] [Resolved] (SPARK-47814) Remove the `KinesisTestUtils` from `main` to `test`

[ https://issues.apache.org/jira/browse/SPARK-47814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47814. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46000

[jira] [Updated] (SPARK-47777) Add spark connect test for python streaming data source

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-4: -- Component/s: Tests > Add spark connect test for python streaming data source >

[jira] [Assigned] (SPARK-47777) Add spark connect test for python streaming data source

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-4: - Assignee: Chaoqin Li > Add spark connect test for python streaming data source >

[jira] [Resolved] (SPARK-47777) Add spark connect test for python streaming data source

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-4. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45950

[jira] [Resolved] (SPARK-47820) Run `ANSI` SQL CI twice per day

[ https://issues.apache.org/jira/browse/SPARK-47820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47820. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46010

[jira] [Updated] (SPARK-47820) Run `ANSI` SQL CI twice per day

[ https://issues.apache.org/jira/browse/SPARK-47820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47820: -- Summary: Run `ANSI` SQL CI twice per day (was: Run `ANSI` SQL Daily CI twice) > Run `ANSI`

[jira] [Created] (SPARK-47820) Run `ANSI` SQL Daily CI twice

Dongjoon Hyun created SPARK-47820: - Summary: Run `ANSI` SQL Daily CI twice Key: SPARK-47820 URL: https://issues.apache.org/jira/browse/SPARK-47820 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-47820) Run `ANSI` SQL Daily CI twice

[ https://issues.apache.org/jira/browse/SPARK-47820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47820: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Run `ANSI` SQL Daily CI twice

[jira] [Updated] (SPARK-47799) Preserve parameter information when using SBT package jar

[ https://issues.apache.org/jira/browse/SPARK-47799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47799: -- Affects Version/s: 4.0.0 (was: 3.5.1) > Preserve parameter

[jira] [Resolved] (SPARK-47799) Preserve parameter information when using SBT package jar

[ https://issues.apache.org/jira/browse/SPARK-47799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47799. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45983

[jira] [Assigned] (SPARK-47799) Preserve parameter information when using SBT package jar

[ https://issues.apache.org/jira/browse/SPARK-47799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47799: - Assignee: dzcxzl > Preserve parameter information when using SBT package jar >

[jira] [Updated] (SPARK-47797) Skip deleting pod from k8s if the pod does not exists

[ https://issues.apache.org/jira/browse/SPARK-47797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47797: -- Affects Version/s: 4.0.0 (was: 3.5.1) > Skip deleting pod from k8s

[jira] [Resolved] (SPARK-47797) Skip deleting pod from k8s if the pod does not exists

[ https://issues.apache.org/jira/browse/SPARK-47797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47797. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45979

[jira] [Assigned] (SPARK-47797) Skip deleting pod from k8s if the pod does not exists

[ https://issues.apache.org/jira/browse/SPARK-47797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47797: - Assignee: leesf > Skip deleting pod from k8s if the pod does not exists >

[jira] [Assigned] (SPARK-47817) Update pandas to 2.2.2

[ https://issues.apache.org/jira/browse/SPARK-47817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47817: - Assignee: Bjørn Jørgensen > Update pandas to 2.2.2 > -- > >

[jira] [Resolved] (SPARK-47817) Update pandas to 2.2.2

[ https://issues.apache.org/jira/browse/SPARK-47817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47817. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46009

[jira] [Updated] (SPARK-46812) Make `mapInPandas` / mapInArrow` support ResourceProfile (Stage-Level scheduling)

[ https://issues.apache.org/jira/browse/SPARK-46812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46812: -- Affects Version/s: (was: 3.5.2) > Make `mapInPandas` / mapInArrow` support

[jira] (SPARK-44478) Executor decommission causes stage failure

[ https://issues.apache.org/jira/browse/SPARK-44478 ] Dongjoon Hyun deleted comment on SPARK-44478: --- was (Author: dongjoon): Ya, it's difficult to reproduce. BTW, could you try 3.4.2, [~juhai], because SPARK-44630 is in Apache Spark 3.4.2

[jira] [Commented] (SPARK-44478) Executor decommission causes stage failure

[ https://issues.apache.org/jira/browse/SPARK-44478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835831#comment-17835831 ] Dongjoon Hyun commented on SPARK-44478: --- Ya, it's difficult to reproduce. BTW, could you try

[jira] [Updated] (SPARK-47790) Upgrade `commons-io` to 2.16.1

[ https://issues.apache.org/jira/browse/SPARK-47790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47790: -- Fix Version/s: 3.5.2 > Upgrade `commons-io` to 2.16.1 > -- > >

[jira] [Resolved] (SPARK-47790) Upgrade `commons-io` to 2.16.1

[ https://issues.apache.org/jira/browse/SPARK-47790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47790. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45973

[jira] [Resolved] (SPARK-47706) Bump json4s 4.0.7

[ https://issues.apache.org/jira/browse/SPARK-47706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47706. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45838

[jira] [Updated] (SPARK-45444) Upgrade `commons-io` to 2.14.0

[ https://issues.apache.org/jira/browse/SPARK-45444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45444: -- Summary: Upgrade `commons-io` to 2.14.0 (was: Upgrade `commons-io` to 1.24.0) > Upgrade

[jira] [Updated] (SPARK-45444) Upgrade `commons-io` to 1.24.0

[ https://issues.apache.org/jira/browse/SPARK-45444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45444: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade `commons-io`

[jira] [Updated] (SPARK-45734) Upgrade commons-io to 2.15.0

[ https://issues.apache.org/jira/browse/SPARK-45734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45734: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade commons-io to

[jira] [Updated] (SPARK-47083) Upgrade `commons-codec` to 1.16.1

[ https://issues.apache.org/jira/browse/SPARK-47083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47083: -- Fix Version/s: 3.5.2 > Upgrade `commons-codec` to 1.16.1 > -

[jira] [Updated] (SPARK-47182) Exclude `commons-(io|lang3)` transitive dependencies from `commons-compress` and `avro-*`

[ https://issues.apache.org/jira/browse/SPARK-47182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47182: -- Fix Version/s: 3.5.2 > Exclude `commons-(io|lang3)` transitive dependencies from

[jira] [Resolved] (SPARK-47787) Upgrade `commons-compress` to 1.26.1`

[ https://issues.apache.org/jira/browse/SPARK-47787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47787. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45966

[jira] [Updated] (SPARK-47787) Upgrade `commons-compress` to 1.26.1`

[ https://issues.apache.org/jira/browse/SPARK-47787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47787: -- Summary: Upgrade `commons-compress` to 1.26.1` (was: Upgrade `commons-compress` to 1.26.`)

[jira] [Created] (SPARK-47787) Upgrade `commons-compress` to 1.26.`

Dongjoon Hyun created SPARK-47787: - Summary: Upgrade `commons-compress` to 1.26.` Key: SPARK-47787 URL: https://issues.apache.org/jira/browse/SPARK-47787 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47785) Upgrade `bouncycastle` to 1.78

Dongjoon Hyun created SPARK-47785: - Summary: Upgrade `bouncycastle` to 1.78 Key: SPARK-47785 URL: https://issues.apache.org/jira/browse/SPARK-47785 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47748) Upgrade `zstd-jni` to 1.5.6-2

[ https://issues.apache.org/jira/browse/SPARK-47748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47748: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade `zstd-jni` to

[jira] [Assigned] (SPARK-47782) Remove redundant json4s-jackson definition in sql/api POM

[ https://issues.apache.org/jira/browse/SPARK-47782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47782: - Assignee: Cheng Pan (was: Dongjoon Hyun) > Remove redundant json4s-jackson definition

[jira] [Assigned] (SPARK-47782) Remove redundant json4s-jackson definition in sql/api POM

[ https://issues.apache.org/jira/browse/SPARK-47782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47782: - Assignee: Dongjoon Hyun > Remove redundant json4s-jackson definition in sql/api POM >

[jira] [Resolved] (SPARK-47782) Remove redundant json4s-jackson definition in sql/api POM

[ https://issues.apache.org/jira/browse/SPARK-47782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47782. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45943

[jira] [Updated] (SPARK-47782) Remove redundant json4s-jackson definition in sql/api POM

[ https://issues.apache.org/jira/browse/SPARK-47782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47782: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Task) > Remove redundant

[jira] [Created] (SPARK-47782) Remove redundant json4s-jackson definition in sql/api POM

Dongjoon Hyun created SPARK-47782: - Summary: Remove redundant json4s-jackson definition in sql/api POM Key: SPARK-47782 URL: https://issues.apache.org/jira/browse/SPARK-47782 Project: Spark

[jira] [Updated] (SPARK-47774) Remove redundant rules from `MimaExcludes`

[ https://issues.apache.org/jira/browse/SPARK-47774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47774: -- Fix Version/s: 3.4.3 > Remove redundant rules from `MimaExcludes` >

[jira] [Updated] (SPARK-47774) Remove redundant rules from `MimaExcludes`

[ https://issues.apache.org/jira/browse/SPARK-47774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47774: -- Fix Version/s: 3.5.2 > Remove redundant rules from `MimaExcludes` >

[jira] [Resolved] (SPARK-47774) Remove redundant rules from `MimaExcludes`

[ https://issues.apache.org/jira/browse/SPARK-47774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47774. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45944

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47773: -- Affects Version/s: 4.0.0 (was: 3.5.1) > Enhancing the Flexibility

[jira] [Commented] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835181#comment-17835181 ] Dongjoon Hyun commented on SPARK-47773: --- Since this is a new feature which cannot affect old

[jira] [Resolved] (SPARK-47754) Postgres: Support reading multidimensional arrays

[ https://issues.apache.org/jira/browse/SPARK-47754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47754. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45917

[jira] [Created] (SPARK-47774) Remove redundant rules from `MimaExcludes`

Dongjoon Hyun created SPARK-47774: - Summary: Remove redundant rules from `MimaExcludes` Key: SPARK-47774 URL: https://issues.apache.org/jira/browse/SPARK-47774 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

[ https://issues.apache.org/jira/browse/SPARK-47770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47770: -- Fix Version/s: 3.5.2 3.4.3 > Fix

[jira] [Updated] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

[ https://issues.apache.org/jira/browse/SPARK-47770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47770: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Fix

[jira] [Assigned] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

[ https://issues.apache.org/jira/browse/SPARK-47770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47770: - Assignee: Dongjoon Hyun > Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return

[jira] [Created] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

Dongjoon Hyun created SPARK-47770: - Summary: Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing Key: SPARK-47770 URL: https://issues.apache.org/jira/browse/SPARK-47770

[jira] [Resolved] (SPARK-47737) Bump PyArrow to 10.0.0

[ https://issues.apache.org/jira/browse/SPARK-47737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47737. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45892

[jira] [Updated] (SPARK-47737) Bump PyArrow to 10.0.0

[ https://issues.apache.org/jira/browse/SPARK-47737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47737: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Bump PyArrow to 10.0.0 >

[jira] [Assigned] (SPARK-47737) Bump PyArrow to 10.0.0

[ https://issues.apache.org/jira/browse/SPARK-47737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47737: - Assignee: Haejoon Lee > Bump PyArrow to 10.0.0 > -- > >

[jira] [Assigned] (SPARK-47725) Set up the CI for pyspark-connect package

[ https://issues.apache.org/jira/browse/SPARK-47725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47725: - Assignee: Hyukjin Kwon > Set up the CI for pyspark-connect package >

[jira] [Resolved] (SPARK-47725) Set up the CI for pyspark-connect package

[ https://issues.apache.org/jira/browse/SPARK-47725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47725. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45870

[jira] [Commented] (SPARK-47318) AuthEngine key exchange needs additional KDF round

[ https://issues.apache.org/jira/browse/SPARK-47318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834987#comment-17834987 ] Dongjoon Hyun commented on SPARK-47318: --- I added a target version (3.4.3) based on the dev mailing

[jira] [Updated] (SPARK-47318) AuthEngine key exchange needs additional KDF round

[ https://issues.apache.org/jira/browse/SPARK-47318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47318: -- Target Version/s: 3.4.3 > AuthEngine key exchange needs additional KDF round >

[jira] [Assigned] (SPARK-47709) Upgrade tink to 1.13.0

[ https://issues.apache.org/jira/browse/SPARK-47709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47709: - Assignee: Yang Jie > Upgrade tink to 1.13.0 > -- > >

[jira] [Resolved] (SPARK-47709) Upgrade tink to 1.13.0

[ https://issues.apache.org/jira/browse/SPARK-47709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47709. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45843

[jira] [Assigned] (SPARK-47727) Make SparkConf to root level to for both SparkSession and SparkContext

[ https://issues.apache.org/jira/browse/SPARK-47727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47727: - Assignee: Hyukjin Kwon > Make SparkConf to root level to for both SparkSession and

[jira] [Resolved] (SPARK-47727) Make SparkConf to root level to for both SparkSession and SparkContext

[ https://issues.apache.org/jira/browse/SPARK-47727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47727. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45873

[jira] [Updated] (SPARK-47719) Change default of spark.sql.legacy.timeParserPolicy from EXCEPTION to CORRECTED

[ https://issues.apache.org/jira/browse/SPARK-47719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47719: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Change default of

[jira] [Updated] (SPARK-45445) Upgrade snappy to 1.1.10.5

[ https://issues.apache.org/jira/browse/SPARK-45445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45445: -- Fix Version/s: 3.4.3 > Upgrade snappy to 1.1.10.5 > -- > >

[jira] [Updated] (SPARK-45445) Upgrade snappy to 1.1.10.5

[ https://issues.apache.org/jira/browse/SPARK-45445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45445: -- Fix Version/s: 3.5.2 > Upgrade snappy to 1.1.10.5 > -- > >

[jira] [Updated] (SPARK-46411) Change to use bcprov/bcpkix-jdk18on for test

[ https://issues.apache.org/jira/browse/SPARK-46411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46411: -- Fix Version/s: 3.4.3 > Change to use bcprov/bcpkix-jdk18on for test >

[jira] [Updated] (SPARK-46411) Change to use bcprov/bcpkix-jdk18on for test

[ https://issues.apache.org/jira/browse/SPARK-46411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46411: -- Fix Version/s: 3.5.2 > Change to use bcprov/bcpkix-jdk18on for test >

[jira] [Updated] (SPARK-45445) Upgrade snappy to 1.1.10.5

[ https://issues.apache.org/jira/browse/SPARK-45445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45445: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade snappy to

[jira] [Updated] (SPARK-45323) Upgrade snappy to 1.1.10.4

[ https://issues.apache.org/jira/browse/SPARK-45323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45323: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Dependency upgrade) > Upgrade snappy

[jira] [Updated] (SPARK-45172) Upgrade commons-compress.version to 1.24.0

[ https://issues.apache.org/jira/browse/SPARK-45172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45172: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade

[jira] [Updated] (SPARK-44393) Upgrade H2 from 2.1.214 to 2.2.220

[ https://issues.apache.org/jira/browse/SPARK-44393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44393: -- Fix Version/s: 3.4.3 > Upgrade H2 from 2.1.214 to 2.2.220 >

[jira] [Updated] (SPARK-44279) Upgrade optionator to ^0.9.3

[ https://issues.apache.org/jira/browse/SPARK-44279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44279: -- Fix Version/s: 3.5.0 > Upgrade optionator to ^0.9.3 > > >

[jira] [Resolved] (SPARK-47735) Make pyspark.testing.connectutils compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47735. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45887

[jira] [Assigned] (SPARK-47735) Make pyspark.testing.connectutils compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47735: - Assignee: Hyukjin Kwon > Make pyspark.testing.connectutils compatible with

[jira] [Resolved] (SPARK-47728) Document G1 Concurrent GC metrics

[ https://issues.apache.org/jira/browse/SPARK-47728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47728. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45874

[jira] [Assigned] (SPARK-47728) Document G1 Concurrent GC metrics

[ https://issues.apache.org/jira/browse/SPARK-47728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47728: - Assignee: Luca Canali > Document G1 Concurrent GC metrics >

[jira] [Resolved] (SPARK-47729) Get the proper default port for pyspark-connect testcases

[ https://issues.apache.org/jira/browse/SPARK-47729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47729. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45875

[jira] [Assigned] (SPARK-47720) Update `spark.speculation.multiplier` to 3 and `spark.speculation.quantile` to 0.9

[ https://issues.apache.org/jira/browse/SPARK-47720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47720: - Assignee: Dongjoon Hyun > Update `spark.speculation.multiplier` to 3 and

[jira] [Resolved] (SPARK-47720) Update `spark.speculation.multiplier` to 3 and `spark.speculation.quantile` to 0.9

[ https://issues.apache.org/jira/browse/SPARK-47720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47720. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45858

[jira] [Assigned] (SPARK-47710) Postgres: Document Mapping Spark SQL Data Types from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-47710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47710: - Assignee: Kent Yao > Postgres: Document Mapping Spark SQL Data Types from PostgreSQL >

[jira] [Resolved] (SPARK-47710) Postgres: Document Mapping Spark SQL Data Types from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-47710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47710. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45845

[jira] [Updated] (SPARK-47714) Set spark.sql.legacy.timeParserPolicy to CORRECTED by default

[ https://issues.apache.org/jira/browse/SPARK-47714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47714: -- Summary: Set spark.sql.legacy.timeParserPolicy to CORRECTED by default (was: set

[jira] [Resolved] (SPARK-47711) Parameterize JDBC Drivers for docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-47711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47711. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45847

[jira] [Resolved] (SPARK-47691) Postgres: Support multi dimensional array on the write side

[ https://issues.apache.org/jira/browse/SPARK-47691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47691. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45815

[jira] [Assigned] (SPARK-47691) Postgres: Support multi dimensional array on the write side

[ https://issues.apache.org/jira/browse/SPARK-47691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47691: - Assignee: Kent Yao > Postgres: Support multi dimensional array on the write side >

[jira] [Resolved] (SPARK-47697) Add scala style check for invalid MDC usage

[ https://issues.apache.org/jira/browse/SPARK-47697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47697. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45823

[jira] [Updated] (SPARK-46793) Revert S3A endpoint fixup logic of SPARK-35878

[ https://issues.apache.org/jira/browse/SPARK-46793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46793: -- Parent: (was: SPARK-44124) Issue Type: Bug (was: Sub-task) > Revert S3A endpoint

[jira] [Created] (SPARK-47695) Update AWS SDK v2 to 2.24.6

Dongjoon Hyun created SPARK-47695: - Summary: Update AWS SDK v2 to 2.24.6 Key: SPARK-47695 URL: https://issues.apache.org/jira/browse/SPARK-47695 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-47686) Use `=!=` instead of `!==` in `JoinHintSuite`

[ https://issues.apache.org/jira/browse/SPARK-47686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47686: - Assignee: Yang Jie > Use `=!=` instead of `!==` in `JoinHintSuite` >

[jira] [Resolved] (SPARK-47686) Use `=!=` instead of `!==` in `JoinHintSuite`

[ https://issues.apache.org/jira/browse/SPARK-47686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47686. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45812

[jira] [Resolved] (SPARK-47679) Use `HiveConf.getConfVars` or Hive conf names directly

[ https://issues.apache.org/jira/browse/SPARK-47679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47679. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45804

[jira] [Updated] (SPARK-47679) Use `HiveConf.getConfVars` or Hive conf names directly

[ https://issues.apache.org/jira/browse/SPARK-47679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47679: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Use

[jira] [Created] (SPARK-47679) Use `HiveConf.getConfVars` or Hive conf names directly

Dongjoon Hyun created SPARK-47679: - Summary: Use `HiveConf.getConfVars` or Hive conf names directly Key: SPARK-47679 URL: https://issues.apache.org/jira/browse/SPARK-47679 Project: Spark

[jira] [Resolved] (SPARK-47676) Clean up the removed `VersionsSuite` references

[ https://issues.apache.org/jira/browse/SPARK-47676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47676. --- Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution:

[jira] [Assigned] (SPARK-47676) Clean up the removed `VersionsSuite` references

[ https://issues.apache.org/jira/browse/SPARK-47676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47676: - Assignee: Dongjoon Hyun > Clean up the removed `VersionsSuite` references >

[jira] [Created] (SPARK-47676) Clean up the removed `VersionsSuite` references

Dongjoon Hyun created SPARK-47676: - Summary: Clean up the removed `VersionsSuite` references Key: SPARK-47676 URL: https://issues.apache.org/jira/browse/SPARK-47676 Project: Spark Issue

[jira] [Resolved] (SPARK-47675) Use AWS SDK v2 2.23.19 in K8s IT

[ https://issues.apache.org/jira/browse/SPARK-47675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47675. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45799

[jira] [Updated] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47556: -- Fix Version/s: (was: SPARK-36014) > [K8] Spark App ID collision resulting in deleting

[jira] [Closed] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-47556. - > [K8] Spark App ID collision resulting in deleting wrong resources >

[jira] [Resolved] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47556. --- Fix Version/s: SPARK-36014 Resolution: Duplicate > [K8] Spark App ID collision

[jira] [Updated] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47556: -- Fix Version/s: (was: 3.3.0) > [K8] Spark App ID collision resulting in deleting wrong

[jira] [Reopened] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-47556: --- > [K8] Spark App ID collision resulting in deleting wrong resources >

<    3   4   5   6   7   8   9   10   11   12   >