[jira] [Created] (SPARK-48171) Clean up the use of deprecated APIs related to `o.rocksdb.Logger`

2024-05-07 Thread Yang Jie (Jira)
Yang Jie created SPARK-48171: Summary: Clean up the use of deprecated APIs related to `o.rocksdb.Logger` Key: SPARK-48171 URL: https://issues.apache.org/jira/browse/SPARK-48171 Project: Spark

[jira] [Resolved] (SPARK-48138) Disable a flaky `SparkSessionE2ESuite.interrupt tag` test

2024-05-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48138. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46396

[jira] [Assigned] (SPARK-48138) Disable a flaky `SparkSessionE2ESuite.interrupt tag` test

2024-05-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-48138: Assignee: Dongjoon Hyun > Disable a flaky `SparkSessionE2ESuite.interrupt tag` test >

[jira] [Created] (SPARK-48001) Remove unused `private implicit def arrayToArrayWritable` from `SparkContext`

2024-04-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-48001: Summary: Remove unused `private implicit def arrayToArrayWritable` from `SparkContext` Key: SPARK-48001 URL: https://issues.apache.org/jira/browse/SPARK-48001 Project: Spark

[jira] [Created] (SPARK-47984) Change `MetricsAggregate/V2Aggregator`'s `serialize/deserialize` to call `SparkSerDeUtils`'s `serialize/deserialize` methods.

2024-04-25 Thread Yang Jie (Jira)
Yang Jie created SPARK-47984: Summary: Change `MetricsAggregate/V2Aggregator`'s `serialize/deserialize` to call `SparkSerDeUtils`'s `serialize/deserialize` methods. Key: SPARK-47984 URL:

[jira] [Resolved] (SPARK-47928) Speed up test "Add jar support Ivy URI in SQL"

2024-04-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47928. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46150

[jira] [Assigned] (SPARK-47928) Speed up test "Add jar support Ivy URI in SQL"

2024-04-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-47928: Assignee: Cheng Pan > Speed up test "Add jar support Ivy URI in SQL" >

[jira] [Resolved] (SPARK-47932) Avoid using legacy commons-lang

2024-04-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47932. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46154

[jira] [Assigned] (SPARK-47901) Upgrade commons-text to 1.12.0

2024-04-18 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-47901: Assignee: Yang Jie > Upgrade commons-text to 1.12.0 > -- > >

[jira] [Resolved] (SPARK-47901) Upgrade commons-text to 1.12.0

2024-04-18 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47901. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46127

[jira] [Created] (SPARK-47901) UPgrade commons-text to 1.12.0

2024-04-18 Thread Yang Jie (Jira)
Yang Jie created SPARK-47901: Summary: UPgrade commons-text to 1.12.0 Key: SPARK-47901 URL: https://issues.apache.org/jira/browse/SPARK-47901 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47901) Upgrade commons-text to 1.12.0

2024-04-18 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-47901: - Summary: Upgrade commons-text to 1.12.0 (was: UPgrade commons-text to 1.12.0) > Upgrade commons-text

[jira] [Assigned] (SPARK-47850) Support converting insert for unpartitioned Hive table

2024-04-18 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-47850: Assignee: Cheng Pan > Support converting insert for unpartitioned Hive table >

[jira] [Resolved] (SPARK-47850) Support converting insert for unpartitioned Hive table

2024-04-18 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47850. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46052

[jira] [Created] (SPARK-47887) Remove unused import `spark/connect/common.proto` from `spark/connect/relations.proto`

2024-04-17 Thread Yang Jie (Jira)
Yang Jie created SPARK-47887: Summary: Remove unused import `spark/connect/common.proto` from `spark/connect/relations.proto` Key: SPARK-47887 URL: https://issues.apache.org/jira/browse/SPARK-47887

[jira] [Created] (SPARK-47834) Mark deprecated functions with `@deprecated` in `SQLImplicits`

2024-04-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-47834: Summary: Mark deprecated functions with `@deprecated` in `SQLImplicits` Key: SPARK-47834 URL: https://issues.apache.org/jira/browse/SPARK-47834 Project: Spark

[jira] [Resolved] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

2024-04-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47770. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45938

[jira] [Created] (SPARK-47709) Upgrade tink to 1.13.0

2024-04-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-47709: Summary: Upgrade tink to 1.13.0 Key: SPARK-47709 URL: https://issues.apache.org/jira/browse/SPARK-47709 Project: Spark Issue Type: Improvement Components:

[jira] [Assigned] (SPARK-47685) Should restore the handling of `Stream` in `RelationalGroupedDataset#toDF`

2024-04-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-47685: Assignee: Yang Jie > Should restore the handling of `Stream` in `RelationalGroupedDataset#toDF`

[jira] [Resolved] (SPARK-47685) Should restore the handling of `Stream` in `RelationalGroupedDataset#toDF`

2024-04-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47685. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45811

[jira] [Created] (SPARK-47686) Use `=!=` instead of `!==` in `JoinHintSuite`

2024-04-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-47686: Summary: Use `=!=` instead of `!==` in `JoinHintSuite` Key: SPARK-47686 URL: https://issues.apache.org/jira/browse/SPARK-47686 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47685) Should restore the handling of `Stream` in `RelationalGroupedDataset#toDF`

2024-04-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-47685: - Summary: Should restore the handling of `Stream` in `RelationalGroupedDataset#toDF` (was: Restore the

[jira] [Created] (SPARK-47685) Restore the handling of `Stream` in `RelationalGroupedDataset#toDF`

2024-04-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-47685: Summary: Restore the handling of `Stream` in `RelationalGroupedDataset#toDF` Key: SPARK-47685 URL: https://issues.apache.org/jira/browse/SPARK-47685 Project: Spark

[jira] [Updated] (SPARK-45593) Building a runnable distribution from master code running spark-sql raise error "java.lang.ClassNotFoundException: org.sparkproject.guava.util.concurrent.internal.Intern

2024-04-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45593: - Affects Version/s: 3.5.1 > Building a runnable distribution from master code running spark-sql raise >

[jira] [Updated] (SPARK-45593) Building a runnable distribution from master code running spark-sql raise error "java.lang.ClassNotFoundException: org.sparkproject.guava.util.concurrent.internal.Intern

2024-04-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45593: - Fix Version/s: 3.5.2 > Building a runnable distribution from master code running spark-sql raise >

[jira] [Updated] (SPARK-47645) Make Spark build with -release instead of -target

2024-03-29 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-47645: - Description: https://github.com/scala/scala/pull/9982 > Make Spark build with -release instead of

[jira] [Created] (SPARK-47645) Make Spark build with -release instead of -target

2024-03-29 Thread Yang Jie (Jira)
Yang Jie created SPARK-47645: Summary: Make Spark build with -release instead of -target Key: SPARK-47645 URL: https://issues.apache.org/jira/browse/SPARK-47645 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47629) Add `common/variant` and `connector/kinesis-asl` to maven daily test module list

2024-03-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47629. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45754

[jira] [Assigned] (SPARK-47629) Add `common/variant` and `connector/kinesis-asl` to maven daily test module list

2024-03-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-47629: Assignee: Yang Jie > Add `common/variant` and `connector/kinesis-asl` to maven daily test module

[jira] [Updated] (SPARK-47642) Exclude `org.junit.jupiter` and `org.junit.platform` from `jmock-junit5`

2024-03-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-47642: - Summary: Exclude `org.junit.jupiter` and `org.junit.platform` from `jmock-junit5` (was: Exclude

[jira] [Created] (SPARK-47642) Exclude `junit-jupiter-api` and `org.junit.platform` from `jmock-junit5`

2024-03-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-47642: Summary: Exclude `junit-jupiter-api` and `org.junit.platform` from `jmock-junit5` Key: SPARK-47642 URL: https://issues.apache.org/jira/browse/SPARK-47642 Project: Spark

[jira] [Updated] (SPARK-47629) Add `common/variant` and `connector/kinesis-asl` to maven daily test module list

2024-03-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-47629: - Summary: Add `common/variant` and `connector/kinesis-asl` to maven daily test module list (was: Add

[jira] [Created] (SPARK-47629) Add `common/variant` to maven daily test module list

2024-03-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-47629: Summary: Add `common/variant` to maven daily test module list Key: SPARK-47629 URL: https://issues.apache.org/jira/browse/SPARK-47629 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47610) Always set io.netty.tryReflectionSetAccessible=true

2024-03-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47610. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45733

[jira] [Assigned] (SPARK-47610) Always set io.netty.tryReflectionSetAccessible=true

2024-03-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-47610: Assignee: Cheng Pan > Always set io.netty.tryReflectionSetAccessible=true >

[jira] [Created] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1

2024-03-24 Thread Yang Jie (Jira)
Yang Jie created SPARK-47536: Summary: Upgrade jmock-junit5 to 2.13.1 Key: SPARK-47536 URL: https://issues.apache.org/jira/browse/SPARK-47536 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47523) Replace Deprecated `JsonParser#getCurrentName` with `JsonParser#currentName`

2024-03-22 Thread Yang Jie (Jira)
Yang Jie created SPARK-47523: Summary: Replace Deprecated `JsonParser#getCurrentName` with `JsonParser#currentName` Key: SPARK-47523 URL: https://issues.apache.org/jira/browse/SPARK-47523 Project: Spark

[jira] [Assigned] (SPARK-46920) Improve executor exit error message on YARN

2024-03-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46920: Assignee: Cheng Pan > Improve executor exit error message on YARN >

[jira] [Resolved] (SPARK-46920) Improve executor exit error message on YARN

2024-03-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46920. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44951

[jira] [Created] (SPARK-47486) Remove unused private method `getString` from `ArrowDeserializers`

2024-03-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-47486: Summary: Remove unused private method `getString` from `ArrowDeserializers` Key: SPARK-47486 URL: https://issues.apache.org/jira/browse/SPARK-47486 Project: Spark

[jira] [Resolved] (SPARK-47455) Fix Resource Handling of `scalaStyleOnCompileConfig` in SparkBuild.scala

2024-03-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47455. -- Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-47455) Fix Resource Handling of `scalaStyleOnCompileConfig` in SparkBuild.scala

2024-03-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-47455: Assignee: Yang Jie > Fix Resource Handling of `scalaStyleOnCompileConfig` in SparkBuild.scala >

[jira] [Created] (SPARK-47474) Revert change of SPARK-47461 and add some comments

2024-03-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-47474: Summary: Revert change of SPARK-47461 and add some comments Key: SPARK-47474 URL: https://issues.apache.org/jira/browse/SPARK-47474 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47461) Remove unused private function `totalRunningTasksPerResourceProfile` from `ExecutorAllocationManager`

2024-03-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-47461: - Summary: Remove unused private function `totalRunningTasksPerResourceProfile` from

[jira] [Created] (SPARK-47461) Remove the unused private function `totalRunningTasksPerResourceProfile` from `ExecutorAllocationManager`

2024-03-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-47461: Summary: Remove the unused private function `totalRunningTasksPerResourceProfile` from `ExecutorAllocationManager` Key: SPARK-47461 URL: https://issues.apache.org/jira/browse/SPARK-47461

[jira] [Created] (SPARK-47455) Fix Resource Handling of `scalaStyleOnCompileConfig` in SparkBuild.scala

2024-03-18 Thread Yang Jie (Jira)
Yang Jie created SPARK-47455: Summary: Fix Resource Handling of `scalaStyleOnCompileConfig` in SparkBuild.scala Key: SPARK-47455 URL: https://issues.apache.org/jira/browse/SPARK-47455 Project: Spark

[jira] [Commented] (SPARK-47369) Fix performance regression in JDK 17 caused from RocksDB logging

2024-03-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825945#comment-17825945 ] Yang Jie commented on SPARK-47369: -- >From the current Spark code, it appears that the {{Logger}} is

[jira] [Created] (SPARK-47278) Upgrade rocksdbjni to 8.11.3

2024-03-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-47278: Summary: Upgrade rocksdbjni to 8.11.3 Key: SPARK-47278 URL: https://issues.apache.org/jira/browse/SPARK-47278 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47269) Upgrade jetty to 11.0.20

2024-03-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-47269: Summary: Upgrade jetty to 11.0.20 Key: SPARK-47269 URL: https://issues.apache.org/jira/browse/SPARK-47269 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-44173) Make Spark an sbt build only project

2024-03-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822747#comment-17822747 ] Yang Jie commented on SPARK-44173: -- Hi, [~dongjoon] ~ Sorry, I missed the previous message. This Jira

[jira] [Created] (SPARK-47243) Correct the package name of `StateMetadataSource.scala`

2024-02-29 Thread Yang Jie (Jira)
Yang Jie created SPARK-47243: Summary: Correct the package name of `StateMetadataSource.scala` Key: SPARK-47243 URL: https://issues.apache.org/jira/browse/SPARK-47243 Project: Spark Issue Type:

[jira] [Created] (SPARK-47229) Change the never changed 'var' to 'val'

2024-02-29 Thread Yang Jie (Jira)
Yang Jie created SPARK-47229: Summary: Change the never changed 'var' to 'val' Key: SPARK-47229 URL: https://issues.apache.org/jira/browse/SPARK-47229 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46919) Upgrade `grpcio*` and `grpc-java` to 1.62

2024-02-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46919: - Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade `grpcio*` and

[jira] [Updated] (SPARK-46919) Upgrade `grpcio*` and `grpc-java` to 1.62

2024-02-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46919: - Summary: Upgrade `grpcio*` and `grpc-java` to 1.62 (was: Upgrade `grpcio*` to 1.60.0 and `grpc-java`

[jira] [Created] (SPARK-47209) Upgrade slf4j to 2.0.12

2024-02-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-47209: Summary: Upgrade slf4j to 2.0.12 Key: SPARK-47209 URL: https://issues.apache.org/jira/browse/SPARK-47209 Project: Spark Issue Type: Sub-task Components:

[jira] [Comment Edited] (SPARK-47194) Upgrade log4j2 to 2.23.0

2024-02-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821543#comment-17821543 ] Yang Jie edited comment on SPARK-47194 at 2/28/24 7:19 AM: --- It seems that the

[jira] [Resolved] (SPARK-47194) Upgrade log4j2 to 2.23.0

2024-02-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47194. -- Resolution: Won't Fix It seems that the `-Dlog4j2.debug` option may not be working in 2.23.0, perhaps

[jira] [Created] (SPARK-47194) Upgrade log4j2 to 2.23.0

2024-02-27 Thread Yang Jie (Jira)
Yang Jie created SPARK-47194: Summary: Upgrade log4j2 to 2.23.0 Key: SPARK-47194 URL: https://issues.apache.org/jira/browse/SPARK-47194 Project: Spark Issue Type: Sub-task Components:

[jira] [Resolved] (SPARK-47100) Upgrade netty to 4.1.107.Final and netty-tcnative to 2.0.62.Final

2024-02-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47100. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45178

[jira] [Commented] (SPARK-47089) Migrate mockito 4 to mockito5

2024-02-18 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818338#comment-17818338 ] Yang Jie commented on SPARK-47089: -- Thanks [~panbingkun]  > Migrate mockito 4 to mockito5 >

[jira] [Created] (SPARK-47089) Migrate mockito 4 to mockito5

2024-02-18 Thread Yang Jie (Jira)
Yang Jie created SPARK-47089: Summary: Migrate mockito 4 to mockito5 Key: SPARK-47089 URL: https://issues.apache.org/jira/browse/SPARK-47089 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-47084) Upgrade joda-time to 2.12.7

2024-02-18 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47084. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45153

[jira] [Resolved] (SPARK-47073) Upgrade several Maven plugins to the latest versions

2024-02-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47073. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45136

[jira] [Assigned] (SPARK-47025) Switch `Guava 19.0` dependency scope from `provided` to `test`

2024-02-12 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-47025: Assignee: Dongjoon Hyun > Switch `Guava 19.0` dependency scope from `provided` to `test` >

[jira] [Resolved] (SPARK-47025) Switch `Guava 19.0` dependency scope from `provided` to `test`

2024-02-12 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47025. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45088

[jira] [Commented] (SPARK-47016) Upgrade scalatest related dependencies to the 3.2.18 series

2024-02-09 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17816030#comment-17816030 ] Yang Jie commented on SPARK-47016: -- It seems that for `org.scalatestplus:mockito` corresponding to

[jira] [Created] (SPARK-47016) Upgrade scalatest related dependencies to the 3.2.18 series

2024-02-09 Thread Yang Jie (Jira)
Yang Jie created SPARK-47016: Summary: Upgrade scalatest related dependencies to the 3.2.18 series Key: SPARK-47016 URL: https://issues.apache.org/jira/browse/SPARK-47016 Project: Spark Issue

[jira] [Updated] (SPARK-47006) Refactor refill() method to isExhausted() in NioBufferedFileInputStream

2024-02-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-47006: - Description: Currently, in NioBufferedFileInputStream, the refill() method is always invoked in a

[jira] [Created] (SPARK-47006) Refactor refill() method to isExhausted() in NioBufferedFileInputStream

2024-02-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-47006: Summary: Refactor refill() method to isExhausted() in NioBufferedFileInputStream Key: SPARK-47006 URL: https://issues.apache.org/jira/browse/SPARK-47006 Project: Spark

[jira] [Assigned] (SPARK-46615) Support s.c.immutable.ArraySeq in ArrowDeserializers

2024-02-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46615: Assignee: BingKun Pan > Support s.c.immutable.ArraySeq in ArrowDeserializers >

[jira] [Resolved] (SPARK-46615) Support s.c.immutable.ArraySeq in ArrowDeserializers

2024-02-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46615. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44618

[jira] [Assigned] (SPARK-47005) Refine docstring of `asc_nulls_first/asc_nulls_last/desc_nulls_first/desc_nulls_last`

2024-02-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-47005: Assignee: Yang Jie > Refine docstring of >

[jira] [Resolved] (SPARK-47005) Refine docstring of `asc_nulls_first/asc_nulls_last/desc_nulls_first/desc_nulls_last`

2024-02-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47005. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45066

[jira] [Created] (SPARK-47005) Refine docstring of `asc_nulls_first/asc_nulls_last/desc_nulls_first/desc_nulls_last`

2024-02-07 Thread Yang Jie (Jira)
Yang Jie created SPARK-47005: Summary: Refine docstring of `asc_nulls_first/asc_nulls_last/desc_nulls_first/desc_nulls_last` Key: SPARK-47005 URL: https://issues.apache.org/jira/browse/SPARK-47005

[jira] [Assigned] (SPARK-46987) ProtoUtils.abbreviate avoid unnecessary setField

2024-02-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46987: Assignee: Ruifeng Zheng > ProtoUtils.abbreviate avoid unnecessary setField >

[jira] [Resolved] (SPARK-46987) ProtoUtils.abbreviate avoid unnecessary setField

2024-02-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46987. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45045

[jira] [Resolved] (SPARK-46895) Replace Timer with single thread scheduled executor

2024-02-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46895. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44718

[jira] [Created] (SPARK-46978) Refine docstring of `sum_distinct/array_agg/count_if`

2024-02-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-46978: Summary: Refine docstring of `sum_distinct/array_agg/count_if` Key: SPARK-46978 URL: https://issues.apache.org/jira/browse/SPARK-46978 Project: Spark Issue Type:

[jira] [Commented] (SPARK-44319) Migrate jersey 2 to jersey 3

2024-02-03 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814041#comment-17814041 ] Yang Jie commented on SPARK-44319: -- done > Migrate jersey 2 to jersey 3 >

[jira] [Created] (SPARK-46970) Rewrite `OpenHashSet#hasher` with pattern matching

2024-02-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-46970: Summary: Rewrite `OpenHashSet#hasher` with pattern matching Key: SPARK-46970 URL: https://issues.apache.org/jira/browse/SPARK-46970 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46969) Recover `to_timestamp('366', 'DD')` test case in `datetime-parsing-invalid.sql`

2024-02-03 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46969. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45011

[jira] [Assigned] (SPARK-46969) Recover `to_timestamp('366', 'DD')` test case in `datetime-parsing-invalid.sql`

2024-02-03 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46969: Assignee: Dongjoon Hyun > Recover `to_timestamp('366', 'DD')` test case in >

[jira] [Created] (SPARK-46939) Simplify IndylambdaScalaClosures#getSerializationProxy

2024-01-31 Thread Yang Jie (Jira)
Yang Jie created SPARK-46939: Summary: Simplify IndylambdaScalaClosures#getSerializationProxy Key: SPARK-46939 URL: https://issues.apache.org/jira/browse/SPARK-46939 Project: Spark Issue Type:

[jira] [Commented] (SPARK-45522) Migrate jetty 9 to jetty 10

2024-01-31 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813043#comment-17813043 ] Yang Jie commented on SPARK-45522: -- [~HF] I have created SPARK-46938, we can use this ticket to

[jira] [Created] (SPARK-46938) Migrate jetty 10 to jetty 11

2024-01-31 Thread Yang Jie (Jira)
Yang Jie created SPARK-46938: Summary: Migrate jetty 10 to jetty 11 Key: SPARK-46938 URL: https://issues.apache.org/jira/browse/SPARK-46938 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-45522) Migrate jetty 9 to jetty 10

2024-01-31 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45522: - Summary: Migrate jetty 9 to jetty 10 (was: Migrate jetty 9 to jetty 12) > Migrate jetty 9 to jetty 10

[jira] [Resolved] (SPARK-46918) Replace self-defined variables with Hadoop ContainerExitStatus

2024-01-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46918. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44950

[jira] [Assigned] (SPARK-46918) Replace self-defined variables with Hadoop ContainerExitStatus

2024-01-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46918: Assignee: Cheng Pan > Replace self-defined variables with Hadoop ContainerExitStatus >

[jira] [Created] (SPARK-46919) Upgrade `grpcio*` to 1.60.0 and `grpc-java` to 1.61.0

2024-01-30 Thread Yang Jie (Jira)
Yang Jie created SPARK-46919: Summary: Upgrade `grpcio*` to 1.60.0 and `grpc-java` to 1.61.0 Key: SPARK-46919 URL: https://issues.apache.org/jira/browse/SPARK-46919 Project: Spark Issue Type:

[jira] [Created] (SPARK-46900) Upgrade slf4j to 2.0.11

2024-01-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-46900: Summary: Upgrade slf4j to 2.0.11 Key: SPARK-46900 URL: https://issues.apache.org/jira/browse/SPARK-46900 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46898) Simplify the protobuf function transformation in Planner

2024-01-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46898. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44925

[jira] [Assigned] (SPARK-46898) Simplify the protobuf function transformation in Planner

2024-01-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46898: Assignee: Ruifeng Zheng > Simplify the protobuf function transformation in Planner >

[jira] [Created] (SPARK-46897) Refine docstring of `bit_and/bit_or/bit_xor`

2024-01-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-46897: Summary: Refine docstring of `bit_and/bit_or/bit_xor` Key: SPARK-46897 URL: https://issues.apache.org/jira/browse/SPARK-46897 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-46855) Add `sketch` to the dependencies of the `catalyst` module in `module.py`

2024-01-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46855: - Issue Type: Bug (was: Improvement) > Add `sketch` to the dependencies of the `catalyst` module in

[jira] [Updated] (SPARK-46855) Add `sketch` to the dependencies of the `catalyst` module in `module.py`

2024-01-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46855: - Affects Version/s: 3.5.0 3.4.2 > Add `sketch` to the dependencies of the

[jira] [Updated] (SPARK-46432) Upgrade Netty to 4.1.106.Final

2024-01-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46432: - Summary: Upgrade Netty to 4.1.106.Final (was: Upgrade Netty to 4.1.104.Final) > Upgrade Netty to

[jira] [Resolved] (SPARK-46432) Upgrade Netty to 4.1.104.Final

2024-01-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46432. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44384

[jira] [Assigned] (SPARK-46432) Upgrade Netty to 4.1.104.Final

2024-01-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46432: Assignee: BingKun Pan > Upgrade Netty to 4.1.104.Final > -- > >

[jira] [Updated] (SPARK-46855) Add `sketch` to the dependencies of the `catalyst` module in `module.py`

2024-01-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46855: - Summary: Add `sketch` to the dependencies of the `catalyst` module in `module.py` (was: Add `sketch`

[jira] [Updated] (SPARK-46855) Add `sketch` to the dependencies of the `catalys` module in `module.py`

2024-01-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46855: - Summary: Add `sketch` to the dependencies of the `catalys` module in `module.py` (was: Add `sketch` to

  1   2   3   4   5   6   7   8   9   10   >