[jira] [Assigned] (SPARK-45288) Remove outdated benchmark result files `jdk1[17]*results.txt`

2023-09-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45288: Assignee: Dongjoon Hyun > Remove outdated benchmark result files `jdk1[17]*results.txt` >

[jira] [Created] (SPARK-45280) Change Maven daily test use Java 17 for testing.

2023-09-22 Thread Yang Jie (Jira)
Yang Jie created SPARK-45280: Summary: Change Maven daily test use Java 17 for testing. Key: SPARK-45280 URL: https://issues.apache.org/jira/browse/SPARK-45280 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-45277) Install Java 17 for Windows SparkR test

2023-09-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45277: - Summary: Install Java 17 for Windows SparkR test (was: Install a Java 17 for windows SparkR test) >

[jira] [Created] (SPARK-45277) Install a Java 17 for windows SparkR test

2023-09-22 Thread Yang Jie (Jira)
Yang Jie created SPARK-45277: Summary: Install a Java 17 for windows SparkR test Key: SPARK-45277 URL: https://issues.apache.org/jira/browse/SPARK-45277 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-45276) Replace Java 8 and Java 11 installed in the Dockerfile with Java

2023-09-22 Thread Yang Jie (Jira)
Yang Jie created SPARK-45276: Summary: Replace Java 8 and Java 11 installed in the Dockerfile with Java Key: SPARK-45276 URL: https://issues.apache.org/jira/browse/SPARK-45276 Project: Spark

[jira] [Updated] (SPARK-45252) `sbt doc` execution failed.

2023-09-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45252: - Affects Version/s: 3.3.4 > `sbt doc` execution failed. > --- > >

[jira] [Updated] (SPARK-45252) `sbt doc` execution failed.

2023-09-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45252: - Affects Version/s: 3.4.2 > `sbt doc` execution failed. > --- > >

[jira] [Updated] (SPARK-45252) `sbt doc` execution failed.

2023-09-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45252: - Description: run    {code:java} build/sbt clean doc -Phadoop-3 -Phadoop-cloud -Pmesos -Pyarn

[jira] [Updated] (SPARK-45252) `sbt doc` execution failed.

2023-09-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45252: - Affects Version/s: 3.5.1 > `sbt doc` execution failed. > --- > >

[jira] [Created] (SPARK-45252) `sbt doc` execution failed.

2023-09-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-45252: Summary: `sbt doc` execution failed. Key: SPARK-45252 URL: https://issues.apache.org/jira/browse/SPARK-45252 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45252) `sbt doc` execution failed.

2023-09-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45252: - Issue Type: Bug (was: Improvement) > `sbt doc` execution failed. > --- > >

[jira] [Updated] (SPARK-45252) `sbt doc` execution failed.

2023-09-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45252: - Priority: Minor (was: Major) > `sbt doc` execution failed. > --- > >

[jira] [Updated] (SPARK-45237) Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md`

2023-09-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45237: - Issue Type: Bug (was: Improvement) > Correct the default value of

[jira] [Created] (SPARK-45237) Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md`

2023-09-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-45237: Summary: Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md` Key: SPARK-45237 URL: https://issues.apache.org/jira/browse/SPARK-45237

[jira] [Commented] (SPARK-44112) Drop Java 8 and 11 support

2023-09-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17767091#comment-17767091 ] Yang Jie commented on SPARK-44112: -- Sorry, there might have been a delay in receiving emails, I just

[jira] [Commented] (SPARK-44112) Drop Java 8 Support

2023-09-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766965#comment-17766965 ] Yang Jie commented on SPARK-44112: -- !image-2023-09-20-10-53-34-956.png|width=729,height=161!   I have

[jira] [Updated] (SPARK-44112) Drop Java 8 Support

2023-09-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44112: - Attachment: image-2023-09-20-10-53-34-956.png > Drop Java 8 Support > --- > >

[jira] [Updated] (SPARK-44112) Drop Java 8 Support

2023-09-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44112: - Attachment: image-2023-09-20-10-52-59-327.png > Drop Java 8 Support > --- > >

[jira] [Updated] (SPARK-44112) Drop Java 8 and Java 11 Support

2023-09-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44112: - Summary: Drop Java 8 and Java 11 Support (was: Drop Java 8 Support) > Drop Java 8 and Java 11 Support

[jira] [Assigned] (SPARK-45211) Scala 2.13 daily test failed

2023-09-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45211: Assignee: Yang Jie > Scala 2.13 daily test failed > - > >

[jira] [Resolved] (SPARK-45211) Scala 2.13 daily test failed

2023-09-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45211. -- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Updated] (SPARK-45212) Install independent Python linter dependencies for branch-3.5

2023-09-18 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45212: - Description: Python linter failed in branch -3.5 daily test: *

[jira] [Updated] (SPARK-45212) Install independent Python linter dependencies for branch-3.5

2023-09-18 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45212: - Description: branch -3.5  > Install independent Python linter dependencies for branch-3.5 >

[jira] [Created] (SPARK-45212) Install independent Python linter dependencies for branch-3.5

2023-09-18 Thread Yang Jie (Jira)
Yang Jie created SPARK-45212: Summary: Install independent Python linter dependencies for branch-3.5 Key: SPARK-45212 URL: https://issues.apache.org/jira/browse/SPARK-45212 Project: Spark Issue

[jira] [Updated] (SPARK-45211) Scala 2.13 daily test failed

2023-09-18 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45211: - Affects Version/s: 3.5.1 > Scala 2.13 daily test failed > - > >

[jira] [Created] (SPARK-45211) Scala 2.13 daily test failed

2023-09-18 Thread Yang Jie (Jira)
Yang Jie created SPARK-45211: Summary: Scala 2.13 daily test failed Key: SPARK-45211 URL: https://issues.apache.org/jira/browse/SPARK-45211 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-45196) Refine docstring of `array/array_contains/arrays_overlap`

2023-09-18 Thread Yang Jie (Jira)
Yang Jie created SPARK-45196: Summary: Refine docstring of `array/array_contains/arrays_overlap` Key: SPARK-45196 URL: https://issues.apache.org/jira/browse/SPARK-45196 Project: Spark Issue

[jira] [Commented] (SPARK-44113) Make Scala 2.13+ as default Scala version

2023-09-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17765474#comment-17765474 ] Yang Jie commented on SPARK-44113: -- [~dongjoon] Spark 3.5.0 has been released. Will we start working on

[jira] [Updated] (SPARK-45158) There are ProblemFilters in the wrong place in MimaExcludes.scala.

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45158: - Affects Version/s: (was: 4.0.0) > There are ProblemFilters in the wrong place in

[jira] [Updated] (SPARK-45158) There are ProblemFilters in the wrong place in MimaExcludes.scala.

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45158: - Issue Type: Improvement (was: Bug) > There are ProblemFilters in the wrong place in

[jira] [Created] (SPARK-45161) Bump `previousSparkVersion` to 3.5.0

2023-09-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-45161: Summary: Bump `previousSparkVersion` to 3.5.0 Key: SPARK-45161 URL: https://issues.apache.org/jira/browse/SPARK-45161 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-45158) There are ProblemFilters in the wrong place in MimaExcludes.scala.

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45158: - Component/s: Build (was: Project Infra) > There are ProblemFilters in the wrong

[jira] [Created] (SPARK-45158) There are ProblemFilters in the wrong place in MimaExcludes.scala.

2023-09-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-45158: Summary: There are ProblemFilters in the wrong place in MimaExcludes.scala. Key: SPARK-45158 URL: https://issues.apache.org/jira/browse/SPARK-45158 Project: Spark

[jira] [Resolved] (SPARK-45149) flaky test: RocksDBBackendChromeUIHistoryServerSuite

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45149. -- Resolution: Won't Fix It may be a problem with my local disk, close this one > flaky test:

[jira] [Updated] (SPARK-45149) flaky test: RocksDBBackendChromeUIHistoryServerSuite

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45149: - Summary: flaky test: RocksDBBackendChromeUIHistoryServerSuite (was:

[jira] [Updated] (SPARK-45149) RocksDBBackendChromeUIHistoryServerSuite test failed

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45149: - Description: build/sbt -Dguava.version=31.1-jre

[jira] [Created] (SPARK-45150) ChromeUISeleniumSuite test failed

2023-09-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-45150: Summary: ChromeUISeleniumSuite test failed Key: SPARK-45150 URL: https://issues.apache.org/jira/browse/SPARK-45150 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-45149) RocksDBBackendChromeUIHistoryServerSuite test failed

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45149: - Issue Type: Bug (was: Improvement) > RocksDBBackendChromeUIHistoryServerSuite test failed >

[jira] [Created] (SPARK-45149) RocksDBBackendChromeUIHistoryServerSuite test failed

2023-09-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-45149: Summary: RocksDBBackendChromeUIHistoryServerSuite test failed Key: SPARK-45149 URL: https://issues.apache.org/jira/browse/SPARK-45149 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45148) Upgrade ScalaTest to the 3.2.17 series.

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45148: - Summary: Upgrade ScalaTest to the 3.2.17 series. (was: Upgraded ScalaTest to the 3.2.17 series.) >

[jira] [Created] (SPARK-45148) Upgraded ScalaTest to the 3.2.17 series.

2023-09-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-45148: Summary: Upgraded ScalaTest to the 3.2.17 series. Key: SPARK-45148 URL: https://issues.apache.org/jira/browse/SPARK-45148 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45144) Downgrade scala-maven-plugin to 4.7.1

2023-09-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45144: - Description: The `scala-maven-plugin` versions 4.7.2 and later will try to automatically append the

[jira] [Created] (SPARK-45144) Downgrade scala-maven-plugin to 4.7.1

2023-09-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-45144: Summary: Downgrade scala-maven-plugin to 4.7.1 Key: SPARK-45144 URL: https://issues.apache.org/jira/browse/SPARK-45144 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-45113) Refine docstrings of `collect_list/collect_set`

2023-09-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-45113: Summary: Refine docstrings of `collect_list/collect_set` Key: SPARK-45113 URL: https://issues.apache.org/jira/browse/SPARK-45113 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-45111) Upgrade maven to 3.9.4

2023-09-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-45111: Summary: Upgrade maven to 3.9.4 Key: SPARK-45111 URL: https://issues.apache.org/jira/browse/SPARK-45111 Project: Spark Issue Type: Improvement Components:

[jira] [Resolved] (SPARK-45046) Set shadeTestJar of core module to false

2023-09-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45046. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42766

[jira] [Assigned] (SPARK-45046) Set shadeTestJar of core module to false

2023-09-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45046: Assignee: Yang Jie > Set shadeTestJar of core module to false >

[jira] [Created] (SPARK-45067) Upgrade slf4j to 2.0.9

2023-09-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-45067: Summary: Upgrade slf4j to 2.0.9 Key: SPARK-45067 URL: https://issues.apache.org/jira/browse/SPARK-45067 Project: Spark Issue Type: Improvement Components:

[jira] [Resolved] (SPARK-45042) Upgrade jetty to 9.4.52.v20230823

2023-09-03 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45042. -- Fix Version/s: 4.0.0 Resolution: Fixed > Upgrade jetty to 9.4.52.v20230823 >

[jira] [Assigned] (SPARK-45042) Upgrade jetty to 9.4.52.v20230823

2023-09-03 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45042: Assignee: BingKun Pan > Upgrade jetty to 9.4.52.v20230823 > - >

[jira] [Created] (SPARK-45063) Refine docstrings of `min_by/max_by`

2023-09-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-45063: Summary: Refine docstrings of `min_by/max_by` Key: SPARK-45063 URL: https://issues.apache.org/jira/browse/SPARK-45063 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-45032) Fix compilation warnings related to `Top-level wildcard is not allowed and will error under -Xsource:3`

2023-09-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45032: - Affects Version/s: (was: 3.5.0) > Fix compilation warnings related to `Top-level wildcard is not

[jira] [Created] (SPARK-45046) Set shadeTestJar of core module to false

2023-09-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-45046: Summary: Set shadeTestJar of core module to false Key: SPARK-45046 URL: https://issues.apache.org/jira/browse/SPARK-45046 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-44444) Enabled ANSI mode by default

2023-08-31 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17761161#comment-17761161 ] Yang Jie commented on SPARK-4: -- +1 > Enabled ANSI mode by default > >

[jira] [Assigned] (SPARK-45029) Ignore `from_protobuf messageClassName` and `from_protobuf messageClassName options` in `PlanGenerationTestSuite`

2023-08-31 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45029: Assignee: Yang Jie > Ignore `from_protobuf messageClassName` and `from_protobuf messageClassName

[jira] [Resolved] (SPARK-45029) Ignore `from_protobuf messageClassName` and `from_protobuf messageClassName options` in `PlanGenerationTestSuite`

2023-08-31 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45029. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Updated] (SPARK-45032) Fix compilation warnings related to `Top-level wildcard is not allowed and will error under -Xsource:3`

2023-08-31 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45032: - Description: {code:java} [warn]

[jira] [Created] (SPARK-45032) Fix compilation warnings related to `Top-level wildcard is not allowed and will error under -Xsource:3`

2023-08-31 Thread Yang Jie (Jira)
Yang Jie created SPARK-45032: Summary: Fix compilation warnings related to `Top-level wildcard is not allowed and will error under -Xsource:3` Key: SPARK-45032 URL: https://issues.apache.org/jira/browse/SPARK-45032

[jira] [Created] (SPARK-45030) Re-enable `from_protobuf messageClassName` and `from_protobuf messageClassName options` in `PlanGenerationTestSuite`

2023-08-31 Thread Yang Jie (Jira)
Yang Jie created SPARK-45030: Summary: Re-enable `from_protobuf messageClassName` and `from_protobuf messageClassName options` in `PlanGenerationTestSuite` Key: SPARK-45030 URL:

[jira] [Updated] (SPARK-45029) Ignore `from_protobuf messageClassName` and `from_protobuf messageClassName options` in `PlanGenerationTestSuite`

2023-08-31 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45029: - Description: The SPARK-43646 makes both Maven and SBT use the shaded `spark-protobuf` module when

[jira] [Updated] (SPARK-45029) Ignore `from_protobuf messageClassName` and `from_protobuf messageClassName options` in `PlanGenerationTestSuite`

2023-08-31 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45029: - Description: The SPARK-43646 makes both Maven and SBT use the shaded `spark-protobuf` module when

[jira] [Updated] (SPARK-45029) Ignore `from_protobuf messageClassName` and `from_protobuf messageClassName options` in `PlanGenerationTestSuite`

2023-08-31 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45029: - Description: The SPARK-43646 makes both Maven and SBT use the shaded `spark-protobuf` module when

[jira] [Updated] (SPARK-45029) Ignore `from_protobuf messageClassName` and `from_protobuf messageClassName options` in `PlanGenerationTestSuite`

2023-08-31 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45029: - Description: The SPARK-43646 makes both Maven and SBT use the shaded `spark-protobuf` module when

[jira] [Created] (SPARK-45029) Ignore `from_protobuf messageClassName` and `from_protobuf messageClassName options` in `PlanGenerationTestSuite`

2023-08-31 Thread Yang Jie (Jira)
Yang Jie created SPARK-45029: Summary: Ignore `from_protobuf messageClassName` and `from_protobuf messageClassName options` in `PlanGenerationTestSuite` Key: SPARK-45029 URL:

[jira] [Created] (SPARK-45021) Remove `antlr4-maven-plugin` configuration from `sql/catalyst/pom.xml`

2023-08-30 Thread Yang Jie (Jira)
Yang Jie created SPARK-45021: Summary: Remove `antlr4-maven-plugin` configuration from `sql/catalyst/pom.xml` Key: SPARK-45021 URL: https://issues.apache.org/jira/browse/SPARK-45021 Project: Spark

[jira] [Created] (SPARK-45003) Refine docstring of `asc/desc`

2023-08-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-45003: Summary: Refine docstring of `asc/desc` Key: SPARK-45003 URL: https://issues.apache.org/jira/browse/SPARK-45003 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-44999) Refactor ExternalSorter to reduce checks on shouldPartition when calling getPartition

2023-08-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44999: - Summary: Refactor ExternalSorter to reduce checks on shouldPartition when calling getPartition (was:

[jira] [Updated] (SPARK-44999) Refactor ExternalSorter#getPartition to reduce checks on shouldPartition

2023-08-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44999: - Summary: Refactor ExternalSorter#getPartition to reduce checks on shouldPartition (was: Refactor

[jira] [Updated] (SPARK-44999) Refactor `ExternalSorter#getPartition` to reduce the number of i`f else` judgments

2023-08-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44999: - Description: {code:java}   private def getPartition(key: K): Int = {     if (shouldPartition)

[jira] [Updated] (SPARK-44999) Refactor `ExternalSorter#getPartition` to reduce the number of i`f else` judgments

2023-08-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44999: - Description: {code:java}   private def getPartition(key: K): Int = {     if (shouldPartition)

[jira] [Created] (SPARK-44999) Refactor `ExternalSorter#getPartition` to reduce the number of i`f else` judgments

2023-08-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-44999: Summary: Refactor `ExternalSorter#getPartition` to reduce the number of i`f else` judgments Key: SPARK-44999 URL: https://issues.apache.org/jira/browse/SPARK-44999 Project:

[jira] [Assigned] (SPARK-43646) Make `connect` module daily test pass

2023-08-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-43646: Assignee: Yang Jie > Make `connect` module daily test pass >

[jira] [Resolved] (SPARK-43646) Make `connect` module daily test pass

2023-08-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-43646. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Resolved] (SPARK-44784) Failure in testing `SparkSessionE2ESuite` using Maven

2023-08-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44784. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Resolved] (SPARK-44968) Downgrade ivy to 2.5.1

2023-08-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44968. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-44968) Downgrade ivy to 2.5.1

2023-08-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44968: Assignee: Yang Jie > Downgrade ivy to 2.5.1 > -- > > Key:

[jira] [Created] (SPARK-44968) Downgrade ivy to 2.5.1

2023-08-25 Thread Yang Jie (Jira)
Yang Jie created SPARK-44968: Summary: Downgrade ivy to 2.5.1 Key: SPARK-44968 URL: https://issues.apache.org/jira/browse/SPARK-44968 Project: Spark Issue Type: Improvement Components:

[jira] [Created] (SPARK-44966) Change the never changed 'var' to 'val'

2023-08-25 Thread Yang Jie (Jira)
Yang Jie created SPARK-44966: Summary: Change the never changed 'var' to 'val' Key: SPARK-44966 URL: https://issues.apache.org/jira/browse/SPARK-44966 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-44784) Failure in testing `SparkSessionE2ESuite` using Maven

2023-08-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758831#comment-17758831 ] Yang Jie edited comment on SPARK-44784 at 8/25/23 5:17 AM: --- -Just a test-only

[jira] [Updated] (SPARK-44784) Failure in testing `SparkSessionE2ESuite` using Maven

2023-08-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44784: - Priority: Blocker (was: Major) > Failure in testing `SparkSessionE2ESuite` using Maven >

[jira] [Updated] (SPARK-44784) Failure in testing `SparkSessionE2ESuite` using Maven

2023-08-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44784: - Priority: Major (was: Blocker) > Failure in testing `SparkSessionE2ESuite` using Maven >

[jira] [Commented] (SPARK-44784) Failure in testing `SparkSessionE2ESuite` using Maven

2023-08-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758831#comment-17758831 ] Yang Jie commented on SPARK-44784: -- Just a test-only issue,  not a real blocker, but we should at least

[jira] [Resolved] (SPARK-44606) Generate Java PB files and replace the package names in the files when testing

2023-08-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44606. -- Resolution: Won't Fix > Generate Java PB files and replace the package names in the files when

[jira] [Resolved] (SPARK-44452) Ignore ArrowEncoderSuite for Java 21

2023-08-23 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44452. -- Resolution: Won't Fix Arrow 13.0 has already been released, this fix is no longer needed. > Ignore

[jira] [Assigned] (SPARK-44914) Upgrade Apache ivy to 2.5.2

2023-08-23 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44914: Assignee: Bjørn Jørgensen > Upgrade Apache ivy to 2.5.2 > > >

[jira] [Resolved] (SPARK-44914) Upgrade Apache ivy to 2.5.2

2023-08-23 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44914. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Updated] (SPARK-44904) Correct the ‘versionadded’ of `sql.functions.approx_percentile` to 3.5.0.

2023-08-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44904: - Summary: Correct the ‘versionadded’ of `sql.functions.approx_percentile` to 3.5.0. (was: Correct the

[jira] [Created] (SPARK-44904) Correct the ‘versionchanged’ of `sql.functions.approx_percentile` to 3.5.0.

2023-08-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-44904: Summary: Correct the ‘versionchanged’ of `sql.functions.approx_percentile` to 3.5.0. Key: SPARK-44904 URL: https://issues.apache.org/jira/browse/SPARK-44904 Project: Spark

[jira] [Updated] (SPARK-44903) Refine docstring of `approx_count_distinct`

2023-08-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44903: - Affects Version/s: 3.5.0 > Refine docstring of `approx_count_distinct` >

[jira] [Updated] (SPARK-44903) Refine docstring of `approx_count_distinct`

2023-08-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44903: - Component/s: Documentation PySpark (was: Pandas API on Spark) >

[jira] [Created] (SPARK-44903) Refine docstring of `approx_count_distinct`

2023-08-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-44903: Summary: Refine docstring of `approx_count_distinct` Key: SPARK-44903 URL: https://issues.apache.org/jira/browse/SPARK-44903 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-44894) Upgrade tink to 1.10

2023-08-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-44894: Summary: Upgrade tink to 1.10 Key: SPARK-44894 URL: https://issues.apache.org/jira/browse/SPARK-44894 Project: Spark Issue Type: Improvement Components:

[jira] [Assigned] (SPARK-44888) Need to update the golden files of SQLQueryTestSuite for Java 21.

2023-08-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44888: Assignee: Yang Jie > Need to update the golden files of SQLQueryTestSuite for Java 21. >

[jira] [Resolved] (SPARK-44888) Need to update the golden files of SQLQueryTestSuite for Java 21.

2023-08-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44888. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42580

[jira] [Created] (SPARK-44888) Need to update the golden files of SQLQueryTestSuite for Java 21.

2023-08-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-44888: Summary: Need to update the golden files of SQLQueryTestSuite for Java 21. Key: SPARK-44888 URL: https://issues.apache.org/jira/browse/SPARK-44888 Project: Spark

[jira] [Created] (SPARK-44852) Need exclude `junit-jupiter-api` from `curator-test`

2023-08-17 Thread Yang Jie (Jira)
Yang Jie created SPARK-44852: Summary: Need exclude `junit-jupiter-api` from `curator-test` Key: SPARK-44852 URL: https://issues.apache.org/jira/browse/SPARK-44852 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-44784) Failure in testing `SparkSessionE2ESuite` using Maven

2023-08-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755373#comment-17755373 ] Yang Jie commented on SPARK-44784: -- Because in https://github.com/apache/spark/pull/42523, SparkResult

[jira] [Created] (SPARK-44843) flaky test: RocksDBStateStoreStreamingAggregationSuite

2023-08-16 Thread Yang Jie (Jira)
Yang Jie created SPARK-44843: Summary: flaky test: RocksDBStateStoreStreamingAggregationSuite Key: SPARK-44843 URL: https://issues.apache.org/jira/browse/SPARK-44843 Project: Spark Issue Type:

[jira] [Commented] (SPARK-44825) flaky pyspark tests

2023-08-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755371#comment-17755371 ] Yang Jie commented on SPARK-44825: -- Newly added case today:

[jira] [Resolved] (SPARK-44824) There is content overlap in `ammoniteOut` used in ReplE2ESuite.

2023-08-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44824. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42509

<    2   3   4   5   6   7   8   9   10   11   >