[jira] [Resolved] (SPARK-46898) Simplify the protobuf function transformation in Planner

2024-01-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46898. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44925

[jira] [Assigned] (SPARK-46898) Simplify the protobuf function transformation in Planner

2024-01-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46898: Assignee: Ruifeng Zheng > Simplify the protobuf function transformation in Planner >

[jira] [Created] (SPARK-46897) Refine docstring of `bit_and/bit_or/bit_xor`

2024-01-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-46897: Summary: Refine docstring of `bit_and/bit_or/bit_xor` Key: SPARK-46897 URL: https://issues.apache.org/jira/browse/SPARK-46897 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-46855) Add `sketch` to the dependencies of the `catalyst` module in `module.py`

2024-01-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46855: - Issue Type: Bug (was: Improvement) > Add `sketch` to the dependencies of the `catalyst` module in

[jira] [Updated] (SPARK-46855) Add `sketch` to the dependencies of the `catalyst` module in `module.py`

2024-01-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46855: - Affects Version/s: 3.5.0 3.4.2 > Add `sketch` to the dependencies of the

[jira] [Updated] (SPARK-46432) Upgrade Netty to 4.1.106.Final

2024-01-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46432: - Summary: Upgrade Netty to 4.1.106.Final (was: Upgrade Netty to 4.1.104.Final) > Upgrade Netty to

[jira] [Resolved] (SPARK-46432) Upgrade Netty to 4.1.104.Final

2024-01-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46432. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44384

[jira] [Assigned] (SPARK-46432) Upgrade Netty to 4.1.104.Final

2024-01-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46432: Assignee: BingKun Pan > Upgrade Netty to 4.1.104.Final > -- > >

[jira] [Updated] (SPARK-46855) Add `sketch` to the dependencies of the `catalyst` module in `module.py`

2024-01-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46855: - Summary: Add `sketch` to the dependencies of the `catalyst` module in `module.py` (was: Add `sketch`

[jira] [Updated] (SPARK-46855) Add `sketch` to the dependencies of the `catalys` module in `module.py`

2024-01-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46855: - Summary: Add `sketch` to the dependencies of the `catalys` module in `module.py` (was: Add `sketch` to

[jira] [Created] (SPARK-46855) Add `sketch` to the dependencies of the `core` module in `module.py`

2024-01-24 Thread Yang Jie (Jira)
Yang Jie created SPARK-46855: Summary: Add `sketch` to the dependencies of the `core` module in `module.py` Key: SPARK-46855 URL: https://issues.apache.org/jira/browse/SPARK-46855 Project: Spark

[jira] [Assigned] (SPARK-46787) `bloomFilter` function should throw `AnalysisException`

2024-01-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46787: Assignee: Ruifeng Zheng > `bloomFilter` function should throw `AnalysisException` >

[jira] [Resolved] (SPARK-46787) `bloomFilter` function should throw `AnalysisException`

2024-01-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46787. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44821

[jira] [Resolved] (SPARK-46826) Reset grpcio installation version of `Python linter dependencies for branch-3.4/branch-3.5`

2024-01-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46826. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44866

[jira] [Assigned] (SPARK-46826) Reset grpcio installation version of `Python linter dependencies for branch-3.4/branch-3.5`

2024-01-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46826: Assignee: Yang Jie > Reset grpcio installation version of `Python linter dependencies for >

[jira] [Updated] (SPARK-46826) Reset the installed grpcio version of `Python linter dependencies for branch-3.4/branch-3.5`

2024-01-23 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46826: - Summary: Reset the installed grpcio version of `Python linter dependencies for branch-3.4/branch-3.5`

[jira] [Updated] (SPARK-46826) Reset grpcio installation version of `Python linter dependencies for branch-3.4/branch-3.5`

2024-01-23 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46826: - Summary: Reset grpcio installation version of `Python linter dependencies for branch-3.4/branch-3.5`

[jira] [Created] (SPARK-46826) Reset the installed version of grpcio in `Python linter dependencies for branch-3.4/branch-3.5`

2024-01-23 Thread Yang Jie (Jira)
Yang Jie created SPARK-46826: Summary: Reset the installed version of grpcio in `Python linter dependencies for branch-3.4/branch-3.5` Key: SPARK-46826 URL: https://issues.apache.org/jira/browse/SPARK-46826

[jira] [Resolved] (SPARK-44495) Use the latest minikube in K8s IT

2024-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44495. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44813

[jira] [Resolved] (SPARK-46767) Refine docstring of `abs/acos/acosh`

2024-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46767. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44794

[jira] [Assigned] (SPARK-46767) Refine docstring of `abs/acos/acosh`

2024-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46767: Assignee: Yang Jie > Refine docstring of `abs/acos/acosh` >

[jira] [Created] (SPARK-46773) Change to use whitelist to generate assemblyExcludedJars for the connect server module

2024-01-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-46773: Summary: Change to use whitelist to generate assemblyExcludedJars for the connect server module Key: SPARK-46773 URL: https://issues.apache.org/jira/browse/SPARK-46773

[jira] [Created] (SPARK-46768) Upgrade the Guava version used by the connect module to 33.0-jre

2024-01-18 Thread Yang Jie (Jira)
Yang Jie created SPARK-46768: Summary: Upgrade the Guava version used by the connect module to 33.0-jre Key: SPARK-46768 URL: https://issues.apache.org/jira/browse/SPARK-46768 Project: Spark

[jira] [Created] (SPARK-46767) Refine docstring of `abs/acos/acosh`

2024-01-18 Thread Yang Jie (Jira)
Yang Jie created SPARK-46767: Summary: Refine docstring of `abs/acos/acosh` Key: SPARK-46767 URL: https://issues.apache.org/jira/browse/SPARK-46767 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-45593) Building a runnable distribution from master code running spark-sql raise error "java.lang.ClassNotFoundException: org.sparkproject.guava.util.concurrent.internal.Inter

2024-01-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45593. -- Resolution: Fixed Issue resolved by pull request 43436 [https://github.com/apache/spark/pull/43436]

[jira] [Assigned] (SPARK-45593) Building a runnable distribution from master code running spark-sql raise error "java.lang.ClassNotFoundException: org.sparkproject.guava.util.concurrent.internal.Inter

2024-01-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45593: Assignee: yikaifei > Building a runnable distribution from master code running spark-sql raise

[jira] [Created] (SPARK-46733) Simplify the ContextCleaner|BlockManager by the exit operation only depend on interrupt thread

2024-01-16 Thread Yang Jie (Jira)
Yang Jie created SPARK-46733: Summary: Simplify the ContextCleaner|BlockManager by the exit operation only depend on interrupt thread Key: SPARK-46733 URL: https://issues.apache.org/jira/browse/SPARK-46733

[jira] [Created] (SPARK-46730) Refine docstring of `str_to_map/map_filter/map_zip_with`

2024-01-15 Thread Yang Jie (Jira)
Yang Jie created SPARK-46730: Summary: Refine docstring of `str_to_map/map_filter/map_zip_with` Key: SPARK-46730 URL: https://issues.apache.org/jira/browse/SPARK-46730 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46713) Refine docstring of `map_keys/map_values/map_entries`

2024-01-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46713. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44724

[jira] [Assigned] (SPARK-46713) Refine docstring of `map_keys/map_values/map_entries`

2024-01-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46713: Assignee: Yang Jie > Refine docstring of `map_keys/map_values/map_entries` >

[jira] [Comment Edited] (SPARK-45393) Upgrade Hadoop to 3.3.7

2024-01-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806639#comment-17806639 ] Yang Jie edited comment on SPARK-45393 at 1/15/24 6:16 AM: --- Friendly ping

[jira] [Commented] (SPARK-45393) Upgrade Hadoop to 3.3.7

2024-01-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806639#comment-17806639 ] Yang Jie commented on SPARK-45393: -- Friendly ping [~dongjoon]  It looks like the next version is

[jira] [Commented] (SPARK-46718) Upgrade Arrow to 15.0.0

2024-01-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806638#comment-17806638 ] Yang Jie commented on SPARK-46718: -- ok > Upgrade Arrow to 15.0.0 > --- > >

[jira] [Commented] (SPARK-46718) Upgrade Arrow to 15.0.0

2024-01-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806635#comment-17806635 ] Yang Jie commented on SPARK-46718: -- cc [~panbingkun] could we upgrade to use this version? Does this

[jira] [Created] (SPARK-46718) Upgrade Arrow to 15.0.0

2024-01-14 Thread Yang Jie (Jira)
Yang Jie created SPARK-46718: Summary: Upgrade Arrow to 15.0.0 Key: SPARK-46718 URL: https://issues.apache.org/jira/browse/SPARK-46718 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46717) Simplify the ReloadingX509TrustManager by the exit operation only depend on interrupt thread

2024-01-14 Thread Yang Jie (Jira)
Yang Jie created SPARK-46717: Summary: Simplify the ReloadingX509TrustManager by the exit operation only depend on interrupt thread Key: SPARK-46717 URL: https://issues.apache.org/jira/browse/SPARK-46717

[jira] [Created] (SPARK-46713) Refine docstring of `map_keys/map_values/map_entries`

2024-01-14 Thread Yang Jie (Jira)
Yang Jie created SPARK-46713: Summary: Refine docstring of `map_keys/map_values/map_entries` Key: SPARK-46713 URL: https://issues.apache.org/jira/browse/SPARK-46713 Project: Spark Issue Type:

[jira] [Created] (SPARK-46698) Replace Timer with single thread scheduled executor for ConsoleProgressBar

2024-01-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-46698: Summary: Replace Timer with single thread scheduled executor for ConsoleProgressBar Key: SPARK-46698 URL: https://issues.apache.org/jira/browse/SPARK-46698 Project: Spark

[jira] [Created] (SPARK-46681) Refactor `ExecutorFailureTracker#maxNumExecutorFailures` to avoid unnecessary computations when `MAX_EXECUTOR_FAILURES` is configured

2024-01-11 Thread Yang Jie (Jira)
Yang Jie created SPARK-46681: Summary: Refactor `ExecutorFailureTracker#maxNumExecutorFailures` to avoid unnecessary computations when `MAX_EXECUTOR_FAILURES` is configured Key: SPARK-46681 URL:

[jira] [Created] (SPARK-46680) Upgrade Apache commons-pool2 to 2.12.0

2024-01-11 Thread Yang Jie (Jira)
Yang Jie created SPARK-46680: Summary: Upgrade Apache commons-pool2 to 2.12.0 Key: SPARK-46680 URL: https://issues.apache.org/jira/browse/SPARK-46680 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46672) Upgrade log4j2 to 2.22.1

2024-01-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-46672: Summary: Upgrade log4j2 to 2.22.1 Key: SPARK-46672 URL: https://issues.apache.org/jira/browse/SPARK-46672 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46635) Refine docstring of `from_csv/schema_of_csv/to_csv`

2024-01-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46635. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44639

[jira] [Assigned] (SPARK-46635) Refine docstring of `from_csv/schema_of_csv/to_csv`

2024-01-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46635: Assignee: Yang Jie > Refine docstring of `from_csv/schema_of_csv/to_csv` >

[jira] [Created] (SPARK-46654) df.show() of pyspark displayed different results between Regular Spark and Spark Connect

2024-01-09 Thread Yang Jie (Jira)
Yang Jie created SPARK-46654: Summary: df.show() of pyspark displayed different results between Regular Spark and Spark Connect Key: SPARK-46654 URL: https://issues.apache.org/jira/browse/SPARK-46654

[jira] [Created] (SPARK-46650) Replace AtomicBoolean with volatile boolean

2024-01-09 Thread Yang Jie (Jira)
Yang Jie created SPARK-46650: Summary: Replace AtomicBoolean with volatile boolean Key: SPARK-46650 URL: https://issues.apache.org/jira/browse/SPARK-46650 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46635) Refine docstring of `from_csv/schema_of_csv/to_csv`

2024-01-09 Thread Yang Jie (Jira)
Yang Jie created SPARK-46635: Summary: Refine docstring of `from_csv/schema_of_csv/to_csv` Key: SPARK-46635 URL: https://issues.apache.org/jira/browse/SPARK-46635 Project: Spark Issue Type:

[jira] [Created] (SPARK-46624) Upgrade joda-time to 2.12.6

2024-01-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-46624: Summary: Upgrade joda-time to 2.12.6 Key: SPARK-46624 URL: https://issues.apache.org/jira/browse/SPARK-46624 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-46621) Address null from Exception.getMessage in Py4J captured exception

2024-01-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46621: Assignee: Hyukjin Kwon > Address null from Exception.getMessage in Py4J captured exception >

[jira] [Resolved] (SPARK-46621) Address null from Exception.getMessage in Py4J captured exception

2024-01-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46621. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44623

[jira] [Created] (SPARK-46623) Replace SimpleDateFormat with DateTimeFormatter

2024-01-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-46623: Summary: Replace SimpleDateFormat with DateTimeFormatter Key: SPARK-46623 URL: https://issues.apache.org/jira/browse/SPARK-46623 Project: Spark Issue Type:

[jira] [Created] (SPARK-46622) Should override `toString` method for `shuffledb.StoreVersion`

2024-01-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-46622: Summary: Should override `toString` method for `shuffledb.StoreVersion` Key: SPARK-46622 URL: https://issues.apache.org/jira/browse/SPARK-46622 Project: Spark

[jira] [Resolved] (SPARK-46611) Remove ThreadLocal by replace SimpleDateFormat with DateTimeFormatter

2024-01-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46611. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44613

[jira] [Created] (SPARK-46605) Make `lit/typedLit` function in connect module support `s.c.immutable.ArraySeq`

2024-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-46605: Summary: Make `lit/typedLit` function in connect module support `s.c.immutable.ArraySeq` Key: SPARK-46605 URL: https://issues.apache.org/jira/browse/SPARK-46605 Project:

[jira] [Created] (SPARK-46604) Make `Literal.apply` support `s.c.immuable.ArraySeq`

2024-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-46604: Summary: Make `Literal.apply` support `s.c.immuable.ArraySeq` Key: SPARK-46604 URL: https://issues.apache.org/jira/browse/SPARK-46604 Project: Spark Issue Type:

[jira] [Created] (SPARK-46603) Refine docstring of `parse_url/url_encode/url_decode`

2024-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-46603: Summary: Refine docstring of `parse_url/url_encode/url_decode` Key: SPARK-46603 URL: https://issues.apache.org/jira/browse/SPARK-46603 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46595) Refine docstring of `map_from_arrays/map_from_entries/map_concat`

2024-01-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46595. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44595

[jira] [Assigned] (SPARK-46595) Refine docstring of `map_from_arrays/map_from_entries/map_concat`

2024-01-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46595: Assignee: Yang Jie > Refine docstring of `map_from_arrays/map_from_entries/map_concat` >

[jira] [Updated] (SPARK-46596) Correct package name of `SslTestUtils`

2024-01-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46596: - Priority: Minor (was: Major) > Correct package name of `SslTestUtils` >

[jira] [Created] (SPARK-46597) Optimize the command used to execute tests in the doc of `docker-integration-tests`

2024-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-46597: Summary: Optimize the command used to execute tests in the doc of `docker-integration-tests` Key: SPARK-46597 URL: https://issues.apache.org/jira/browse/SPARK-46597 Project:

[jira] [Created] (SPARK-46596) Correct package name of `SslTestUtils`

2024-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-46596: Summary: Correct package name of `SslTestUtils` Key: SPARK-46596 URL: https://issues.apache.org/jira/browse/SPARK-46596 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46595) Refine docstring of `map_from_arrays/map_from_entries/map_concat`

2024-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-46595: Summary: Refine docstring of `map_from_arrays/map_from_entries/map_concat` Key: SPARK-46595 URL: https://issues.apache.org/jira/browse/SPARK-46595 Project: Spark

[jira] [Resolved] (SPARK-46585) `metricPeaks` can be directly constructed as an immutable.ArraySeq instead of use `mutable.ArraySeq.toSeq` in `Executor`

2024-01-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46585. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44586

[jira] [Updated] (SPARK-46550) Upgrade `datasketches-java` to 5.0.1

2024-01-03 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46550: - Description: * [https://github.com/apache/datasketches-java/releases/tag/4.0.0] *

[jira] [Updated] (SPARK-46586) Support `s.c.immutable.ArraySeq` as `customCollectionCls` in `MapObjects`

2024-01-03 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46586: - Description: {code:java} val myUdf = udf((a: immutable.ArraySeq[Int]) =>    

[jira] [Updated] (SPARK-46586) Support `s.c.immutable.ArraySeq` as `customCollectionCls` in `MapObjects`

2024-01-03 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46586: - Summary: Support `s.c.immutable.ArraySeq` as `customCollectionCls` in `MapObjects` (was: Make

[jira] [Created] (SPARK-46586) Make `MapObjects` support `s.c.immutable.ArraySeq`

2024-01-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-46586: Summary: Make `MapObjects` support `s.c.immutable.ArraySeq` Key: SPARK-46586 URL: https://issues.apache.org/jira/browse/SPARK-46586 Project: Spark Issue Type:

[jira] [Created] (SPARK-46585) `metricPeaks` can be directly constructed as an immutable.ArraySeq instead of use `mutable.ArraySeq.toSeq` in `Executor`

2024-01-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-46585: Summary: `metricPeaks` can be directly constructed as an immutable.ArraySeq instead of use `mutable.ArraySeq.toSeq` in `Executor` Key: SPARK-46585 URL:

[jira] [Created] (SPARK-46578) Remove ThreadLocal for fallbackConf

2024-01-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-46578: Summary: Remove ThreadLocal for fallbackConf Key: SPARK-46578 URL: https://issues.apache.org/jira/browse/SPARK-46578 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46573) Should always use `appId` instead of `conf.appId` in `LoggingPodStatusWatcherImpl`

2024-01-02 Thread Yang Jie (Jira)
Yang Jie created SPARK-46573: Summary: Should always use `appId` instead of `conf.appId` in `LoggingPodStatusWatcherImpl` Key: SPARK-46573 URL: https://issues.apache.org/jira/browse/SPARK-46573 Project:

[jira] [Resolved] (SPARK-46559) Wrap the `export` in the package name with backticks

2024-01-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46559. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44555

[jira] [Assigned] (SPARK-46559) Wrap the `export` in the package name with backticks

2024-01-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46559: Assignee: Yang Jie > Wrap the `export` in the package name with backticks >

[jira] [Commented] (SPARK-46257) Upgrade Derby to 10.16.1.1

2024-01-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801763#comment-17801763 ] Yang Jie commented on SPARK-46257: -- [~julienlau] Has 10.16.1.2 been released? I still can't find it in

[jira] [Resolved] (SPARK-46561) Use `exists` instead of `filter + nonEmpty` to get `showResourceColumn` in `MasterPage.scala`

2024-01-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46561. -- Resolution: Won't Fix > Use `exists` instead of `filter + nonEmpty` to get `showResourceColumn` in >

[jira] [Updated] (SPARK-46562) Remove retrieval of `keytabFile` from `UserGroupInformation` in `HiveAuthFactory`

2024-01-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46562: - Summary: Remove retrieval of `keytabFile` from `UserGroupInformation` in `HiveAuthFactory` (was:

[jira] [Created] (SPARK-46562) Remove the process of obtaining `keytabFile` from `UserGroupInformation` in `HiveAuthFactory`

2024-01-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-46562: Summary: Remove the process of obtaining `keytabFile` from `UserGroupInformation` in `HiveAuthFactory` Key: SPARK-46562 URL: https://issues.apache.org/jira/browse/SPARK-46562

[jira] [Created] (SPARK-46561) Use `exists` instead of `filter + nonEmpty` to get `showResourceColumn` in `MasterPage.scala`

2024-01-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-46561: Summary: Use `exists` instead of `filter + nonEmpty` to get `showResourceColumn` in `MasterPage.scala` Key: SPARK-46561 URL: https://issues.apache.org/jira/browse/SPARK-46561

[jira] [Created] (SPARK-46559) Wrap the `export` in the package name with backticks

2024-01-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-46559: Summary: Wrap the `export` in the package name with backticks Key: SPARK-46559 URL: https://issues.apache.org/jira/browse/SPARK-46559 Project: Spark Issue Type:

[jira] [Created] (SPARK-46558) Extract a helper method to eliminate the duplicate code in `GrpcExceptionConverter` that retrieves `MessageParameters` from `ErrorParams`

2024-01-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-46558: Summary: Extract a helper method to eliminate the duplicate code in `GrpcExceptionConverter` that retrieves `MessageParameters` from `ErrorParams` Key: SPARK-46558 URL:

[jira] [Resolved] (SPARK-46554) Upgrade slf4j to 2.0.10

2024-01-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46554. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44544

[jira] [Resolved] (SPARK-46551) Refine docstring of `flatten/sequence/shuffle`

2024-01-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46551. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44548

[jira] [Assigned] (SPARK-46551) Refine docstring of `flatten/sequence/shuffle`

2024-01-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46551: Assignee: Yang Jie > Refine docstring of `flatten/sequence/shuffle` >

[jira] [Created] (SPARK-46551) Refine docstring of `flatten/sequence/shuffle`

2023-12-31 Thread Yang Jie (Jira)
Yang Jie created SPARK-46551: Summary: Refine docstring of `flatten/sequence/shuffle` Key: SPARK-46551 URL: https://issues.apache.org/jira/browse/SPARK-46551 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-46550) Upgrade `datasketches-java` to 5.0.0

2023-12-31 Thread Yang Jie (Jira)
Yang Jie created SPARK-46550: Summary: Upgrade `datasketches-java` to 5.0.0 Key: SPARK-46550 URL: https://issues.apache.org/jira/browse/SPARK-46550 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46548) Refine docstring of `get/array_zip/sort_array`

2023-12-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46548. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44545

[jira] [Assigned] (SPARK-46548) Refine docstring of `get/array_zip/sort_array`

2023-12-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46548: Assignee: Yang Jie > Refine docstring of `get/array_zip/sort_array` >

[jira] [Created] (SPARK-46548) Refine docstring of `get/array_zip/sort_array`

2023-12-30 Thread Yang Jie (Jira)
Yang Jie created SPARK-46548: Summary: Refine docstring of `get/array_zip/sort_array` Key: SPARK-46548 URL: https://issues.apache.org/jira/browse/SPARK-46548 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-46542) Remove the check for `c>=0` from `ExternalCatalogUtils#needsEscaping`

2023-12-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-46542: Summary: Remove the check for `c>=0` from `ExternalCatalogUtils#needsEscaping` Key: SPARK-46542 URL: https://issues.apache.org/jira/browse/SPARK-46542 Project: Spark

[jira] [Assigned] (SPARK-46533) Refine docstring of `array_min/array_max/array_size/array_repeat`

2023-12-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46533: Assignee: Yang Jie > Refine docstring of `array_min/array_max/array_size/array_repeat` >

[jira] [Resolved] (SPARK-46533) Refine docstring of `array_min/array_max/array_size/array_repeat`

2023-12-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46533. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44522

[jira] [Created] (SPARK-46533) Refine docstring of `array_min/array_max/array_size/array_repeat`

2023-12-27 Thread Yang Jie (Jira)
Yang Jie created SPARK-46533: Summary: Refine docstring of `array_min/array_max/array_size/array_repeat` Key: SPARK-46533 URL: https://issues.apache.org/jira/browse/SPARK-46533 Project: Spark

[jira] [Created] (SPARK-46531) Move the version management of 'datasketches-java' from 'catalyst' to 'parent'

2023-12-27 Thread Yang Jie (Jira)
Yang Jie created SPARK-46531: Summary: Move the version management of 'datasketches-java' from 'catalyst' to 'parent' Key: SPARK-46531 URL: https://issues.apache.org/jira/browse/SPARK-46531 Project:

[jira] [Created] (SPARK-46521) Refine docstring of `array_compact/array_distinct/array_remove`

2023-12-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-46521: Summary: Refine docstring of `array_compact/array_distinct/array_remove` Key: SPARK-46521 URL: https://issues.apache.org/jira/browse/SPARK-46521 Project: Spark

[jira] [Assigned] (SPARK-46506) Refine docstring of `array_intersect/array_union/array_except`

2023-12-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46506: Assignee: Yang Jie > Refine docstring of `array_intersect/array_union/array_except` >

[jira] [Resolved] (SPARK-46506) Refine docstring of `array_intersect/array_union/array_except`

2023-12-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46506. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44490

[jira] [Created] (SPARK-46508) Upgrade Jackson to 2.16.1

2023-12-25 Thread Yang Jie (Jira)
Yang Jie created SPARK-46508: Summary: Upgrade Jackson to 2.16.1 Key: SPARK-46508 URL: https://issues.apache.org/jira/browse/SPARK-46508 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46506) Refine docstring of `array_intersect/array_union/array_except`

2023-12-25 Thread Yang Jie (Jira)
Yang Jie created SPARK-46506: Summary: Refine docstring of `array_intersect/array_union/array_except` Key: SPARK-46506 URL: https://issues.apache.org/jira/browse/SPARK-46506 Project: Spark

[jira] [Updated] (SPARK-46498) Remove an unused local variables from `o.a.spark.util.Utils#getConfiguredLocalDirs`

2023-12-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46498: - Summary: Remove an unused local variables from `o.a.spark.util.Utils#getConfiguredLocalDirs` (was:

[jira] [Created] (SPARK-46498) Clean up unused methods and local variables in `o.a.s.util.Utils`

2023-12-24 Thread Yang Jie (Jira)
Yang Jie created SPARK-46498: Summary: Clean up unused methods and local variables in `o.a.s.util.Utils` Key: SPARK-46498 URL: https://issues.apache.org/jira/browse/SPARK-46498 Project: Spark

[jira] [Created] (SPARK-46497) Re-enable the test cases that were ignored in SPARK-45309

2023-12-24 Thread Yang Jie (Jira)
Yang Jie created SPARK-46497: Summary: Re-enable the test cases that were ignored in SPARK-45309 Key: SPARK-46497 URL: https://issues.apache.org/jira/browse/SPARK-46497 Project: Spark Issue

[jira] [Created] (SPARK-46493) Upgrade `apache-rat` to 0.15

2023-12-23 Thread Yang Jie (Jira)
Yang Jie created SPARK-46493: Summary: Upgrade `apache-rat` to 0.15 Key: SPARK-46493 URL: https://issues.apache.org/jira/browse/SPARK-46493 Project: Spark Issue Type: Improvement

<    1   2   3   4   5   6   7   8   9   10   >