[jira] [Created] (SPARK-48549) Restrict the number of parameters for function `sentences` to 1 or 3

2024-06-06 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48549: --- Summary: Restrict the number of parameters for function `sentences` to 1 or 3 Key: SPARK-48549 URL: https://issues.apache.org/jira/browse/SPARK-48549 Project: Spark

[jira] [Updated] (SPARK-48537) Support `Hive UDAF` inherited from `GenericUDAFResolver` or `GenericUDAFResolver2`

2024-06-05 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48537: Summary: Support `Hive UDAF` inherited from `GenericUDAFResolver` or `GenericUDAFResolver2`

[jira] [Created] (SPARK-48537) Support Hive UDAF inherit from `GenericUDAFResolver` and `GenericUDAFResolver2`

2024-06-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48537: --- Summary: Support Hive UDAF inherit from `GenericUDAFResolver` and `GenericUDAFResolver2` Key: SPARK-48537 URL: https://issues.apache.org/jira/browse/SPARK-48537

[jira] [Updated] (SPARK-48523) Add `grpc_max_message_size ` description to `client-connection-string.md`

2024-06-04 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48523: Summary: Add `grpc_max_message_size ` description to `client-connection-string.md` (was: Add

[jira] [Created] (SPARK-48523) Add `grpc_max_message_size ` to `client-connection-string.md`

2024-06-04 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48523: --- Summary: Add `grpc_max_message_size ` to `client-connection-string.md` Key: SPARK-48523 URL: https://issues.apache.org/jira/browse/SPARK-48523 Project: Spark

[jira] [Created] (SPARK-48507) Use Hadoop 3.3.6 winutils in `build_sparkr_window`

2024-06-03 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48507: --- Summary: Use Hadoop 3.3.6 winutils in `build_sparkr_window` Key: SPARK-48507 URL: https://issues.apache.org/jira/browse/SPARK-48507 Project: Spark Issue Type:

[jira] [Updated] (SPARK-48488) Fix methods `log[info|warning|error]` in SparkSubmit

2024-06-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48488: Summary: Fix methods `log[info|warning|error]` in SparkSubmit (was: Restore the original logic

[jira] [Created] (SPARK-48490) Unescapes any literals for message of MessageWithContext

2024-05-31 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48490: --- Summary: Unescapes any literals for message of MessageWithContext Key: SPARK-48490 URL: https://issues.apache.org/jira/browse/SPARK-48490 Project: Spark Issue

[jira] [Created] (SPARK-48488) Restore the original logic of methods `log[info|warning|error]` in `SparkSubmit`

2024-05-31 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48488: --- Summary: Restore the original logic of methods `log[info|warning|error]` in `SparkSubmit` Key: SPARK-48488 URL: https://issues.apache.org/jira/browse/SPARK-48488

[jira] [Created] (SPARK-48474) Fix the class name of the log in `SparkSubmitArguments` & `SparkSubmit`

2024-05-30 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48474: --- Summary: Fix the class name of the log in `SparkSubmitArguments` & `SparkSubmit` Key: SPARK-48474 URL: https://issues.apache.org/jira/browse/SPARK-48474 Project: Spark

[jira] [Created] (SPARK-48467) Upgrade Maven to 3.9.7

2024-05-29 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48467: --- Summary: Upgrade Maven to 3.9.7 Key: SPARK-48467 URL: https://issues.apache.org/jira/browse/SPARK-48467 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48449) Using `getPropertyInfo` instead of `reflection` to obtain `JAAS application name`

2024-05-28 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48449: --- Summary: Using `getPropertyInfo` instead of `reflection` to obtain `JAAS application name` Key: SPARK-48449 URL: https://issues.apache.org/jira/browse/SPARK-48449

[jira] [Updated] (SPARK-48436) `c.m.c.j.Driver` instead of `c.m.j.Driver` in `MySQLNamespaceSuite`

2024-05-28 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48436: Summary: `c.m.c.j.Driver` instead of `c.m.j.Driver` in `MySQLNamespaceSuite` (was: Use

[jira] [Updated] (SPARK-48436) Use `c.m.c.j.Driver` instead of `c.m.j.Driver` in `MySQLNamespaceSuite`

2024-05-28 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48436: Summary: Use `c.m.c.j.Driver` instead of `c.m.j.Driver` in `MySQLNamespaceSuite` (was:

[jira] [Created] (SPARK-48436) Use `com.mysql.cj.jdbc.Driver` instead of `com.mysql.jdbc.Driver` in tests

2024-05-28 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48436: --- Summary: Use `com.mysql.cj.jdbc.Driver` instead of `com.mysql.jdbc.Driver` in tests Key: SPARK-48436 URL: https://issues.apache.org/jira/browse/SPARK-48436 Project:

[jira] [Created] (SPARK-48433) Upgrade `checkstyle` to 10.17.0

2024-05-27 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48433: --- Summary: Upgrade `checkstyle` to 10.17.0 Key: SPARK-48433 URL: https://issues.apache.org/jira/browse/SPARK-48433 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48420) Upgrade netty to `4.1.110.Final`

2024-05-24 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48420: --- Summary: Upgrade netty to `4.1.110.Final` Key: SPARK-48420 URL: https://issues.apache.org/jira/browse/SPARK-48420 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48409) Upgrade MySQL & Postgres & mariadb docker image version

2024-05-24 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48409: --- Summary: Upgrade MySQL & Postgres & mariadb docker image version Key: SPARK-48409 URL: https://issues.apache.org/jira/browse/SPARK-48409 Project: Spark Issue

[jira] [Created] (SPARK-48408) Simplify `date_format` & `from_unixtime`

2024-05-23 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48408: --- Summary: Simplify `date_format` & `from_unixtime` Key: SPARK-48408 URL: https://issues.apache.org/jira/browse/SPARK-48408 Project: Spark Issue Type:

[jira] [Created] (SPARK-48405) Upgrade `commons-compress` to 1.26.2

2024-05-23 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48405: --- Summary: Upgrade `commons-compress` to 1.26.2 Key: SPARK-48405 URL: https://issues.apache.org/jira/browse/SPARK-48405 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48386) Replace JVM assert with JUnit Assert in tests

2024-05-22 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48386: --- Summary: Replace JVM assert with JUnit Assert in tests Key: SPARK-48386 URL: https://issues.apache.org/jira/browse/SPARK-48386 Project: Spark Issue Type:

[jira] [Updated] (SPARK-48385) Migrate the jdbc driver of mariadb from 2.x to 3.x

2024-05-22 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48385: Summary: Migrate the jdbc driver of mariadb from 2.x to 3.x (was: Migrate the driver of mariadb

[jira] [Created] (SPARK-48384) Exclude `io.netty:netty-tcnative-boringssl-static` from `zookeeper`

2024-05-21 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48384: --- Summary: Exclude `io.netty:netty-tcnative-boringssl-static` from `zookeeper` Key: SPARK-48384 URL: https://issues.apache.org/jira/browse/SPARK-48384 Project: Spark

[jira] [Created] (SPARK-48363) Cleanup some redundant codes in `from_xml`

2024-05-20 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48363: --- Summary: Cleanup some redundant codes in `from_xml` Key: SPARK-48363 URL: https://issues.apache.org/jira/browse/SPARK-48363 Project: Spark Issue Type:

[jira] [Created] (SPARK-48332) Upgrade `jdbc` related test dependencies

2024-05-18 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48332: --- Summary: Upgrade `jdbc` related test dependencies Key: SPARK-48332 URL: https://issues.apache.org/jira/browse/SPARK-48332 Project: Spark Issue Type:

[jira] [Created] (SPARK-48328) Upgrade `Arrow` to 16.1.0

2024-05-17 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48328: --- Summary: Upgrade `Arrow` to 16.1.0 Key: SPARK-48328 URL: https://issues.apache.org/jira/browse/SPARK-48328 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-44810) XML: ArrayType and MapType support in from_xml

2024-05-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847457#comment-17847457 ] BingKun Pan commented on SPARK-44810: - Let me refactor it and delete unnecessary logic. Thank you

[jira] [Created] (SPARK-48324) Codegen Support for `hll_sketch_estimate` and `hll_union`

2024-05-17 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48324: --- Summary: Codegen Support for `hll_sketch_estimate` and `hll_union` Key: SPARK-48324 URL: https://issues.apache.org/jira/browse/SPARK-48324 Project: Spark

[jira] [Commented] (SPARK-44810) XML: ArrayType and MapType support in from_xml

2024-05-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847247#comment-17847247 ] BingKun Pan commented on SPARK-44810: - [~sandip.agarwala] Sorry to bother you, I want to know that

[jira] [Updated] (SPARK-44810) XML: ArrayType and MapType support in from_xml

2024-05-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44810: Attachment: image-2024-05-17-19-23-07-534.png > XML: ArrayType and MapType support in from_xml >

[jira] [Updated] (SPARK-44810) XML: ArrayType and MapType support in from_xml

2024-05-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44810: Attachment: image-2024-05-17-19-22-31-844.png > XML: ArrayType and MapType support in from_xml >

[jira] [Updated] (SPARK-48320) Add external third-party ecosystem access guide to the doc

2024-05-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48320: Summary: Add external third-party ecosystem access guide to the doc (was: Add third-party access

[jira] [Created] (SPARK-48320) Add third-party access guide to the doc

2024-05-17 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48320: --- Summary: Add third-party access guide to the doc Key: SPARK-48320 URL: https://issues.apache.org/jira/browse/SPARK-48320 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-48303) Reorganize `LogKey`

2024-05-16 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48303: Summary: Reorganize `LogKey` (was: Organize `LogKey`) > Reorganize `LogKey` >

[jira] [Created] (SPARK-48303) Organize `LogKey`

2024-05-16 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48303: --- Summary: Organize `LogKey` Key: SPARK-48303 URL: https://issues.apache.org/jira/browse/SPARK-48303 Project: Spark Issue Type: Sub-task Components:

[jira] [Commented] (SPARK-48300) Codegen Support for `from_xml`

2024-05-16 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846830#comment-17846830 ] BingKun Pan commented on SPARK-48300: - I work on it.   > Codegen Support for `from_xml` >

[jira] [Created] (SPARK-48300) Codegen Support for `from_xml`

2024-05-16 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48300: --- Summary: Codegen Support for `from_xml` Key: SPARK-48300 URL: https://issues.apache.org/jira/browse/SPARK-48300 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48296) Codegen Support for `to_xml`

2024-05-15 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48296: --- Summary: Codegen Support for `to_xml` Key: SPARK-48296 URL: https://issues.apache.org/jira/browse/SPARK-48296 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48256) Add a rule to check file headers for the java side, and fix inconsistent files

2024-05-13 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48256: --- Summary: Add a rule to check file headers for the java side, and fix inconsistent files Key: SPARK-48256 URL: https://issues.apache.org/jira/browse/SPARK-48256

[jira] [Updated] (SPARK-48251) Disable `maven local cache` on GA's step `MIMA test`

2024-05-13 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48251: Summary: Disable `maven local cache` on GA's step `MIMA test` (was: Disable `maven local cache`

[jira] [Created] (SPARK-48251) Disable `maven local cache` on step `MIMA test` of the GA's job `lint`

2024-05-13 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48251: --- Summary: Disable `maven local cache` on step `MIMA test` of the GA's job `lint` Key: SPARK-48251 URL: https://issues.apache.org/jira/browse/SPARK-48251 Project: Spark

[jira] [Created] (SPARK-48246) Add a new ScalaStyle Rule `RedundantIfChecker`

2024-05-12 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48246: --- Summary: Add a new ScalaStyle Rule `RedundantIfChecker` Key: SPARK-48246 URL: https://issues.apache.org/jira/browse/SPARK-48246 Project: Spark Issue Type:

[jira] [Created] (SPARK-48242) Upgrade extra-enforcer-rules to 1.8.0

2024-05-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48242: --- Summary: Upgrade extra-enforcer-rules to 1.8.0 Key: SPARK-48242 URL: https://issues.apache.org/jira/browse/SPARK-48242 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-48240) Replace `Local[..]` with `"Local[...]"` in the docs

2024-05-11 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48240: Summary: Replace `Local[..]` with `"Local[...]"` in the docs (was: Replace `Local[..]` with

[jira] [Created] (SPARK-48237) After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted

2024-05-10 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48237: --- Summary: After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted Key: SPARK-48237 URL: https://issues.apache.org/jira/browse/SPARK-48237

[jira] [Updated] (SPARK-48226) Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and `jvm-profiler` to `sbt-checkstyle`

2024-05-09 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48226: Component/s: Build (was: Project Infra) > Add `spark-ganglia-lgpl` to

[jira] [Created] (SPARK-48226) Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and `jvm-profiler` to `sbt-checkstyle`

2024-05-09 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48226: --- Summary: Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and `jvm-profiler` to `sbt-checkstyle` Key: SPARK-48226 URL:

[jira] [Created] (SPARK-48214) Ban import `org.slf4j.Logger` & `org.slf4j.LoggerFactory`

2024-05-09 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48214: --- Summary: Ban import `org.slf4j.Logger` & `org.slf4j.LoggerFactory` Key: SPARK-48214 URL: https://issues.apache.org/jira/browse/SPARK-48214 Project: Spark

[jira] [Created] (SPARK-48209) Common (java side): Migrate `error/warn/info` with variables to structured logging framework

2024-05-08 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48209: --- Summary: Common (java side): Migrate `error/warn/info` with variables to structured logging framework Key: SPARK-48209 URL: https://issues.apache.org/jira/browse/SPARK-48209

[jira] [Created] (SPARK-48198) Upgrade jackson to 2.17.1

2024-05-08 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48198: --- Summary: Upgrade jackson to 2.17.1 Key: SPARK-48198 URL: https://issues.apache.org/jira/browse/SPARK-48198 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times

2024-05-08 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48193: --- Summary: Make `maven-deploy-plugin` retry 3 times Key: SPARK-48193 URL: https://issues.apache.org/jira/browse/SPARK-48193 Project: Spark Issue Type:

[jira] [Created] (SPARK-48182) SQL (java side): Migrate `error/warn/info` with variables to structured logging framework

2024-05-07 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48182: --- Summary: SQL (java side): Migrate `error/warn/info` with variables to structured logging framework Key: SPARK-48182 URL: https://issues.apache.org/jira/browse/SPARK-48182

[jira] [Updated] (SPARK-48152) Make spark-profiler as a part of release and publish to maven central repo

2024-05-07 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48152: Summary: Make spark-profiler as a part of release and publish to maven central repo (was:

[jira] [Updated] (SPARK-48152) Publish the module `spark-profiler` to `maven central repository`

2024-05-07 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48152: Summary: Publish the module `spark-profiler` to `maven central repository` (was: Make the module

[jira] [Created] (SPARK-48165) Update `ap-loader` to 3.0-9

2024-05-07 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48165: --- Summary: Update `ap-loader` to 3.0-9 Key: SPARK-48165 URL: https://issues.apache.org/jira/browse/SPARK-48165 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48152) Make the module `spark-profiler` as a part of Spark release

2024-05-06 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48152: --- Summary: Make the module `spark-profiler` as a part of Spark release Key: SPARK-48152 URL: https://issues.apache.org/jira/browse/SPARK-48152 Project: Spark

[jira] [Created] (SPARK-48134) Spark core (java side): Migrate `error/warn/info` with variables to structured logging framework

2024-05-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48134: --- Summary: Spark core (java side): Migrate `error/warn/info` with variables to structured logging framework Key: SPARK-48134 URL: https://issues.apache.org/jira/browse/SPARK-48134

[jira] [Created] (SPARK-48059) Implement the structured log framework on the java side

2024-04-30 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48059: --- Summary: Implement the structured log framework on the java side Key: SPARK-48059 URL: https://issues.apache.org/jira/browse/SPARK-48059 Project: Spark Issue

[jira] [Updated] (SPARK-48029) Update the packages name removed in building the spark docker image

2024-04-28 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48029: Summary: Update the packages name removed in building the spark docker image (was: Make more

[jira] [Created] (SPARK-48029) Make more accurate to remove unused packages in spark docker image

2024-04-28 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48029: --- Summary: Make more accurate to remove unused packages in spark docker image Key: SPARK-48029 URL: https://issues.apache.org/jira/browse/SPARK-48029 Project: Spark

[jira] [Created] (SPARK-48021) Add `--add-modules=jdk.incubator.vector` to `JavaModuleOptions`

2024-04-27 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48021: --- Summary: Add `--add-modules=jdk.incubator.vector` to `JavaModuleOptions` Key: SPARK-48021 URL: https://issues.apache.org/jira/browse/SPARK-48021 Project: Spark

[jira] [Updated] (SPARK-47963) Make the external Spark ecosystem can use structured logging mechanisms

2024-04-25 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47963: Summary: Make the external Spark ecosystem can use structured logging mechanisms (was: Add an

[jira] [Created] (SPARK-47982) Update code style' plugins to latest version

2024-04-24 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47982: --- Summary: Update code style' plugins to latest version Key: SPARK-47982 URL: https://issues.apache.org/jira/browse/SPARK-47982 Project: Spark Issue Type:

[jira] [Created] (SPARK-47936) Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules

2024-04-22 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47936: --- Summary: Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules Key: SPARK-47936 URL: https://issues.apache.org/jira/browse/SPARK-47936 Project: Spark

[jira] [Resolved] (SPARK-47913) Move `src/test/java/test/*` to `src/test/java/*`

2024-04-19 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan resolved SPARK-47913. - Resolution: Not A Problem > Move `src/test/java/test/*` to `src/test/java/*` >

[jira] [Created] (SPARK-47913) Move `src/test/java/test/*` to `src/test/java/*`

2024-04-19 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47913: --- Summary: Move `src/test/java/test/*` to `src/test/java/*` Key: SPARK-47913 URL: https://issues.apache.org/jira/browse/SPARK-47913 Project: Spark Issue Type:

[jira] [Created] (SPARK-47896) Upgrade netty to `4.1.109.Final`

2024-04-17 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47896: --- Summary: Upgrade netty to `4.1.109.Final` Key: SPARK-47896 URL: https://issues.apache.org/jira/browse/SPARK-47896 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-47429) Rename errorClass to errorCondition

2024-04-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838412#comment-17838412 ] BingKun Pan edited comment on SPARK-47429 at 4/18/24 1:26 AM: -- This will be

[jira] [Comment Edited] (SPARK-47429) Rename errorClass to errorCondition

2024-04-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838412#comment-17838412 ] BingKun Pan edited comment on SPARK-47429 at 4/18/24 1:26 AM: -- This will be

[jira] [Commented] (SPARK-47429) Rename errorClass to errorCondition

2024-04-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838412#comment-17838412 ] BingKun Pan commented on SPARK-47429: - This will be a very huge task, and I roughly counted almost

[jira] [Created] (SPARK-47825) Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` deprecated

2024-04-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47825: --- Summary: Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` deprecated Key: SPARK-47825 URL: https://issues.apache.org/jira/browse/SPARK-47825 Project:

[jira] [Created] (SPARK-47814) Remove the `KinesisTestUtils` from `main` to `test`

2024-04-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47814: --- Summary: Remove the `KinesisTestUtils` from `main` to `test` Key: SPARK-47814 URL: https://issues.apache.org/jira/browse/SPARK-47814 Project: Spark Issue

[jira] [Created] (SPARK-47748) Upgrade `zstd-jni` to 1.5.6-2

2024-04-06 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47748: --- Summary: Upgrade `zstd-jni` to 1.5.6-2 Key: SPARK-47748 URL: https://issues.apache.org/jira/browse/SPARK-47748 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47688) Support `three` methods of the log `concatenation` in the `structured logging framework`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Summary: Support `three` methods of the log `concatenation` in the `structured logging framework`

[jira] [Updated] (SPARK-47688) Support `three` types of the log `concatenation` in the `structured logging framework`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Description: Allow log syntax like - 1.log"... MDC(...) $normal_variables ..." {code:java}

[jira] [Updated] (SPARK-47688) Support `three` types of the log `concatenation` in the `structured logging framework`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Summary: Support `three` types of the log `concatenation` in the `structured logging framework`

[jira] [Updated] (SPARK-47688) Support concatenation `normal variables` and `MDC`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Description: Allow log syntax like {code:java} log"Driver terminated with exit code

[jira] [Updated] (SPARK-47688) Support concatenation `normal variables` and `MDC`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Summary: Support concatenation `normal variables` and `MDC` (was: Support concatenation between

[jira] [Created] (SPARK-47688) Support concatenation between `normal variables` and `MDC`

2024-04-02 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47688: --- Summary: Support concatenation between `normal variables` and `MDC` Key: SPARK-47688 URL: https://issues.apache.org/jira/browse/SPARK-47688 Project: Spark

[jira] [Commented] (SPARK-47240) SPIP: Structured Logging Framework for Apache Spark

2024-04-01 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832783#comment-17832783 ] BingKun Pan commented on SPARK-47240: - [~Gengliang.Wang] Can I participate in the subsequent log

[jira] [Created] (SPARK-47649) Make the parameter `inputs` of the function `[csv|parquet|orc|json|text|xml](paths: String*)` non empty

2024-03-29 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47649: --- Summary: Make the parameter `inputs` of the function `[csv|parquet|orc|json|text|xml](paths: String*)` non empty Key: SPARK-47649 URL:

[jira] [Updated] (SPARK-47648) Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite` and `[Csv|Json]FunctionsSuite`

2024-03-29 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47648: Summary: Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite` and

[jira] [Updated] (SPARK-47648) Use checkError() to check Exception in [CSV|Json|Xml]Suite and [Csv|Json]FunctionsSuite

2024-03-29 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47648: Summary: Use checkError() to check Exception in [CSV|Json|Xml]Suite and [Csv|Json]FunctionsSuite

[jira] [Updated] (SPARK-47648) Use checkError() to check Exception in [Json|Xml|CSV]Suite and [Json|CSV]FunctionsSuite

2024-03-29 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47648: Summary: Use checkError() to check Exception in [Json|Xml|CSV]Suite and [Json|CSV]FunctionsSuite

[jira] [Updated] (SPARK-47648) Use checkError() to check Exception in `Json/Xml/CSV`Suite and `Csv/Json`FunctionsSuite

2024-03-29 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47648: Summary: Use checkError() to check Exception in `Json/Xml/CSV`Suite and `Csv/Json`FunctionsSuite

[jira] [Created] (SPARK-47648) Use checkError() to check Exception in `Json/Xml/Csv`Suite and ``

2024-03-29 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47648: --- Summary: Use checkError() to check Exception in `Json/Xml/Csv`Suite and `` Key: SPARK-47648 URL: https://issues.apache.org/jira/browse/SPARK-47648 Project: Spark

[jira] [Updated] (SPARK-47614) Update some outdated comments about JavaModuleOptions

2024-03-28 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47614: Component/s: Documentation > Update some outdated comments about JavaModuleOptions >

[jira] [Updated] (SPARK-47614) Update some outdated comments about JavaModuleOptions

2024-03-28 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47614: Summary: Update some outdated comments about JavaModuleOptions (was: Rename `JavaModuleOptions`

[jira] [Created] (SPARK-47614) Rename `JavaModuleOptions` to `JVMRuntimeOptions`

2024-03-27 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47614: --- Summary: Rename `JavaModuleOptions` to `JVMRuntimeOptions` Key: SPARK-47614 URL: https://issues.apache.org/jira/browse/SPARK-47614 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47559) Codegen Support for variant `parse_json`

2024-03-26 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47559: Summary: Codegen Support for variant `parse_json` (was: Codegen Support for variant parse_json)

[jira] [Created] (SPARK-47559) Codegen Support for variant parse_json

2024-03-26 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47559: --- Summary: Codegen Support for variant parse_json Key: SPARK-47559 URL: https://issues.apache.org/jira/browse/SPARK-47559 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47539) Make the return value of method `castToString` be `Any => UTF8String`

2024-03-25 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47539: Summary: Make the return value of method `castToString` be `Any => UTF8String` (was: Make the

[jira] [Created] (SPARK-47539) Make the method `castToString(from: DataType): Any => Any` to `castToString(from: DataType): Any => UTF8String` in `ToStringBase`.

2024-03-25 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47539: --- Summary: Make the method `castToString(from: DataType): Any => Any` to `castToString(from: DataType): Any => UTF8String` in `ToStringBase`. Key: SPARK-47539 URL:

[jira] [Created] (SPARK-47533) Migrate scalafmt dialect to scala213

2024-03-24 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47533: --- Summary: Migrate scalafmt dialect to scala213 Key: SPARK-47533 URL: https://issues.apache.org/jira/browse/SPARK-47533 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47526) Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final

2024-03-23 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47526: Summary: Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final (was: Upgrade

[jira] [Created] (SPARK-47529) Use hadoop 3.4.0 in some docs

2024-03-23 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47529: --- Summary: Use hadoop 3.4.0 in some docs Key: SPARK-47529 URL: https://issues.apache.org/jira/browse/SPARK-47529 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47526) Upgrade `netty` to 4.1.108.Final, `netty-tcnative` to 2.0.65.Final and `arrow-memory-netty` to 15.0.2

2024-03-23 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47526: --- Summary: Upgrade `netty` to 4.1.108.Final, `netty-tcnative` to 2.0.65.Final and `arrow-memory-netty` to 15.0.2 Key: SPARK-47526 URL:

[jira] [Updated] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`

2024-03-21 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47516: Description: When creating the docker image, remove unused installation packages. > Move `remove

[jira] [Updated] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`

2024-03-21 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47516: Summary: Move `remove unused installation package logic` from `each test job` to `create the

[jira] [Created] (SPARK-47516) When creating the docker image, remove unused installation packages

2024-03-21 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47516: --- Summary: When creating the docker image, remove unused installation packages Key: SPARK-47516 URL: https://issues.apache.org/jira/browse/SPARK-47516 Project: Spark

  1   2   3   4   5   6   7   8   >