[jira] [Created] (SPARK-48214) Ban import `org.slf4j.Logger` & `org.slf4j.LoggerFactory`

2024-05-09 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48214: --- Summary: Ban import `org.slf4j.Logger` & `org.slf4j.LoggerFactory` Key: SPARK-48214 URL: https://issues.apache.org/jira/browse/SPARK-48214 Project: Spark

[jira] [Created] (SPARK-48209) Common (java side): Migrate `error/warn/info` with variables to structured logging framework

2024-05-08 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48209: --- Summary: Common (java side): Migrate `error/warn/info` with variables to structured logging framework Key: SPARK-48209 URL: https://issues.apache.org/jira/browse/SPARK-48209

[jira] [Created] (SPARK-48198) Upgrade jackson to 2.17.1

2024-05-08 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48198: --- Summary: Upgrade jackson to 2.17.1 Key: SPARK-48198 URL: https://issues.apache.org/jira/browse/SPARK-48198 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times

2024-05-08 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48193: --- Summary: Make `maven-deploy-plugin` retry 3 times Key: SPARK-48193 URL: https://issues.apache.org/jira/browse/SPARK-48193 Project: Spark Issue Type:

[jira] [Created] (SPARK-48182) SQL (java side): Migrate `error/warn/info` with variables to structured logging framework

2024-05-07 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48182: --- Summary: SQL (java side): Migrate `error/warn/info` with variables to structured logging framework Key: SPARK-48182 URL: https://issues.apache.org/jira/browse/SPARK-48182

[jira] [Updated] (SPARK-48152) Make spark-profiler as a part of release and publish to maven central repo

2024-05-07 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48152: Summary: Make spark-profiler as a part of release and publish to maven central repo (was:

[jira] [Updated] (SPARK-48152) Publish the module `spark-profiler` to `maven central repository`

2024-05-07 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48152: Summary: Publish the module `spark-profiler` to `maven central repository` (was: Make the module

[jira] [Created] (SPARK-48165) Update `ap-loader` to 3.0-9

2024-05-07 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48165: --- Summary: Update `ap-loader` to 3.0-9 Key: SPARK-48165 URL: https://issues.apache.org/jira/browse/SPARK-48165 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48152) Make the module `spark-profiler` as a part of Spark release

2024-05-06 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48152: --- Summary: Make the module `spark-profiler` as a part of Spark release Key: SPARK-48152 URL: https://issues.apache.org/jira/browse/SPARK-48152 Project: Spark

[jira] [Created] (SPARK-48134) Spark core (java side): Migrate `error/warn/info` with variables to structured logging framework

2024-05-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48134: --- Summary: Spark core (java side): Migrate `error/warn/info` with variables to structured logging framework Key: SPARK-48134 URL: https://issues.apache.org/jira/browse/SPARK-48134

[jira] [Created] (SPARK-48059) Implement the structured log framework on the java side

2024-04-30 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48059: --- Summary: Implement the structured log framework on the java side Key: SPARK-48059 URL: https://issues.apache.org/jira/browse/SPARK-48059 Project: Spark Issue

[jira] [Updated] (SPARK-48029) Update the packages name removed in building the spark docker image

2024-04-28 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48029: Summary: Update the packages name removed in building the spark docker image (was: Make more

[jira] [Created] (SPARK-48029) Make more accurate to remove unused packages in spark docker image

2024-04-28 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48029: --- Summary: Make more accurate to remove unused packages in spark docker image Key: SPARK-48029 URL: https://issues.apache.org/jira/browse/SPARK-48029 Project: Spark

[jira] [Created] (SPARK-48021) Add `--add-modules=jdk.incubator.vector` to `JavaModuleOptions`

2024-04-27 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48021: --- Summary: Add `--add-modules=jdk.incubator.vector` to `JavaModuleOptions` Key: SPARK-48021 URL: https://issues.apache.org/jira/browse/SPARK-48021 Project: Spark

[jira] [Updated] (SPARK-47963) Make the external Spark ecosystem can use structured logging mechanisms

2024-04-25 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47963: Summary: Make the external Spark ecosystem can use structured logging mechanisms (was: Add an

[jira] [Created] (SPARK-47982) Update code style' plugins to latest version

2024-04-24 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47982: --- Summary: Update code style' plugins to latest version Key: SPARK-47982 URL: https://issues.apache.org/jira/browse/SPARK-47982 Project: Spark Issue Type:

[jira] [Created] (SPARK-47936) Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules

2024-04-22 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47936: --- Summary: Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules Key: SPARK-47936 URL: https://issues.apache.org/jira/browse/SPARK-47936 Project: Spark

[jira] [Resolved] (SPARK-47913) Move `src/test/java/test/*` to `src/test/java/*`

2024-04-19 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan resolved SPARK-47913. - Resolution: Not A Problem > Move `src/test/java/test/*` to `src/test/java/*` >

[jira] [Created] (SPARK-47913) Move `src/test/java/test/*` to `src/test/java/*`

2024-04-19 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47913: --- Summary: Move `src/test/java/test/*` to `src/test/java/*` Key: SPARK-47913 URL: https://issues.apache.org/jira/browse/SPARK-47913 Project: Spark Issue Type:

[jira] [Created] (SPARK-47896) Upgrade netty to `4.1.109.Final`

2024-04-17 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47896: --- Summary: Upgrade netty to `4.1.109.Final` Key: SPARK-47896 URL: https://issues.apache.org/jira/browse/SPARK-47896 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-47429) Rename errorClass to errorCondition

2024-04-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838412#comment-17838412 ] BingKun Pan edited comment on SPARK-47429 at 4/18/24 1:26 AM: -- This will be

[jira] [Comment Edited] (SPARK-47429) Rename errorClass to errorCondition

2024-04-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838412#comment-17838412 ] BingKun Pan edited comment on SPARK-47429 at 4/18/24 1:26 AM: -- This will be

[jira] [Commented] (SPARK-47429) Rename errorClass to errorCondition

2024-04-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838412#comment-17838412 ] BingKun Pan commented on SPARK-47429: - This will be a very huge task, and I roughly counted almost

[jira] [Created] (SPARK-47825) Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` deprecated

2024-04-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47825: --- Summary: Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` deprecated Key: SPARK-47825 URL: https://issues.apache.org/jira/browse/SPARK-47825 Project:

[jira] [Created] (SPARK-47814) Remove the `KinesisTestUtils` from `main` to `test`

2024-04-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47814: --- Summary: Remove the `KinesisTestUtils` from `main` to `test` Key: SPARK-47814 URL: https://issues.apache.org/jira/browse/SPARK-47814 Project: Spark Issue

[jira] [Created] (SPARK-47748) Upgrade `zstd-jni` to 1.5.6-2

2024-04-06 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47748: --- Summary: Upgrade `zstd-jni` to 1.5.6-2 Key: SPARK-47748 URL: https://issues.apache.org/jira/browse/SPARK-47748 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47688) Support `three` methods of the log `concatenation` in the `structured logging framework`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Summary: Support `three` methods of the log `concatenation` in the `structured logging framework`

[jira] [Updated] (SPARK-47688) Support `three` types of the log `concatenation` in the `structured logging framework`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Description: Allow log syntax like - 1.log"... MDC(...) $normal_variables ..." {code:java}

[jira] [Updated] (SPARK-47688) Support `three` types of the log `concatenation` in the `structured logging framework`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Summary: Support `three` types of the log `concatenation` in the `structured logging framework`

[jira] [Updated] (SPARK-47688) Support concatenation `normal variables` and `MDC`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Description: Allow log syntax like {code:java} log"Driver terminated with exit code

[jira] [Updated] (SPARK-47688) Support concatenation `normal variables` and `MDC`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Summary: Support concatenation `normal variables` and `MDC` (was: Support concatenation between

[jira] [Created] (SPARK-47688) Support concatenation between `normal variables` and `MDC`

2024-04-02 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47688: --- Summary: Support concatenation between `normal variables` and `MDC` Key: SPARK-47688 URL: https://issues.apache.org/jira/browse/SPARK-47688 Project: Spark

[jira] [Commented] (SPARK-47240) SPIP: Structured Logging Framework for Apache Spark

2024-04-01 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832783#comment-17832783 ] BingKun Pan commented on SPARK-47240: - [~Gengliang.Wang] Can I participate in the subsequent log

[jira] [Created] (SPARK-47649) Make the parameter `inputs` of the function `[csv|parquet|orc|json|text|xml](paths: String*)` non empty

2024-03-29 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47649: --- Summary: Make the parameter `inputs` of the function `[csv|parquet|orc|json|text|xml](paths: String*)` non empty Key: SPARK-47649 URL:

[jira] [Updated] (SPARK-47648) Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite` and `[Csv|Json]FunctionsSuite`

2024-03-29 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47648: Summary: Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite` and

[jira] [Updated] (SPARK-47648) Use checkError() to check Exception in [CSV|Json|Xml]Suite and [Csv|Json]FunctionsSuite

2024-03-29 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47648: Summary: Use checkError() to check Exception in [CSV|Json|Xml]Suite and [Csv|Json]FunctionsSuite

[jira] [Updated] (SPARK-47648) Use checkError() to check Exception in [Json|Xml|CSV]Suite and [Json|CSV]FunctionsSuite

2024-03-29 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47648: Summary: Use checkError() to check Exception in [Json|Xml|CSV]Suite and [Json|CSV]FunctionsSuite

[jira] [Updated] (SPARK-47648) Use checkError() to check Exception in `Json/Xml/CSV`Suite and `Csv/Json`FunctionsSuite

2024-03-29 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47648: Summary: Use checkError() to check Exception in `Json/Xml/CSV`Suite and `Csv/Json`FunctionsSuite

[jira] [Created] (SPARK-47648) Use checkError() to check Exception in `Json/Xml/Csv`Suite and ``

2024-03-29 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47648: --- Summary: Use checkError() to check Exception in `Json/Xml/Csv`Suite and `` Key: SPARK-47648 URL: https://issues.apache.org/jira/browse/SPARK-47648 Project: Spark

[jira] [Updated] (SPARK-47614) Update some outdated comments about JavaModuleOptions

2024-03-28 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47614: Component/s: Documentation > Update some outdated comments about JavaModuleOptions >

[jira] [Updated] (SPARK-47614) Update some outdated comments about JavaModuleOptions

2024-03-28 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47614: Summary: Update some outdated comments about JavaModuleOptions (was: Rename `JavaModuleOptions`

[jira] [Created] (SPARK-47614) Rename `JavaModuleOptions` to `JVMRuntimeOptions`

2024-03-27 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47614: --- Summary: Rename `JavaModuleOptions` to `JVMRuntimeOptions` Key: SPARK-47614 URL: https://issues.apache.org/jira/browse/SPARK-47614 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47559) Codegen Support for variant `parse_json`

2024-03-26 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47559: Summary: Codegen Support for variant `parse_json` (was: Codegen Support for variant parse_json)

[jira] [Created] (SPARK-47559) Codegen Support for variant parse_json

2024-03-26 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47559: --- Summary: Codegen Support for variant parse_json Key: SPARK-47559 URL: https://issues.apache.org/jira/browse/SPARK-47559 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47539) Make the return value of method `castToString` be `Any => UTF8String`

2024-03-25 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47539: Summary: Make the return value of method `castToString` be `Any => UTF8String` (was: Make the

[jira] [Created] (SPARK-47539) Make the method `castToString(from: DataType): Any => Any` to `castToString(from: DataType): Any => UTF8String` in `ToStringBase`.

2024-03-25 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47539: --- Summary: Make the method `castToString(from: DataType): Any => Any` to `castToString(from: DataType): Any => UTF8String` in `ToStringBase`. Key: SPARK-47539 URL:

[jira] [Created] (SPARK-47533) Migrate scalafmt dialect to scala213

2024-03-24 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47533: --- Summary: Migrate scalafmt dialect to scala213 Key: SPARK-47533 URL: https://issues.apache.org/jira/browse/SPARK-47533 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47526) Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final

2024-03-23 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47526: Summary: Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final (was: Upgrade

[jira] [Created] (SPARK-47529) Use hadoop 3.4.0 in some docs

2024-03-23 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47529: --- Summary: Use hadoop 3.4.0 in some docs Key: SPARK-47529 URL: https://issues.apache.org/jira/browse/SPARK-47529 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47526) Upgrade `netty` to 4.1.108.Final, `netty-tcnative` to 2.0.65.Final and `arrow-memory-netty` to 15.0.2

2024-03-23 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47526: --- Summary: Upgrade `netty` to 4.1.108.Final, `netty-tcnative` to 2.0.65.Final and `arrow-memory-netty` to 15.0.2 Key: SPARK-47526 URL:

[jira] [Updated] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`

2024-03-21 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47516: Description: When creating the docker image, remove unused installation packages. > Move `remove

[jira] [Updated] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`

2024-03-21 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47516: Summary: Move `remove unused installation package logic` from `each test job` to `create the

[jira] [Created] (SPARK-47516) When creating the docker image, remove unused installation packages

2024-03-21 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47516: --- Summary: When creating the docker image, remove unused installation packages Key: SPARK-47516 URL: https://issues.apache.org/jira/browse/SPARK-47516 Project: Spark

[jira] [Updated] (SPARK-47497) Make `to_csv` support the output of `array/struct/map` as pretty strings

2024-03-21 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47497: Summary: Make `to_csv` support the output of `array/struct/map` as pretty strings (was: Make

[jira] [Updated] (SPARK-47497) Make `to_csv` support the output of `array/struct/map ` as pretty strings

2024-03-21 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47497: Summary: Make `to_csv` support the output of `array/struct/map ` as pretty strings (was: Make

[jira] [Created] (SPARK-47514) Add a test coverage for createTable method (partitioned-table) in CatalogSuite

2024-03-21 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47514: --- Summary: Add a test coverage for createTable method (partitioned-table) in CatalogSuite Key: SPARK-47514 URL: https://issues.apache.org/jira/browse/SPARK-47514

[jira] [Updated] (SPARK-47505) Fix `pyspark-errors` test jobs for branch-3.4

2024-03-21 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47505: Summary: Fix `pyspark-errors` test jobs for branch-3.4 (was: Fix `Pyspark-errors` for

[jira] [Created] (SPARK-47505) Fix `Pyspark-errors` for branch-3.4

2024-03-21 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47505: --- Summary: Fix `Pyspark-errors` for branch-3.4 Key: SPARK-47505 URL: https://issues.apache.org/jira/browse/SPARK-47505 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47502) Make the `size` of the installed packages output in `descending` order, and add a `header`

2024-03-21 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47502: Summary: Make the `size` of the installed packages output in `descending` order, and add a

[jira] [Created] (SPARK-47502) Make the size of the installed packages output in the script `free_disk_space` and `free_disk_space_container` be output in `descending order`

2024-03-21 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47502: --- Summary: Make the size of the installed packages output in the script `free_disk_space` and `free_disk_space_container` be output in `descending order` Key: SPARK-47502 URL:

[jira] [Commented] (SPARK-47497) Make `to_csv` support some types of data

2024-03-20 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829378#comment-17829378 ] BingKun Pan commented on SPARK-47497: - I work on it > Make `to_csv` support some types of data >

[jira] [Updated] (SPARK-47497) Make `to_csv` support some types of data

2024-03-20 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47497: Summary: Make `to_csv` support some types of data (was: Upgrade github action cache to v4) >

[jira] [Updated] (SPARK-47481) Fix Python linter

2024-03-20 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47481: Summary: Fix Python linter (was: pin `matplotlib<3.3.0`) > Fix Python linter > -

[jira] [Updated] (SPARK-47481) Fix Python linter

2024-03-20 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47481: Affects Version/s: 3.5.2 > Fix Python linter > - > > Key:

[jira] [Created] (SPARK-47481) pin `matplotlib<3.3.0`

2024-03-20 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47481: --- Summary: pin `matplotlib<3.3.0` Key: SPARK-47481 URL: https://issues.apache.org/jira/browse/SPARK-47481 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47464) Update labeler.yml

2024-03-19 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47464: --- Summary: Update labeler.yml Key: SPARK-47464 URL: https://issues.apache.org/jira/browse/SPARK-47464 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47460) Fix daily scheduled jobs for branch-3.4 & branch-3.5

2024-03-19 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47460: --- Summary: Fix daily scheduled jobs for branch-3.4 & branch-3.5 Key: SPARK-47460 URL: https://issues.apache.org/jira/browse/SPARK-47460 Project: Spark Issue

[jira] [Updated] (SPARK-47426) Upgrade Guava used by the connect module to 33.1.0-jre

2024-03-15 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47426: Summary: Upgrade Guava used by the connect module to 33.1.0-jre (was: Upgrade Guava used by the

[jira] [Updated] (SPARK-47419) Move `log4j2-defaults.properties` to `common/utils`

2024-03-15 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47419: Summary: Move `log4j2-defaults.properties` to `common/utils` (was: Move

[jira] [Created] (SPARK-47419) Move `log4j2-defaults.properties` to `common\utils`

2024-03-15 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47419: --- Summary: Move `log4j2-defaults.properties` to `common\utils` Key: SPARK-47419 URL: https://issues.apache.org/jira/browse/SPARK-47419 Project: Spark Issue

[jira] [Created] (SPARK-47387) Remove some unused error classes

2024-03-14 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47387: --- Summary: Remove some unused error classes Key: SPARK-47387 URL: https://issues.apache.org/jira/browse/SPARK-47387 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47378) Make the related Protobuf UT run well in IDE

2024-03-13 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47378: Summary: Make the related Protobuf UT run well in IDE (was: Make related Protobuf UT run well in

[jira] [Created] (SPARK-47378) Make related Protobuf UT run well in IDE

2024-03-13 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47378: --- Summary: Make related Protobuf UT run well in IDE Key: SPARK-47378 URL: https://issues.apache.org/jira/browse/SPARK-47378 Project: Spark Issue Type:

[jira] [Created] (SPARK-47374) Fix connect-repl `usage prompt` & `docs link`

2024-03-13 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47374: --- Summary: Fix connect-repl `usage prompt` & `docs link` Key: SPARK-47374 URL: https://issues.apache.org/jira/browse/SPARK-47374 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-47348) Align the version of the ubuntu host machine where the GitHub workflow runs on

2024-03-12 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47348: --- Summary: Align the version of the ubuntu host machine where the GitHub workflow runs on Key: SPARK-47348 URL: https://issues.apache.org/jira/browse/SPARK-47348

[jira] [Created] (SPARK-47339) Upgrade checkStyle to `10.14.0`.

2024-03-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47339: --- Summary: Upgrade checkStyle to `10.14.0`. Key: SPARK-47339 URL: https://issues.apache.org/jira/browse/SPARK-47339 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47333) Use checkInputDataTypes to check the parameter types of the function to_xml & remove _LEGACY_ERROR_TEMP_3234

2024-03-09 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47333: --- Summary: Use checkInputDataTypes to check the parameter types of the function to_xml & remove _LEGACY_ERROR_TEMP_3234 Key: SPARK-47333 URL:

[jira] [Updated] (SPARK-47325) Use the latest buf-setup-action in github workflow

2024-03-08 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47325: Component/s: Project Infra (was: Build) > Use the latest buf-setup-action in

[jira] [Created] (SPARK-47325) Use the latest buf-setup-action in github workflow

2024-03-08 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47325: --- Summary: Use the latest buf-setup-action in github workflow Key: SPARK-47325 URL: https://issues.apache.org/jira/browse/SPARK-47325 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47301) Fix flaky ParquetIOSuite

2024-03-06 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47301: Component/s: SQL (was: Spark Core) > Fix flaky ParquetIOSuite >

[jira] [Created] (SPARK-47301) Fix flaky ParquetIOSuite

2024-03-06 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47301: --- Summary: Fix flaky ParquetIOSuite Key: SPARK-47301 URL: https://issues.apache.org/jira/browse/SPARK-47301 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47299) Use the same `versions. json` in the dropdown of different versions of PySpark documents

2024-03-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47299: --- Summary: Use the same `versions. json` in the dropdown of different versions of PySpark documents Key: SPARK-47299 URL: https://issues.apache.org/jira/browse/SPARK-47299

[jira] [Created] (SPARK-47298) Upgrade `mysql-connector-j` to `8.3.0` and `mariadb-java-client` to `2.7.12`

2024-03-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47298: --- Summary: Upgrade `mysql-connector-j` to `8.3.0` and `mariadb-java-client` to `2.7.12` Key: SPARK-47298 URL: https://issues.apache.org/jira/browse/SPARK-47298 Project:

[jira] [Updated] (SPARK-47281) Update the `versions. json` file for the already released spark version

2024-03-05 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47281: Summary: Update the `versions. json` file for the already released spark version (was: Update

[jira] [Created] (SPARK-47283) Remove Spark version drop down to the PySpark doc site

2024-03-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47283: --- Summary: Remove Spark version drop down to the PySpark doc site Key: SPARK-47283 URL: https://issues.apache.org/jira/browse/SPARK-47283 Project: Spark Issue

[jira] [Updated] (SPARK-47281) Update the `versions. json` file for the already released saprk version

2024-03-05 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47281: Affects Version/s: 3.5.1 > Update the `versions. json` file for the already released saprk

[jira] [Created] (SPARK-47281) Update the `versions. json` file for the already released saprk version

2024-03-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47281: --- Summary: Update the `versions. json` file for the already released saprk version Key: SPARK-47281 URL: https://issues.apache.org/jira/browse/SPARK-47281 Project: Spark

[jira] [Updated] (SPARK-47265) Use `createTable(..., schema: StructType, ...)` instead of `createTable(..., columns: Array[Column], ...)` in UT

2024-03-04 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47265: Summary: Use `createTable(..., schema: StructType, ...)` instead of `createTable(..., columns:

[jira] [Resolved] (SPARK-47265) Enable test of v2 data sources in `FileBasedDataSourceSuite`

2024-03-03 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan resolved SPARK-47265. - Resolution: Won't Fix > Enable test of v2 data sources in `FileBasedDataSourceSuite` >

[jira] [Created] (SPARK-47265) Enable test of v2 data sources in `FileBasedDataSourceSuite`

2024-03-03 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47265: --- Summary: Enable test of v2 data sources in `FileBasedDataSourceSuite` Key: SPARK-47265 URL: https://issues.apache.org/jira/browse/SPARK-47265 Project: Spark

[jira] [Created] (SPARK-47237) Upgrade xmlschema-core to 2.3.1

2024-02-29 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47237: --- Summary: Upgrade xmlschema-core to 2.3.1 Key: SPARK-47237 URL: https://issues.apache.org/jira/browse/SPARK-47237 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47099) The `start` value of `paramIndex` for the error class `UNEXPECTED_INPUT_TYPE` should be `1`1

2024-02-19 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47099: --- Summary: The `start` value of `paramIndex` for the error class `UNEXPECTED_INPUT_TYPE` should be `1`1 Key: SPARK-47099 URL: https://issues.apache.org/jira/browse/SPARK-47099

[jira] [Created] (SPARK-47083) Upgrade `commons-codec` to 1.16.1

2024-02-17 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47083: --- Summary: Upgrade `commons-codec` to 1.16.1 Key: SPARK-47083 URL: https://issues.apache.org/jira/browse/SPARK-47083 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46971) When the `compression` is null, a `NullPointException` should not be thrown

2024-02-03 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46971: --- Summary: When the `compression` is null, a `NullPointException` should not be thrown Key: SPARK-46971 URL: https://issues.apache.org/jira/browse/SPARK-46971 Project:

[jira] [Updated] (SPARK-46950) Align `not available codec` error-class

2024-02-01 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46950: Summary: Align `not available codec` error-class (was: Align not available codec error-class) >

[jira] [Updated] (SPARK-46950) Align not available codec error-class

2024-02-01 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46950: Summary: Align not available codec error-class (was: Align not avaliable codec error-class) >

[jira] [Updated] (SPARK-46950) Align not avaliable codec error-class

2024-02-01 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46950: Summary: Align not avaliable codec error-class (was: Align not avaliable codec error) > Align

[jira] [Created] (SPARK-46950) Align not avaliable codec error

2024-02-01 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46950: --- Summary: Align not avaliable codec error Key: SPARK-46950 URL: https://issues.apache.org/jira/browse/SPARK-46950 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46940) Remove unused `updateSparkConfigFromProperties` and `isAbsoluteURI` in `o.a.s.u.Utils`

2024-01-31 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46940: --- Summary: Remove unused `updateSparkConfigFromProperties` and `isAbsoluteURI` in `o.a.s.u.Utils` Key: SPARK-46940 URL: https://issues.apache.org/jira/browse/SPARK-46940

[jira] [Updated] (SPARK-46917) [SPARK-46753][PYTHON][TESTS] Fix pypy3 python test

2024-01-30 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46917: Summary: [SPARK-46753][PYTHON][TESTS] Fix pypy3 python test (was: Improve merge_spark_pr.py) >

  1   2   3   4   5   6   7   8   >