[jira] [Commented] (SPARK-47497) Make `to_csv` support some types of data

2024-03-20 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829378#comment-17829378 ] BingKun Pan commented on SPARK-47497: - I work on it > Make `to_csv` support some types of data >

[jira] [Updated] (SPARK-47497) Make `to_csv` support some types of data

2024-03-20 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47497: Summary: Make `to_csv` support some types of data (was: Upgrade github action cache to v4) >

[jira] [Updated] (SPARK-47481) Fix Python linter

2024-03-20 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47481: Summary: Fix Python linter (was: pin `matplotlib<3.3.0`) > Fix Python linter > -

[jira] [Updated] (SPARK-47481) Fix Python linter

2024-03-20 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47481: Affects Version/s: 3.5.2 > Fix Python linter > - > > Key:

[jira] [Created] (SPARK-47481) pin `matplotlib<3.3.0`

2024-03-20 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47481: --- Summary: pin `matplotlib<3.3.0` Key: SPARK-47481 URL: https://issues.apache.org/jira/browse/SPARK-47481 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47464) Update labeler.yml

2024-03-19 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47464: --- Summary: Update labeler.yml Key: SPARK-47464 URL: https://issues.apache.org/jira/browse/SPARK-47464 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47460) Fix daily scheduled jobs for branch-3.4 & branch-3.5

2024-03-19 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47460: --- Summary: Fix daily scheduled jobs for branch-3.4 & branch-3.5 Key: SPARK-47460 URL: https://issues.apache.org/jira/browse/SPARK-47460 Project: Spark Issue

[jira] [Updated] (SPARK-47426) Upgrade Guava used by the connect module to 33.1.0-jre

2024-03-15 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47426: Summary: Upgrade Guava used by the connect module to 33.1.0-jre (was: Upgrade Guava used by the

[jira] [Updated] (SPARK-47419) Move `log4j2-defaults.properties` to `common/utils`

2024-03-15 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47419: Summary: Move `log4j2-defaults.properties` to `common/utils` (was: Move

[jira] [Created] (SPARK-47419) Move `log4j2-defaults.properties` to `common\utils`

2024-03-15 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47419: --- Summary: Move `log4j2-defaults.properties` to `common\utils` Key: SPARK-47419 URL: https://issues.apache.org/jira/browse/SPARK-47419 Project: Spark Issue

[jira] [Created] (SPARK-47387) Remove some unused error classes

2024-03-14 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47387: --- Summary: Remove some unused error classes Key: SPARK-47387 URL: https://issues.apache.org/jira/browse/SPARK-47387 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47378) Make the related Protobuf UT run well in IDE

2024-03-13 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47378: Summary: Make the related Protobuf UT run well in IDE (was: Make related Protobuf UT run well in

[jira] [Created] (SPARK-47378) Make related Protobuf UT run well in IDE

2024-03-13 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47378: --- Summary: Make related Protobuf UT run well in IDE Key: SPARK-47378 URL: https://issues.apache.org/jira/browse/SPARK-47378 Project: Spark Issue Type:

[jira] [Created] (SPARK-47374) Fix connect-repl `usage prompt` & `docs link`

2024-03-13 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47374: --- Summary: Fix connect-repl `usage prompt` & `docs link` Key: SPARK-47374 URL: https://issues.apache.org/jira/browse/SPARK-47374 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-47348) Align the version of the ubuntu host machine where the GitHub workflow runs on

2024-03-12 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47348: --- Summary: Align the version of the ubuntu host machine where the GitHub workflow runs on Key: SPARK-47348 URL: https://issues.apache.org/jira/browse/SPARK-47348

[jira] [Created] (SPARK-47339) Upgrade checkStyle to `10.14.0`.

2024-03-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47339: --- Summary: Upgrade checkStyle to `10.14.0`. Key: SPARK-47339 URL: https://issues.apache.org/jira/browse/SPARK-47339 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47333) Use checkInputDataTypes to check the parameter types of the function to_xml & remove _LEGACY_ERROR_TEMP_3234

2024-03-09 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47333: --- Summary: Use checkInputDataTypes to check the parameter types of the function to_xml & remove _LEGACY_ERROR_TEMP_3234 Key: SPARK-47333 URL:

[jira] [Updated] (SPARK-47325) Use the latest buf-setup-action in github workflow

2024-03-08 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47325: Component/s: Project Infra (was: Build) > Use the latest buf-setup-action in

[jira] [Created] (SPARK-47325) Use the latest buf-setup-action in github workflow

2024-03-08 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47325: --- Summary: Use the latest buf-setup-action in github workflow Key: SPARK-47325 URL: https://issues.apache.org/jira/browse/SPARK-47325 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47301) Fix flaky ParquetIOSuite

2024-03-06 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47301: Component/s: SQL (was: Spark Core) > Fix flaky ParquetIOSuite >

[jira] [Created] (SPARK-47301) Fix flaky ParquetIOSuite

2024-03-06 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47301: --- Summary: Fix flaky ParquetIOSuite Key: SPARK-47301 URL: https://issues.apache.org/jira/browse/SPARK-47301 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47299) Use the same `versions. json` in the dropdown of different versions of PySpark documents

2024-03-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47299: --- Summary: Use the same `versions. json` in the dropdown of different versions of PySpark documents Key: SPARK-47299 URL: https://issues.apache.org/jira/browse/SPARK-47299

[jira] [Created] (SPARK-47298) Upgrade `mysql-connector-j` to `8.3.0` and `mariadb-java-client` to `2.7.12`

2024-03-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47298: --- Summary: Upgrade `mysql-connector-j` to `8.3.0` and `mariadb-java-client` to `2.7.12` Key: SPARK-47298 URL: https://issues.apache.org/jira/browse/SPARK-47298 Project:

[jira] [Updated] (SPARK-47281) Update the `versions. json` file for the already released spark version

2024-03-05 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47281: Summary: Update the `versions. json` file for the already released spark version (was: Update

[jira] [Created] (SPARK-47283) Remove Spark version drop down to the PySpark doc site

2024-03-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47283: --- Summary: Remove Spark version drop down to the PySpark doc site Key: SPARK-47283 URL: https://issues.apache.org/jira/browse/SPARK-47283 Project: Spark Issue

[jira] [Updated] (SPARK-47281) Update the `versions. json` file for the already released saprk version

2024-03-05 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47281: Affects Version/s: 3.5.1 > Update the `versions. json` file for the already released saprk

[jira] [Created] (SPARK-47281) Update the `versions. json` file for the already released saprk version

2024-03-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47281: --- Summary: Update the `versions. json` file for the already released saprk version Key: SPARK-47281 URL: https://issues.apache.org/jira/browse/SPARK-47281 Project: Spark

[jira] [Updated] (SPARK-47265) Use `createTable(..., schema: StructType, ...)` instead of `createTable(..., columns: Array[Column], ...)` in UT

2024-03-04 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47265: Summary: Use `createTable(..., schema: StructType, ...)` instead of `createTable(..., columns:

[jira] [Resolved] (SPARK-47265) Enable test of v2 data sources in `FileBasedDataSourceSuite`

2024-03-03 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan resolved SPARK-47265. - Resolution: Won't Fix > Enable test of v2 data sources in `FileBasedDataSourceSuite` >

[jira] [Created] (SPARK-47265) Enable test of v2 data sources in `FileBasedDataSourceSuite`

2024-03-03 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47265: --- Summary: Enable test of v2 data sources in `FileBasedDataSourceSuite` Key: SPARK-47265 URL: https://issues.apache.org/jira/browse/SPARK-47265 Project: Spark

[jira] [Created] (SPARK-47237) Upgrade xmlschema-core to 2.3.1

2024-02-29 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47237: --- Summary: Upgrade xmlschema-core to 2.3.1 Key: SPARK-47237 URL: https://issues.apache.org/jira/browse/SPARK-47237 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47099) The `start` value of `paramIndex` for the error class `UNEXPECTED_INPUT_TYPE` should be `1`1

2024-02-19 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47099: --- Summary: The `start` value of `paramIndex` for the error class `UNEXPECTED_INPUT_TYPE` should be `1`1 Key: SPARK-47099 URL: https://issues.apache.org/jira/browse/SPARK-47099

[jira] [Created] (SPARK-47083) Upgrade `commons-codec` to 1.16.1

2024-02-17 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47083: --- Summary: Upgrade `commons-codec` to 1.16.1 Key: SPARK-47083 URL: https://issues.apache.org/jira/browse/SPARK-47083 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46971) When the `compression` is null, a `NullPointException` should not be thrown

2024-02-03 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46971: --- Summary: When the `compression` is null, a `NullPointException` should not be thrown Key: SPARK-46971 URL: https://issues.apache.org/jira/browse/SPARK-46971 Project:

[jira] [Updated] (SPARK-46950) Align `not available codec` error-class

2024-02-01 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46950: Summary: Align `not available codec` error-class (was: Align not available codec error-class) >

[jira] [Updated] (SPARK-46950) Align not available codec error-class

2024-02-01 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46950: Summary: Align not available codec error-class (was: Align not avaliable codec error-class) >

[jira] [Updated] (SPARK-46950) Align not avaliable codec error-class

2024-02-01 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46950: Summary: Align not avaliable codec error-class (was: Align not avaliable codec error) > Align

[jira] [Created] (SPARK-46950) Align not avaliable codec error

2024-02-01 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46950: --- Summary: Align not avaliable codec error Key: SPARK-46950 URL: https://issues.apache.org/jira/browse/SPARK-46950 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46940) Remove unused `updateSparkConfigFromProperties` and `isAbsoluteURI` in `o.a.s.u.Utils`

2024-01-31 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46940: --- Summary: Remove unused `updateSparkConfigFromProperties` and `isAbsoluteURI` in `o.a.s.u.Utils` Key: SPARK-46940 URL: https://issues.apache.org/jira/browse/SPARK-46940

[jira] [Updated] (SPARK-46917) [SPARK-46753][PYTHON][TESTS] Fix pypy3 python test

2024-01-30 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46917: Summary: [SPARK-46753][PYTHON][TESTS] Fix pypy3 python test (was: Improve merge_spark_pr.py) >

[jira] [Updated] (SPARK-46851) Remove buf version information from the doc contributing.rst

2024-01-30 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46851: Summary: Remove buf version information from the doc contributing.rst (was: Upgrade `buf` to

[jira] [Created] (SPARK-46915) Simplify `UnaryMinus` and align error class

2024-01-29 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46915: --- Summary: Simplify `UnaryMinus` and align error class Key: SPARK-46915 URL: https://issues.apache.org/jira/browse/SPARK-46915 Project: Spark Issue Type:

[jira] [Created] (SPARK-46892) Upgrade dropwizard metrics 4.2.25

2024-01-28 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46892: --- Summary: Upgrade dropwizard metrics 4.2.25 Key: SPARK-46892 URL: https://issues.apache.org/jira/browse/SPARK-46892 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46850) Convert `_LEGACY_ERROR_TEMP_2102 ` to `UNSUPPORTED_DATATYPE`

2024-01-24 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46850: --- Summary: Convert `_LEGACY_ERROR_TEMP_2102 ` to `UNSUPPORTED_DATATYPE` Key: SPARK-46850 URL: https://issues.apache.org/jira/browse/SPARK-46850 Project: Spark

[jira] [Resolved] (SPARK-46803) Remove scala-2.13 profile

2024-01-22 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan resolved SPARK-46803. - Resolution: Not A Problem > Remove scala-2.13 profile > - > >

[jira] [Created] (SPARK-46803) Remove scala-2.13 profile

2024-01-22 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46803: --- Summary: Remove scala-2.13 profile Key: SPARK-46803 URL: https://issues.apache.org/jira/browse/SPARK-46803 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46738) `Cast` displayed different results between Regular Spark and Spark Connect

2024-01-22 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46738: Summary: `Cast` displayed different results between Regular Spark and Spark Connect (was: `Cast`

[jira] [Updated] (SPARK-46753) Fix `pypy3` python test

2024-01-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46753: Summary: Fix `pypy3` python test (was: Skip `test_session` `test_udf` if PyArrow is not

[jira] [Updated] (SPARK-46744) Display clear exit command for all spark terminal

2024-01-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46744: Summary: Display clear exit command for all spark terminal (was: Display clear `exit command`

[jira] [Updated] (SPARK-46744) Display clear exit command for all spark terminal

2024-01-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46744: Component/s: Connect PySpark R Spark Shell

[jira] [Updated] (SPARK-46753) Skip `test_session` `test_udf` if PyArrow is not installed

2024-01-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46753: Summary: Skip `test_session` `test_udf` if PyArrow is not installed (was: Skip test_session if

[jira] [Updated] (SPARK-46744) Display clear `exit command` for the terminal: `spark-shell`, `spark-sql` and `spark-connect-repl`

2024-01-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46744: Summary: Display clear `exit command` for the terminal: `spark-shell`, `spark-sql` and

[jira] [Updated] (SPARK-46744) Prompt for exit command after `spark-shell` `spark-sql` `spark-connect-repl` startup

2024-01-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46744: Summary: Prompt for exit command after `spark-shell` `spark-sql` `spark-connect-repl` startup

[jira] [Created] (SPARK-46744) Prompt for exit command after `spark-shell` startup

2024-01-17 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46744: --- Summary: Prompt for exit command after `spark-shell` startup Key: SPARK-46744 URL: https://issues.apache.org/jira/browse/SPARK-46744 Project: Spark Issue

[jira] [Updated] (SPARK-46738) `Cast` of pyspark displayed different results between Regular Spark and Spark Connect

2024-01-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46738: Description: The following doctest will throw an error in the tests of the pyspark-connect

[jira] [Updated] (SPARK-46738) `Cast` of pyspark displayed different results between Regular Spark and Spark Connect

2024-01-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46738: Attachment: screenshot-1.png > `Cast` of pyspark displayed different results between Regular

[jira] [Commented] (SPARK-46738) `Cast` of pyspark displayed different results between Regular Spark and Spark Connect

2024-01-16 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807499#comment-17807499 ] BingKun Pan commented on SPARK-46738: - I work on it. > `Cast` of pyspark displayed different

[jira] [Updated] (SPARK-46738) `Cast` of pyspark displayed different results between Regular Spark and Spark Connect

2024-01-16 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46738: Description: The following doctest will throw an error in the tests of the pyspark-connect

[jira] [Created] (SPARK-46738) `Cast` of pyspark displayed different results between Regular Spark and Spark Connect

2024-01-16 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46738: --- Summary: `Cast` of pyspark displayed different results between Regular Spark and Spark Connect Key: SPARK-46738 URL: https://issues.apache.org/jira/browse/SPARK-46738

[jira] [Commented] (SPARK-46718) Upgrade Arrow to 15.0.0

2024-01-14 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806637#comment-17806637 ] BingKun Pan commented on SPARK-46718: - !image-2024-01-15-14-02-57-814.png|width=1118,height=102!

[jira] [Updated] (SPARK-46718) Upgrade Arrow to 15.0.0

2024-01-14 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46718: Attachment: image-2024-01-15-14-02-57-814.png > Upgrade Arrow to 15.0.0 > ---

[jira] [Commented] (SPARK-46718) Upgrade Arrow to 15.0.0

2024-01-14 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806636#comment-17806636 ] BingKun Pan commented on SPARK-46718: - Let me take a look at this version first to see if it

[jira] [Updated] (SPARK-46692) Fix potential environmental variable transfer issue in `pyspark job GA`

2024-01-12 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46692: Summary: Fix potential environmental variable transfer issue in `pyspark job GA` (was: Fix

[jira] [Updated] (SPARK-46692) Fix potential issues with environment variable transmission `PYTHON_TO_TEST`

2024-01-11 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46692: Summary: Fix potential issues with environment variable transmission `PYTHON_TO_TEST` (was: Fix

[jira] [Updated] (SPARK-46692) Fix potential issues with environment variable transmission `PYTHON_TO_TEST` in `build_python`

2024-01-11 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46692: Summary: Fix potential issues with environment variable transmission `PYTHON_TO_TEST` in

[jira] [Created] (SPARK-46692) Fix potential issues with environment variable transmission `$PYTHON_TO_TEST` in `build_python`

2024-01-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46692: --- Summary: Fix potential issues with environment variable transmission `$PYTHON_TO_TEST` in `build_python` Key: SPARK-46692 URL: https://issues.apache.org/jira/browse/SPARK-46692

[jira] [Created] (SPARK-46673) Refine docstring `aes_encrypt\aes_decrypt\try_aes_decrypt`

2024-01-10 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46673: --- Summary: Refine docstring `aes_encrypt\aes_decrypt\try_aes_decrypt` Key: SPARK-46673 URL: https://issues.apache.org/jira/browse/SPARK-46673 Project: Spark

[jira] [Updated] (SPARK-46673) Refine docstring `aes_encrypt/aes_decrypt/try_aes_decrypt`

2024-01-10 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46673: Summary: Refine docstring `aes_encrypt/aes_decrypt/try_aes_decrypt` (was: Refine docstring

[jira] [Created] (SPARK-46615) Support s.c.immutable.ArraySeq in ArrowDeserializers

2024-01-07 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46615: --- Summary: Support s.c.immutable.ArraySeq in ArrowDeserializers Key: SPARK-46615 URL: https://issues.apache.org/jira/browse/SPARK-46615 Project: Spark Issue

[jira] [Created] (SPARK-46614) Refine docstring `make_timestamp/make_timestamp_ltz/make_timestamp_ntz/make_ym_interval`

2024-01-07 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46614: --- Summary: Refine docstring `make_timestamp/make_timestamp_ltz/make_timestamp_ntz/make_ym_interval` Key: SPARK-46614 URL: https://issues.apache.org/jira/browse/SPARK-46614

[jira] [Created] (SPARK-46606) Refine docstring of `convert_timezone/make_dt_interval/make_interval`

2024-01-04 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46606: --- Summary: Refine docstring of `convert_timezone/make_dt_interval/make_interval` Key: SPARK-46606 URL: https://issues.apache.org/jira/browse/SPARK-46606 Project: Spark

[jira] [Created] (SPARK-46594) The description of `spark.yarn.shuffle.server.recovery.disabled` should be in chapter `Configuring the External Shuffle Service`

2024-01-04 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46594: --- Summary: The description of `spark.yarn.shuffle.server.recovery.disabled` should be in chapter `Configuring the External Shuffle Service` Key: SPARK-46594 URL:

[jira] [Commented] (SPARK-46586) Support `s.c.immutable.ArraySeq` as `customCollectionCls` in `MapObjects`

2024-01-03 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17802380#comment-17802380 ] BingKun Pan commented on SPARK-46586: - Okay, I will do it   > Support `s.c.immutable.ArraySeq` as

[jira] [Updated] (SPARK-46546) Fix the formatting of tables in `running-on-yarn` pages

2024-01-03 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46546: Summary: Fix the formatting of tables in `running-on-yarn` pages (was: Fix the formatting of

[jira] [Updated] (SPARK-46560) Refine docstring `reverse/map_contains_key`

2024-01-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46560: Summary: Refine docstring `reverse/map_contains_key` (was: Refine docstring `reverse`) > Refine

[jira] [Updated] (SPARK-46560) Refine docstring `reverse`

2024-01-01 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46560: Summary: Refine docstring `reverse` (was: Refine docstring `reverse/flatten`) > Refine

[jira] [Created] (SPARK-46560) Refine docstring `reverse/flatten`

2024-01-01 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46560: --- Summary: Refine docstring `reverse/flatten` Key: SPARK-46560 URL: https://issues.apache.org/jira/browse/SPARK-46560 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-46554) Upgrade slf4j to 2.0.10

2024-01-01 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46554: --- Summary: Upgrade slf4j to 2.0.10 Key: SPARK-46554 URL: https://issues.apache.org/jira/browse/SPARK-46554 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46519) Clear unused error classes from error-classes.json file

2023-12-26 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46519: --- Summary: Clear unused error classes from error-classes.json file Key: SPARK-46519 URL: https://issues.apache.org/jira/browse/SPARK-46519 Project: Spark Issue

[jira] [Created] (SPARK-46432) Upgrade Netty to 4.1.104.Final

2023-12-17 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46432: --- Summary: Upgrade Netty to 4.1.104.Final Key: SPARK-46432 URL: https://issues.apache.org/jira/browse/SPARK-46432 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46400) When there are corrupted files in the local maven repo, retry to skip this cache

2023-12-13 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46400: Summary: When there are corrupted files in the local maven repo, retry to skip this cache (was:

[jira] [Created] (SPARK-46400) When there are corrupted files in the local maven repo, try to skip this cache

2023-12-13 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46400: --- Summary: When there are corrupted files in the local maven repo, try to skip this cache Key: SPARK-46400 URL: https://issues.apache.org/jira/browse/SPARK-46400

[jira] [Created] (SPARK-46371) Clean up outdated items in `.rat-excludes`

2023-12-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46371: --- Summary: Clean up outdated items in `.rat-excludes` Key: SPARK-46371 URL: https://issues.apache.org/jira/browse/SPARK-46371 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46356) Upgrade `sbt-assembly` to 2.1.5, `sbt-checkstyle-plugin` to 4.0.1

2023-12-11 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46356: Summary: Upgrade `sbt-assembly` to 2.1.5, `sbt-checkstyle-plugin` to 4.0.1 (was: Upgrade

[jira] [Updated] (SPARK-46304) Upgrade setup-java action to v4 and setup-python to v5

2023-12-07 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46304: Summary: Upgrade setup-java action to v4 and setup-python to v5 (was: Upgrade setup-java action

[jira] [Created] (SPARK-46302) Fix maven daily testing

2023-12-06 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46302: --- Summary: Fix maven daily testing Key: SPARK-46302 URL: https://issues.apache.org/jira/browse/SPARK-46302 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46236) Using brighter color for docs h3 title for better visibility

2023-12-03 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46236: --- Summary: Using brighter color for docs h3 title for better visibility Key: SPARK-46236 URL: https://issues.apache.org/jira/browse/SPARK-46236 Project: Spark

[jira] [Created] (SPARK-46218) Upgrade commons-cli to 1.6.0

2023-12-03 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46218: --- Summary: Upgrade commons-cli to 1.6.0 Key: SPARK-46218 URL: https://issues.apache.org/jira/browse/SPARK-46218 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46214) Upgrade commons-io to 2.15.1

2023-12-02 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46214: --- Summary: Upgrade commons-io to 2.15.1 Key: SPARK-46214 URL: https://issues.apache.org/jira/browse/SPARK-46214 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46199) Add PyPi link icon to PySpark doc header

2023-12-01 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46199: --- Summary: Add PyPi link icon to PySpark doc header Key: SPARK-46199 URL: https://issues.apache.org/jira/browse/SPARK-46199 Project: Spark Issue Type:

[jira] [Created] (SPARK-46151) Hide the "More" drop-down button in the PySpark docs navigation bar

2023-11-28 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46151: --- Summary: Hide the "More" drop-down button in the PySpark docs navigation bar Key: SPARK-46151 URL: https://issues.apache.org/jira/browse/SPARK-46151 Project: Spark

[jira] [Created] (SPARK-46135) Fix table format error in ipynb docs

2023-11-27 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46135: --- Summary: Fix table format error in ipynb docs Key: SPARK-46135 URL: https://issues.apache.org/jira/browse/SPARK-46135 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-46088) Add a self-contained example about creating dataframe from jdbc

2023-11-23 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46088: --- Summary: Add a self-contained example about creating dataframe from jdbc Key: SPARK-46088 URL: https://issues.apache.org/jira/browse/SPARK-46088 Project: Spark

[jira] [Created] (SPARK-46060) Upgrade jdbc related test dependencies

2023-11-22 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46060: --- Summary: Upgrade jdbc related test dependencies Key: SPARK-46060 URL: https://issues.apache.org/jira/browse/SPARK-46060 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46033) Fix flaky ArithmeticExpressionSuite

2023-11-21 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46033: --- Summary: Fix flaky ArithmeticExpressionSuite Key: SPARK-46033 URL: https://issues.apache.org/jira/browse/SPARK-46033 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-46019) Fix HiveThriftServer2ListenerSuite and ThriftServerPageSuite failed when there are running on local

2023-11-20 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46019: Summary: Fix HiveThriftServer2ListenerSuite and ThriftServerPageSuite failed when there are

[jira] [Updated] (SPARK-46019) Fix when `HiveThriftServer2ListenerSuite` and `ThriftServerPageSuite` failed to run locally

2023-11-20 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46019: Affects Version/s: (was: 3.5.0) (was: 3.4.1) > Fix when

[jira] [Updated] (SPARK-46019) Fix when `HiveThriftServer2ListenerSuite` and `ThriftServerPageSuite` failed to run locally

2023-11-20 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46019: Component/s: Tests > Fix when `HiveThriftServer2ListenerSuite` and `ThriftServerPageSuite` failed

[jira] [Created] (SPARK-46019) Fix when `HiveThriftServer2ListenerSuite` and `ThriftServerPageSuite` failed to run locally

2023-11-20 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46019: --- Summary: Fix when `HiveThriftServer2ListenerSuite` and `ThriftServerPageSuite` failed to run locally Key: SPARK-46019 URL: https://issues.apache.org/jira/browse/SPARK-46019

[jira] [Created] (SPARK-46004) Refine docstring of `DataFrame.dropna/fillna/replace`

2023-11-19 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46004: --- Summary: Refine docstring of `DataFrame.dropna/fillna/replace` Key: SPARK-46004 URL: https://issues.apache.org/jira/browse/SPARK-46004 Project: Spark Issue

<    1   2   3   4   5   6   7   8   >