[jira] [Created] (SPARK-48332) Upgrade `jdbc` related test dependencies
BingKun Pan created SPARK-48332: --- Summary: Upgrade `jdbc` related test dependencies Key: SPARK-48332 URL: https://issues.apache.org/jira/browse/SPARK-48332 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48328) Upgrade `Arrow` to 16.1.0
BingKun Pan created SPARK-48328: --- Summary: Upgrade `Arrow` to 16.1.0 Key: SPARK-48328 URL: https://issues.apache.org/jira/browse/SPARK-48328 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-44810) XML: ArrayType and MapType support in from_xml
[ https://issues.apache.org/jira/browse/SPARK-44810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847457#comment-17847457 ] BingKun Pan commented on SPARK-44810: - Let me refactor it and delete unnecessary logic. Thank you for your clarification! > XML: ArrayType and MapType support in from_xml > -- > > Key: SPARK-44810 > URL: https://issues.apache.org/jira/browse/SPARK-44810 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Sandip Agarwala >Priority: Major > Attachments: image-2024-05-17-19-22-31-844.png, > image-2024-05-17-19-23-07-534.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48324) Codegen Support for `hll_sketch_estimate` and `hll_union`
BingKun Pan created SPARK-48324: --- Summary: Codegen Support for `hll_sketch_estimate` and `hll_union` Key: SPARK-48324 URL: https://issues.apache.org/jira/browse/SPARK-48324 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-44810) XML: ArrayType and MapType support in from_xml
[ https://issues.apache.org/jira/browse/SPARK-44810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847247#comment-17847247 ] BingKun Pan commented on SPARK-44810: - [~sandip.agarwala] Sorry to bother you, I want to know that our function seems to be able to handle type `StructType`, `ArrayType` and `MapType` from the code `XmlToStructs`, but from the entry `sql/core/src/main/scala/org/apache/spark/sql/functions.scala#from_xml(...)`, it seems to only support `StructType`. Will we support `ArrayType` and `MapType` in the future? or we should remote it? !image-2024-05-17-19-22-31-844.png|width=638,height=187! !image-2024-05-17-19-23-07-534.png|width=638,height=213! > XML: ArrayType and MapType support in from_xml > -- > > Key: SPARK-44810 > URL: https://issues.apache.org/jira/browse/SPARK-44810 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Sandip Agarwala >Priority: Major > Attachments: image-2024-05-17-19-22-31-844.png, > image-2024-05-17-19-23-07-534.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-44810) XML: ArrayType and MapType support in from_xml
[ https://issues.apache.org/jira/browse/SPARK-44810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44810: Attachment: image-2024-05-17-19-23-07-534.png > XML: ArrayType and MapType support in from_xml > -- > > Key: SPARK-44810 > URL: https://issues.apache.org/jira/browse/SPARK-44810 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Sandip Agarwala >Priority: Major > Attachments: image-2024-05-17-19-22-31-844.png, > image-2024-05-17-19-23-07-534.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-44810) XML: ArrayType and MapType support in from_xml
[ https://issues.apache.org/jira/browse/SPARK-44810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44810: Attachment: image-2024-05-17-19-22-31-844.png > XML: ArrayType and MapType support in from_xml > -- > > Key: SPARK-44810 > URL: https://issues.apache.org/jira/browse/SPARK-44810 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Sandip Agarwala >Priority: Major > Attachments: image-2024-05-17-19-22-31-844.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-48320) Add external third-party ecosystem access guide to the doc
[ https://issues.apache.org/jira/browse/SPARK-48320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48320: Summary: Add external third-party ecosystem access guide to the doc (was: Add third-party access guide to the doc) > Add external third-party ecosystem access guide to the doc > -- > > Key: SPARK-48320 > URL: https://issues.apache.org/jira/browse/SPARK-48320 > Project: Spark > Issue Type: Sub-task > Components: Documentation, Spark Core >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48320) Add third-party access guide to the doc
BingKun Pan created SPARK-48320: --- Summary: Add third-party access guide to the doc Key: SPARK-48320 URL: https://issues.apache.org/jira/browse/SPARK-48320 Project: Spark Issue Type: Sub-task Components: Documentation, Spark Core Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-48303) Reorganize `LogKey`
[ https://issues.apache.org/jira/browse/SPARK-48303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48303: Summary: Reorganize `LogKey` (was: Organize `LogKey`) > Reorganize `LogKey` > --- > > Key: SPARK-48303 > URL: https://issues.apache.org/jira/browse/SPARK-48303 > Project: Spark > Issue Type: Sub-task > Components: Spark Core >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48303) Organize `LogKey`
BingKun Pan created SPARK-48303: --- Summary: Organize `LogKey` Key: SPARK-48303 URL: https://issues.apache.org/jira/browse/SPARK-48303 Project: Spark Issue Type: Sub-task Components: Spark Core Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-48300) Codegen Support for `from_xml`
[ https://issues.apache.org/jira/browse/SPARK-48300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846830#comment-17846830 ] BingKun Pan commented on SPARK-48300: - I work on it. > Codegen Support for `from_xml` > -- > > Key: SPARK-48300 > URL: https://issues.apache.org/jira/browse/SPARK-48300 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48300) Codegen Support for `from_xml`
BingKun Pan created SPARK-48300: --- Summary: Codegen Support for `from_xml` Key: SPARK-48300 URL: https://issues.apache.org/jira/browse/SPARK-48300 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48296) Codegen Support for `to_xml`
BingKun Pan created SPARK-48296: --- Summary: Codegen Support for `to_xml` Key: SPARK-48296 URL: https://issues.apache.org/jira/browse/SPARK-48296 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48256) Add a rule to check file headers for the java side, and fix inconsistent files
BingKun Pan created SPARK-48256: --- Summary: Add a rule to check file headers for the java side, and fix inconsistent files Key: SPARK-48256 URL: https://issues.apache.org/jira/browse/SPARK-48256 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-48251) Disable `maven local cache` on GA's step `MIMA test`
[ https://issues.apache.org/jira/browse/SPARK-48251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48251: Summary: Disable `maven local cache` on GA's step `MIMA test` (was: Disable `maven local cache` on step `MIMA test` of the GA's job `lint`) > Disable `maven local cache` on GA's step `MIMA test` > > > Key: SPARK-48251 > URL: https://issues.apache.org/jira/browse/SPARK-48251 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48251) Disable `maven local cache` on step `MIMA test` of the GA's job `lint`
BingKun Pan created SPARK-48251: --- Summary: Disable `maven local cache` on step `MIMA test` of the GA's job `lint` Key: SPARK-48251 URL: https://issues.apache.org/jira/browse/SPARK-48251 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48246) Add a new ScalaStyle Rule `RedundantIfChecker`
BingKun Pan created SPARK-48246: --- Summary: Add a new ScalaStyle Rule `RedundantIfChecker` Key: SPARK-48246 URL: https://issues.apache.org/jira/browse/SPARK-48246 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48242) Upgrade extra-enforcer-rules to 1.8.0
BingKun Pan created SPARK-48242: --- Summary: Upgrade extra-enforcer-rules to 1.8.0 Key: SPARK-48242 URL: https://issues.apache.org/jira/browse/SPARK-48242 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-48240) Replace `Local[..]` with `"Local[...]"` in the docs
[ https://issues.apache.org/jira/browse/SPARK-48240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48240: Summary: Replace `Local[..]` with `"Local[...]"` in the docs (was: Replace `Local[..]` with `"Local[...]"` in the doc) > Replace `Local[..]` with `"Local[...]"` in the docs > --- > > Key: SPARK-48240 > URL: https://issues.apache.org/jira/browse/SPARK-48240 > Project: Spark > Issue Type: Improvement > Components: Documentation >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48237) After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted
BingKun Pan created SPARK-48237: --- Summary: After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted Key: SPARK-48237 URL: https://issues.apache.org/jira/browse/SPARK-48237 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-48226) Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and `jvm-profiler` to `sbt-checkstyle`
[ https://issues.apache.org/jira/browse/SPARK-48226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48226: Component/s: Build (was: Project Infra) > Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and > `jvm-profiler` to `sbt-checkstyle` > - > > Key: SPARK-48226 > URL: https://issues.apache.org/jira/browse/SPARK-48226 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48226) Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and `jvm-profiler` to `sbt-checkstyle`
BingKun Pan created SPARK-48226: --- Summary: Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and `jvm-profiler` to `sbt-checkstyle` Key: SPARK-48226 URL: https://issues.apache.org/jira/browse/SPARK-48226 Project: Spark Issue Type: Improvement Components: Project Infra Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48214) Ban import `org.slf4j.Logger` & `org.slf4j.LoggerFactory`
BingKun Pan created SPARK-48214: --- Summary: Ban import `org.slf4j.Logger` & `org.slf4j.LoggerFactory` Key: SPARK-48214 URL: https://issues.apache.org/jira/browse/SPARK-48214 Project: Spark Issue Type: Sub-task Components: Project Infra Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48209) Common (java side): Migrate `error/warn/info` with variables to structured logging framework
BingKun Pan created SPARK-48209: --- Summary: Common (java side): Migrate `error/warn/info` with variables to structured logging framework Key: SPARK-48209 URL: https://issues.apache.org/jira/browse/SPARK-48209 Project: Spark Issue Type: Sub-task Components: Spark Core Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48198) Upgrade jackson to 2.17.1
BingKun Pan created SPARK-48198: --- Summary: Upgrade jackson to 2.17.1 Key: SPARK-48198 URL: https://issues.apache.org/jira/browse/SPARK-48198 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48193) Make `maven-deploy-plugin` retry 3 times
BingKun Pan created SPARK-48193: --- Summary: Make `maven-deploy-plugin` retry 3 times Key: SPARK-48193 URL: https://issues.apache.org/jira/browse/SPARK-48193 Project: Spark Issue Type: Improvement Components: Project Infra Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48182) SQL (java side): Migrate `error/warn/info` with variables to structured logging framework
BingKun Pan created SPARK-48182: --- Summary: SQL (java side): Migrate `error/warn/info` with variables to structured logging framework Key: SPARK-48182 URL: https://issues.apache.org/jira/browse/SPARK-48182 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-48152) Make spark-profiler as a part of release and publish to maven central repo
[ https://issues.apache.org/jira/browse/SPARK-48152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48152: Summary: Make spark-profiler as a part of release and publish to maven central repo (was: Publish the module `spark-profiler` to `maven central repository`) > Make spark-profiler as a part of release and publish to maven central repo > -- > > Key: SPARK-48152 > URL: https://issues.apache.org/jira/browse/SPARK-48152 > Project: Spark > Issue Type: Improvement > Components: Build, Documentation >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-48152) Publish the module `spark-profiler` to `maven central repository`
[ https://issues.apache.org/jira/browse/SPARK-48152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48152: Summary: Publish the module `spark-profiler` to `maven central repository` (was: Make the module `spark-profiler` as a part of Spark release) > Publish the module `spark-profiler` to `maven central repository` > - > > Key: SPARK-48152 > URL: https://issues.apache.org/jira/browse/SPARK-48152 > Project: Spark > Issue Type: Improvement > Components: Build, Documentation >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48165) Update `ap-loader` to 3.0-9
BingKun Pan created SPARK-48165: --- Summary: Update `ap-loader` to 3.0-9 Key: SPARK-48165 URL: https://issues.apache.org/jira/browse/SPARK-48165 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48152) Make the module `spark-profiler` as a part of Spark release
BingKun Pan created SPARK-48152: --- Summary: Make the module `spark-profiler` as a part of Spark release Key: SPARK-48152 URL: https://issues.apache.org/jira/browse/SPARK-48152 Project: Spark Issue Type: Improvement Components: Build, Documentation Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48134) Spark core (java side): Migrate `error/warn/info` with variables to structured logging framework
BingKun Pan created SPARK-48134: --- Summary: Spark core (java side): Migrate `error/warn/info` with variables to structured logging framework Key: SPARK-48134 URL: https://issues.apache.org/jira/browse/SPARK-48134 Project: Spark Issue Type: Sub-task Components: Spark Core Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48059) Implement the structured log framework on the java side
BingKun Pan created SPARK-48059: --- Summary: Implement the structured log framework on the java side Key: SPARK-48059 URL: https://issues.apache.org/jira/browse/SPARK-48059 Project: Spark Issue Type: Sub-task Components: Spark Core Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-48029) Update the packages name removed in building the spark docker image
[ https://issues.apache.org/jira/browse/SPARK-48029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48029: Summary: Update the packages name removed in building the spark docker image (was: Make more accurate to remove unused packages in spark docker image) > Update the packages name removed in building the spark docker image > --- > > Key: SPARK-48029 > URL: https://issues.apache.org/jira/browse/SPARK-48029 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48029) Make more accurate to remove unused packages in spark docker image
BingKun Pan created SPARK-48029: --- Summary: Make more accurate to remove unused packages in spark docker image Key: SPARK-48029 URL: https://issues.apache.org/jira/browse/SPARK-48029 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48021) Add `--add-modules=jdk.incubator.vector` to `JavaModuleOptions`
BingKun Pan created SPARK-48021: --- Summary: Add `--add-modules=jdk.incubator.vector` to `JavaModuleOptions` Key: SPARK-48021 URL: https://issues.apache.org/jira/browse/SPARK-48021 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47963) Make the external Spark ecosystem can use structured logging mechanisms
[ https://issues.apache.org/jira/browse/SPARK-47963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47963: Summary: Make the external Spark ecosystem can use structured logging mechanisms (was: Add an external LogKey usage case in UT) > Make the external Spark ecosystem can use structured logging mechanisms > > > Key: SPARK-47963 > URL: https://issues.apache.org/jira/browse/SPARK-47963 > Project: Spark > Issue Type: Sub-task > Components: Spark Core >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47982) Update code style' plugins to latest version
BingKun Pan created SPARK-47982: --- Summary: Update code style' plugins to latest version Key: SPARK-47982 URL: https://issues.apache.org/jira/browse/SPARK-47982 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47936) Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules
BingKun Pan created SPARK-47936: --- Summary: Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules Key: SPARK-47936 URL: https://issues.apache.org/jira/browse/SPARK-47936 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47913) Move `src/test/java/test/*` to `src/test/java/*`
[ https://issues.apache.org/jira/browse/SPARK-47913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan resolved SPARK-47913. - Resolution: Not A Problem > Move `src/test/java/test/*` to `src/test/java/*` > > > Key: SPARK-47913 > URL: https://issues.apache.org/jira/browse/SPARK-47913 > Project: Spark > Issue Type: Improvement > Components: DStreams, Spark Core, SQL, Tests >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47913) Move `src/test/java/test/*` to `src/test/java/*`
BingKun Pan created SPARK-47913: --- Summary: Move `src/test/java/test/*` to `src/test/java/*` Key: SPARK-47913 URL: https://issues.apache.org/jira/browse/SPARK-47913 Project: Spark Issue Type: Improvement Components: DStreams, Spark Core, SQL, Tests Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47896) Upgrade netty to `4.1.109.Final`
BingKun Pan created SPARK-47896: --- Summary: Upgrade netty to `4.1.109.Final` Key: SPARK-47896 URL: https://issues.apache.org/jira/browse/SPARK-47896 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Comment Edited] (SPARK-47429) Rename errorClass to errorCondition
[
https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838412#comment-17838412
]
BingKun Pan edited comment on SPARK-47429 at 4/18/24 1:26 AM:
--
This will be a very huge task, and I roughly counted almost 4k+ places where
the variable `errorClass` is used
!image-2024-04-18-09-26-04-493.png|width=543,height=32!
But this consistent of terms that follow by SQL standards is really very great!
was (Author: panbingkun):
This will be a very huge task, and I roughly counted almost 4k+ places where
the variable `errorClass` is used
!image-2024-04-18-09-26-04-493.png|width=543,height=32!
But this consistent of terms that follow by SQL standards is really very great!
> Rename errorClass to errorCondition
> ---
>
> Key: SPARK-47429
> URL: https://issues.apache.org/jira/browse/SPARK-47429
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
>Affects Versions: 4.0.0
>Reporter: Nicholas Chammas
>Priority: Minor
> Attachments: image-2024-04-18-09-26-04-493.png
>
>
> We've agreed on the parent task to rename {{errorClass}} to align it more
> closely with the SQL standard, and take advantage of the opportunity to break
> backwards compatibility offered by the Spark version change from 3.5 to 4.0.
> This ticket also covers renaming {{subClass}} as well.
> This is a subtask so the changes are in their own PR and easier to review
> apart from other things.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Comment Edited] (SPARK-47429) Rename errorClass to errorCondition
[
https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838412#comment-17838412
]
BingKun Pan edited comment on SPARK-47429 at 4/18/24 1:26 AM:
--
This will be a very huge task, and I roughly counted almost 4k+ places where
the variable `errorClass` is used
!image-2024-04-18-09-26-04-493.png|width=543,height=32!
But this consistent of terms that follow by SQL standards is really very great!
was (Author: panbingkun):
This will be a very huge task, and I roughly counted almost 4k+ places where
the variable `errorClass` is used
!image-2024-04-18-09-22-20-736.png|width=680,height=42!
But this consistent of terms that follow by SQL standards is really very great!
> Rename errorClass to errorCondition
> ---
>
> Key: SPARK-47429
> URL: https://issues.apache.org/jira/browse/SPARK-47429
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
>Affects Versions: 4.0.0
>Reporter: Nicholas Chammas
>Priority: Minor
> Attachments: image-2024-04-18-09-26-04-493.png
>
>
> We've agreed on the parent task to rename {{errorClass}} to align it more
> closely with the SQL standard, and take advantage of the opportunity to break
> backwards compatibility offered by the Spark version change from 3.5 to 4.0.
> This ticket also covers renaming {{subClass}} as well.
> This is a subtask so the changes are in their own PR and easier to review
> apart from other things.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-47429) Rename errorClass to errorCondition
[
https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838412#comment-17838412
]
BingKun Pan commented on SPARK-47429:
-
This will be a very huge task, and I roughly counted almost 4k+ places where
the variable `errorClass` is used
!image-2024-04-18-09-22-20-736.png|width=680,height=42!
But this consistent of terms that follow by SQL standards is really very great!
> Rename errorClass to errorCondition
> ---
>
> Key: SPARK-47429
> URL: https://issues.apache.org/jira/browse/SPARK-47429
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
>Affects Versions: 4.0.0
>Reporter: Nicholas Chammas
>Priority: Minor
>
> We've agreed on the parent task to rename {{errorClass}} to align it more
> closely with the SQL standard, and take advantage of the opportunity to break
> backwards compatibility offered by the Spark version change from 3.5 to 4.0.
> This ticket also covers renaming {{subClass}} as well.
> This is a subtask so the changes are in their own PR and easier to review
> apart from other things.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47825) Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` deprecated
BingKun Pan created SPARK-47825: --- Summary: Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` deprecated Key: SPARK-47825 URL: https://issues.apache.org/jira/browse/SPARK-47825 Project: Spark Issue Type: Improvement Components: DStreams Affects Versions: 3.5.2 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47814) Remove the `KinesisTestUtils` from `main` to `test`
BingKun Pan created SPARK-47814: --- Summary: Remove the `KinesisTestUtils` from `main` to `test` Key: SPARK-47814 URL: https://issues.apache.org/jira/browse/SPARK-47814 Project: Spark Issue Type: Improvement Components: DStreams Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47748) Upgrade `zstd-jni` to 1.5.6-2
BingKun Pan created SPARK-47748: --- Summary: Upgrade `zstd-jni` to 1.5.6-2 Key: SPARK-47748 URL: https://issues.apache.org/jira/browse/SPARK-47748 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47688) Support `three` methods of the log `concatenation` in the `structured logging framework`
[
https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-47688:
Summary: Support `three` methods of the log `concatenation` in the
`structured logging framework` (was: Support `three` types of the log
`concatenation` in the `structured logging framework`)
> Support `three` methods of the log `concatenation` in the `structured logging
> framework`
>
>
> Key: SPARK-47688
> URL: https://issues.apache.org/jira/browse/SPARK-47688
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
>Affects Versions: 4.0.0
>Reporter: BingKun Pan
>Priority: Major
> Labels: pull-request-available
>
> Allow log syntax like
> - 1.log"... MDC(...) $normal_variables ..."
> {code:java}
> log"Driver terminated with exit code ${MDC(EXIT_CODE, exitCode)}! Shutting
> down. $remoteAddress"
> {code}
> - 2.s"... $normal_variables ..." ++ log"... MDC(...) ..."
> {code:java}
> log"Driver terminated with exit code ${MDC(EXIT_CODE, exitCode)}! Shutting
> down." ++ s"$remoteAddress"
> {code}
> - 3.log"... MDC(...) ..." ++ s"... $normal_variables ..."
> {code:java}
> s"$remoteAddress" ++ log"Driver terminated with exit code ${MDC(EXIT_CODE,
> exitCode)}! Shutting down."
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47688) Support `three` types of the log `concatenation` in the `structured logging framework`
[
https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-47688:
Description:
Allow log syntax like
- 1.log"... MDC(...) $normal_variables ..."
{code:java}
log"Driver terminated with exit code ${MDC(EXIT_CODE, exitCode)}! Shutting
down. $remoteAddress"
{code}
- 2.s"... $normal_variables ..." ++ log"... MDC(...) ..."
{code:java}
log"Driver terminated with exit code ${MDC(EXIT_CODE, exitCode)}! Shutting
down." ++ s"$remoteAddress"
{code}
- 3.log"... MDC(...) ..." ++ s"... $normal_variables ..."
{code:java}
s"$remoteAddress" ++ log"Driver terminated with exit code ${MDC(EXIT_CODE,
exitCode)}! Shutting down."
{code}
was:
Allow log syntax like
{code:java}
log"Driver terminated with exit code ${MDC(EXIT_CODE, exitCode)}! Shutting
down. $remoteAddress"{code}
> Support `three` types of the log `concatenation` in the `structured logging
> framework`
> --
>
> Key: SPARK-47688
> URL: https://issues.apache.org/jira/browse/SPARK-47688
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
>Affects Versions: 4.0.0
>Reporter: BingKun Pan
>Priority: Major
> Labels: pull-request-available
>
> Allow log syntax like
> - 1.log"... MDC(...) $normal_variables ..."
> {code:java}
> log"Driver terminated with exit code ${MDC(EXIT_CODE, exitCode)}! Shutting
> down. $remoteAddress"
> {code}
> - 2.s"... $normal_variables ..." ++ log"... MDC(...) ..."
> {code:java}
> log"Driver terminated with exit code ${MDC(EXIT_CODE, exitCode)}! Shutting
> down." ++ s"$remoteAddress"
> {code}
> - 3.log"... MDC(...) ..." ++ s"... $normal_variables ..."
> {code:java}
> s"$remoteAddress" ++ log"Driver terminated with exit code ${MDC(EXIT_CODE,
> exitCode)}! Shutting down."
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47688) Support `three` types of the log `concatenation` in the `structured logging framework`
[
https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-47688:
Summary: Support `three` types of the log `concatenation` in the
`structured logging framework` (was: Support concatenation `normal variables`
and `MDC`)
> Support `three` types of the log `concatenation` in the `structured logging
> framework`
> --
>
> Key: SPARK-47688
> URL: https://issues.apache.org/jira/browse/SPARK-47688
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
>Affects Versions: 4.0.0
>Reporter: BingKun Pan
>Priority: Major
> Labels: pull-request-available
>
> Allow log syntax like
> {code:java}
> log"Driver terminated with exit code ${MDC(EXIT_CODE, exitCode)}! Shutting
> down. $remoteAddress"{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47688) Support concatenation `normal variables` and `MDC`
[
https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-47688:
Description:
Allow log syntax like
{code:java}
log"Driver terminated with exit code ${MDC(EXIT_CODE, exitCode)}! Shutting
down. $remoteAddress"{code}
> Support concatenation `normal variables` and `MDC`
> --
>
> Key: SPARK-47688
> URL: https://issues.apache.org/jira/browse/SPARK-47688
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
>Affects Versions: 4.0.0
>Reporter: BingKun Pan
>Priority: Major
> Labels: pull-request-available
>
> Allow log syntax like
> {code:java}
> log"Driver terminated with exit code ${MDC(EXIT_CODE, exitCode)}! Shutting
> down. $remoteAddress"{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47688) Support concatenation `normal variables` and `MDC`
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Summary: Support concatenation `normal variables` and `MDC` (was: Support concatenation between `normal variables` and `MDC`) > Support concatenation `normal variables` and `MDC` > -- > > Key: SPARK-47688 > URL: https://issues.apache.org/jira/browse/SPARK-47688 > Project: Spark > Issue Type: Sub-task > Components: Spark Core >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47688) Support concatenation between `normal variables` and `MDC`
BingKun Pan created SPARK-47688: --- Summary: Support concatenation between `normal variables` and `MDC` Key: SPARK-47688 URL: https://issues.apache.org/jira/browse/SPARK-47688 Project: Spark Issue Type: Sub-task Components: Spark Core Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-47240) SPIP: Structured Logging Framework for Apache Spark
[
https://issues.apache.org/jira/browse/SPARK-47240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832783#comment-17832783
]
BingKun Pan commented on SPARK-47240:
-
[~Gengliang.Wang] Can I participate in the subsequent log migration work?
> SPIP: Structured Logging Framework for Apache Spark
> ---
>
> Key: SPARK-47240
> URL: https://issues.apache.org/jira/browse/SPARK-47240
> Project: Spark
> Issue Type: New Feature
> Components: Project Infra
>Affects Versions: 4.0.0
>Reporter: Gengliang Wang
>Priority: Major
>
> This proposal aims to enhance Apache Spark's logging system by implementing
> structured logging. This transition will change the format of the default log
> files from plain text to JSON, making them more accessible and analyzable.
> The new logs will include crucial identifiers such as worker, executor,
> query, job, stage, and task IDs, thereby making the logs more informative and
> facilitating easier search and analysis.
> h2. Current Logging Format
> The current format of Spark logs is plain text, which can be challenging to
> parse and analyze efficiently. An example of the current log format is as
> follows:
> {code:java}
> 23/11/29 17:53:44 ERROR BlockManagerMasterEndpoint: Fail to know the executor
> 289 is alive or not.
> org.apache.spark.SparkException: Exception thrown in awaitResult:
>
> Caused by: org.apache.spark.rpc.RpcEndpointNotFoundException: ..
> {code}
> h2. Proposed Structured Logging Format
> The proposed change involves structuring the logs in JSON format, which
> organizes the log information into easily identifiable fields. Here is how
> the new structured log format would look:
> {code:java}
> {
> "ts":"23/11/29 17:53:44",
> "level":"ERROR",
> "msg":"Fail to know the executor 289 is alive or not",
> "context":{
> "executor_id":"289"
> },
> "exception":{
> "class":"org.apache.spark.SparkException",
> "msg":"Exception thrown in awaitResult",
> "stackTrace":"..."
> },
> "source":"BlockManagerMasterEndpoint"
> } {code}
> This format will enable users to upload and directly query
> driver/executor/master/worker log files using Spark SQL for more effective
> problem-solving and analysis, such as tracking executor losses or identifying
> faulty tasks:
> {code:java}
> spark.read.json("hdfs://hdfs_host/logs").createOrReplaceTempView("logs")
> /* To get all the executor lost logs */
> SELECT * FROM logs WHERE contains(message, 'Lost executor');
> /* To get all the distributed logs about executor 289 */
> SELECT * FROM logs WHERE executor_id = 289;
> /* To get all the errors on host 100.116.29.4 */
> SELECT * FROM logs WHERE host = "100.116.29.4" and log_level="ERROR";
> {code}
>
> SPIP doc:
> [https://docs.google.com/document/d/1rATVGmFLNVLmtxSpWrEceYm7d-ocgu8ofhryVs4g3XU/edit?usp=sharing]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47649) Make the parameter `inputs` of the function `[csv|parquet|orc|json|text|xml](paths: String*)` non empty
BingKun Pan created SPARK-47649: --- Summary: Make the parameter `inputs` of the function `[csv|parquet|orc|json|text|xml](paths: String*)` non empty Key: SPARK-47649 URL: https://issues.apache.org/jira/browse/SPARK-47649 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47648) Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite` and `[Csv|Json]FunctionsSuite`
[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47648: Summary: Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite` and `[Csv|Json]FunctionsSuite` (was: Use checkError() to check Exception in [CSV|Json|Xml]Suite and [Csv|Json]FunctionsSuite) > Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite` and > `[Csv|Json]FunctionsSuite` > - > > Key: SPARK-47648 > URL: https://issues.apache.org/jira/browse/SPARK-47648 > Project: Spark > Issue Type: Improvement > Components: Tests >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47648) Use checkError() to check Exception in [CSV|Json|Xml]Suite and [Csv|Json]FunctionsSuite
[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47648: Summary: Use checkError() to check Exception in [CSV|Json|Xml]Suite and [Csv|Json]FunctionsSuite (was: Use checkError() to check Exception in [Json|Xml|CSV]Suite and [Json|CSV]FunctionsSuite) > Use checkError() to check Exception in [CSV|Json|Xml]Suite and > [Csv|Json]FunctionsSuite > --- > > Key: SPARK-47648 > URL: https://issues.apache.org/jira/browse/SPARK-47648 > Project: Spark > Issue Type: Improvement > Components: Tests >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47648) Use checkError() to check Exception in [Json|Xml|CSV]Suite and [Json|CSV]FunctionsSuite
[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47648: Summary: Use checkError() to check Exception in [Json|Xml|CSV]Suite and [Json|CSV]FunctionsSuite (was: Use checkError() to check Exception in `Json/Xml/CSV`Suite and `Csv/Json`FunctionsSuite) > Use checkError() to check Exception in [Json|Xml|CSV]Suite and > [Json|CSV]FunctionsSuite > --- > > Key: SPARK-47648 > URL: https://issues.apache.org/jira/browse/SPARK-47648 > Project: Spark > Issue Type: Improvement > Components: Tests >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47648) Use checkError() to check Exception in `Json/Xml/CSV`Suite and `Csv/Json`FunctionsSuite
[ https://issues.apache.org/jira/browse/SPARK-47648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47648: Summary: Use checkError() to check Exception in `Json/Xml/CSV`Suite and `Csv/Json`FunctionsSuite (was: Use checkError() to check Exception in `Json/Xml/Csv`Suite and ``) > Use checkError() to check Exception in `Json/Xml/CSV`Suite and > `Csv/Json`FunctionsSuite > --- > > Key: SPARK-47648 > URL: https://issues.apache.org/jira/browse/SPARK-47648 > Project: Spark > Issue Type: Improvement > Components: Tests >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47648) Use checkError() to check Exception in `Json/Xml/Csv`Suite and ``
BingKun Pan created SPARK-47648: --- Summary: Use checkError() to check Exception in `Json/Xml/Csv`Suite and `` Key: SPARK-47648 URL: https://issues.apache.org/jira/browse/SPARK-47648 Project: Spark Issue Type: Improvement Components: Tests Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47614) Update some outdated comments about JavaModuleOptions
[ https://issues.apache.org/jira/browse/SPARK-47614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47614: Component/s: Documentation > Update some outdated comments about JavaModuleOptions > - > > Key: SPARK-47614 > URL: https://issues.apache.org/jira/browse/SPARK-47614 > Project: Spark > Issue Type: Improvement > Components: Documentation, Spark Core >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47614) Update some outdated comments about JavaModuleOptions
[ https://issues.apache.org/jira/browse/SPARK-47614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47614: Summary: Update some outdated comments about JavaModuleOptions (was: Rename `JavaModuleOptions` to `JVMRuntimeOptions`) > Update some outdated comments about JavaModuleOptions > - > > Key: SPARK-47614 > URL: https://issues.apache.org/jira/browse/SPARK-47614 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47614) Rename `JavaModuleOptions` to `JVMRuntimeOptions`
BingKun Pan created SPARK-47614: --- Summary: Rename `JavaModuleOptions` to `JVMRuntimeOptions` Key: SPARK-47614 URL: https://issues.apache.org/jira/browse/SPARK-47614 Project: Spark Issue Type: Improvement Components: Spark Core Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47559) Codegen Support for variant `parse_json`
[ https://issues.apache.org/jira/browse/SPARK-47559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47559: Summary: Codegen Support for variant `parse_json` (was: Codegen Support for variant parse_json) > Codegen Support for variant `parse_json` > > > Key: SPARK-47559 > URL: https://issues.apache.org/jira/browse/SPARK-47559 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47559) Codegen Support for variant parse_json
BingKun Pan created SPARK-47559: --- Summary: Codegen Support for variant parse_json Key: SPARK-47559 URL: https://issues.apache.org/jira/browse/SPARK-47559 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47539) Make the return value of method `castToString` be `Any => UTF8String`
[ https://issues.apache.org/jira/browse/SPARK-47539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47539: Summary: Make the return value of method `castToString` be `Any => UTF8String` (was: Make the method `castToString(from: DataType): Any => Any` to `castToString(from: DataType): Any => UTF8String` in `ToStringBase`.) > Make the return value of method `castToString` be `Any => UTF8String` > - > > Key: SPARK-47539 > URL: https://issues.apache.org/jira/browse/SPARK-47539 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47539) Make the method `castToString(from: DataType): Any => Any` to `castToString(from: DataType): Any => UTF8String` in `ToStringBase`.
BingKun Pan created SPARK-47539: --- Summary: Make the method `castToString(from: DataType): Any => Any` to `castToString(from: DataType): Any => UTF8String` in `ToStringBase`. Key: SPARK-47539 URL: https://issues.apache.org/jira/browse/SPARK-47539 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47533) Migrate scalafmt dialect to scala213
BingKun Pan created SPARK-47533: --- Summary: Migrate scalafmt dialect to scala213 Key: SPARK-47533 URL: https://issues.apache.org/jira/browse/SPARK-47533 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47526) Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final
[ https://issues.apache.org/jira/browse/SPARK-47526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47526: Summary: Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final (was: Upgrade `netty` to 4.1.108.Final, `netty-tcnative` to 2.0.65.Final and `arrow-memory-netty` to 15.0.2) > Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final > - > > Key: SPARK-47526 > URL: https://issues.apache.org/jira/browse/SPARK-47526 > Project: Spark > Issue Type: Sub-task > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47529) Use hadoop 3.4.0 in some docs
BingKun Pan created SPARK-47529: --- Summary: Use hadoop 3.4.0 in some docs Key: SPARK-47529 URL: https://issues.apache.org/jira/browse/SPARK-47529 Project: Spark Issue Type: Improvement Components: Documentation Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47526) Upgrade `netty` to 4.1.108.Final, `netty-tcnative` to 2.0.65.Final and `arrow-memory-netty` to 15.0.2
BingKun Pan created SPARK-47526: --- Summary: Upgrade `netty` to 4.1.108.Final, `netty-tcnative` to 2.0.65.Final and `arrow-memory-netty` to 15.0.2 Key: SPARK-47526 URL: https://issues.apache.org/jira/browse/SPARK-47526 Project: Spark Issue Type: Sub-task Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`
[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47516: Description: When creating the docker image, remove unused installation packages. > Move `remove unused installation package logic` from `each test job` to > `create the docker image` > - > > Key: SPARK-47516 > URL: https://issues.apache.org/jira/browse/SPARK-47516 > Project: Spark > Issue Type: Improvement > Components: Project Infra >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > > When creating the docker image, remove unused installation packages. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`
[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47516: Summary: Move `remove unused installation package logic` from `each test job` to `create the docker image` (was: When creating the docker image, remove unused installation packages) > Move `remove unused installation package logic` from `each test job` to > `create the docker image` > - > > Key: SPARK-47516 > URL: https://issues.apache.org/jira/browse/SPARK-47516 > Project: Spark > Issue Type: Improvement > Components: Project Infra >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47516) When creating the docker image, remove unused installation packages
BingKun Pan created SPARK-47516: --- Summary: When creating the docker image, remove unused installation packages Key: SPARK-47516 URL: https://issues.apache.org/jira/browse/SPARK-47516 Project: Spark Issue Type: Improvement Components: Project Infra Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47497) Make `to_csv` support the output of `array/struct/map` as pretty strings
[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47497: Summary: Make `to_csv` support the output of `array/struct/map` as pretty strings (was: Make `to_csv` support the output of `array/struct/map ` as pretty strings) > Make `to_csv` support the output of `array/struct/map` as pretty strings > > > Key: SPARK-47497 > URL: https://issues.apache.org/jira/browse/SPARK-47497 > Project: Spark > Issue Type: Improvement > Components: Project Infra >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47497) Make `to_csv` support the output of `array/struct/map ` as pretty strings
[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47497: Summary: Make `to_csv` support the output of `array/struct/map ` as pretty strings (was: Make `to_csv` support some types of data) > Make `to_csv` support the output of `array/struct/map ` as pretty strings > - > > Key: SPARK-47497 > URL: https://issues.apache.org/jira/browse/SPARK-47497 > Project: Spark > Issue Type: Improvement > Components: Project Infra >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47514) Add a test coverage for createTable method (partitioned-table) in CatalogSuite
BingKun Pan created SPARK-47514: --- Summary: Add a test coverage for createTable method (partitioned-table) in CatalogSuite Key: SPARK-47514 URL: https://issues.apache.org/jira/browse/SPARK-47514 Project: Spark Issue Type: Improvement Components: SQL, Tests Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47505) Fix `pyspark-errors` test jobs for branch-3.4
[ https://issues.apache.org/jira/browse/SPARK-47505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47505: Summary: Fix `pyspark-errors` test jobs for branch-3.4 (was: Fix `Pyspark-errors` for branch-3.4) > Fix `pyspark-errors` test jobs for branch-3.4 > - > > Key: SPARK-47505 > URL: https://issues.apache.org/jira/browse/SPARK-47505 > Project: Spark > Issue Type: Improvement > Components: Project Infra >Affects Versions: 3.4.3 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47505) Fix `Pyspark-errors` for branch-3.4
BingKun Pan created SPARK-47505: --- Summary: Fix `Pyspark-errors` for branch-3.4 Key: SPARK-47505 URL: https://issues.apache.org/jira/browse/SPARK-47505 Project: Spark Issue Type: Improvement Components: Project Infra Affects Versions: 3.4.3 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47502) Make the `size` of the installed packages output in `descending` order, and add a `header`
[ https://issues.apache.org/jira/browse/SPARK-47502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47502: Summary: Make the `size` of the installed packages output in `descending` order, and add a `header` (was: Make the size of the installed packages output in the script `free_disk_space` and `free_disk_space_container` be output in `descending order`) > Make the `size` of the installed packages output in `descending` order, and > add a `header` > -- > > Key: SPARK-47502 > URL: https://issues.apache.org/jira/browse/SPARK-47502 > Project: Spark > Issue Type: Improvement > Components: Project Infra >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47502) Make the size of the installed packages output in the script `free_disk_space` and `free_disk_space_container` be output in `descending order`
BingKun Pan created SPARK-47502: --- Summary: Make the size of the installed packages output in the script `free_disk_space` and `free_disk_space_container` be output in `descending order` Key: SPARK-47502 URL: https://issues.apache.org/jira/browse/SPARK-47502 Project: Spark Issue Type: Improvement Components: Project Infra Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-47497) Make `to_csv` support some types of data
[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829378#comment-17829378 ] BingKun Pan commented on SPARK-47497: - I work on it > Make `to_csv` support some types of data > > > Key: SPARK-47497 > URL: https://issues.apache.org/jira/browse/SPARK-47497 > Project: Spark > Issue Type: Improvement > Components: Project Infra >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47497) Make `to_csv` support some types of data
[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47497: Summary: Make `to_csv` support some types of data (was: Upgrade github action cache to v4) > Make `to_csv` support some types of data > > > Key: SPARK-47497 > URL: https://issues.apache.org/jira/browse/SPARK-47497 > Project: Spark > Issue Type: Improvement > Components: Project Infra >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47481) Fix Python linter
[ https://issues.apache.org/jira/browse/SPARK-47481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47481: Summary: Fix Python linter (was: pin `matplotlib<3.3.0`) > Fix Python linter > - > > Key: SPARK-47481 > URL: https://issues.apache.org/jira/browse/SPARK-47481 > Project: Spark > Issue Type: Improvement > Components: Project Infra >Affects Versions: 3.4.3 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47481) Fix Python linter
[ https://issues.apache.org/jira/browse/SPARK-47481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47481: Affects Version/s: 3.5.2 > Fix Python linter > - > > Key: SPARK-47481 > URL: https://issues.apache.org/jira/browse/SPARK-47481 > Project: Spark > Issue Type: Improvement > Components: Project Infra >Affects Versions: 3.5.2, 3.4.3 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47481) pin `matplotlib<3.3.0`
BingKun Pan created SPARK-47481: --- Summary: pin `matplotlib<3.3.0` Key: SPARK-47481 URL: https://issues.apache.org/jira/browse/SPARK-47481 Project: Spark Issue Type: Improvement Components: Project Infra Affects Versions: 3.4.3 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47464) Update labeler.yml
BingKun Pan created SPARK-47464: --- Summary: Update labeler.yml Key: SPARK-47464 URL: https://issues.apache.org/jira/browse/SPARK-47464 Project: Spark Issue Type: Improvement Components: Project Infra Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47460) Fix daily scheduled jobs for branch-3.4 & branch-3.5
BingKun Pan created SPARK-47460: --- Summary: Fix daily scheduled jobs for branch-3.4 & branch-3.5 Key: SPARK-47460 URL: https://issues.apache.org/jira/browse/SPARK-47460 Project: Spark Issue Type: Improvement Components: Project Infra Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47426) Upgrade Guava used by the connect module to 33.1.0-jre
[ https://issues.apache.org/jira/browse/SPARK-47426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47426: Summary: Upgrade Guava used by the connect module to 33.1.0-jre (was: Upgrade Guava used by the connect module to 33.1-jre) > Upgrade Guava used by the connect module to 33.1.0-jre > -- > > Key: SPARK-47426 > URL: https://issues.apache.org/jira/browse/SPARK-47426 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47419) Move `log4j2-defaults.properties` to `common/utils`
[ https://issues.apache.org/jira/browse/SPARK-47419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47419: Summary: Move `log4j2-defaults.properties` to `common/utils` (was: Move `log4j2-defaults.properties` to `common\utils`) > Move `log4j2-defaults.properties` to `common/utils` > --- > > Key: SPARK-47419 > URL: https://issues.apache.org/jira/browse/SPARK-47419 > Project: Spark > Issue Type: Improvement > Components: Connect >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47419) Move `log4j2-defaults.properties` to `common\utils`
BingKun Pan created SPARK-47419: --- Summary: Move `log4j2-defaults.properties` to `common\utils` Key: SPARK-47419 URL: https://issues.apache.org/jira/browse/SPARK-47419 Project: Spark Issue Type: Improvement Components: Connect Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47387) Remove some unused error classes
BingKun Pan created SPARK-47387: --- Summary: Remove some unused error classes Key: SPARK-47387 URL: https://issues.apache.org/jira/browse/SPARK-47387 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47378) Make the related Protobuf UT run well in IDE
[ https://issues.apache.org/jira/browse/SPARK-47378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47378: Summary: Make the related Protobuf UT run well in IDE (was: Make related Protobuf UT run well in IDE) > Make the related Protobuf UT run well in IDE > > > Key: SPARK-47378 > URL: https://issues.apache.org/jira/browse/SPARK-47378 > Project: Spark > Issue Type: Improvement > Components: Protobuf, Tests >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47378) Make related Protobuf UT run well in IDE
BingKun Pan created SPARK-47378: --- Summary: Make related Protobuf UT run well in IDE Key: SPARK-47378 URL: https://issues.apache.org/jira/browse/SPARK-47378 Project: Spark Issue Type: Improvement Components: Protobuf, Tests Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47374) Fix connect-repl `usage prompt` & `docs link`
BingKun Pan created SPARK-47374: --- Summary: Fix connect-repl `usage prompt` & `docs link` Key: SPARK-47374 URL: https://issues.apache.org/jira/browse/SPARK-47374 Project: Spark Issue Type: Bug Components: Connect, Documentation Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47348) Align the version of the ubuntu host machine where the GitHub workflow runs on
BingKun Pan created SPARK-47348: --- Summary: Align the version of the ubuntu host machine where the GitHub workflow runs on Key: SPARK-47348 URL: https://issues.apache.org/jira/browse/SPARK-47348 Project: Spark Issue Type: Improvement Components: Project Infra Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47339) Upgrade checkStyle to `10.14.0`.
BingKun Pan created SPARK-47339: --- Summary: Upgrade checkStyle to `10.14.0`. Key: SPARK-47339 URL: https://issues.apache.org/jira/browse/SPARK-47339 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47333) Use checkInputDataTypes to check the parameter types of the function to_xml & remove _LEGACY_ERROR_TEMP_3234
BingKun Pan created SPARK-47333: --- Summary: Use checkInputDataTypes to check the parameter types of the function to_xml & remove _LEGACY_ERROR_TEMP_3234 Key: SPARK-47333 URL: https://issues.apache.org/jira/browse/SPARK-47333 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
