[jira] [Updated] (SPARK-47435) SPARK-45561 causes mysql unsigned tinyint overflow

2024-03-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47435: - Fix Version/s: 3.5.2 > SPARK-45561 causes mysql unsigned tinyint overflow >

[jira] [Resolved] (SPARK-47453) Upgrade MySQL docker image version to 8.3.0

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47453. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45581

[jira] [Assigned] (SPARK-47453) Upgrade MySQL docker image version to 8.3.0

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47453: - Assignee: Kent Yao > Upgrade MySQL docker image version to 8.3.0 >

[jira] [Resolved] (SPARK-47422) Support collated strings in array operations

2024-03-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47422. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45563

[jira] [Assigned] (SPARK-47422) Support collated strings in array operations

2024-03-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47422: --- Assignee: Nikola Mandic > Support collated strings in array operations >

[jira] [Updated] (SPARK-47456) Support ORC Brotli codec

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47456: --- Labels: pull-request-available (was: ) > Support ORC Brotli codec >

[jira] [Created] (SPARK-47456) Support ORC Brotli codec

2024-03-18 Thread dzcxzl (Jira)
dzcxzl created SPARK-47456: -- Summary: Support ORC Brotli codec Key: SPARK-47456 URL: https://issues.apache.org/jira/browse/SPARK-47456 Project: Spark Issue Type: Improvement Components:

[jira] [Updated] (SPARK-45393) Upgrade Hadoop to 3.4.0

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45393: --- Labels: pull-request-available (was: ) > Upgrade Hadoop to 3.4.0 > ---

[jira] [Updated] (SPARK-47455) Fix Resource Handling of `scalaStyleOnCompileConfig` in SparkBuild.scala

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47455: --- Labels: pull-request-available (was: ) > Fix Resource Handling of

[jira] [Created] (SPARK-47455) Fix Resource Handling of `scalaStyleOnCompileConfig` in SparkBuild.scala

2024-03-18 Thread Yang Jie (Jira)
Yang Jie created SPARK-47455: Summary: Fix Resource Handling of `scalaStyleOnCompileConfig` in SparkBuild.scala Key: SPARK-47455 URL: https://issues.apache.org/jira/browse/SPARK-47455 Project: Spark

[jira] [Updated] (SPARK-47453) Upgrade MySQL docker image version to 8.3.0

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47453: --- Labels: pull-request-available (was: ) > Upgrade MySQL docker image version to 8.3.0 >

[jira] [Updated] (SPARK-47453) Upgrade MySQL docker image version to 8.3.0

2024-03-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47453: - Priority: Minor (was: Major) > Upgrade MySQL docker image version to 8.3.0 >

[jira] [Created] (SPARK-47453) Upgrade MySQL docker image version to 8.3.0

2024-03-18 Thread Kent Yao (Jira)
Kent Yao created SPARK-47453: Summary: Upgrade MySQL docker image version to 8.3.0 Key: SPARK-47453 URL: https://issues.apache.org/jira/browse/SPARK-47453 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47329) Persist df while using foreachbatch and stateful streaming query to prevent state from being re-loaded in each batch

2024-03-18 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47329. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45432

[jira] [Commented] (SPARK-46990) Regression: Unable to load empty avro files emitted by event-hubs

2024-03-18 Thread Ivan Sadikov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828143#comment-17828143 ] Ivan Sadikov commented on SPARK-46990: -- Opened PR https://github.com/apache/spark/pull/45578. >

[jira] [Updated] (SPARK-46990) Regression: Unable to load empty avro files emitted by event-hubs

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46990: --- Labels: pull-request-available (was: ) > Regression: Unable to load empty avro files

[jira] [Updated] (SPARK-47452) Use `Ubuntu 22.04` in `dev/infra/Dockerfile`

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47452: -- Summary: Use `Ubuntu 22.04` in `dev/infra/Dockerfile` (was: Use Ubuntu 22.04 in

[jira] [Updated] (SPARK-47452) Use `Ubuntu 22.04` in `dev/infra/Dockerfile`

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47452: --- Labels: pull-request-available (was: ) > Use `Ubuntu 22.04` in `dev/infra/Dockerfile` >

[jira] [Created] (SPARK-47452) Use Ubuntu 22.04 in `dev/infra/Dockerfile`

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47452: - Summary: Use Ubuntu 22.04 in `dev/infra/Dockerfile` Key: SPARK-47452 URL: https://issues.apache.org/jira/browse/SPARK-47452 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47450) Use R 4.3.3 in `windows` R GitHub Action job

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47450. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45574

[jira] [Resolved] (SPARK-47448) Enable spark.shuffle.service.removeShuffle by default

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47448. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45572

[jira] [Updated] (SPARK-47451) Support to_json(variant)

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47451: --- Labels: pull-request-available (was: ) > Support to_json(variant) >

[jira] [Created] (SPARK-47451) Support to_json(variant)

2024-03-18 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47451: -- Summary: Support to_json(variant) Key: SPARK-47451 URL: https://issues.apache.org/jira/browse/SPARK-47451 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47450) Use R 4.3.3 in `windows` R GitHub Action job

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47450: --- Labels: pull-request-available (was: ) > Use R 4.3.3 in `windows` R GitHub Action job >

[jira] [Updated] (SPARK-45921) Use Hadoop 3.3.5 winutils in AppVeyor build

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45921: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Use Hadoop 3.3.5

[jira] [Updated] (SPARK-45995) Upgrade R version from 4.3.1 to 4.3.2 in AppVeyor

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45995: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Upgrade R version from

[jira] [Commented] (SPARK-46990) Regression: Unable to load empty avro files emitted by event-hubs

2024-03-18 Thread Pavlo Pohrrebnyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828113#comment-17828113 ] Pavlo Pohrrebnyi commented on SPARK-46990: -- [~ivan.sadikov], feel free to use it. That is a

[jira] [Created] (SPARK-47449) Refactor and split list/timer unit tests

2024-03-18 Thread Jing Zhan (Jira)
Jing Zhan created SPARK-47449: - Summary: Refactor and split list/timer unit tests Key: SPARK-47449 URL: https://issues.apache.org/jira/browse/SPARK-47449 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-46990) Regression: Unable to load empty avro files emitted by event-hubs

2024-03-18 Thread Ivan Sadikov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828107#comment-17828107 ] Ivan Sadikov commented on SPARK-46990: -- Thanks, Kamil. I am still debugging, will try to open a PR

[jira] [Commented] (SPARK-46990) Regression: Unable to load empty avro files emitted by event-hubs

2024-03-18 Thread Kamil Kandzia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828106#comment-17828106 ] Kamil Kandzia commented on SPARK-46990: --- It is likely that the cause appeared earlier than you

[jira] [Commented] (SPARK-46990) Regression: Unable to load empty avro files emitted by event-hubs

2024-03-18 Thread Ivan Sadikov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828100#comment-17828100 ] Ivan Sadikov commented on SPARK-46990: -- Yes, sure. Thanks for reporting. I will take a look and

[jira] [Commented] (SPARK-46990) Regression: Unable to load empty avro files emitted by event-hubs

2024-03-18 Thread Kamil Kandzia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828095#comment-17828095 ] Kamil Kandzia commented on SPARK-46990: --- Could you [~ivan.sadikov] look into issue? Pavlo has

[jira] [Assigned] (SPARK-47448) Enable spark.shuffle.service.removeShuffle by default

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47448: - Assignee: Dongjoon Hyun > Enable spark.shuffle.service.removeShuffle by default >

[jira] [Assigned] (SPARK-45375) [CORE] Mark connection as timedOut in TransportClient.close

2024-03-18 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45375: --- Assignee: Hasnain Lakhani > [CORE] Mark connection as timedOut in

[jira] [Comment Edited] (SPARK-45374) [CORE] Add test keys for SSL functionality

2024-03-18 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828087#comment-17828087 ] Mridul Muralidharan edited comment on SPARK-45374 at 3/18/24 8:28 PM:

[jira] [Assigned] (SPARK-45374) [CORE] Add test keys for SSL functionality

2024-03-18 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45374: --- Assignee: Hasnain Lakhani > [CORE] Add test keys for SSL functionality >

[jira] [Updated] (SPARK-47448) Enable spark.shuffle.service.removeShuffle by default

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47448: --- Labels: pull-request-available (was: ) > Enable spark.shuffle.service.removeShuffle by

[jira] [Created] (SPARK-47448) Enable spark.shuffle.service.removeShuffle by default

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47448: - Summary: Enable spark.shuffle.service.removeShuffle by default Key: SPARK-47448 URL: https://issues.apache.org/jira/browse/SPARK-47448 Project: Spark

[jira] [Comment Edited] (SPARK-46990) Regression: Unable to load empty avro files emitted by event-hubs

2024-03-18 Thread Pavlo Pohrrebnyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828090#comment-17828090 ] Pavlo Pohrrebnyi edited comment on SPARK-46990 at 3/18/24 8:22 PM: --- We

[jira] [Comment Edited] (SPARK-46990) Regression: Unable to load empty avro files emitted by event-hubs

2024-03-18 Thread Pavlo Pohrrebnyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828090#comment-17828090 ] Pavlo Pohrrebnyi edited comment on SPARK-46990 at 3/18/24 8:21 PM: --- We

[jira] [Comment Edited] (SPARK-46990) Regression: Unable to load empty avro files emitted by event-hubs

2024-03-18 Thread Pavlo Pohrrebnyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828090#comment-17828090 ] Pavlo Pohrrebnyi edited comment on SPARK-46990 at 3/18/24 8:21 PM: --- We

[jira] [Commented] (SPARK-46990) Regression: Unable to load empty avro files emitted by event-hubs

2024-03-18 Thread Pavlo Pohrrebnyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828090#comment-17828090 ] Pavlo Pohrrebnyi commented on SPARK-46990: -- We are experiencing the same with Spark 3.5. That

[jira] [Comment Edited] (SPARK-45374) [CORE] Add test keys for SSL functionality

2024-03-18 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828087#comment-17828087 ] Mridul Muralidharan edited comment on SPARK-45374 at 3/18/24 8:05 PM:

[jira] [Updated] (SPARK-46990) Regression: Unable to load empty avro files emitted by event-hubs

2024-03-18 Thread Pavlo Pohrrebnyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavlo Pohrrebnyi updated SPARK-46990: - Attachment: second=02.avro > Regression: Unable to load empty avro files emitted by

[jira] [Commented] (SPARK-45374) [CORE] Add test keys for SSL functionality

2024-03-18 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828087#comment-17828087 ] Mridul Muralidharan commented on SPARK-45374: - Missed your query, you can link by: "more' ->

[jira] [Resolved] (SPARK-47446) Make `BlockManager` warn before `removeBlockInternal`

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47446. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45570

[jira] [Assigned] (SPARK-47446) Make `BlockManager` warn before `removeBlockInternal`

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47446: - Assignee: Dongjoon Hyun > Make `BlockManager` warn before `removeBlockInternal` >

[jira] [Updated] (SPARK-47447) Allow reading Parquet TimestampLTZ as TimestampNTZ

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47447: --- Labels: pull-request-available (was: ) > Allow reading Parquet TimestampLTZ as

[jira] [Created] (SPARK-47447) Allow reading Parquet TimestampLTZ as TimestampNTZ

2024-03-18 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47447: -- Summary: Allow reading Parquet TimestampLTZ as TimestampNTZ Key: SPARK-47447 URL: https://issues.apache.org/jira/browse/SPARK-47447 Project: Spark Issue

[jira] [Updated] (SPARK-47446) Make `BlockManager` warn before `removeBlockInternal`

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47446: --- Labels: pull-request-available (was: ) > Make `BlockManager` warn before

[jira] [Created] (SPARK-47446) Make `BlockManager` warn before `removeBlockInternal`

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47446: - Summary: Make `BlockManager` warn before `removeBlockInternal` Key: SPARK-47446 URL: https://issues.apache.org/jira/browse/SPARK-47446 Project: Spark

[jira] [Updated] (SPARK-47383) Support `spark.shutdown.timeout` config

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47383: -- Summary: Support `spark.shutdown.timeout` config (was: Make the shutdown hook timeout

[jira] [Resolved] (SPARK-47383) Make the shutdown hook timeout configurable

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47383. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45504

[jira] [Assigned] (SPARK-47383) Make the shutdown hook timeout configurable

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47383: - Assignee: Rob Reeves > Make the shutdown hook timeout configurable >

[jira] [Created] (SPARK-47445) Adding new 'Silent' ExplainMode

2024-03-18 Thread Victor Sunderland (Jira)
Victor Sunderland created SPARK-47445: - Summary: Adding new 'Silent' ExplainMode Key: SPARK-47445 URL: https://issues.apache.org/jira/browse/SPARK-47445 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47444) Empty numRows table stats should not break Hive tables

2024-03-18 Thread Miklos Szurap (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szurap updated SPARK-47444: -- Attachment: reproduction_steps_SPARK-47444.txt > Empty numRows table stats should not break

[jira] [Created] (SPARK-47444) Empty numRows table stats should not break Hive tables

2024-03-18 Thread Miklos Szurap (Jira)
Miklos Szurap created SPARK-47444: - Summary: Empty numRows table stats should not break Hive tables Key: SPARK-47444 URL: https://issues.apache.org/jira/browse/SPARK-47444 Project: Spark

[jira] [Resolved] (SPARK-47442) Use port 0 to start worker server in MasterSuite

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47442. --- Fix Version/s: 4.0.0 Assignee: wuyi Resolution: Fixed > Use port 0 to start

[jira] [Resolved] (SPARK-47435) SPARK-45561 causes mysql unsigned tinyint overflow

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47435. --- Fix Version/s: 4.0.0 Assignee: Kent Yao Resolution: Fixed > SPARK-45561

[jira] [Resolved] (SPARK-47438) Upgrade jackson to 2.17.0

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47438. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45562

[jira] [Updated] (SPARK-47443) Window aggregate support

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47443: --- Labels: pull-request-available (was: ) > Window aggregate support >

[jira] [Created] (SPARK-47443) Window aggregate support

2024-03-18 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-47443: Summary: Window aggregate support Key: SPARK-47443 URL: https://issues.apache.org/jira/browse/SPARK-47443 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-47442) Use port 0 to start worker server in MasterSuite

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47442: -- Reporter: wuyi (was: Dongjoon Hyun) > Use port 0 to start worker server in MasterSuite >

[jira] [Assigned] (SPARK-47434) Streaming Statistics link redirect causing 302 error

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47434: - Assignee: Huw > Streaming Statistics link redirect causing 302 error >

[jira] [Resolved] (SPARK-47434) Streaming Statistics link redirect causing 302 error

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47434. --- Fix Version/s: 3.4.3 4.0.0 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-47442) Use port 0 to start worker server in MasterSuite

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47442: --- Labels: pull-request-available (was: ) > Use port 0 to start worker server in MasterSuite

[jira] [Created] (SPARK-47442) Use port 0 to start worker server in MasterSuite

2024-03-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47442: - Summary: Use port 0 to start worker server in MasterSuite Key: SPARK-47442 URL: https://issues.apache.org/jira/browse/SPARK-47442 Project: Spark Issue

[jira] [Updated] (SPARK-47438) Upgrade jackson to 2.17.0

2024-03-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47438: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade jackson to

[jira] [Updated] (SPARK-47441) Do not add log link for unmanaged AM in Spark UI

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47441: --- Labels: pull-request-available (was: ) > Do not add log link for unmanaged AM in Spark UI

[jira] [Created] (SPARK-47441) Do not add log link for unmanaged AM in Spark UI

2024-03-18 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-47441: --- Summary: Do not add log link for unmanaged AM in Spark UI Key: SPARK-47441 URL: https://issues.apache.org/jira/browse/SPARK-47441 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47440) SQLServer does not support LIKE operator in binary comparison

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47440: --- Labels: pull-request-available (was: ) > SQLServer does not support LIKE operator in

[jira] [Created] (SPARK-47440) SQLServer does not support LIKE operator in binary comparison

2024-03-18 Thread Stefan Bukorovic (Jira)
Stefan Bukorovic created SPARK-47440: Summary: SQLServer does not support LIKE operator in binary comparison Key: SPARK-47440 URL: https://issues.apache.org/jira/browse/SPARK-47440 Project: Spark

[jira] [Updated] (SPARK-47422) Support collated strings in array operations

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47422: --- Labels: pull-request-available (was: ) > Support collated strings in array operations >

[jira] [Updated] (SPARK-47438) Upgrade jackson to 2.17.0

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47438: --- Labels: pull-request-available (was: ) > Upgrade jackson to 2.17.0 >

[jira] [Assigned] (SPARK-47437) Correct the error class for `DataFrame.sort`

2024-03-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47437: Assignee: Ruifeng Zheng > Correct the error class for `DataFrame.sort` >

[jira] [Resolved] (SPARK-47437) Correct the error class for `DataFrame.sort`

2024-03-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47437. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45559

[jira] [Resolved] (SPARK-43435) re-enable doctest `pyspark.sql.connect.dataframe.DataFrame.writeStream`

2024-03-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43435. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45560

[jira] [Resolved] (SPARK-47439) Document Python Data Source API in API reference page

2024-03-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47439. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45561

[jira] [Assigned] (SPARK-47439) Document Python Data Source API in API reference page

2024-03-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47439: Assignee: Hyukjin Kwon > Document Python Data Source API in API reference page >

[jira] [Assigned] (SPARK-47439) Document Python Data Source API in API reference page

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47439: -- Assignee: Apache Spark > Document Python Data Source API in API reference page >

[jira] [Assigned] (SPARK-47439) Document Python Data Source API in API reference page

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47439: -- Assignee: (was: Apache Spark) > Document Python Data Source API in API reference

[jira] [Assigned] (SPARK-47439) Document Python Data Source API in API reference page

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47439: -- Assignee: Apache Spark > Document Python Data Source API in API reference page >

[jira] [Assigned] (SPARK-47439) Document Python Data Source API in API reference page

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47439: -- Assignee: (was: Apache Spark) > Document Python Data Source API in API reference

[jira] [Updated] (SPARK-47439) Document Python Data Source API in API reference page

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47439: --- Labels: pull-request-available (was: ) > Document Python Data Source API in API reference

[jira] [Updated] (SPARK-43435) re-enable doctest `pyspark.sql.connect.dataframe.DataFrame.writeStream`

2024-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43435: --- Labels: pull-request-available (was: ) > re-enable doctest

[jira] [Updated] (SPARK-47439) Document Python Data Source API in API reference page

2024-03-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47439: - Summary: Document Python Data Source API in API reference page (was: Document Python Data

[jira] [Created] (SPARK-47439) Document Python Data Source API

2024-03-18 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47439: Summary: Document Python Data Source API Key: SPARK-47439 URL: https://issues.apache.org/jira/browse/SPARK-47439 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-47436) Fix docstring links and type hints in Python Data Source

2024-03-18 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-47436: - Assignee: Hyukjin Kwon > Fix docstring links and type hints in Python Data Source >

[jira] [Resolved] (SPARK-47436) Fix docstring links and type hints in Python Data Source

2024-03-18 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-47436. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45557

[jira] [Created] (SPARK-47437) Correct the error class for `DataFrame.sort`

2024-03-18 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-47437: - Summary: Correct the error class for `DataFrame.sort` Key: SPARK-47437 URL: https://issues.apache.org/jira/browse/SPARK-47437 Project: Spark Issue Type: