[jira] [Created] (SPARK-47791) Truncate exceed decimals with scale first instead of precision from JDBC datasource

2024-04-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-47791: Summary: Truncate exceed decimals with scale first instead of precision from JDBC datasource Key: SPARK-47791 URL: https://issues.apache.org/jira/browse/SPARK-47791 Project:

[jira] [Updated] (SPARK-47781) Handle negative scale for JDBC data sources

2024-04-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47781: - Summary: Handle negative scale for JDBC data sources (was: Handle negative scale and truncate exceed

[jira] [Updated] (SPARK-47790) Upgrade `commons-io` to 2.16.1

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47790: --- Labels: pull-request-available (was: ) > Upgrade `commons-io` to 2.16.1 >

[jira] [Resolved] (SPARK-47781) Handle negative scale and truncate exceed scale first for JDBC data sources

2024-04-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47781. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45956

[jira] [Updated] (SPARK-45444) Upgrade `commons-io` to 2.14.0

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45444: -- Summary: Upgrade `commons-io` to 2.14.0 (was: Upgrade `commons-io` to 1.24.0) > Upgrade

[jira] [Updated] (SPARK-45444) Upgrade `commons-io` to 1.24.0

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45444: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade `commons-io`

[jira] [Updated] (SPARK-45734) Upgrade commons-io to 2.15.0

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45734: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade commons-io to

[jira] [Resolved] (SPARK-47593) Connector module: Migrate logWarn with variables to structured logging framework

2024-04-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47593. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45879

[jira] [Assigned] (SPARK-47776) State store operation cannot work properly with binary inequality collation

2024-04-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-47776: Assignee: Jungtaek Lim > State store operation cannot work properly with binary

[jira] [Resolved] (SPARK-47776) State store operation cannot work properly with binary inequality collation

2024-04-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47776. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45951

[jira] [Comment Edited] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

2024-04-09 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835587#comment-17835587 ] Mridul Muralidharan edited comment on SPARK-47759 at 4/10/24 4:08 AM:

[jira] [Comment Edited] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

2024-04-09 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835587#comment-17835587 ] Mridul Muralidharan edited comment on SPARK-47759 at 4/10/24 4:08 AM:

[jira] [Commented] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

2024-04-09 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835587#comment-17835587 ] Mridul Muralidharan commented on SPARK-47759: - In order to validate, I would suggest two

[jira] [Updated] (SPARK-47083) Upgrade `commons-codec` to 1.16.1

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47083: -- Fix Version/s: 3.5.2 > Upgrade `commons-codec` to 1.16.1 > -

[jira] [Resolved] (SPARK-47761) Oracle: Support reading AnsiIntervalTypes

2024-04-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47761. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45925

[jira] [Assigned] (SPARK-47761) Oracle: Support reading AnsiIntervalTypes

2024-04-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47761: Assignee: Kent Yao > Oracle: Support reading AnsiIntervalTypes >

[jira] [Updated] (SPARK-47182) Exclude `commons-(io|lang3)` transitive dependencies from `commons-compress` and `avro-*`

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47182: -- Fix Version/s: 3.5.2 > Exclude `commons-(io|lang3)` transitive dependencies from

[jira] [Comment Edited] (SPARK-47463) An error occurred while pushing down the filter of if expression for iceberg datasource.

2024-04-09 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835282#comment-17835282 ] Zhen Wang edited comment on SPARK-47463 at 4/10/24 2:22 AM: new case:

[jira] [Resolved] (SPARK-47586) Hive module: Migrate logError with variables to structured logging framework

2024-04-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47586. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45876

[jira] [Resolved] (SPARK-47787) Upgrade `commons-compress` to 1.26.1`

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47787. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45966

[jira] [Updated] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

2024-04-09 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with an unexpected

[jira] [Updated] (SPARK-47788) Ensure the same hash partitioning scheme/hash function is used across batches

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47788: --- Labels: pull-request-available (was: ) > Ensure the same hash partitioning scheme/hash

[jira] [Commented] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835552#comment-17835552 ] Daniel commented on SPARK-47578: spark-2$ grep logWarning sql/core/src/main/* -R | cut -d ':' -f 1 |

[jira] [Created] (SPARK-47789) Review and improve error message texts

2024-04-09 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-47789: Summary: Review and improve error message texts Key: SPARK-47789 URL: https://issues.apache.org/jira/browse/SPARK-47789 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835546#comment-17835546 ] Daniel edited comment on SPARK-47583 at 4/9/24 11:26 PM: - spark$ grep logError

[jira] [Created] (SPARK-47788) Ensure the same hash partitioning scheme/hash function is used across batches

2024-04-09 Thread Fanyue Xia (Jira)
Fanyue Xia created SPARK-47788: -- Summary: Ensure the same hash partitioning scheme/hash function is used across batches Key: SPARK-47788 URL: https://issues.apache.org/jira/browse/SPARK-47788 Project:

[jira] [Comment Edited] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835546#comment-17835546 ] Daniel edited comment on SPARK-47583 at 4/9/24 11:16 PM: - spark$ grep logError

[jira] [Comment Edited] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835546#comment-17835546 ] Daniel edited comment on SPARK-47583 at 4/9/24 11:14 PM: - spark$ grep logError

[jira] [Comment Edited] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835546#comment-17835546 ] Daniel edited comment on SPARK-47583 at 4/9/24 11:14 PM: - spark$ grep logError

[jira] [Comment Edited] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835546#comment-17835546 ] Daniel edited comment on SPARK-47583 at 4/9/24 11:07 PM: - spark$ grep logError

[jira] [Comment Edited] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835546#comment-17835546 ] Daniel edited comment on SPARK-47583 at 4/9/24 11:07 PM: - spark$ grep logError

[jira] [Comment Edited] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835546#comment-17835546 ] Daniel edited comment on SPARK-47583 at 4/9/24 10:59 PM: - spark$ grep logError

[jira] [Comment Edited] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835546#comment-17835546 ] Daniel edited comment on SPARK-47583 at 4/9/24 10:55 PM: - spark$ grep logError

[jira] [Comment Edited] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835546#comment-17835546 ] Daniel edited comment on SPARK-47583 at 4/9/24 10:53 PM: - spark$ grep logError

[jira] [Comment Edited] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835546#comment-17835546 ] Daniel edited comment on SPARK-47583 at 4/9/24 10:47 PM: - spark$ grep logError

[jira] [Comment Edited] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835546#comment-17835546 ] Daniel edited comment on SPARK-47583 at 4/9/24 10:32 PM: - spark$ grep logError

[jira] [Comment Edited] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835546#comment-17835546 ] Daniel edited comment on SPARK-47583 at 4/9/24 10:30 PM: - spark$ grep logError

[jira] [Commented] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835546#comment-17835546 ] Daniel commented on SPARK-47583: spark$ grep logError sql/core/src/main/* -R | cut -d ':' -f 1 | sort -u

[jira] [Updated] (SPARK-47787) Upgrade `commons-compress` to 1.26.1`

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47787: --- Labels: pull-request-available (was: ) > Upgrade `commons-compress` to 1.26.1` >

[jira] [Updated] (SPARK-47787) Upgrade `commons-compress` to 1.26.1`

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47787: -- Summary: Upgrade `commons-compress` to 1.26.1` (was: Upgrade `commons-compress` to 1.26.`)

[jira] [Created] (SPARK-47787) Upgrade `commons-compress` to 1.26.`

2024-04-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47787: - Summary: Upgrade `commons-compress` to 1.26.` Key: SPARK-47787 URL: https://issues.apache.org/jira/browse/SPARK-47787 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47718) .sql() does not recognize watermark defined upstream

2024-04-09 Thread Wei Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Liu updated SPARK-47718: Labels: (was: pull-request-available) > .sql() does not recognize watermark defined upstream >

[jira] [Assigned] (SPARK-47783) Refresh error-states.json

2024-04-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-47783: -- Assignee: Serge Rielau > Refresh error-states.json > - > >

[jira] [Resolved] (SPARK-47783) Refresh error-states.json

2024-04-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47783. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45961

[jira] [Updated] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

2024-04-09 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with an unexpected

[jira] [Updated] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

2024-04-09 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with an unexpected

[jira] [Updated] (SPARK-47415) Levenshtein (all collations)

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47415: --- Labels: pull-request-available (was: ) > Levenshtein (all collations) >

[jira] [Updated] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

2024-04-09 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with an unexpected

[jira] [Created] (SPARK-47785) Upgrade `bouncycastle` to 1.78

2024-04-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47785: - Summary: Upgrade `bouncycastle` to 1.78 Key: SPARK-47785 URL: https://issues.apache.org/jira/browse/SPARK-47785 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47783) Refresh error-states.json

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47783: --- Labels: pull-request-available (was: ) > Refresh error-states.json >

[jira] [Updated] (SPARK-47783) Refresh error-states.json

2024-04-09 Thread Serge Rielau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serge Rielau updated SPARK-47783: - Summary: Refresh error-states.json (was: Refresh error-state.sql) > Refresh error-states.json

[jira] [Created] (SPARK-47783) Refresh error-state.sql

2024-04-09 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-47783: Summary: Refresh error-state.sql Key: SPARK-47783 URL: https://issues.apache.org/jira/browse/SPARK-47783 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47673) [Arbitrary State Support] State TTL support - ListState

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47673: --- Labels: pull-request-available (was: ) > [Arbitrary State Support] State TTL support -

[jira] [Updated] (SPARK-47748) Upgrade `zstd-jni` to 1.5.6-2

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47748: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade `zstd-jni` to

[jira] [Assigned] (SPARK-47782) Remove redundant json4s-jackson definition in sql/api POM

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47782: - Assignee: Cheng Pan (was: Dongjoon Hyun) > Remove redundant json4s-jackson definition

[jira] [Updated] (SPARK-47782) Remove redundant json4s-jackson definition in sql/api POM

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47782: --- Labels: pull-request-available (was: ) > Remove redundant json4s-jackson definition in

[jira] [Assigned] (SPARK-47782) Remove redundant json4s-jackson definition in sql/api POM

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47782: - Assignee: Dongjoon Hyun > Remove redundant json4s-jackson definition in sql/api POM >

[jira] [Resolved] (SPARK-47782) Remove redundant json4s-jackson definition in sql/api POM

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47782. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45943

[jira] [Updated] (SPARK-47782) Remove redundant json4s-jackson definition in sql/api POM

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47782: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Task) > Remove redundant

[jira] [Created] (SPARK-47782) Remove redundant json4s-jackson definition in sql/api POM

2024-04-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47782: - Summary: Remove redundant json4s-jackson definition in sql/api POM Key: SPARK-47782 URL: https://issues.apache.org/jira/browse/SPARK-47782 Project: Spark

[jira] [Updated] (SPARK-47601) Graphx: Migrate logs with variables to structured logging framework

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47601: --- Labels: pull-request-available (was: ) > Graphx: Migrate logs with variables to

[jira] [Updated] (SPARK-47781) Handle negative scale and truncate exceed scale first for JDBC data sources

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47781: --- Labels: pull-request-available (was: ) > Handle negative scale and truncate exceed scale

[jira] [Created] (SPARK-47781) Handle negative scale and truncate exceed scale first for JDBC data sources

2024-04-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-47781: Summary: Handle negative scale and truncate exceed scale first for JDBC data sources Key: SPARK-47781 URL: https://issues.apache.org/jira/browse/SPARK-47781 Project: Spark

[jira] [Commented] (SPARK-47416) SoundEx (all collations)

2024-04-09 Thread Nikola Mandic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835328#comment-17835328 ] Nikola Mandic commented on SPARK-47416: --- Working on it. > SoundEx (all collations) >

[jira] [Updated] (SPARK-47780) Generate stable and uniquely-named classes in the Catalyst code generator

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47780: --- Labels: pull-request-available (was: ) > Generate stable and uniquely-named classes in the

[jira] [Created] (SPARK-47780) Generate stable and uniquely-named classes in the Catalyst code generator

2024-04-09 Thread Vojin Jovanovic (Jira)
Vojin Jovanovic created SPARK-47780: --- Summary: Generate stable and uniquely-named classes in the Catalyst code generator Key: SPARK-47780 URL: https://issues.apache.org/jira/browse/SPARK-47780

[jira] [Assigned] (SPARK-47413) Substring, Right, Left (all collations)

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47413: -- Assignee: (was: Apache Spark) > Substring, Right, Left (all collations) >

[jira] [Assigned] (SPARK-47779) Add a helper function to sort PS Frame/Series

2024-04-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-47779: - Assignee: Ruifeng Zheng > Add a helper function to sort PS Frame/Series >

[jira] [Assigned] (SPARK-47413) Substring, Right, Left (all collations)

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47413: -- Assignee: Apache Spark > Substring, Right, Left (all collations) >

[jira] [Resolved] (SPARK-47779) Add a helper function to sort PS Frame/Series

2024-04-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-47779. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45952

[jira] [Assigned] (SPARK-47779) Add a helper function to sort PS Frame/Series

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47779: -- Assignee: (was: Apache Spark) > Add a helper function to sort PS Frame/Series >

[jira] [Assigned] (SPARK-47413) Substring, Right, Left (all collations)

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47413: -- Assignee: Apache Spark > Substring, Right, Left (all collations) >

[jira] [Assigned] (SPARK-47413) Substring, Right, Left (all collations)

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47413: -- Assignee: (was: Apache Spark) > Substring, Right, Left (all collations) >

[jira] [Assigned] (SPARK-47779) Add a helper function to sort PS Frame/Series

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47779: -- Assignee: Apache Spark > Add a helper function to sort PS Frame/Series >

[jira] [Commented] (SPARK-47718) .sql() does not recognize watermark defined upstream

2024-04-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835303#comment-17835303 ] Jungtaek Lim commented on SPARK-47718: -- window('createTime', '1 hour', '30 minutes') 'createTime'

[jira] [Resolved] (SPARK-47718) .sql() does not recognize watermark defined upstream

2024-04-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47718. -- Resolution: Not A Bug > .sql() does not recognize watermark defined upstream >

[jira] [Updated] (SPARK-47779) Add a helper function to sort PS Frame/Series

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47779: --- Labels: pull-request-available (was: ) > Add a helper function to sort PS Frame/Series >

[jira] [Created] (SPARK-47779) Add a helper function to sort PS Frame/Series

2024-04-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-47779: - Summary: Add a helper function to sort PS Frame/Series Key: SPARK-47779 URL: https://issues.apache.org/jira/browse/SPARK-47779 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47779) Add a helper function to sort PS Frame/Series

2024-04-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-47779: -- Component/s: PS Tests (was: PySpark) > Add a helper

[jira] [Created] (SPARK-47778) Promote `--wait` option to all services

2024-04-09 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-47778: - Summary: Promote `--wait` option to all services Key: SPARK-47778 URL: https://issues.apache.org/jira/browse/SPARK-47778 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-47774) Remove redundant rules from `MimaExcludes`

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47774: -- Fix Version/s: 3.4.3 > Remove redundant rules from `MimaExcludes` >

[jira] [Updated] (SPARK-47776) State store operation cannot work properly with binary inequality collation

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47776: --- Labels: pull-request-available (was: ) > State store operation cannot work properly with

[jira] [Updated] (SPARK-47774) Remove redundant rules from `MimaExcludes`

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47774: -- Fix Version/s: 3.5.2 > Remove redundant rules from `MimaExcludes` >

[jira] [Resolved] (SPARK-47774) Remove redundant rules from `MimaExcludes`

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47774. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45944

[jira] [Commented] (SPARK-47412) StringLPad, StringRPad (all collations)

2024-04-09 Thread Gideon P (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835182#comment-17835182 ] Gideon P commented on SPARK-47412: -- [~uros-db] I agree -- this one can be expected to be simple and

[jira] [Updated] (SPARK-47777) Add spark connect test for python streaming data source

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-4: --- Labels: pull-request-available (was: ) > Add spark connect test for python streaming data

[jira] [Created] (SPARK-47777) Add spark connect test for python streaming data source

2024-04-09 Thread Chaoqin Li (Jira)
Chaoqin Li created SPARK-4: -- Summary: Add spark connect test for python streaming data source Key: SPARK-4 URL: https://issues.apache.org/jira/browse/SPARK-4 Project: Spark Issue

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47773: -- Affects Version/s: 4.0.0 (was: 3.5.1) > Enhancing the Flexibility

[jira] [Commented] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835181#comment-17835181 ] Dongjoon Hyun commented on SPARK-47773: --- Since this is a new feature which cannot affect old

[jira] [Resolved] (SPARK-47772) Fix the doctest of mode function

2024-04-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-47772. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45940

[jira] [Created] (SPARK-47776) State store operation cannot work properly with binary inequality collation

2024-04-09 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-47776: Summary: State store operation cannot work properly with binary inequality collation Key: SPARK-47776 URL: https://issues.apache.org/jira/browse/SPARK-47776 Project:

[jira] [Commented] (SPARK-47718) .sql() does not recognize watermark defined upstream

2024-04-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835175#comment-17835175 ] Jungtaek Lim commented on SPARK-47718: -- I've lowered down to major - this is neither a regression

[jira] [Updated] (SPARK-47718) .sql() does not recognize watermark defined upstream

2024-04-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-47718: - Priority: Major (was: Blocker) > .sql() does not recognize watermark defined upstream >

[jira] [Commented] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-09 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835171#comment-17835171 ] Ke Jia commented on SPARK-47773: [~viirya] Great, I have added comment permissions in the SPIP Doc. I'm

[jira] [Commented] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-09 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835168#comment-17835168 ] L. C. Hsieh commented on SPARK-47773: - Can you open comment on the SPIP doc? > Enhancing the

[jira] [Updated] (SPARK-47736) Add support for AbstractArrayType

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47736: --- Labels: pull-request-available (was: ) > Add support for AbstractArrayType >

[jira] [Updated] (SPARK-47736) Add support for AbstractArrayType

2024-04-09 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-47736: -- Summary: Add support for AbstractArrayType (was: Add support for

[jira] [Updated] (SPARK-47240) SPIP: Structured Logging Framework for Apache Spark

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47240: --- Labels: pull-request-available (was: ) > SPIP: Structured Logging Framework for Apache

[jira] [Updated] (SPARK-47765) Add SET COLLATION to parser rules

2024-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47765: --- Labels: pull-request-available (was: ) > Add SET COLLATION to parser rules >