[jira] [Created] (SPARK-47704) JSON parsing fails with "java.lang.ClassCastException: org.apache.spark.sql.catalyst.util.ArrayBasedMapData cannot be cast to org.apache.spark.sql.catalyst.util.ArrayDat

2024-04-02 Thread Ivan Sadikov (Jira)
Ivan Sadikov created SPARK-47704: Summary: JSON parsing fails with "java.lang.ClassCastException: org.apache.spark.sql.catalyst.util.ArrayBasedMapData cannot be cast to org.apache.spark.sql.catalyst.util.ArrayData" when

[jira] [Updated] (SPARK-47704) JSON parsing fails with "java.lang.ClassCastException: org.apache.spark.sql.catalyst.util.ArrayBasedMapData cannot be cast to org.apache.spark.sql.catalyst.util.ArrayDat

2024-04-02 Thread Ivan Sadikov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Sadikov updated SPARK-47704: - Description: TODO: Please don't close the ticket, I will fill in the description. > JSON

[jira] [Updated] (SPARK-47703) Modify the simpleString of DataSourceV2ScanRelation to distinguish it from DataSourceV2Relation

2024-04-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47703: --- Labels: pull-request-available (was: ) > Modify the simpleString of

[jira] [Updated] (SPARK-47703) Modify the simpleString of DataSourceV2ScanRelation to distinguish it from DataSourceV2Relation

2024-04-02 Thread Xinyu Zou (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyu Zou updated SPARK-47703: -- Summary: Modify the simpleString of DataSourceV2ScanRelation to distinguish it from

[jira] [Created] (SPARK-47703) Modify the simpleString of DataSourveV2ScanRelation to distinguish it from DataSourveV2Relation

2024-04-02 Thread Xinyu Zou (Jira)
Xinyu Zou created SPARK-47703: - Summary: Modify the simpleString of DataSourveV2ScanRelation to distinguish it from DataSourveV2Relation Key: SPARK-47703 URL: https://issues.apache.org/jira/browse/SPARK-47703

[jira] [Created] (SPARK-47702) Shuffle service endpoint is not removed from the locations list when RDD block is removed form a node.

2024-04-02 Thread mahesh kumar behera (Jira)
mahesh kumar behera created SPARK-47702: --- Summary: Shuffle service endpoint is not removed from the locations list when RDD block is removed form a node. Key: SPARK-47702 URL:

[jira] [Resolved] (SPARK-47655) Integrate timer with Initial State handling for state-v2

2024-04-02 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47655. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45780

[jira] (SPARK-47580) SQL catalyst: Migrate logError with variables to structured logging framework

2024-04-02 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47580 ] Haejoon Lee deleted comment on SPARK-47580: - was (Author: itholic): I'm working on this :)  > SQL catalyst: Migrate logError with variables to structured logging framework >

[jira] [Commented] (SPARK-47580) SQL catalyst: Migrate logError with variables to structured logging framework

2024-04-02 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833368#comment-17833368 ] Haejoon Lee commented on SPARK-47580: - I'm working on this :)  > SQL catalyst: Migrate logError

[jira] [Commented] (SPARK-47240) SPIP: Structured Logging Framework for Apache Spark

2024-04-02 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833367#comment-17833367 ] Haejoon Lee commented on SPARK-47240: - Thanks [~Gengliang.Wang] and [~panbingkun] for working on

[jira] [Updated] (SPARK-47588) Hive module: Migrate logInfo with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47588: --- Component/s: Spark Core (was: Project Infra) > Hive module: Migrate

[jira] [Updated] (SPARK-47602) Resource managers: Migrate logError with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47602: --- Component/s: Spark Core (was: Project Infra) > Resource managers:

[jira] [Updated] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47583: --- Component/s: Spark Core (was: Project Infra) > SQL core: Migrate

[jira] [Updated] (SPARK-47659) Improve `*LoggingSuite*`

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47659: --- Component/s: (was: Tests) > Improve `*LoggingSuite*` > > >

[jira] [Updated] (SPARK-47589) Hive-thriftserver: Migrate logError with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47589: --- Component/s: Spark Core (was: Project Infra) > Hive-thriftserver:

[jira] [Updated] (SPARK-47606) Create log4j templates for both structured logging and plain text logging

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47606: --- Component/s: Spark Core (was: Project Infra) > Create log4j templates

[jira] [Updated] (SPARK-47598) MLLib: Migrate logError with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47598: --- Component/s: Spark Core (was: Project Infra) > MLLib: Migrate logError

[jira] [Updated] (SPARK-47600) MLLib: Migrate logInfo with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47600: --- Component/s: Spark Core (was: Project Infra) > MLLib: Migrate logInfo

[jira] [Updated] (SPARK-47671) Enable structured logging in log4j2.properties.template and update `configuration.md`

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47671: --- Component/s: Spark Core (was: Project Infra) > Enable structured

[jira] [Updated] (SPARK-47581) SQL catalyst: Migrate logWarn with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47581: --- Component/s: Spark Core (was: Project Infra) > SQL catalyst: Migrate

[jira] [Updated] (SPARK-47593) Connector module: Migrate logWarn with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47593: --- Component/s: Spark Core (was: Project Infra) > Connector module:

[jira] [Updated] (SPARK-47697) Add scala style check for invalid MDC usage

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47697: --- Component/s: Spark Core (was: Project Infra) > Add scala style check

[jira] [Updated] (SPARK-47601) Graphx: Migrate logs with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47601: --- Component/s: Spark Core (was: Project Infra) > Graphx: Migrate logs

[jira] [Updated] (SPARK-47586) Hive module: Migrate logError with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47586: --- Component/s: Spark Core (was: Project Infra) > Hive module: Migrate

[jira] [Updated] (SPARK-47603) Resource managers: Migrate logWarn with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47603: --- Component/s: Spark Core (was: Project Infra) > Resource managers:

[jira] [Updated] (SPARK-47590) Hive-thriftserver: Migrate logWarn with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47590: --- Component/s: Spark Core (was: Project Infra) > Hive-thriftserver:

[jira] [Updated] (SPARK-47584) SQL core: Migrate logWarn with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47584: --- Component/s: Spark Core (was: Project Infra) > SQL core: Migrate

[jira] [Updated] (SPARK-47604) Resource managers: Migrate logInfo with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47604: --- Component/s: Spark Core (was: Project Infra) > Resource managers:

[jira] [Updated] (SPARK-47592) Connector module: Migrate logError with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47592: --- Component/s: Spark Core (was: Project Infra) > Connector module:

[jira] [Updated] (SPARK-47605) Enable structured logging in all the test log4j2.properties

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47605: --- Component/s: Spark Core (was: Project Infra) > Enable structured

[jira] [Updated] (SPARK-47587) Hive module: Migrate logWarn with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47587: --- Component/s: Spark Core (was: Project Infra) > Hive module: Migrate

[jira] [Updated] (SPARK-47574) Introduce Structured Logging Framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47574: --- Component/s: Spark Core (was: Project Infra) > Introduce Structured

[jira] [Updated] (SPARK-47594) Connector module: Migrate logInfo with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47594: --- Component/s: Spark Core (was: Project Infra) > Connector module:

[jira] [Updated] (SPARK-47575) Implement logWarning API in structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47575: --- Component/s: Spark Core (was: Project Infra) > Implement logWarning

[jira] [Updated] (SPARK-47576) Implement logInfo API in structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47576: --- Component/s: Spark Core (was: Project Infra) > Implement logInfo API

[jira] [Updated] (SPARK-47608) Improve user experience of loading logs as json data source

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47608: --- Component/s: Spark Core (was: Project Infra) > Improve user experience

[jira] [Updated] (SPARK-47654) Structured logging framework: support log concatenation

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47654: --- Component/s: Spark Core (was: Project Infra) > Structured logging

[jira] [Updated] (SPARK-47240) SPIP: Structured Logging Framework for Apache Spark

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47240: --- Component/s: Spark Core (was: Project Infra) > SPIP: Structured

[jira] [Resolved] (SPARK-47691) Postgres: Support multi dimensional array on the write side

2024-04-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47691. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45815

[jira] [Assigned] (SPARK-47691) Postgres: Support multi dimensional array on the write side

2024-04-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47691: - Assignee: Kent Yao > Postgres: Support multi dimensional array on the write side >

[jira] [Updated] (SPARK-47683) Separate pure Python packaging

2024-04-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47683: --- Labels: pull-request-available (was: ) > Separate pure Python packaging >

[jira] [Resolved] (SPARK-47669) Add `try_cast` function in DataFrame

2024-04-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-47669. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45796

[jira] [Resolved] (SPARK-47697) Add scala style check for invalid MDC usage

2024-04-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47697. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45823

[jira] [Updated] (SPARK-47700) Fix formatting of error messages with treeNode

2024-04-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47700: --- Labels: pull-request-available (was: ) > Fix formatting of error messages with treeNode >

[jira] [Created] (SPARK-47700) Fix formatting of error messages with treeNode

2024-04-02 Thread Jack Chen (Jira)
Jack Chen created SPARK-47700: - Summary: Fix formatting of error messages with treeNode Key: SPARK-47700 URL: https://issues.apache.org/jira/browse/SPARK-47700 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47681) Add schema_of_variant expression.

2024-04-02 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-47681: --- Summary: Add schema_of_variant expression. (was: Add variant_schema expression.) > Add

[jira] [Updated] (SPARK-47698) Current doc section handling-late-data-and-watermarking is misleading after the support for multiple stateful operators

2024-04-02 Thread Lingeshwaran Radhakrishnan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingeshwaran Radhakrishnan updated SPARK-47698: --- Attachment: image-2024-04-02-15-04-34-287.png > Current doc section

[jira] [Created] (SPARK-47698) Current doc section handling-late-data-and-watermarking is misleading after the support for multiple stateful operators

2024-04-02 Thread Lingeshwaran Radhakrishnan (Jira)
Lingeshwaran Radhakrishnan created SPARK-47698: -- Summary: Current doc section handling-late-data-and-watermarking is misleading after the support for multiple stateful operators Key: SPARK-47698 URL:

[jira] [Updated] (SPARK-47698) Current doc section handling-late-data-and-watermarking is misleading after the support for multiple stateful operators

2024-04-02 Thread Lingeshwaran Radhakrishnan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingeshwaran Radhakrishnan updated SPARK-47698: --- Description: [This

[jira] [Updated] (SPARK-46793) Revert S3A endpoint fixup logic of SPARK-35878

2024-04-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46793: -- Parent: (was: SPARK-44124) Issue Type: Bug (was: Sub-task) > Revert S3A endpoint

[jira] [Updated] (SPARK-47696) try_to_timestamp should handle SparkUpgradeException

2024-04-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47696: --- Labels: pull-request-available (was: ) > try_to_timestamp should handle

[jira] [Created] (SPARK-47696) try_to_timestamp should handle SparkUpgradeException

2024-04-02 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47696: -- Summary: try_to_timestamp should handle SparkUpgradeException Key: SPARK-47696 URL: https://issues.apache.org/jira/browse/SPARK-47696 Project: Spark

[jira] [Resolved] (SPARK-47602) Resource managers: Migrate logError with variables to structured logging framework

2024-04-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47602. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45808

[jira] [Updated] (SPARK-47695) Update AWS SDK v2 to 2.24.6

2024-04-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47695: --- Labels: pull-request-available (was: ) > Update AWS SDK v2 to 2.24.6 >

[jira] [Created] (SPARK-47695) Update AWS SDK v2 to 2.24.6

2024-04-02 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47695: - Summary: Update AWS SDK v2 to 2.24.6 Key: SPARK-47695 URL: https://issues.apache.org/jira/browse/SPARK-47695 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47477) SubstringIndex, StringLocate (all collations)

2024-04-02 Thread Milan Dankovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Dankovic updated SPARK-47477: --- Issue Type: Task (was: New Feature) > SubstringIndex, StringLocate (all collations) >

[jira] [Updated] (SPARK-47477) SubstringIndex, StringLocate (all collations)

2024-04-02 Thread Milan Dankovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Dankovic updated SPARK-47477: --- Epic Link: (was: SPARK-46830) > SubstringIndex, StringLocate (all collations) >

[jira] [Updated] (SPARK-47359) StringTranslate (all collations)

2024-04-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47359: --- Labels: pull-request-available (was: ) > StringTranslate (all collations) >

[jira] [Updated] (SPARK-47688) Support `three` methods of the log `concatenation` in the `structured logging framework`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Summary: Support `three` methods of the log `concatenation` in the `structured logging framework`

[jira] [Updated] (SPARK-47694) Make max message size configurable on client side

2024-04-02 Thread Robert Dillitz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Dillitz updated SPARK-47694: --- Fix Version/s: 3.4.3 (was: 3.4.1) > Make max message size

[jira] [Updated] (SPARK-47694) Make max message size configurable on client side

2024-04-02 Thread Robert Dillitz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Dillitz updated SPARK-47694: --- Description: Follow-up to SPARK-42816: Make the limit configurable on the client side.

[jira] [Updated] (SPARK-47694) Make max message size configurable on client side

2024-04-02 Thread Robert Dillitz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Dillitz updated SPARK-47694: --- Affects Version/s: 3.4.1 (was: 3.4.0) > Make max message size

[jira] [Created] (SPARK-47694) Make max message size configurable on client side

2024-04-02 Thread Robert Dillitz (Jira)
Robert Dillitz created SPARK-47694: -- Summary: Make max message size configurable on client side Key: SPARK-47694 URL: https://issues.apache.org/jira/browse/SPARK-47694 Project: Spark Issue

[jira] [Updated] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47666: - Fix Version/s: 3.4.3 > Fix NPE when reading mysql bit array as LongType >

[jira] [Updated] (SPARK-47692) Addition of priority flag to StringType

2024-04-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47692: --- Labels: pull-request-available (was: ) > Addition of priority flag to StringType >

[jira] [Updated] (SPARK-47692) Addition of priority flag to StringType

2024-04-02 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-47692: -- Summary: Addition of priority flag to StringType (was: Addition of default priority

[jira] [Commented] (SPARK-47359) StringTranslate (all collations)

2024-04-02 Thread Milan Dankovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833164#comment-17833164 ] Milan Dankovic commented on SPARK-47359: I am working on this > StringTranslate (all

[jira] [Updated] (SPARK-47416) SoundEx (all collations)

2024-04-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47416: - Summary: SoundEx (all collations) (was: SoundEx, Luhncheck (all collations)) > SoundEx (all

[jira] [Updated] (SPARK-47408) Luhncheck (all collations)

2024-04-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47408: - Summary: Luhncheck (all collations) (was: FindInSet (all collations)) > Luhncheck (all

[jira] [Updated] (SPARK-47688) Support `three` types of the log `concatenation` in the `structured logging framework`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Description: Allow log syntax like - 1.log"... MDC(...) $normal_variables ..." {code:java}

[jira] [Updated] (SPARK-47688) Support `three` types of the log `concatenation` in the `structured logging framework`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Summary: Support `three` types of the log `concatenation` in the `structured logging framework`

[jira] [Updated] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47666: - Fix Version/s: 3.5.2 > Fix NPE when reading mysql bit array as LongType >

[jira] [Updated] (SPARK-47691) Postgres: Support multi dimensional array on the write side

2024-04-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47691: --- Labels: pull-request-available (was: ) > Postgres: Support multi dimensional array on the

[jira] [Created] (SPARK-47692) Addition of default priority flag

2024-04-02 Thread Mihailo Milosevic (Jira)
Mihailo Milosevic created SPARK-47692: - Summary: Addition of default priority flag Key: SPARK-47692 URL: https://issues.apache.org/jira/browse/SPARK-47692 Project: Spark Issue Type:

[jira] [Created] (SPARK-47691) Postgres: Support multi dimensional array on the write side

2024-04-02 Thread Kent Yao (Jira)
Kent Yao created SPARK-47691: Summary: Postgres: Support multi dimensional array on the write side Key: SPARK-47691 URL: https://issues.apache.org/jira/browse/SPARK-47691 Project: Spark Issue

[jira] [Assigned] (SPARK-47685) Should restore the handling of `Stream` in `RelationalGroupedDataset#toDF`

2024-04-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-47685: Assignee: Yang Jie > Should restore the handling of `Stream` in `RelationalGroupedDataset#toDF`

[jira] [Resolved] (SPARK-47685) Should restore the handling of `Stream` in `RelationalGroupedDataset#toDF`

2024-04-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47685. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45811

[jira] [Updated] (SPARK-47397) count_distinct ignores null values

2024-04-02 Thread Martin Rueckl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Rueckl updated SPARK-47397: -- Priority: Minor (was: Critical) > count_distinct ignores null values >

[jira] [Comment Edited] (SPARK-47397) count_distinct ignores null values

2024-04-02 Thread Martin Rueckl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833076#comment-17833076 ] Martin Rueckl edited comment on SPARK-47397 at 4/2/24 8:52 AM: --- Hi

[jira] [Commented] (SPARK-47397) count_distinct ignores null values

2024-04-02 Thread Martin Rueckl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833076#comment-17833076 ] Martin Rueckl commented on SPARK-47397: --- I was told that this is inline with the SQL standard by a

[jira] [Updated] (SPARK-47397) count_distinct ignores null values

2024-04-02 Thread Martin Rueckl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Rueckl updated SPARK-47397: -- Attachment: image-2024-04-02-10-32-44-461.png > count_distinct ignores null values >

[jira] [Resolved] (SPARK-47634) Legacy support for map normalization

2024-04-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47634. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45760

[jira] [Created] (SPARK-47690) Hash aggregate support for strings with collation

2024-04-02 Thread Jira
Uroš Bojanić created SPARK-47690: Summary: Hash aggregate support for strings with collation Key: SPARK-47690 URL: https://issues.apache.org/jira/browse/SPARK-47690 Project: Spark Issue

[jira] [Updated] (SPARK-47688) Support concatenation `normal variables` and `MDC`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Description: Allow log syntax like {code:java} log"Driver terminated with exit code

[jira] [Updated] (SPARK-47687) When creating a table through ThriftServer, set the table owner to the connected user

2024-04-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47687: --- Labels: pull-request-available (was: ) > When creating a table through ThriftServer, set

[jira] [Updated] (SPARK-47688) Support concatenation `normal variables` and `MDC`

2024-04-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47688: --- Labels: pull-request-available (was: ) > Support concatenation `normal variables` and

[jira] [Updated] (SPARK-47688) Support concatenation `normal variables` and `MDC`

2024-04-02 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47688: Summary: Support concatenation `normal variables` and `MDC` (was: Support concatenation between

[jira] [Resolved] (SPARK-47663) Add an end to end tests for checking if spark task works well with resources

2024-04-02 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-47663. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45794

[jira] [Assigned] (SPARK-47663) Add an end to end tests for checking if spark task works well with resources

2024-04-02 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-47663: -- Assignee: Bobby Wang > Add an end to end tests for checking if spark task works well with

[jira] [Created] (SPARK-47689) Do not wrap query execution error during data writing

2024-04-02 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47689: --- Summary: Do not wrap query execution error during data writing Key: SPARK-47689 URL: https://issues.apache.org/jira/browse/SPARK-47689 Project: Spark Issue

[jira] [Created] (SPARK-47688) Support concatenation between `normal variables` and `MDC`

2024-04-02 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47688: --- Summary: Support concatenation between `normal variables` and `MDC` Key: SPARK-47688 URL: https://issues.apache.org/jira/browse/SPARK-47688 Project: Spark

[jira] [Assigned] (SPARK-47686) Use `=!=` instead of `!==` in `JoinHintSuite`

2024-04-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47686: - Assignee: Yang Jie > Use `=!=` instead of `!==` in `JoinHintSuite` >

[jira] [Resolved] (SPARK-47686) Use `=!=` instead of `!==` in `JoinHintSuite`

2024-04-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47686. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45812

[jira] [Created] (SPARK-47687) When creating a table through ThriftServer, set the table owner to the connected user

2024-04-02 Thread Yun Zhao (Jira)
Yun Zhao created SPARK-47687: Summary: When creating a table through ThriftServer, set the table owner to the connected user Key: SPARK-47687 URL: https://issues.apache.org/jira/browse/SPARK-47687