[jira] [Updated] (SPARK-48578) Add new expressions for UTF8 string validation

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48578: --- Labels: pull-request-available (was: ) > Add new expressions for UTF8 string validation >

[jira] [Updated] (SPARK-48577) Replace invalid byte sequences in UTF8Strings

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48577: --- Labels: pull-request-available (was: ) > Replace invalid byte sequences in UTF8Strings >

[jira] [Updated] (SPARK-48582) Bump `braces` from 3.0.2 to 3.0.3 in /ui-test

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48582: --- Labels: pull-request-available (was: ) > Bump `braces` from 3.0.2 to 3.0.3 in /ui-test >

[jira] [Created] (SPARK-48582) Bump `braces` from 3.0.2 to 3.0.3 in /ui-test

2024-06-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-48582: Summary: Bump `braces` from 3.0.2 to 3.0.3 in /ui-test Key: SPARK-48582 URL: https://issues.apache.org/jira/browse/SPARK-48582 Project: Spark Issue Type:

[jira] [Updated] (SPARK-48581) Upgrade dropwizard metrics to 4.2.26

2024-06-10 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48581: Summary: Upgrade dropwizard metrics to 4.2.26 (was: Upgrade dropwizard metrics 4.2.26) > Upgrade

[jira] [Updated] (SPARK-48581) Upgrade dropwizard metrics 4.2.26

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48581: --- Labels: pull-request-available (was: ) > Upgrade dropwizard metrics 4.2.26 >

[jira] [Created] (SPARK-48581) Upgrade dropwizard metrics 4.2.26

2024-06-10 Thread Wei Guo (Jira)
Wei Guo created SPARK-48581: --- Summary: Upgrade dropwizard metrics 4.2.26 Key: SPARK-48581 URL: https://issues.apache.org/jira/browse/SPARK-48581 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-48565) Fix thread dump display in UI

2024-06-10 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48565. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46916

[jira] [Assigned] (SPARK-48565) Fix thread dump display in UI

2024-06-10 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48565: Assignee: Cheng Pan > Fix thread dump display in UI > - > >

[jira] [Resolved] (SPARK-48563) Upgrade pickle to 1.5

2024-06-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48563. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46913

[jira] [Updated] (SPARK-48580) MergedBlock read by reduce have missing chunks, leading to inconsistent shuffle data

2024-06-10 Thread gaoyajun02 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaoyajun02 updated SPARK-48580: --- Description: When push-based shuffle enabled, 0.03% of the spark application in our cluster

[jira] [Updated] (SPARK-48580) MergedBlock read by reduce have missing chunks, leading to inconsistent shuffle data

2024-06-10 Thread gaoyajun02 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaoyajun02 updated SPARK-48580: --- Description: When push-based shuffle enabled, 0.03% of the spark application in our cluster

[jira] [Updated] (SPARK-48580) MergedBlock read by reduce have missing chunks, leading to inconsistent shuffle data

2024-06-10 Thread gaoyajun02 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaoyajun02 updated SPARK-48580: --- Attachment: (was: image-2024-06-11-10-19-22-284.png) > MergedBlock read by reduce have missing

[jira] [Updated] (SPARK-48580) MergedBlock read by reduce have missing chunks, leading to inconsistent shuffle data

2024-06-10 Thread gaoyajun02 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaoyajun02 updated SPARK-48580: --- Attachment: image-2024-06-11-10-19-57-227.png > MergedBlock read by reduce have missing chunks,

[jira] [Updated] (SPARK-48580) MergedBlock read by reduce have missing chunks, leading to inconsistent shuffle data

2024-06-10 Thread gaoyajun02 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaoyajun02 updated SPARK-48580: --- Attachment: image-2024-06-11-10-19-22-284.png > MergedBlock read by reduce have missing chunks,

[jira] [Updated] (SPARK-48580) MergedBlock read by reduce have missing chunks, leading to inconsistent shuffle data

2024-06-10 Thread gaoyajun02 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaoyajun02 updated SPARK-48580: --- Summary: MergedBlock read by reduce have missing chunks, leading to inconsistent shuffle data

[jira] [Created] (SPARK-48580) The merge blocks read by reduce have missing chunks, leading to inconsistent shuffle data

2024-06-10 Thread gaoyajun02 (Jira)
gaoyajun02 created SPARK-48580: -- Summary: The merge blocks read by reduce have missing chunks, leading to inconsistent shuffle data Key: SPARK-48580 URL: https://issues.apache.org/jira/browse/SPARK-48580

[jira] [Updated] (SPARK-48480) StreamingQueryListener thread should not be interruptable

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48480: --- Labels: pull-request-available (was: ) > StreamingQueryListener thread should not be

[jira] [Resolved] (SPARK-48569) Connect - StreamingQuery.name should return null when not specified

2024-06-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48569. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46920

[jira] [Assigned] (SPARK-48410) Fix InitCap expression

2024-06-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48410: --- Assignee: Uroš Bojanić > Fix InitCap expression > -- > >

[jira] [Resolved] (SPARK-48410) Fix InitCap expression

2024-06-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48410. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46732

[jira] [Resolved] (SPARK-48403) Fix Upper & Lower expressions for UTF8_BINARY_LCASE

2024-06-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48403. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46720

[jira] [Resolved] (SPARK-48564) Propagate cached schema in set operations

2024-06-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48564. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46915

[jira] [Assigned] (SPARK-48564) Propagate cached schema in set operations

2024-06-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48564: Assignee: Ruifeng Zheng > Propagate cached schema in set operations >

[jira] [Assigned] (SPARK-48342) [M0] Parser support

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48342: -- Assignee: (was: Apache Spark) > [M0] Parser support > --- > >

[jira] [Assigned] (SPARK-48342) [M0] Parser support

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48342: -- Assignee: Apache Spark > [M0] Parser support > --- > >

[jira] [Updated] (SPARK-48579) [M1] Merge DatabricksSqlParser with SparkSqlParser

2024-06-10 Thread David Milicevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-48579: Description: OSS has single parser for SQL statements - SparkSqlParser. However, in

[jira] [Updated] (SPARK-48579) [M1] Merge DatabricksSqlParser with SparkSqlParser

2024-06-10 Thread David Milicevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-48579: Description: OSS has single parser for SQL statements - SparkSqlParser. However, in

[jira] [Updated] (SPARK-48579) [M1] Merge DatabricksSqlParser with SparkSqlParser

2024-06-10 Thread David Milicevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-48579: Description: OSS has single parser for SQL statements - SparkSqlParser. However, in

[jira] [Created] (SPARK-48579) [M1] Merge DatabricksSqlParser with SparkSqlParser

2024-06-10 Thread David Milicevic (Jira)
David Milicevic created SPARK-48579: --- Summary: [M1] Merge DatabricksSqlParser with SparkSqlParser Key: SPARK-48579 URL: https://issues.apache.org/jira/browse/SPARK-48579 Project: Spark

[jira] [Commented] (SPARK-48311) Nested pythonUDF in groupBy and aggregate result in Binding Exception

2024-06-10 Thread Sumit Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853582#comment-17853582 ] Sumit Singh commented on SPARK-48311: - I have created the PR based on details explained in details

[jira] [Updated] (SPARK-48311) Nested pythonUDF in groupBy and aggregate result in Binding Exception

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48311: --- Labels: pull-request-available (was: ) > Nested pythonUDF in groupBy and aggregate result

[jira] [Updated] (SPARK-48576) Rename UTF8_BINARY_LCASE to UTF8_LCASE

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48576: --- Labels: pull-request-available (was: ) > Rename UTF8_BINARY_LCASE to UTF8_LCASE >

[jira] [Updated] (SPARK-48280) Improve collation testing surface area using expression walking

2024-06-10 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-48280: -- Summary: Improve collation testing surface area using expression walking (was: Add