[jira] [Updated] (SPARK-48300) Codegen Support for `from_xml`

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48300: --- Labels: pull-request-available (was: ) > Codegen Support for `from_xml` > -

[jira] [Updated] (SPARK-48301) Rename CREATE_FUNC_WITH_IF_NOT_EXISTS_AND_REPLACE to CREATE_ROUTINE_WITH_IF_NOT_EXISTS_AND_REPLACE

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48301: --- Labels: pull-request-available (was: ) > Rename CREATE_FUNC_WITH_IF_NOT_EXISTS_AND_REPLACE

[jira] [Commented] (SPARK-48300) Codegen Support for `from_xml`

2024-05-15 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846830#comment-17846830 ] BingKun Pan commented on SPARK-48300: - I work on it.   > Codegen Support for `from

[jira] [Created] (SPARK-48300) Codegen Support for `from_xml`

2024-05-15 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48300: --- Summary: Codegen Support for `from_xml` Key: SPARK-48300 URL: https://issues.apache.org/jira/browse/SPARK-48300 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-48293) Add test for when ForeachBatchUserFuncException wraps interrupted exception due to query stop

2024-05-15 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-48293. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46601 [https://gi

[jira] [Resolved] (SPARK-48264) Upgrade `datasketches-java` to 6.0.0

2024-05-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48264. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46563 [https://github.com

[jira] [Resolved] (SPARK-47607) Add documentation for Structured logging framework

2024-05-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47607. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46605 [https://github.com

[jira] [Assigned] (SPARK-47607) Add documentation for Structured logging framework

2024-05-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47607: Assignee: Gengliang Wang > Add documentation for Structured logging framework > -

[jira] [Resolved] (SPARK-46001) Spark UI Test Improvements

2024-05-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46001. -- Fix Version/s: 4.0.0 Assignee: Kent Yao Resolution: Fixed > Spark UI Test Improvements

[jira] [Assigned] (SPARK-48299) Upgrade scala-maven-plugin to 4.9.1

2024-05-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48299: Assignee: Yang Jie > Upgrade scala-maven-plugin to 4.9.1 > --- >

[jira] [Resolved] (SPARK-48299) Upgrade scala-maven-plugin to 4.9.1

2024-05-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48299. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46593 [https://github.com

[jira] [Updated] (SPARK-48299) Upgrade scala-maven-plugin to 4.9.1

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48299: --- Labels: pull-request-available (was: ) > Upgrade scala-maven-plugin to 4.9.1 >

[jira] [Updated] (SPARK-47607) Add documentation for Structured logging framework

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47607: --- Labels: pull-request-available (was: ) > Add documentation for Structured logging framework

[jira] [Assigned] (SPARK-48214) Ban import `org.slf4j.Logger` & `org.slf4j.LoggerFactory`

2024-05-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48214: -- Assignee: BingKun Pan > Ban import `org.slf4j.Logger` & `org.slf4j.LoggerFactory` > -

[jira] [Resolved] (SPARK-48214) Ban import `org.slf4j.Logger` & `org.slf4j.LoggerFactory`

2024-05-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48214. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46502 [https:

[jira] [Comment Edited] (SPARK-48298) Add TCP mode to StatsdSink

2024-05-15 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846789#comment-17846789 ] Eric Yang edited comment on SPARK-48298 at 5/16/24 4:48 AM:

[jira] [Updated] (SPARK-36783) ScanOperation should not push Filter through nondeterministic Project

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-36783: --- Labels: pull-request-available (was: ) > ScanOperation should not push Filter through nonde

[jira] [Assigned] (SPARK-48287) Apply the builtin `timestamp_diff` method

2024-05-15 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-48287: - Assignee: Ruifeng Zheng > Apply the builtin `timestamp_diff` method > -

[jira] [Resolved] (SPARK-48287) Apply the builtin `timestamp_diff` method

2024-05-15 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-48287. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46595 [https://

[jira] [Assigned] (SPARK-48219) StreamReader Charset fix with UTF8

2024-05-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48219: Assignee: xy > StreamReader Charset fix with UTF8 > -- > >

[jira] [Resolved] (SPARK-48219) StreamReader Charset fix with UTF8

2024-05-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48219. -- Resolution: Fixed Issue resolved by pull request 46509 [https://github.com/apache/spark/pull/46509] >

[jira] [Created] (SPARK-48299) Upgrade scala-maven-plugin to 4.9.1

2024-05-15 Thread Yang Jie (Jira)
Yang Jie created SPARK-48299: Summary: Upgrade scala-maven-plugin to 4.9.1 Key: SPARK-48299 URL: https://issues.apache.org/jira/browse/SPARK-48299 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-48298) Add TCP mode to StatsdSink

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48298: --- Labels: pull-request-available (was: ) > Add TCP mode to StatsdSink > -

[jira] [Updated] (SPARK-48298) Add TCP mode to StatsdSink

2024-05-15 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated SPARK-48298: -- Summary: Add TCP mode to StatsdSink (was: StatsdSink supports TCP mode) > Add TCP mode to StatsdSink

[jira] [Resolved] (SPARK-48295) Turn on compute.ops_on_diff_frames by default

2024-05-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48295. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46602 [https://gi

[jira] [Assigned] (SPARK-48295) Turn on compute.ops_on_diff_frames by default

2024-05-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48295: Assignee: Ruifeng Zheng > Turn on compute.ops_on_diff_frames by default > ---

[jira] [Updated] (SPARK-48298) StatsdSink supports TCP mode

2024-05-15 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated SPARK-48298: -- Description: Currently, the StatsdSink in Spark supports UDP mode only, which is the default mode of

[jira] [Created] (SPARK-48298) StatsdSink supports TCP mode

2024-05-15 Thread Eric Yang (Jira)
Eric Yang created SPARK-48298: - Summary: StatsdSink supports TCP mode Key: SPARK-48298 URL: https://issues.apache.org/jira/browse/SPARK-48298 Project: Spark Issue Type: New Feature Comp

[jira] [Commented] (SPARK-48298) StatsdSink supports TCP mode

2024-05-15 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846789#comment-17846789 ] Eric Yang commented on SPARK-48298: --- I'm preparing a PR for it. > StatsdSink supports

[jira] [Created] (SPARK-48297) Char/Varchar breaks in TRANSFORM clause

2024-05-15 Thread Kent Yao (Jira)
Kent Yao created SPARK-48297: Summary: Char/Varchar breaks in TRANSFORM clause Key: SPARK-48297 URL: https://issues.apache.org/jira/browse/SPARK-48297 Project: Spark Issue Type: Bug Com

[jira] [Updated] (SPARK-48296) Codegen Support for `to_xml`

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48296: --- Labels: pull-request-available (was: ) > Codegen Support for `to_xml` > ---

[jira] [Created] (SPARK-48296) Codegen Support for `to_xml`

2024-05-15 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48296: --- Summary: Codegen Support for `to_xml` Key: SPARK-48296 URL: https://issues.apache.org/jira/browse/SPARK-48296 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-48289) Clean up Oracle JDBC tests by skipping redundant SYSTEM password reset

2024-05-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48289. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46598 [https://github.com

[jira] [Assigned] (SPARK-48289) Clean up Oracle JDBC tests by skipping redundant SYSTEM password reset

2024-05-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48289: Assignee: Luca Canali > Clean up Oracle JDBC tests by skipping redundant SYSTEM password reset >

[jira] [Resolved] (SPARK-48252) Update CommonExpressionRef when necessary

2024-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48252. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46552 [https://gith

[jira] [Assigned] (SPARK-48252) Update CommonExpressionRef when necessary

2024-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48252: --- Assignee: Wenchen Fan > Update CommonExpressionRef when necessary > ---

[jira] [Resolved] (SPARK-47946) Nested field's nullable value could be invalid after extracted using GetStructField

2024-05-15 Thread Linhong Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linhong Liu resolved SPARK-47946. - Resolution: Not A Problem > Nested field's nullable value could be invalid after extracted using

[jira] [Commented] (SPARK-47946) Nested field's nullable value could be invalid after extracted using GetStructField

2024-05-15 Thread Linhong Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846773#comment-17846773 ] Linhong Liu commented on SPARK-47946: - No, it's not an issue. think about this   |

[jira] [Updated] (SPARK-48295) Turn on compute.ops_on_diff_frames by default

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48295: --- Labels: pull-request-available (was: ) > Turn on compute.ops_on_diff_frames by default > --

[jira] [Created] (SPARK-48295) Turn on compute.ops_on_diff_frames by default

2024-05-15 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-48295: - Summary: Turn on compute.ops_on_diff_frames by default Key: SPARK-48295 URL: https://issues.apache.org/jira/browse/SPARK-48295 Project: Spark Issue Type: I

[jira] [Resolved] (SPARK-48291) Rename Java Logger as SparkLogger

2024-05-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48291. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46600 [https:

[jira] [Comment Edited] (SPARK-48238) Spark fail to start due to class o.a.h.yarn.server.webproxy.amfilter.AmIpFilter is not a jakarta.servlet.Filter

2024-05-15 Thread HiuFung Kwok (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846764#comment-17846764 ] HiuFung Kwok edited comment on SPARK-48238 at 5/15/24 10:06 PM: --

[jira] [Commented] (SPARK-48238) Spark fail to start due to class o.a.h.yarn.server.webproxy.amfilter.AmIpFilter is not a jakarta.servlet.Filter

2024-05-15 Thread HiuFung Kwok (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846764#comment-17846764 ] HiuFung Kwok commented on SPARK-48238: -- [~dongjoon] I'm still new to the codebase,

[jira] [Created] (SPARK-48294) Make nestedTypeMissingElementTypeError case insensitive

2024-05-15 Thread Michael Zhang (Jira)
Michael Zhang created SPARK-48294: - Summary: Make nestedTypeMissingElementTypeError case insensitive Key: SPARK-48294 URL: https://issues.apache.org/jira/browse/SPARK-48294 Project: Spark Iss

[jira] [Commented] (SPARK-48294) Make nestedTypeMissingElementTypeError case insensitive

2024-05-15 Thread Michael Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846739#comment-17846739 ] Michael Zhang commented on SPARK-48294: --- I am working on this issue > Make nested

[jira] [Updated] (SPARK-48291) Rename Java Logger as SparkLogger

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48291: --- Labels: pull-request-available (was: ) > Rename Java Logger as SparkLogger > -

[jira] [Created] (SPARK-48292) Improve stage failure reason message in OutputCommitCoordinator

2024-05-15 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-48292: --- Summary: Improve stage failure reason message in OutputCommitCoordinator Key: SPARK-48292 URL: https://issues.apache.org/jira/browse/SPARK-48292 Project: Spark

[jira] [Updated] (SPARK-48292) Improve stage failure reason message in OutputCommitCoordinator

2024-05-15 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-48292: Affects Version/s: (was: 3.5.1) (was: 3.4.3) > Improve stage failur

[jira] [Updated] (SPARK-48292) Improve stage failure reason message in OutputCommitCoordinator

2024-05-15 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-48292: Affects Version/s: 3.5.1 4.0.0 > Improve stage failure reason message in Ou

[jira] [Updated] (SPARK-48291) Rename Java Logger as SparkLogger

2024-05-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48291: --- Summary: Rename Java Logger as SparkLogger (was: Refactor Java Logger as SparkLogger ) >

[jira] [Created] (SPARK-48291) Refactor Java Logger as SparkLogger

2024-05-15 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-48291: -- Summary: Refactor Java Logger as SparkLogger Key: SPARK-48291 URL: https://issues.apache.org/jira/browse/SPARK-48291 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-48256) Add a rule to check file headers for the java side, and fix inconsistent files

2024-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48256. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46557 [https://

[jira] [Assigned] (SPARK-48256) Add a rule to check file headers for the java side, and fix inconsistent files

2024-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48256: - Assignee: BingKun Pan > Add a rule to check file headers for the java side, and fix inc

[jira] [Assigned] (SPARK-48218) TransportClientFactory.createClient may NPE cause FetchFailedException

2024-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48218: - Assignee: dzcxzl > TransportClientFactory.createClient may NPE cause FetchFailedExcepti

[jira] [Resolved] (SPARK-48218) TransportClientFactory.createClient may NPE cause FetchFailedException

2024-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48218. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46506 [https://

[jira] [Resolved] (SPARK-48049) Upgrade Scala to 2.13.14

2024-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48049. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46288 [https://

[jira] [Resolved] (SPARK-48285) Update docs for size function and sizeOfNull configuration

2024-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48285. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46592 [https://

[jira] [Commented] (SPARK-48238) Spark fail to start due to class o.a.h.yarn.server.webproxy.amfilter.AmIpFilter is not a jakarta.servlet.Filter

2024-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846701#comment-17846701 ] Dongjoon Hyun commented on SPARK-48238: --- Hi, [~chengpan] and [~HF] and [~cloud_fan

[jira] [Updated] (SPARK-48238) Spark fail to start due to class o.a.h.yarn.server.webproxy.amfilter.AmIpFilter is not a jakarta.servlet.Filter

2024-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48238: -- Description: I tested the latest master branch, it failed to start on YARN mode {code:java} de

[jira] [Updated] (SPARK-48290) AQE not working when joining dataframes with more than 2000 partitions

2024-05-15 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] André F. updated SPARK-48290: - Description: We are joining 2 large dataframes with a considerable skew on the left side in one specifi

[jira] [Created] (SPARK-48290) AQE not working when joining dataframes with more than 2000 partitions

2024-05-15 Thread Jira
André F. created SPARK-48290: Summary: AQE not working when joining dataframes with more than 2000 partitions Key: SPARK-48290 URL: https://issues.apache.org/jira/browse/SPARK-48290 Project: Spark

[jira] [Resolved] (SPARK-48172) Fix escaping issues in JDBCDialects

2024-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48172. - Fix Version/s: 3.4.4 3.5.2 4.0.0 Resolution: Fixed

[jira] (SPARK-32472) Expose confusion matrix elements by threshold in BinaryClassificationMetrics

2024-05-15 Thread Gideon P (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32472 ] Gideon P deleted comment on SPARK-32472: -- was (Author: JIRAUSER304403): [~kmoore] can I raise a PR for this issue? > Expose confusion matrix elements by threshold in BinaryClassificationMetric

[jira] [Commented] (SPARK-32472) Expose confusion matrix elements by threshold in BinaryClassificationMetrics

2024-05-15 Thread Gideon P (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846644#comment-17846644 ] Gideon P commented on SPARK-32472: -- [~kmoore] can I raise a PR for this issue? > Expo

[jira] [Updated] (SPARK-48289) Clen up Oracle JDBC tests by skipping redundant SYSTEM password reset

2024-05-15 Thread Luca Canali (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-48289: Summary: Clen up Oracle JDBC tests by skipping redundant SYSTEM password reset (was: Improve Orac

[jira] [Updated] (SPARK-48289) Clean up Oracle JDBC tests by skipping redundant SYSTEM password reset

2024-05-15 Thread Luca Canali (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-48289: Summary: Clean up Oracle JDBC tests by skipping redundant SYSTEM password reset (was: Clen up Ora

[jira] [Updated] (SPARK-48289) Improve Oracle JDBC tests by skipping redundant SYSTEM password reset

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48289: --- Labels: pull-request-available (was: ) > Improve Oracle JDBC tests by skipping redundant SY

[jira] [Commented] (SPARK-45769) data retrieval fails on executors with spark connect

2024-05-15 Thread Sven Teresniak (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846640#comment-17846640 ] Sven Teresniak commented on SPARK-45769: I can confirm this bug when using Spark

[jira] [Created] (SPARK-48289) Improve Oracle JDBC tests by skipping redundant SYSTEM password reset

2024-05-15 Thread Luca Canali (Jira)
Luca Canali created SPARK-48289: --- Summary: Improve Oracle JDBC tests by skipping redundant SYSTEM password reset Key: SPARK-48289 URL: https://issues.apache.org/jira/browse/SPARK-48289 Project: Spark

[jira] [Updated] (SPARK-48288) Add source data type to connector.Cast expression

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48288: --- Labels: pull-request-available (was: ) > Add source data type to connector.Cast expression

[jira] [Created] (SPARK-48288) Add source data type to connector.Cast expression

2024-05-15 Thread Uros Stankovic (Jira)
Uros Stankovic created SPARK-48288: -- Summary: Add source data type to connector.Cast expression Key: SPARK-48288 URL: https://issues.apache.org/jira/browse/SPARK-48288 Project: Spark Issue T

[jira] [Updated] (SPARK-48287) Apply the builtin `timestamp_diff` method

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48287: --- Labels: pull-request-available (was: ) > Apply the builtin `timestamp_diff` method > --

[jira] [Created] (SPARK-48287) Apply the builtin `timestamp_diff` method

2024-05-15 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-48287: - Summary: Apply the builtin `timestamp_diff` method Key: SPARK-48287 URL: https://issues.apache.org/jira/browse/SPARK-48287 Project: Spark Issue Type: Impro

[jira] [Updated] (SPARK-48286) Analyze 'exists' default expression instead of 'current' default expression in structField to v2 column conversion

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48286: --- Labels: pull-request-available (was: ) > Analyze 'exists' default expression instead of 'cu

[jira] [Created] (SPARK-48286) Analyze 'exists' default expression instead of 'current' default expression in structField to v2 column conversion

2024-05-15 Thread Uros Stankovic (Jira)
Uros Stankovic created SPARK-48286: -- Summary: Analyze 'exists' default expression instead of 'current' default expression in structField to v2 column conversion Key: SPARK-48286 URL: https://issues.apache.org/jir

[jira] [Resolved] (SPARK-48271) Turn match error in RowEncoder into UNSUPPORTED_DATA_TYPE_FOR_ENCODER

2024-05-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48271. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46586 [https://github.com

[jira] [Assigned] (SPARK-48271) Turn match error in RowEncoder into UNSUPPORTED_DATA_TYPE_FOR_ENCODER

2024-05-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48271: Assignee: Wenchen Fan > Turn match error in RowEncoder into UNSUPPORTED_DATA_TYPE_FOR_ENCODER > -

[jira] [Updated] (SPARK-48285) Update docs for size function and sizeOfNull configuration

2024-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48285: --- Labels: pull-request-available (was: ) > Update docs for size function and sizeOfNull confi

[jira] [Created] (SPARK-48285) Update docs for size function and sizeOfNull configuration

2024-05-15 Thread Kent Yao (Jira)
Kent Yao created SPARK-48285: Summary: Update docs for size function and sizeOfNull configuration Key: SPARK-48285 URL: https://issues.apache.org/jira/browse/SPARK-48285 Project: Spark Issue Type

[jira] [Resolved] (SPARK-48279) Upgrade ORC to 2.0.1

2024-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48279. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46587 [https://

[jira] [Resolved] (SPARK-48278) Refine the string representation of `Cast`

2024-05-15 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-48278. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46585 [https://

[jira] [Assigned] (SPARK-48272) Add function `timestamp_diff`

2024-05-15 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-48272: - Assignee: Ruifeng Zheng > Add function `timestamp_diff` > -

[jira] [Resolved] (SPARK-48272) Add function `timestamp_diff`

2024-05-15 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-48272. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46576 [https://

[jira] [Commented] (SPARK-24914) totalSize is not a good estimate for broadcast joins

2024-05-15 Thread Giambattista Bloisi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846525#comment-17846525 ] Giambattista Bloisi commented on SPARK-24914: - Also SPARK-40038 reports prob

[jira] [Commented] (SPARK-48284) Fix UTF8String indexOf behaviour for empty string search

2024-05-15 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846527#comment-17846527 ] Uroš Bojanić commented on SPARK-48284: -- Working on this > Fix UTF8String indexOf b

[jira] [Updated] (SPARK-48284) Fix UTF8String indexOf behaviour for empty string search

2024-05-15 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-48284: - Description: Currently, UTF8String.indexOf returns 0 when given an empty parameters string, and

[jira] [Updated] (SPARK-48284) Fix UTF8String indexOf behaviour for empty string search

2024-05-15 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-48284: - Description: Currently, UTF8String.indexOf returns 0 when given an empty parameters string, and

[jira] [Updated] (SPARK-48284) Fix UTF8String indexOf behaviour for empty string search

2024-05-15 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-48284: - Description: Calling UTF8String.indexOf with an empty parameters string, and any integer start v

[jira] [Created] (SPARK-48284) Fix UTF8String indexOf behaviour for empty string search

2024-05-15 Thread Jira
Uroš Bojanić created SPARK-48284: Summary: Fix UTF8String indexOf behaviour for empty string search Key: SPARK-48284 URL: https://issues.apache.org/jira/browse/SPARK-48284 Project: Spark Issu