[jira] [Resolved] (SPARK-47587) Hive module: Migrate logWarn with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47587. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45927

[jira] [Comment Edited] (SPARK-47412) StringLPad, StringRPad (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836009#comment-17836009 ] Gideon P edited comment on SPARK-47412 at 4/11/24 5:30 AM: --- Confirming

[jira] [Commented] (SPARK-47412) StringLPad, StringRPad (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836009#comment-17836009 ] Gideon P commented on SPARK-47412: -- Confirming expected behavior: According to "Collation Support in

[jira] [Resolved] (SPARK-47601) Graphx: Migrate logs with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47601. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45947

[jira] [Assigned] (SPARK-47601) Graphx: Migrate logs with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-47601: -- Assignee: Haejoon Lee > Graphx: Migrate logs with variables to structured logging

[jira] [Resolved] (SPARK-47798) Enrich the error message for the reading failures of decimal values

[ https://issues.apache.org/jira/browse/SPARK-47798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47798. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45981

[jira] [Updated] (SPARK-47809) checkExceptionInExpression should check error for each codegen mode

[ https://issues.apache.org/jira/browse/SPARK-47809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47809: --- Labels: pull-request-available (was: ) > checkExceptionInExpression should check error for

[jira] [Created] (SPARK-47809) checkExceptionInExpression should check error for each codegen mode

Wenchen Fan created SPARK-47809: --- Summary: checkExceptionInExpression should check error for each codegen mode Key: SPARK-47809 URL: https://issues.apache.org/jira/browse/SPARK-47809 Project: Spark

[jira] [Resolved] (SPARK-47001) Pushdown Verification in Optimizer.scala should support changed data types

[ https://issues.apache.org/jira/browse/SPARK-47001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47001. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45146

[jira] [Assigned] (SPARK-47704) JSON parsing fails with "java.lang.ClassCastException: org.apache.spark.sql.catalyst.util.ArrayBasedMapData cannot be cast to org.apache.spark.sql.catalyst.util.ArrayDa

[ https://issues.apache.org/jira/browse/SPARK-47704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47704: Assignee: Ivan Sadikov > JSON parsing fails with "java.lang.ClassCastException: >

[jira] [Resolved] (SPARK-47704) JSON parsing fails with "java.lang.ClassCastException: org.apache.spark.sql.catalyst.util.ArrayBasedMapData cannot be cast to org.apache.spark.sql.catalyst.util.ArrayDa

[ https://issues.apache.org/jira/browse/SPARK-47704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47704. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45833

[jira] [Resolved] (SPARK-47274) Provide more useful context for PySpark DataFrame API errors

[ https://issues.apache.org/jira/browse/SPARK-47274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47274. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45377

[jira] [Assigned] (SPARK-47274) Provide more useful context for PySpark DataFrame API errors

[ https://issues.apache.org/jira/browse/SPARK-47274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47274: --- Assignee: Haejoon Lee > Provide more useful context for PySpark DataFrame API errors >

[jira] [Resolved] (SPARK-47802) Revert mapping ( star ) to named_struct ( star )

[ https://issues.apache.org/jira/browse/SPARK-47802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47802. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45987

[jira] [Assigned] (SPARK-47802) Revert mapping ( star ) to named_struct ( star )

[ https://issues.apache.org/jira/browse/SPARK-47802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47802: --- Assignee: Serge Rielau > Revert mapping ( star ) to named_struct ( star ) >

[jira] [Resolved] (SPARK-47806) Wrap AccessDeniedException in InMemoryFileIndex with error class

[ https://issues.apache.org/jira/browse/SPARK-47806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyi Yu resolved SPARK-47806. -- Resolution: Invalid Created by accident, it does not apply. Closing this one. > Wrap

[jira] [Resolved] (SPARK-47806) Wrap AccessDeniedException in InMemoryFileIndex with error class

[ https://issues.apache.org/jira/browse/SPARK-47806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyi Yu resolved SPARK-47806. -- Resolution: Invalid > Wrap AccessDeniedException in InMemoryFileIndex with error class >

[jira] [Reopened] (SPARK-47806) Wrap AccessDeniedException in InMemoryFileIndex with error class

[ https://issues.apache.org/jira/browse/SPARK-47806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyi Yu reopened SPARK-47806: -- > Wrap AccessDeniedException in InMemoryFileIndex with error class >

[jira] [Resolved] (SPARK-41811) Implement SparkSession.sql's string formatter

[ https://issues.apache.org/jira/browse/SPARK-41811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41811. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45614

[jira] [Assigned] (SPARK-41811) Implement SparkSession.sql's string formatter

[ https://issues.apache.org/jira/browse/SPARK-41811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41811: Assignee: Ruifeng Zheng > Implement SparkSession.sql's string formatter >

[jira] [Created] (SPARK-47806) Wrap AccessDeniedException in InMemoryFileIndex with error class

Xinyi Yu created SPARK-47806: Summary: Wrap AccessDeniedException in InMemoryFileIndex with error class Key: SPARK-47806 URL: https://issues.apache.org/jira/browse/SPARK-47806 Project: Spark

[jira] [Updated] (SPARK-47352) TBD

[ https://issues.apache.org/jira/browse/SPARK-47352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47352: - Summary: TBD (was: improve error handling and collation exception messages) > TBD > --- > >

[jira] [Updated] (SPARK-47805) [Arbitrary State Support] State TTL support - MapState

[ https://issues.apache.org/jira/browse/SPARK-47805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Marnadi updated SPARK-47805: - Description: Add support for expiring state value based on ttl for Map State in

[jira] [Created] (SPARK-47805) [Arbitrary State Support] State TTL support - MapState

Eric Marnadi created SPARK-47805: Summary: [Arbitrary State Support] State TTL support - MapState Key: SPARK-47805 URL: https://issues.apache.org/jira/browse/SPARK-47805 Project: Spark Issue

[jira] [Updated] (SPARK-47804) Add Dataframe cache debug log

[ https://issues.apache.org/jira/browse/SPARK-47804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47804: --- Labels: pull-request-available (was: ) > Add Dataframe cache debug log >

[jira] [Created] (SPARK-47804) Add Dataframe cache debug log

Xinyi Yu created SPARK-47804: Summary: Add Dataframe cache debug log Key: SPARK-47804 URL: https://issues.apache.org/jira/browse/SPARK-47804 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47803) Support cast to variant.

[ https://issues.apache.org/jira/browse/SPARK-47803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47803: --- Labels: pull-request-available (was: ) > Support cast to variant. >

[jira] [Resolved] (SPARK-47595) Streaming: Migrate logError with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47595. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45910

[jira] [Created] (SPARK-47803) Support cast to variant.

Chenhao Li created SPARK-47803: -- Summary: Support cast to variant. Key: SPARK-47803 URL: https://issues.apache.org/jira/browse/SPARK-47803 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-46981) Driver OOM happens in query planning phase with empty tables

[ https://issues.apache.org/jira/browse/SPARK-46981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835896#comment-17835896 ] Yuzhou Sun commented on SPARK-46981: Hello, may I know the driver memory setting when the OOM

[jira] [Updated] (SPARK-47174) Client Side Listener - Server side implementation

[ https://issues.apache.org/jira/browse/SPARK-47174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47174: --- Labels: pull-request-available (was: ) > Client Side Listener - Server side implementation

[jira] [Updated] (SPARK-47802) Revert mapping ( star ) to named_struct ( star )

[ https://issues.apache.org/jira/browse/SPARK-47802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47802: --- Labels: pull-request-available (was: ) > Revert mapping ( star ) to named_struct ( star )

[jira] [Created] (SPARK-47802) Revert mapping ( star ) to named_struct ( star )

Serge Rielau created SPARK-47802: Summary: Revert mapping ( star ) to named_struct ( star ) Key: SPARK-47802 URL: https://issues.apache.org/jira/browse/SPARK-47802 Project: Spark Issue Type:

[jira] (SPARK-44478) Executor decommission causes stage failure

[ https://issues.apache.org/jira/browse/SPARK-44478 ] Dongjoon Hyun deleted comment on SPARK-44478: --- was (Author: dongjoon): Ya, it's difficult to reproduce. BTW, could you try 3.4.2, [~juhai], because SPARK-44630 is in Apache Spark 3.4.2

[jira] [Commented] (SPARK-44478) Executor decommission causes stage failure

[ https://issues.apache.org/jira/browse/SPARK-44478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835831#comment-17835831 ] Dongjoon Hyun commented on SPARK-44478: --- Ya, it's difficult to reproduce. BTW, could you try

[jira] [Created] (SPARK-47801) Use simdjson-java in JSON related UDFs

Zheng Shao created SPARK-47801: -- Summary: Use simdjson-java in JSON related UDFs Key: SPARK-47801 URL: https://issues.apache.org/jira/browse/SPARK-47801 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-47775) Support remaining scalar types in the variant spec.

[ https://issues.apache.org/jira/browse/SPARK-47775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47775: --- Assignee: Chenhao Li > Support remaining scalar types in the variant spec. >

[jira] [Resolved] (SPARK-47775) Support remaining scalar types in the variant spec.

[ https://issues.apache.org/jira/browse/SPARK-47775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47775. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45945

[jira] [Updated] (SPARK-47800) Add method for converting v2 identifier to table identifier

[ https://issues.apache.org/jira/browse/SPARK-47800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47800: --- Labels: pull-request-available (was: ) > Add method for converting v2 identifier to table

[jira] (SPARK-47420) TBD

[ https://issues.apache.org/jira/browse/SPARK-47420 ] Nikola Mandic deleted comment on SPARK-47420: --- was (Author: JIRAUSER304340): Working on it. > TBD > --- > > Key: SPARK-47420 > URL:

[jira] [Updated] (SPARK-47420) TBD

[ https://issues.apache.org/jira/browse/SPARK-47420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Mandic updated SPARK-47420: -- Summary: TBD (was: FormatNumber, Sentences (all collations)) > TBD > --- > >

[jira] [Updated] (SPARK-47417) Ascii, Chr, Base64, UnBase64, Decode, StringDecode, Encode, ToBinary, FormatNumber, Sentences (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Mandic updated SPARK-47417: -- Summary: Ascii, Chr, Base64, UnBase64, Decode, StringDecode, Encode, ToBinary, FormatNumber,

[jira] [Updated] (SPARK-47418) TBD

[ https://issues.apache.org/jira/browse/SPARK-47418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Mandic updated SPARK-47418: -- Summary: TBD (was: Decode, StringDecode, Encode, ToBinary (all collations)) > TBD > --- > >

[jira] [Created] (SPARK-47800) Add method for converting v2 identifier to table identifier

Uros Stankovic created SPARK-47800: -- Summary: Add method for converting v2 identifier to table identifier Key: SPARK-47800 URL: https://issues.apache.org/jira/browse/SPARK-47800 Project: Spark

[jira] [Updated] (SPARK-47799) Preserve parameter information when using SBT package jar

[ https://issues.apache.org/jira/browse/SPARK-47799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47799: --- Labels: pull-request-available (was: ) > Preserve parameter information when using SBT

[jira] [Created] (SPARK-47799) Preserve parameter information when using SBT package jar

dzcxzl created SPARK-47799: -- Summary: Preserve parameter information when using SBT package jar Key: SPARK-47799 URL: https://issues.apache.org/jira/browse/SPARK-47799 Project: Spark Issue Type:

[jira] [Commented] (SPARK-44478) Executor decommission causes stage failure

[ https://issues.apache.org/jira/browse/SPARK-44478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835705#comment-17835705 ] Juha Iso-Sipilä commented on SPARK-44478: - I am seeing this with Spark 3.5.0 for Spark k8s

[jira] [Updated] (SPARK-47230) The column pruning is not working as expected for nested struct in an array

[ https://issues.apache.org/jira/browse/SPARK-47230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ling Qin updated SPARK-47230: - Issue Type: Improvement (was: Bug) > The column pruning is not working as expected for nested struct

[jira] [Updated] (SPARK-47741) Handle stack overflow when parsing query

[ https://issues.apache.org/jira/browse/SPARK-47741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Stefanovic updated SPARK-47741: - Description: Parsing complex queries which can lead to stack overflow. We need to

[jira] [Updated] (SPARK-47741) Handle stack overflow when parsing query

[ https://issues.apache.org/jira/browse/SPARK-47741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Stefanovic updated SPARK-47741: - Summary: Handle stack overflow when parsing query (was: Handle stack overflow when

[jira] [Updated] (SPARK-47795) Supplement the doc of job schedule for K8S

[ https://issues.apache.org/jira/browse/SPARK-47795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47795: --- Labels: pull-request-available (was: ) > Supplement the doc of job schedule for K8S >

[jira] [Updated] (SPARK-47796) Spark Session is not created for spark-2.1.1 when log4j is migrated from 1.* to 2.17.1 to fix the security issue

[ https://issues.apache.org/jira/browse/SPARK-47796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahima Khatri updated SPARK-47796: -- Description: Spark Download Link:

[jira] [Updated] (SPARK-47798) Enrich the error message for the reading failures of decimal values

[ https://issues.apache.org/jira/browse/SPARK-47798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47798: --- Labels: pull-request-available (was: ) > Enrich the error message for the reading failures

[jira] [Created] (SPARK-47798) Enrich the error message for the reading failures of decimal values

Kent Yao created SPARK-47798: Summary: Enrich the error message for the reading failures of decimal values Key: SPARK-47798 URL: https://issues.apache.org/jira/browse/SPARK-47798 Project: Spark

[jira] [Updated] (SPARK-47796) Spark Session is not created for spark-2.1.1 when log4j is migrated from 1.* to 2.17.1 to fix the security issue

[ https://issues.apache.org/jira/browse/SPARK-47796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahima Khatri updated SPARK-47796: -- Priority: Blocker (was: Critical) > Spark Session is not created for spark-2.1.1 when log4j

[jira] [Assigned] (SPARK-47413) Substring, Right, Left (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47413: -- Assignee: (was: Apache Spark) > Substring, Right, Left (all collations) >

[jira] [Assigned] (SPARK-47413) Substring, Right, Left (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47413: -- Assignee: Apache Spark > Substring, Right, Left (all collations) >

[jira] [Assigned] (SPARK-47274) Provide more useful context for PySpark DataFrame API errors

[ https://issues.apache.org/jira/browse/SPARK-47274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47274: -- Assignee: Apache Spark > Provide more useful context for PySpark DataFrame API

[jira] [Assigned] (SPARK-47797) Skip deleting pod from k8s if the pod does not exists

[ https://issues.apache.org/jira/browse/SPARK-47797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47797: -- Assignee: Apache Spark > Skip deleting pod from k8s if the pod does not exists >

[jira] [Assigned] (SPARK-47413) Substring, Right, Left (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47413: -- Assignee: Apache Spark > Substring, Right, Left (all collations) >

[jira] [Updated] (SPARK-47797) Skip deleting pod from k8s if the pod does not exists

[ https://issues.apache.org/jira/browse/SPARK-47797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47797: --- Labels: pull-request-available (was: ) > Skip deleting pod from k8s if the pod does not

[jira] [Assigned] (SPARK-47797) Skip deleting pod from k8s if the pod does not exists

[ https://issues.apache.org/jira/browse/SPARK-47797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47797: -- Assignee: (was: Apache Spark) > Skip deleting pod from k8s if the pod does not

[jira] [Updated] (SPARK-47796) Spark Session is not created for spark-2.1.1 when log4j is migrated from 1.* to 2.17.1 to fix the security issue

[ https://issues.apache.org/jira/browse/SPARK-47796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahima Khatri updated SPARK-47796: -- Description: Spark Download Link:

[jira] [Assigned] (SPARK-47274) Provide more useful context for PySpark DataFrame API errors

[ https://issues.apache.org/jira/browse/SPARK-47274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47274: -- Assignee: (was: Apache Spark) > Provide more useful context for PySpark

[jira] [Resolved] (SPARK-47791) Truncate exceed decimals with scale first instead of precision from JDBC datasource

[ https://issues.apache.org/jira/browse/SPARK-47791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47791. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45976

[jira] [Assigned] (SPARK-47413) Substring, Right, Left (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47413: -- Assignee: (was: Apache Spark) > Substring, Right, Left (all collations) >

[jira] [Updated] (SPARK-47797) Skip deleting pod from k8s if the pod does not exists

[ https://issues.apache.org/jira/browse/SPARK-47797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated SPARK-47797: -- Summary: Skip deleting pod from k8s if the pod does not exists (was: Skip deleting pod if the pod does not

[jira] [Updated] (SPARK-47796) Spark Session is not created for spark-2.1.1 when log4j is migrated from 1.* to 2.17.1 to fix the security issue

[ https://issues.apache.org/jira/browse/SPARK-47796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahima Khatri updated SPARK-47796: -- Description: Spark Download Link:

[jira] [Updated] (SPARK-47796) Spark Session is not created for spark-2.1.1 when log4j is migrated from 1.* to 2.17.1 to fix the security issue

[ https://issues.apache.org/jira/browse/SPARK-47796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahima Khatri updated SPARK-47796: -- Attachment: 1.exception.png 2.log4j1.png 3.log4j-2.png >

[jira] [Created] (SPARK-47797) Skip deleting pod if the pod does not exists

leesf created SPARK-47797: - Summary: Skip deleting pod if the pod does not exists Key: SPARK-47797 URL: https://issues.apache.org/jira/browse/SPARK-47797 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47796) Spark Session is not created for spark-2.1.1 when log4j is migrated from 1.* to 2.17.1 to fix the security issue

Mahima Khatri created SPARK-47796: - Summary: Spark Session is not created for spark-2.1.1 when log4j is migrated from 1.* to 2.17.1 to fix the security issue Key: SPARK-47796 URL:

[jira] [Updated] (SPARK-47790) Upgrade `commons-io` to 2.16.1

[ https://issues.apache.org/jira/browse/SPARK-47790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47790: -- Fix Version/s: 3.5.2 > Upgrade `commons-io` to 2.16.1 > -- > >

[jira] [Created] (SPARK-47795) Supplement the doc of job schedule for K8S

Jiaan Geng created SPARK-47795: -- Summary: Supplement the doc of job schedule for K8S Key: SPARK-47795 URL: https://issues.apache.org/jira/browse/SPARK-47795 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47794) After executing the reboot command on the host where the Driver node is located, the spark streaming ends in a SUCCESSED state

[ https://issues.apache.org/jira/browse/SPARK-47794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengfei zhao updated SPARK-47794: - Description: While running Spark streaming applications on YARN in cluster mode,

[jira] [Updated] (SPARK-47794) After executing the reboot command on the host where the Driver node is located, the spark streaming ends in a SUCCESSED state

[ https://issues.apache.org/jira/browse/SPARK-47794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengfei zhao updated SPARK-47794: - Summary: After executing the reboot command on the host where the Driver node is located, the

[jira] [Updated] (SPARK-47794) After executing the reboot command on the host where the Driver node is located, the spark streaming application ends in a SUCCESSED state

[ https://issues.apache.org/jira/browse/SPARK-47794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengfei zhao updated SPARK-47794: - Description: While running Spark streaming applications on YARN in cluster mode,

[jira] [Created] (SPARK-47794) After executing the reboot command on the host where the Driver node is located, the spark streaming application ends in a SUCCESSED state

pengfei zhao created SPARK-47794: Summary: After executing the reboot command on the host where the Driver node is located, the spark streaming application ends in a SUCCESSED state Key: SPARK-47794 URL:

[jira] [Updated] (SPARK-47794) After executing the reboot command on the host where the Driver node is located, the spark streaming application ends in a SUCCESSED state

[ https://issues.apache.org/jira/browse/SPARK-47794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengfei zhao updated SPARK-47794: - Attachment: image-2024-04-10-16-03-29-393.png > After executing the reboot command on the host

[jira] [Closed] (SPARK-27298) Dataset except operation gives different results(dataset count) on Spark 2.3.0 Windows and Spark 2.3.0 Linux environment

[ https://issues.apache.org/jira/browse/SPARK-27298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahima Khatri closed SPARK-27298. - > Dataset except operation gives different results(dataset count) on Spark > 2.3.0 Windows and

[jira] [Resolved] (SPARK-47790) Upgrade `commons-io` to 2.16.1

[ https://issues.apache.org/jira/browse/SPARK-47790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47790. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45973

[jira] [Updated] (SPARK-47410) refactor UTF8String and CollationFactory

[ https://issues.apache.org/jira/browse/SPARK-47410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47410: --- Labels: pull-request-available (was: ) > refactor UTF8String and CollationFactory >

[jira] [Updated] (SPARK-47793) Implement SimpleDataSourceStreamReader for python streaming data source

[ https://issues.apache.org/jira/browse/SPARK-47793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47793: --- Labels: pull-request-available (was: ) > Implement SimpleDataSourceStreamReader for python

[jira] [Updated] (SPARK-47793) Implement SimpleDataSourceStreamReader for python streaming data source

[ https://issues.apache.org/jira/browse/SPARK-47793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoqin Li updated SPARK-47793: --- Description:  SimpleDataSourceStreamReader is a simplified version of the DataStreamReader

[jira] [Created] (SPARK-47793) Implement SimpleDataSourceStreamReader for python streaming data source

Chaoqin Li created SPARK-47793: -- Summary: Implement SimpleDataSourceStreamReader for python streaming data source Key: SPARK-47793 URL: https://issues.apache.org/jira/browse/SPARK-47793 Project: Spark

[jira] [Updated] (SPARK-47791) Truncate exceed decimals with scale first instead of precision from JDBC datasource

[ https://issues.apache.org/jira/browse/SPARK-47791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47791: --- Labels: pull-request-available (was: ) > Truncate exceed decimals with scale first instead

[jira] [Resolved] (SPARK-47706) Bump json4s 4.0.7

[ https://issues.apache.org/jira/browse/SPARK-47706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47706. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45838