[jira] [Assigned] (SPARK-36919) Make BadRecordException serializable

2021-10-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36919: Assignee: (was: Apache Spark) > Make BadRecordException serializable > --

[jira] [Assigned] (SPARK-36919) Make BadRecordException serializable

2021-10-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36919: Assignee: Apache Spark > Make BadRecordException serializable > -

[jira] [Commented] (SPARK-36919) Make BadRecordException serializable

2021-10-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423767#comment-17423767 ] Apache Spark commented on SPARK-36919: -- User 'tianhanhu' has created a pull request

[jira] [Updated] (SPARK-36919) Make BadRecordException serializable

2021-10-03 Thread Tianhan Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianhan Hu updated SPARK-36919: --- Description: Migrating a Spark application from 2.4.x to 3.1.x and finding a difference in the exce

[jira] [Created] (SPARK-36919) Make BadRecordException serializable

2021-10-03 Thread Tianhan Hu (Jira)
Tianhan Hu created SPARK-36919: -- Summary: Make BadRecordException serializable Key: SPARK-36919 URL: https://issues.apache.org/jira/browse/SPARK-36919 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-36918) unionByName shouldn't consider types when comparing structs

2021-10-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36918: Assignee: (was: Apache Spark) > unionByName shouldn't consider types when comparing s

[jira] [Commented] (SPARK-36918) unionByName shouldn't consider types when comparing structs

2021-10-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423745#comment-17423745 ] Apache Spark commented on SPARK-36918: -- User 'Kimahriman' has created a pull reques

[jira] [Assigned] (SPARK-36918) unionByName shouldn't consider types when comparing structs

2021-10-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36918: Assignee: Apache Spark > unionByName shouldn't consider types when comparing structs > --

[jira] [Created] (SPARK-36918) unionByName shouldn't consider types when comparing structs

2021-10-03 Thread Adam Binford (Jira)
Adam Binford created SPARK-36918: Summary: unionByName shouldn't consider types when comparing structs Key: SPARK-36918 URL: https://issues.apache.org/jira/browse/SPARK-36918 Project: Spark

[jira] [Commented] (SPARK-18075) UDF doesn't work on non-local spark

2021-10-03 Thread Davide Benedetto (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423740#comment-17423740 ] Davide Benedetto commented on SPARK-18075: -- [~cloud_fan] Are you now able to ru

[jira] [Commented] (SPARK-36900) "SPARK-36464: size returns correct positive number even with over 2GB data" will oom with JDK17

2021-10-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423727#comment-17423727 ] Sean R. Owen commented on SPARK-36900: -- We're just going to up the mem limit in tes

[jira] [Created] (SPARK-36917) java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.spark.rdd.MapPartitionsRDD.f of type scala.Function3 in ins

2021-10-03 Thread Davide Benedetto (Jira)
Davide Benedetto created SPARK-36917: Summary: java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.spark.rdd.MapPartitionsRDD.f of type scala.Function3 in instance of org.apache.spark

[jira] [Commented] (SPARK-36915) Pin actions to a full length commit SHA

2021-10-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423711#comment-17423711 ] Apache Spark commented on SPARK-36915: -- User 'naveensrinivasan' has created a pull

[jira] [Commented] (SPARK-36915) Pin actions to a full length commit SHA

2021-10-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423709#comment-17423709 ] Apache Spark commented on SPARK-36915: -- User 'naveensrinivasan' has created a pull

[jira] [Assigned] (SPARK-36915) Pin actions to a full length commit SHA

2021-10-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36915: Assignee: (was: Apache Spark) > Pin actions to a full length commit SHA > ---

[jira] [Assigned] (SPARK-36915) Pin actions to a full length commit SHA

2021-10-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36915: Assignee: Apache Spark > Pin actions to a full length commit SHA > --

[jira] [Assigned] (SPARK-36916) Enable Dependabot for improving security posture of the dependencies

2021-10-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36916: Assignee: Apache Spark > Enable Dependabot for improving security posture of the dependen

[jira] [Assigned] (SPARK-36916) Enable Dependabot for improving security posture of the dependencies

2021-10-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36916: Assignee: (was: Apache Spark) > Enable Dependabot for improving security posture of t

[jira] [Commented] (SPARK-36916) Enable Dependabot for improving security posture of the dependencies

2021-10-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423710#comment-17423710 ] Apache Spark commented on SPARK-36916: -- User 'naveensrinivasan' has created a pull

[jira] [Created] (SPARK-36916) Enable Dependabot for improving security posture of the dependencies

2021-10-03 Thread Naveen S (Jira)
Naveen S created SPARK-36916: Summary: Enable Dependabot for improving security posture of the dependencies Key: SPARK-36916 URL: https://issues.apache.org/jira/browse/SPARK-36916 Project: Spark

[jira] [Created] (SPARK-36915) Pin actions to a full length commit SHA

2021-10-03 Thread Naveen S (Jira)
Naveen S created SPARK-36915: Summary: Pin actions to a full length commit SHA Key: SPARK-36915 URL: https://issues.apache.org/jira/browse/SPARK-36915 Project: Spark Issue Type: Bug Com

[jira] [Updated] (SPARK-36802) Incorrect writing the string, containing symbols like "\" to Hive

2021-10-03 Thread Vladislav (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladislav updated SPARK-36802: -- Priority: Major (was: Minor) > Incorrect writing the string, containing symbols like "\" to Hive > -