[jira] [Updated] (SPARK-45249) Why isCheckpointed returns false while as checkpointing is eager by default?

[ https://issues.apache.org/jira/browse/SPARK-45249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kondziolka9ld updated SPARK-45249: -- Issue Type: Bug (was: Question) > Why isCheckpointed returns false while as checkpointing is

[jira] [Updated] (SPARK-45249) Why isCheckpointed returns false while as checkpointing is eager by default?

[ https://issues.apache.org/jira/browse/SPARK-45249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kondziolka9ld updated SPARK-45249: -- Description: Hi! I consider why `isCheckpointed` method return `false` - could someone explai

[jira] [Created] (SPARK-45249) Why isCheckpointed returns false while as checkpointing is eager by default?

kondziolka9ld created SPARK-45249: - Summary: Why isCheckpointed returns false while as checkpointing is eager by default? Key: SPARK-45249 URL: https://issues.apache.org/jira/browse/SPARK-45249 Projec

[jira] [Updated] (SPARK-44739) Conflicting attribute during join two times the same table (AQE is disabled)

[ https://issues.apache.org/jira/browse/SPARK-44739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kondziolka9ld updated SPARK-44739: -- Description: h2. Issue I come across a something that seems to be bug in *pyspark* (when I di

[jira] [Created] (SPARK-44739) Conflicting attribute during join two times the same table (AQE is disabled)

kondziolka9ld created SPARK-44739: - Summary: Conflicting attribute during join two times the same table (AQE is disabled) Key: SPARK-44739 URL: https://issues.apache.org/jira/browse/SPARK-44739 Projec

[jira] [Updated] (SPARK-39239) Parquet written by spark in yarn mode can not be read by spark in local[2+] mode

[ https://issues.apache.org/jira/browse/SPARK-39239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kondziolka9ld updated SPARK-39239: -- Description: Hi, I came across a strange issue, namely data written by spark in yarn mode can

[jira] [Updated] (SPARK-39239) Parquet written by spark in yarn mode can not be read by spark in local[2+] mode

[ https://issues.apache.org/jira/browse/SPARK-39239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kondziolka9ld updated SPARK-39239: -- Description: Hi, I came across a strange issue, namely data written by spark in yarn mode can

[jira] [Updated] (SPARK-39239) Parquet written by spark in yarn mode can not be read by spark in local[2+] mode

[ https://issues.apache.org/jira/browse/SPARK-39239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kondziolka9ld updated SPARK-39239: -- Description: Hi, I came across a strange issue, namely data written by spark in yarn mode can

[jira] [Updated] (SPARK-39239) Parquet written by spark in yarn mode can not be read by spark in local[2+] mode

[ https://issues.apache.org/jira/browse/SPARK-39239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kondziolka9ld updated SPARK-39239: -- Attachment: threaddump_spark_shell > Parquet written by spark in yarn mode can not be read by

[jira] [Created] (SPARK-39239) Parquet written by spark in yarn mode can not be read by spark in local[2+] mode

kondziolka9ld created SPARK-39239: - Summary: Parquet written by spark in yarn mode can not be read by spark in local[2+] mode Key: SPARK-39239 URL: https://issues.apache.org/jira/browse/SPARK-39239 Pr

[jira] [Commented] (SPARK-34792) Restore previous behaviour of randomSplit from spark-2.4.7 in spark-3

[ https://issues.apache.org/jira/browse/SPARK-34792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17322050#comment-17322050 ] kondziolka9ld commented on SPARK-34792: --- I found a root cause of this difference,

[jira] [Commented] (SPARK-34792) Restore previous behaviour of randomSplit from spark-2.4.7 in spark-3

[ https://issues.apache.org/jira/browse/SPARK-34792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304654#comment-17304654 ] kondziolka9ld commented on SPARK-34792: --- [~dongjoon] > This doesn't look like a b

[jira] [Updated] (SPARK-34792) Restore previous behaviour of randomSplit from spark-2.4.7 in spark-3

[ https://issues.apache.org/jira/browse/SPARK-34792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kondziolka9ld updated SPARK-34792: -- Description: Hi,  Please consider a following difference of `randomSplit` method even despite

[jira] [Created] (SPARK-34792) Restore previous behaviour of randomSplit from spark-2.4.7 in spark-3

kondziolka9ld created SPARK-34792: - Summary: Restore previous behaviour of randomSplit from spark-2.4.7 in spark-3 Key: SPARK-34792 URL: https://issues.apache.org/jira/browse/SPARK-34792 Project: Spar

[jira] [Updated] (SPARK-34583) typed udf fails when it refers to type member in abstract class

[ https://issues.apache.org/jira/browse/SPARK-34583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kondziolka9ld updated SPARK-34583: -- Description:  Please consider a following scenario:  {code:java} scala> abstract class SomeAbs

[jira] [Created] (SPARK-34583) typed udf fails when it refers to type member in abstract class

kondziolka9ld created SPARK-34583: - Summary: typed udf fails when it refers to type member in abstract class Key: SPARK-34583 URL: https://issues.apache.org/jira/browse/SPARK-34583 Project: Spark

[jira] [Comment Edited] (SPARK-34564) DateTimeUtils.fromJavaDate fails for very late dates during casting to Int

[ https://issues.apache.org/jira/browse/SPARK-34564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17292786#comment-17292786 ] kondziolka9ld edited comment on SPARK-34564 at 3/1/21, 9:51 AM: --

[jira] [Commented] (SPARK-34564) DateTimeUtils.fromJavaDate fails for very late dates during casting to Int

[ https://issues.apache.org/jira/browse/SPARK-34564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17292786#comment-17292786 ] kondziolka9ld commented on SPARK-34564: --- > We changed the behaviour intentionally

[jira] [Comment Edited] (SPARK-34564) DateTimeUtils.fromJavaDate fails for very late dates during casting to Int

[ https://issues.apache.org/jira/browse/SPARK-34564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17292786#comment-17292786 ] kondziolka9ld edited comment on SPARK-34564 at 3/1/21, 9:52 AM: --

[jira] [Comment Edited] (SPARK-34564) DateTimeUtils.fromJavaDate fails for very late dates during casting to Int

[ https://issues.apache.org/jira/browse/SPARK-34564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17292786#comment-17292786 ] kondziolka9ld edited comment on SPARK-34564 at 3/1/21, 9:51 AM: --

[jira] [Comment Edited] (SPARK-34564) DateTimeUtils.fromJavaDate fails for very late dates during casting to Int

[ https://issues.apache.org/jira/browse/SPARK-34564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17292786#comment-17292786 ] kondziolka9ld edited comment on SPARK-34564 at 3/1/21, 9:51 AM: --

[jira] [Updated] (SPARK-34564) DateTimeUtils.fromJavaDate fails for very late dates during casting to Int

[ https://issues.apache.org/jira/browse/SPARK-34564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kondziolka9ld updated SPARK-34564: -- Description: Please consider a following scenario on *spark-3.0.1*:  {code:java} scala> List((

[jira] [Updated] (SPARK-34564) DateTimeUtils.fromJavaDate fails for very late dates during casting to Int

[ https://issues.apache.org/jira/browse/SPARK-34564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kondziolka9ld updated SPARK-34564: -- Description: Please consider a following scenario on *spark-3.0.1*:  {code:java} scala> List((

[jira] [Created] (SPARK-34564) DateTimeUtils.fromJavaDate fails for very late dates during casting to Int

kondziolka9ld created SPARK-34564: - Summary: DateTimeUtils.fromJavaDate fails for very late dates during casting to Int Key: SPARK-34564 URL: https://issues.apache.org/jira/browse/SPARK-34564 Project: