[
https://issues.apache.org/jira/browse/SPARK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-40200:
-
Affects Version/s: 3.2.1
> unpersist cascades with Kryo, MEMORY_AND_DISK_SER and
> mono
[
https://issues.apache.org/jira/browse/SPARK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-40200:
-
Description:
Unpersist of a parent dataset which has a column from
_*monotonically_incr
[
https://issues.apache.org/jira/browse/SPARK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-40200:
-
Description:
Unpersist of a parent dataset which has a column from
`monotonically_incre
[
https://issues.apache.org/jira/browse/SPARK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-40200:
-
Description:
Unpersist of a parent dataset which has a column from
`monotonically_incre
Calvin Pietersen created SPARK-40200:
Summary: unpersist cascades with Kryo, MEMORY_AND_DISK_SER and
monotonically_increasing_id
Key: SPARK-40200
URL: https://issues.apache.org/jira/browse/SPARK-40200
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282081#comment-17282081
]
Calvin Pietersen commented on SPARK-34063:
--
So this happened consistently every
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-34063:
-
Description:
Spark streaming application runs at 60s batch intervals.
The application r
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-34063:
-
Environment:
AWS EMR 6.1.0
Spark 3.0.0
Kinesis
was:
AWS EMR 6.1.0
Spark 3.0.0
>
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-34063:
-
Environment:
AWS EMR 6.1.0
Spark 3.0.0
> Major slowdown in spark streaming after 6 day
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-34063:
-
Attachment: 2020-12-29.pdf
> Major slowdown in spark streaming after 6 days
> --
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-34063:
-
Description:
Spark streaming application runs at 60s batch intervals.
The application r
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-34063:
-
Attachment: slow-job
> Major slowdown in spark streaming after 6 days
>
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-34063:
-
Attachment: normal-job
> Major slowdown in spark streaming after 6 days
> --
Calvin Pietersen created SPARK-34063:
Summary: Major slowdown in spark streaming after 6 days
Key: SPARK-34063
URL: https://issues.apache.org/jira/browse/SPARK-34063
Project: Spark
Issue
14 matches
Mail list logo