[jira] [Updated] (SPARK-40200) unpersist cascades with Kryo, MEMORY_AND_DISK_SER and monotonically_increasing_id

2022-08-23 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-40200: - Affects Version/s: 3.2.1 > unpersist cascades with Kryo, MEMORY_AND_DISK_SER and > mono

[jira] [Updated] (SPARK-40200) unpersist cascades with Kryo, MEMORY_AND_DISK_SER and monotonically_increasing_id

2022-08-23 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-40200: - Description: Unpersist of a parent dataset which has a column from _*monotonically_incr

[jira] [Updated] (SPARK-40200) unpersist cascades with Kryo, MEMORY_AND_DISK_SER and monotonically_increasing_id

2022-08-23 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-40200: - Description: Unpersist of a parent dataset which has a column from `monotonically_incre

[jira] [Updated] (SPARK-40200) unpersist cascades with Kryo, MEMORY_AND_DISK_SER and monotonically_increasing_id

2022-08-23 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-40200: - Description: Unpersist of a parent dataset which has a column from `monotonically_incre

[jira] [Created] (SPARK-40200) unpersist cascades with Kryo, MEMORY_AND_DISK_SER and monotonically_increasing_id

2022-08-23 Thread Calvin Pietersen (Jira)
Calvin Pietersen created SPARK-40200: Summary: unpersist cascades with Kryo, MEMORY_AND_DISK_SER and monotonically_increasing_id Key: SPARK-40200 URL: https://issues.apache.org/jira/browse/SPARK-40200

[jira] [Commented] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-02-09 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282081#comment-17282081 ] Calvin Pietersen commented on SPARK-34063: -- So this happened consistently every

[jira] [Updated] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-34063: - Description: Spark streaming application runs at 60s batch intervals. The application r

[jira] [Updated] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-34063: - Environment: AWS EMR 6.1.0 Spark 3.0.0 Kinesis was: AWS EMR 6.1.0 Spark 3.0.0 >

[jira] [Updated] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-34063: - Environment: AWS EMR 6.1.0 Spark 3.0.0 > Major slowdown in spark streaming after 6 day

[jira] [Updated] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-34063: - Attachment: 2020-12-29.pdf > Major slowdown in spark streaming after 6 days > --

[jira] [Updated] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-34063: - Description: Spark streaming application runs at 60s batch intervals. The application r

[jira] [Updated] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-34063: - Attachment: slow-job > Major slowdown in spark streaming after 6 days >

[jira] [Updated] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-34063: - Attachment: normal-job > Major slowdown in spark streaming after 6 days > --

[jira] [Created] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
Calvin Pietersen created SPARK-34063: Summary: Major slowdown in spark streaming after 6 days Key: SPARK-34063 URL: https://issues.apache.org/jira/browse/SPARK-34063 Project: Spark Issue