[jira] [Commented] (SPARK-19525) Enable Compression of RDD Checkpoints

2017-02-17 Thread Aaditya Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15872728#comment-15872728 ] Aaditya Ramesh commented on SPARK-19525: Great, I will get the patch ready. > Enable Compression

[jira] [Commented] (SPARK-19525) Enable Compression of Spark Streaming Checkpoints

2017-02-17 Thread Aaditya Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15872698#comment-15872698 ] Aaditya Ramesh commented on SPARK-19525: We are suggesting to compress only before we write the

[jira] [Commented] (SPARK-19525) Enable Compression of Spark Streaming Checkpoints

2017-02-17 Thread Aaditya Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15872441#comment-15872441 ] Aaditya Ramesh commented on SPARK-19525: [~zsxwing] Actually, we are compressing the data in the

[jira] [Commented] (SPARK-19525) Enable Compression of Spark Streaming Checkpoints

2017-02-08 Thread Aaditya Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858810#comment-15858810 ] Aaditya Ramesh commented on SPARK-19525: We have a patch that works for an older version. I am

[jira] [Created] (SPARK-19525) Enable Compression of Spark Streaming Checkpoints

2017-02-08 Thread Aaditya Ramesh (JIRA)
Aaditya Ramesh created SPARK-19525: -- Summary: Enable Compression of Spark Streaming Checkpoints Key: SPARK-19525 URL: https://issues.apache.org/jira/browse/SPARK-19525 Project: Spark Issue

[jira] [Commented] (SPARK-13027) Add API for updateStateByKey to provide batch time as input

2016-02-16 Thread Aaditya Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149126#comment-15149126 ] Aaditya Ramesh commented on SPARK-13027: Hi [~zsxwing] sorry to bump this again, I've submitted a

[jira] [Updated] (SPARK-13027) Add API for updateStateByKey to provide batch time as input

2016-02-13 Thread Aaditya Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaditya Ramesh updated SPARK-13027: --- Description: The StateDStream currently does not provide the batch time as input to the

[jira] [Updated] (SPARK-13027) Add API for updateStateByKey to provide batch time as input

2016-02-13 Thread Aaditya Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaditya Ramesh updated SPARK-13027: --- Description: wwThe StateDStream currently

[jira] [Commented] (SPARK-13027) Add API for updateStateByKey to provide batch time as input

2016-02-09 Thread Aaditya Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139898#comment-15139898 ] Aaditya Ramesh commented on SPARK-13027: [~zsxwing] I've submitted a pull request. Could you take

[jira] [Commented] (SPARK-13027) Add API for updateStateByKey to provide batch time as input

2016-02-04 Thread Aaditya Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133087#comment-15133087 ] Aaditya Ramesh commented on SPARK-13027: [~zsxwing] Sorry for the late response, definitely, I

[jira] [Created] (SPARK-13027) Add API for updateStateByKey to provide batch time as input

2016-01-26 Thread Aaditya Ramesh (JIRA)
Aaditya Ramesh created SPARK-13027: -- Summary: Add API for updateStateByKey to provide batch time as input Key: SPARK-13027 URL: https://issues.apache.org/jira/browse/SPARK-13027 Project: Spark