[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2019-08-16 Thread Adam Kennedy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909342#comment-16909342 ] Adam Kennedy commented on SPARK-21097: -- Another supporting reason for supporting transfer of memory

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2019-03-26 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801960#comment-16801960 ] Imran Rashid commented on SPARK-21097: -- {quote} I'm wondering if this is going to be subsumed by

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2018-08-27 Thread Erik Erlandson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594271#comment-16594271 ] Erik Erlandson commented on SPARK-21097: I'm wondering if this is going to be subsumed by the

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-24 Thread Brad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16554404#comment-16554404 ] Brad commented on SPARK-21097: -- Hi [~menelaus], I have stalled out on this project, if you would like to

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-23 Thread James (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16553768#comment-16553768 ] James commented on SPARK-21097: --- Hi [~bradkaiser] whats the progress of this project or problem now? i'd

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-23 Thread Brad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552847#comment-16552847 ] Brad commented on SPARK-21097: -- No, I did not consider cpu utilization when redistributing the cache. It

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-21 Thread James (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551572#comment-16551572 ] James commented on SPARK-21097: --- Hi [~bradkaiser]   I find that you consider the memory space when

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-16 Thread Brad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16545240#comment-16545240 ] Brad commented on SPARK-21097: -- Hi [~menelaus] The processing time delay is just a way to simulate

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-15 Thread James (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16544820#comment-16544820 ] James commented on SPARK-21097: --- Hi, [~bradkaiser]   Could you please let me know what is the meaning of

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-15 Thread James (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16544816#comment-16544816 ] James commented on SPARK-21097: --- Hi, [~bradkaiser]   Could you please let me know what is the meaning of

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-15 Thread donglin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16544815#comment-16544815 ] donglin commented on SPARK-21097: - Hi, [~bradkaiser]   Could you please let me know what is the

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-11 Thread Brad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540195#comment-16540195 ] Brad commented on SPARK-21097: -- Hi [~jothor], Thanks for the interest, but to be honest I got a new job

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-10 Thread John Vincent Thorpe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539381#comment-16539381 ] John Vincent Thorpe commented on SPARK-21097: - Hi Brad, Great work on implementing this

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2017-11-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259789#comment-16259789 ] Arun Suresh commented on SPARK-21097: - Thanks for raising this. I would also like to call attention

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2017-08-29 Thread Brad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145708#comment-16145708 ] Brad commented on SPARK-21097: -- Here is a document with some of my benchmark results. I am working on adding

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144043#comment-16144043 ] Apache Spark commented on SPARK-21097: -- User 'brad-kaiser' has created a pull request for this

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2017-08-03 Thread Brad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113264#comment-16113264 ] Brad commented on SPARK-21097: -- I'm still working on thoroughly benchmarking and testing this change. If

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2017-06-14 Thread Brad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049485#comment-16049485 ] Brad commented on SPARK-21097: -- Hey Sean, thanks for your input. I would definitely like to do some

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2017-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049442#comment-16049442 ] Sean Owen commented on SPARK-21097: --- This seems to add a fair bit of complexity when Spark is already

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2017-06-14 Thread Brad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049443#comment-16049443 ] Brad commented on SPARK-21097: -- I am working on this now and will be posting a more detailed design document