Graceful node decommission mechanism for Spark

2017-10-16 Thread Juan Rodríguez Hortalá
Hi all, I have a prototype for "Keep track of nodes which are going to be shut down & avoid scheduling new tasks" ( https://issues.apache.org/jira/browse/SPARK-20628) that I would like to discuss with the community. I added a WIP PR for that in https://github.com/apache/spark/pull/19267. The basic

Re: Graceful node decommission mechanism for Spark

2017-10-20 Thread Juan Rodríguez Hortalá
Hi, Are there any comments or suggestions regarding this proposal? Thanks, Juan On Mon, Oct 16, 2017 at 10:27 AM, Juan Rodríguez Hortalá < juan.rodriguez.hort...@gmail.com> wrote: > Hi all, > > I have a prototype for "Keep track of nodes which are going to be shut > down & avoid scheduling ne