Re: Does long-lived SparkContext hold on to executor resources?

2015-05-12 Thread Josh Rosen
) -Original Message- *From: *Silvio Fiorito [silvio.fior...@granturing.com] *Sent: *Monday, May 11, 2015 01:03 PM Eastern Standard Time *To: *stanley; user@spark.apache.org *Subject: *Re: Does long-lived SparkContext hold on to executor resources? You want to look at dynamic resource

Does long-lived SparkContext hold on to executor resources?

2015-05-11 Thread stanley
hold on to the executor resources when there is no queries running? Is there a way to free executor resources in this type of use cases? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Does-long-lived-SparkContext-hold-on-to-executor-resources-tp22848.html

RE: Does long-lived SparkContext hold on to executor resources?

2015-05-11 Thread Ganelin, Ilya
, 2015 01:03 PM Eastern Standard Time To: stanley; user@spark.apache.org Subject: Re: Does long-lived SparkContext hold on to executor resources? You want to look at dynamic resource allocation, here: http://spark.apache.org/docs/latest/job-scheduling.html#dynamic-resource-allocation On 5/11

Re: Does long-lived SparkContext hold on to executor resources?

2015-05-11 Thread Silvio Fiorito
executor resources in this type of use cases? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Does-long-lived-SparkContext-hold-on-to-executor-resources-tp22848.html Sent from the Apache Spark User List mailing list archive at Nabble.com