Version: spark 1.1.0
42 workers,40g memory per worker 
Running graphx componentgraph ,use five hours

> 在 Oct 25, 2014,1:27,"Sameer Farooqui" <same...@databricks.com> 写道:
> 
> That does seem a bit odd. How many Executors are running under this Driver?
> 
> Does the spark-submit process start out using ~60GB of memory right away or 
> does it start out smaller and slowly build up to that high? If so, how long 
> does it take to get that high?
> 
> Also, which version of Spark are you using? 
> 
> 
> SameerF
> 
>> On Fri, Oct 24, 2014 at 8:07 AM, marylucy <qaz163wsx_...@hotmail.com> wrote:
>> i used standalone spark,set spark.driver.memory=5g,but spark-submit process 
>> use 57g memory, is this normal?how to decrease it?
> 

Reply via email to