Re: Best way to determine # of workers

2016-03-25 Thread Aaron Jackson
at present that the API only > >>> supports > >>> getting information about applications. Is there a good way to > determine > >>> how many workers are available? > >>> > >>> > >>> > >>> -- > >>> View

Re: Best way to determine # of workers

2016-03-25 Thread Jacek Laskowski
kers have come online. It appears at present that the API only >>> supports >>> getting information about applications. Is there a good way to determine >>> how many workers are available? >>> >>> >>> >>> -- >>

Re: Best way to determine # of workers

2016-03-25 Thread Ted Yu
com> wrote: > There is a sc.sparkDefaultParallelism parameter that I use to dynamically > maintain elasticity in my application. Depending upon your scenario this > might be enough. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3

Re: Best way to determine # of workers

2016-03-25 Thread manasdebashiskar
There is a sc.sparkDefaultParallelism parameter that I use to dynamically maintain elasticity in my application. Depending upon your scenario this might be enough. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Best-way-to-determine-of-workers

Re: Best way to determine # of workers

2016-03-24 Thread Aaron Jackson
. It appears at present that the API only >> supports >> getting information about applications. Is there a good way to determine >> how many workers are available? >> >> >> >> -- >> View this message in context: >> http://apache-spark-user

Re: Best way to determine # of workers

2016-03-24 Thread Takeshi Yamamuro
s at present that the API only supports > getting information about applications. Is there a good way to determine > how many workers are available? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Best-way-to-determine-of-workers

Best way to determine # of workers

2016-03-23 Thread Ajaxx
://apache-spark-user-list.1001560.n3.nabble.com/Best-way-to-determine-of-workers-tp26586.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org