If you mean retaining data from past jobs, try running the history server, documented here:
http://spark.apache.org/docs/latest/monitoring.html Dean Wampler, Ph.D. Author: Programming Scala, 2nd Edition <http://shop.oreilly.com/product/0636920033073.do> (O'Reilly) Typesafe <http://typesafe.com> @deanwampler <http://twitter.com/deanwampler> http://polyglotprogramming.com On Thu, Nov 19, 2015 at 3:10 AM, 金国栋 <scu...@gmail.com> wrote: > I don't really know what you mean by saying historical data, but if you > have configured logs, so you can always get historical data of jobs, > stages, tasks etc, unless you delete them. > > Best, > Jelly > > 2015-11-19 16:53 GMT+08:00 aman solanki <youthindia.a...@gmail.com>: > >> Hi All, >> >> I want to know how one can get historical data of jobs,stages,tasks etc >> of a running spark application. >> >> Please share the information regarding the same. >> >> Thanks, >> Aman Solanki >> > >
