I have found ganglia very helpful in understanding network I/o , CPU and memory usage for a given spark cluster. I have not used , but have heard good things about Dr Elephant ( which I think was contributed by LinkedIn but not 100%sure).
On Tue, Mar 26, 2019, 5:59 AM Jack Kolokasis <koloka...@ics.forth.gr> wrote: > Hello all, > > I am looking for a spark profiler to trace my application to find > the bottlenecks. I need to trace CPU usage, Memory Usage and I/O usage. > > I am looking forward for your reply. > > --Iacovos > > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
