measuring time taken in map, reduceByKey, filter, flatMap

2015-01-30 Thread Josh J
Hi, I have a stream pipeline which invokes map, reduceByKey, filter, and flatMap. How can I measure the time taken in each stage? Thanks, Josh

Re: measuring time taken in map, reduceByKey, filter, flatMap

2015-01-30 Thread Akhil Das
I believe From the webui (running on port 8080) you will get these measurements. Thanks Best Regards On Sat, Jan 31, 2015 at 9:29 AM, Josh J joshjd...@gmail.com wrote: Hi, I have a stream pipeline which invokes map, reduceByKey, filter, and flatMap. How can I measure the time taken in each