Re: Incorrect timeline for Scheduling Delay in Streaming page in web UI?

2016-01-18 Thread Shixiong(Ryan) Zhu
Hey, did you mean that the scheduling delay timeline is incorrect because it's too short and some values are missing? A batch won't have a scheduling delay until it starts to run. In your example, a lot of batches are waiting so that they don't have the scheduling delay. On Sun, Jan 17, 2016 at

Re: Incorrect timeline for Scheduling Delay in Streaming page in web UI?

2016-01-18 Thread Jacek Laskowski
Hi Ryan, Ah, you might be right! I didn't think about the batches queued up (and hence without scheduling delay since they're not started yet). Thanks a lot for responding! Pozdrawiam, Jacek Jacek Laskowski | https://medium.com/@jaceklaskowski/ Mastering Apache Spark ==>

Incorrect timeline for Scheduling Delay in Streaming page in web UI?

2016-01-17 Thread Jacek Laskowski
Hi, I'm trying to understand how Scheduling Delays are displayed in Streaming page in web UI and think the values are displayed incorrectly in the Timelines column. I'm only concerned with the scheduling delays (on y axis) per batch times (x axis). It appears that the values (on y axis) are