Can you provide more info (what version of spark, code example)? On Tue, Sep 8, 2015 at 8:18 AM, Alexey Ponkin <alexey.pon...@ya.ru> wrote:
> Hi, > > I have an application with 2 streams, which are joined together. > Stream1 - is simple DStream(relativly small size batch chunks) > Stream2 - is a windowed DStream(with duration for example 60 seconds) > > Stream1 and Stream2 are Kafka direct stream. > The problem is that according to logs window operation is constantly > increasing(<a href=" > http://en.zimagez.com/zimage/screenshot2015-09-0816-06-55.php > ">screen</a>). > And also I see gap in pocessing window(<a href=" > http://en.zimagez.com/zimage/screenshot2015-09-0816-10-22.php";>screen</a>) > in logs there are no events in that period. > So what is happen in that gap and why window is constantly insreasing? > > Thank you in advance > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
