Re: [bug?] streaming window unexpected behaviour

2014-03-25 Thread Tathagata Das
user@spark.apache.org > Cc: u...@spark.incubator.apache.org > Subject: RE: [bug?] streaming window unexpected behaviour > > Thanks TD! > Is it possible to perhaps add another window method that doesn't not > generate partial windows? Or, Is it possible to remove the first few > partia

RE: [bug?] streaming window unexpected behaviour

2014-03-25 Thread Adrian Mocanu
e are. -A -Original Message- From: Tathagata Das [mailto:tathagata.das1...@gmail.com] Sent: March-24-14 6:55 PM To: user@spark.apache.org Cc: u...@spark.incubator.apache.org Subject: Re: [bug?] streaming window unexpected behaviour Yes, I believe that is current behavior. Essentially, the first few

RE: [bug?] streaming window unexpected behaviour

2014-03-25 Thread Adrian Mocanu
hagata Das [mailto:tathagata.das1...@gmail.com] Sent: March-24-14 6:55 PM To: user@spark.apache.org Cc: u...@spark.incubator.apache.org Subject: Re: [bug?] streaming window unexpected behaviour Yes, I believe that is current behavior. Essentially, the first few RDDs will be partial windows (assum

Re: [bug?] streaming window unexpected behaviour

2014-03-24 Thread Tathagata Das
Yes, I believe that is current behavior. Essentially, the first few RDDs will be partial windows (assuming window duration > sliding interval). TD On Mon, Mar 24, 2014 at 1:12 PM, Adrian Mocanu wrote: > I have what I would call unexpected behaviour when using window on a stream. > > I have 2 wi