[Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Tishan Dahanayakage
Hi all, Following is a draft of the interface of Siddhi window data structure that will be exposed. Rationale behind this is to seamlessly support different implementations such as bloom ​ ​ filters, disk backed window, etc. Please review this and propose necessary modifications. //Initializes th

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Rajeev Sampath
Hi, On Mon, Nov 3, 2014 at 3:26 PM, Tishan Dahanayakage wrote: > Hi all, > > Following is a draft of the interface of Siddhi window data structure that > will be exposed. Rationale behind this is to seamlessly support different > implementations such as bloom > ​ ​ > filters, disk backed window,

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Sriskandarajah Suhothayan
I believe in the new implementation we should not give the iterator out This will bring lots of issues like people might get all the events and iterate them :(. Suho On Mon, Nov 3, 2014 at 5:37 AM, Rajeev Sampath wrote: > Hi, > > On Mon, Nov 3, 2014 at 3:26 PM, Tishan Dahanayakage > wrote: > >

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Tishan Dahanayakage
Suho, On Tue, Nov 4, 2014 at 5:02 AM, Sriskandarajah Suhothayan wrote: > I believe in the new implementation we should not give the iterator out > This will bring lots of issues like people might get all the events and > iterate them :(. > ​So are you suggesting to expose last event only?​ Tha

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Srinath Perera
Big picture is CEP retain events within Windows, Windows with Join, and for patterns and sequence matching. When those windows (or data structures) are small they work ok, but when they are big they need specific optimisations like Indexes (B-Trees), Bloom Filters, Compression, disk based etc. Id

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Tishan Dahanayakage
On Tue, Nov 4, 2014 at 9:45 AM, Srinath Perera wrote: > Big picture is CEP retain events within Windows, Windows with Join, and > for patterns and sequence matching. When those windows (or data structures) > are small they work ok, but when they are big they need specific > optimisations like In

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Lasantha Fernando
Hi Tishan, On 4 November 2014 09:58, Tishan Dahanayakage wrote: > > > On Tue, Nov 4, 2014 at 9:45 AM, Srinath Perera wrote: > >> Big picture is CEP retain events within Windows, Windows with Join, and >> for patterns and sequence matching. When those windows (or data structures) >> are small th

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Tishan Dahanayakage
Lasantha, On Tue, Nov 4, 2014 at 12:18 PM, Lasantha Fernando wrote: > Hi Tishan, > > On 4 November 2014 09:58, Tishan Dahanayakage wrote: > >> >> >> On Tue, Nov 4, 2014 at 9:45 AM, Srinath Perera wrote: >> >>> Big picture is CEP retain events within Windows, Windows with Join, and >>> for patt

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-05 Thread Tishan Dahanayakage
Hi all, Please find the draft implementation at [1]. Removed getIterator() for the moment and also changed find method to return List of events if multiple matches happen. [1] https://github.com/wso2-dev/siddhi/blob/Siddhi-3.0.0/modules/siddhi-core/src/main/java/org/wso2/siddhi/core/util/collectio