Re: [Architecture] [SP] [Editor] Export Siddhi App to Worker/Manager

IMO deploy should we a top level Menu item as its a different lifecycle of the project. Under that we have to have "Deploy to Server", and "Deploy to Server" dialog box should have list of server URLs and user should be able to select one or more and say deploy. This can show all the workers or ma

Re: [Architecture] [Siddhi] [Extension] Running select queries with join capabilities on dataource

That should be possible if you are using RDBMS datastore On Wed, Jul 4, 2018 at 2:04 PM Silmy Hasan wrote: > Hi Niveathika, > > Can we write this type of join queries when creating custom widgets(in > widgetConf.json)? > > Shilmy Hasan > Associate Software Engineer | WSO2 > > E-mail :si...@wso2.

Re: [Architecture] [APIM][Micro-Gateway][Analytics] Analytics for Micro-gateway

IMO, we can upload the files to any of the DAS nodes and let it share among its HA seems to be the correct approach. Here we can set the event duplicated in the cluster property as falls all the DAS receivers. Doing so events will be shared and processed on both DAS HA nodes. On Tue, Jul 3, 2018 a

Re: [Architecture] [Dev] [VOTE] Release WSO2 Stream Processor 4.1.0 RC1

-1 In Mac, the graphics of the editor event flow is not rendering correctly. Please check the attached image. On Thu, Mar 15, 2018 at 12:46 AM, Damith Wickramasinghe wrote: > - sup dev > + dev > > On Thu, Mar 15, 2018 at 12:05 AM, Damith Wickramasinghe > wrote: > >> Hi Devs, >> >> We are pleas

Re: [Architecture] [DAS][Feature] Disable all scheduled spark scripts temporarily

On Fri, Jan 5, 2018 at 2:47 PM, Sriskandarajah Suhothayan > wrote: > >> How are we handling this currently? Are we deleting all and adding back? >> >> Regards >> Suho >> >> On Fri, Jan 5, 2018 at 2:12 PM, Nirmal Fernando wrote: >> >>> Hi All, >>

Re: [Architecture] [DAS][Feature] Disable all scheduled spark scripts temporarily

How are we handling this currently? Are we deleting all and adding back? Regards Suho On Fri, Jan 5, 2018 at 2:12 PM, Nirmal Fernando wrote: > Hi All, > > I believe providing a feature to disable all scheduled spark scripts > temporarily in one click via the admin console of the WSO2 Data Analy

Re: [Architecture] [Dev] [VOTE] Release WSO2 Stream Processor 4.0.0 RC2

Hi Chandana, We couldn’t reproduce this in windows 10 and 7. Can you please give us more information about the environment, and also pleas make sure the pack you have downloaded is not corrupted. Thanks On Fri, Dec 22, 2017 at 9:49 AM Chandana Napagoda wrote: > Hi Eranga, > > I tested above wi

Re: [Architecture] [APIM 3.0.0] & [SP 4.0.0] siddhi-store-cassandra implementation

With Stream Processor 4.0, we have added support to RDBMS, HBase, MongoDB, and Solr. We are still working in Progress with Cassandra. As of now, I don't see a reason why you can't use Cassandra with APIM 3.0. When APIM analytics related scripts and Cassandra Store implementation are ready we will

Re: [Architecture] 2 Node Minimum HA Pattern for Stream Processor

The image is missing. On Sun, Oct 22, 2017 at 3:48 PM, Anoukh Jayawardena wrote: > Hi All > > This is an update on the WSO2 Stream Processor’s 2 Node minimum HA > deployment. While some of the design elements changed during the > implementation, this email will cover the overall design > Two SP

Re: [Architecture] [Analytics] Introducing a common permission model.

As of the offline discussion We decided to go ahead with the following databases *PERMISSIONS* APP_NAME VARCHAR(3) NOT NULL PERMISSION_STRING VARCHAR(50) NOT NULL PRIMARY KEY (APP_NAME, PERMISSION_STRING) *ROLE_PERMISSIONS* APP_NAME VARCHAR(3) NOT NULL PERMISSION_STRING VARCHAR(50) NOT NULL

Re: [Architecture] Securing Product Apis and Product artifacts in Stream Processor

On Thu, Oct 19, 2017 at 5:21 PM, Niveathika Rajendran wrote: > Hi all, > > The following points outline the integration of Stream Processor with an > Identity Provider. Identity Provider Client interface will act as the > mediator between SP components and Identity Provider. The points are > divi

Re: [Architecture] Archetype for Siddhi extension.

+94 076 6792895 <076%20679%202895> > LinkedIn :www.linkedin.com/in/kalaiyarasiganeshalingam > Blogs : http://kalai4.blogspot.com/ > > On Thu, Sep 21, 2017 at 1:20 PM, Sriskandarajah Suhothayan > wrote: > >> Why are we asking -DtypeOfIO=? >> I thought it was

Re: [Architecture] Archetype for Siddhi extension.

Why are we asking -DtypeOfIO=? I thought it was asked during the interactive mode? What are some possible values to this? Regards Suho On Thu, Sep 21, 2017 at 12:55 PM, Kalaiyarasi Ganeshalingam < kalaiyar...@wso2.com> wrote: > Hi all, > > I have implemented the archetype for Siddhi extension.

Re: [Architecture] [Dev] WSO2 Stream Processor 4.0.0-M11 Released !

On Fri, Sep 8, 2017 at 4:55 AM Anusha Jayasundara wrote: > Hi All, > > > The WSO2 Analytics team is pleased to announce the release of *WSO2 > Stream Processor Version 4.0.0 Milestone 11*. > > WSO2 Smart Analytics let digital business creating real-time, intelligent, > actionable business insight

Re: [Architecture] [Dashboard] Introducing a base widget component

+1, I think this will also help us to manage user-prefs in the future. On Thu, Aug 31, 2017 at 1:44 PM, Lasantha Samarakoon wrote: > Hi all, > > In the new React based dashboard widget is defined as a another React > component. ATM these widgets are basic React components which extends from > Re

Re: [Architecture] [IS 6.0.0] Email Management Component Implementation

to send the > email[1]. > > 1. > https://github.com/wso2-extensions/identity-event-handler-notification/tree/C5/components/email-mgt/org.wso2.carbon.email.mgt > > Best Regards, > > On Thu, Jun 1, 2017 at 4:49 PM, Sriskandarajah Suhothayan > wrote: > >> Hi All >

Re: [Architecture] [IS 6.0.0] Email Management Component Implementation

Hi All DAS team is about to start C5 based the email transport implementation for DAS. Have we already implemented a common component for Email? What's the status of this? If so is this a carbon transport or common component? Regards Suho On Tue, Jan 24, 2017 at 10:50 AM, Ayesha Dissanayaka wr

Re: [Architecture] [CEP] Behavior of AND in Siddhi pattern

+1 for the change. On Tue, May 23, 2017 at 1:28 AM, Gobinath wrote: > Hi all, > > I have encountered an issue with existing Siddhi pattern unit test > case [1]. Consider the following Siddhi query and the inputs: > > *Query:* > > from e1=Stream1[price > 20] -> e2=Stream2[price > e1.price] and >

[Architecture] WSO2 Data Analytics Server 4.0.0-M2 Released !

Hi All, The WSO2 Smart Analytics team is pleased to announce the release of WSO2 Data Analytics Server version 4.0.0 Milestone 2. WSO2 Smart Analytics let digital business creating real-time, intelligent, actionable business insights, and data products which are

[Architecture] WSO2 Data Analytics Server 4.0.0-M1 Released !

Hi All, The WSO2 Smart Analytics team is pleased to announce the release of WSO2 Data Analytics Server version 4.0.0-M1. WSO2 Smart Analytics let digital business creating real-time, intelligent, actionable business insights, and data products which are achieved

Re: [Architecture] DAS Support for Mesos

Can you evaluate YARN supporting Apache Mesos and Docker? , I think it will be a better resource management infrastructure we can support, this is because with this DAS can live with other Bigdata project cohesively and people really like if they can manage DAS also like Spark inside YARN. Streamin

Re: [Architecture] Introducing interface to get widget configuration files in Dashboard Component

Yes, +1 for the approach. Typically CEP is providing the dashboard its own store via the OSGi service. Regards Suho On Wed, Jan 18, 2017 at 10:39 AM, Nisala Nanayakkara wrote: > Hi, > > @CEP team : Appreciate your response about this matter. > > Thanks, > Nisala > > On Mon, Jan 16, 2017 at 2:14

Re: [Architecture] [PROPOSAL] Distribute internal machine states

Hi Pablo, Thanks for your interest in the project and for the great proposal. We are also considering distributing Siddhi using Kafka, we will consider your ideas when implementing the solution and we are happy to have your contributions. Meanwhile, have you done any implementation regarding thi

Re: [Architecture] [C5] Spark/Lucene Integration in Stream Processor

On Sat, Oct 22, 2016 at 10:45 AM, Nirmal Fernando wrote: > > > On Fri, Oct 21, 2016 at 2:00 PM, Anjana Fernando wrote: > >> Hi, >> >> So we are starting on porting the earlier DAS specific functionality to >> C5. And with this, we are planning on not embedding the Spark server >> functionality t

Re: [Architecture] [C5] Spark/Lucene Integration in Stream Processor

On Fri, Oct 21, 2016 at 2:00 PM, Anjana Fernando wrote: > Hi, > > So we are starting on porting the earlier DAS specific functionality to > C5. And with this, we are planning on not embedding the Spark server > functionality to the primary binary itself, but rather run it separately as > another

Re: [Architecture] [PET] Support UniqueBatchWindow(Time, Length) for Siddhi

t;>> select count(ip) as ipCount, ip, hour >>> insert into uniqueIps ; >>> >>> This is the current implementation of the UniqueBatchWindow (I changed >>> the order of parameters in the current impl, to keep consistency with other >>> examples). >>> >>>

Re: [Architecture] [Dev] [IS] [Analytics] Improvement to use Siddhi streams to send notifications

://wso2.org/claims/givenname";. So that placeholder has to be filled >> with the user claim value corresponding to the above mentioned claim URI. >> You can refer [2] for the implementation done in IS side, we can move that >> logic to analytics side. >> >> [1] h

Re: [Architecture] [Dev] [IS] [Analytics] Improvement to use Siddhi streams to send notifications

> [1] https://github.com/wso2/carbon-analytics-common/blob/ >> master/components/event-publisher/org.wso2.carbon. >> event.publisher.core/src/main/java/org/wso2/carbon/event/ >> publisher/core/internal/ds/EventPublisherServiceDS.java#L56 >> [2] https://github.com/wso2/car

Re: [Architecture] Siddhi Visual Editor (Updated)

at 10:55 PM, Sanjiva Weerawarana wrote: > I'm not sure the notebook concept is what's appropriate for realtime > tooling. Will think about it more. > > On Mon, Aug 8, 2016 at 12:28 AM, Sriskandarajah Suhothayan > wrote: > >> Yes, it will be part of ana

Re: [Architecture] Siddhi Visual Editor (Updated)

We have not decided, it will be part of analysis tooling and it should be used within notebooks for realtime analytics. > > > We have not decided where the notebooks will be. Whether it will be a > separate tooling app or to use the cloud tooling framework that we are > evaluating. > > Please give

Re: [Architecture] Siddhi Visual Editor (Updated)

Yes, it will be part of analysis tooling. It should be used within notebooks for realtime analytics. We have not decided where the notebook will be. Whether it will be a separate tooling app or to use the cloud tooling framework that we are evaluating. Please give suggestion. Regards Suho On Su

Re: [Architecture] [Arch] Adding CEP and ML samples to DAS distribution in a consistent way

t;>> Hi Suho, >>> >>> As per the immediate DAS 310 release, we will continue to keep a local >>> copy of the samples. I have created a JIRA here [1] to add the suggestion >>> provided by Isuru. >>> >>> Best >>> >&

Re: [Architecture] [Arch] Adding CEP and ML samples to DAS distribution in a consistent way

l >> copy of the samples. I have created a JIRA here [1] to add the suggestion >> provided by Isuru. >> >> Best >> >> [1] https://wso2.org/jira/browse/DAS-481 >> >> On Wed, Aug 3, 2016 at 10:02 PM, Sriskandarajah Suhothayan > > wrote: >>

Re: [Architecture] [Arch] Adding CEP and ML samples to DAS distribution in a consistent way

DAS team how about doing it for this release ? Regards Suho On Wed, Aug 3, 2016 at 6:31 PM, Ramith Jayasinghe wrote: > I think we need to ship samples with product. otherwise, The first > 5-minite experience of users will be negatively affected. > > > ___

Re: [Architecture] [Dev] [IS] [Analytics] Improvement to use Siddhi streams to send notifications

HI Indunil Any update on this? Was the provided solution working? We released CEP 4.2-RC1. If we need new features/improvements for this effort, we can incorporate them in the next component release. Regards Suho On Fri, Jul 22, 2016 at 3:10 PM, Sriskandarajah Suhothayan wrote: > > &g

Re: [Architecture] [CEP] Improvement to External Time Batch Window to Allow Specifying Timeout with First Event's Time as Start Time

rnal time batch by you, > which I assume is being handled by Ramindu. > > Regards, > Charini > > On Tue, Jul 26, 2016 at 5:36 AM, Sriskandarajah Suhothayan > wrote: > >> Hi Charini, >> >> Is this implemented? If so can you add this to the docs if it's

Re: [Architecture] [CEP] Improvement to External Time Batch Window to Allow Specifying Timeout with First Event's Time as Start Time

Hi Charini, Is this implemented? If so can you add this to the docs if it's not done so far? Regards Suho On Mon, Jul 25, 2016 at 12:30 PM, Charini Nanayakkara wrote: > Hi Grainier, > > Answers to your queries are as follows. > > 1. What will happen to the events that arrive before, 0th-milli

Re: [Architecture] [Dev] [IS] [Analytics] Improvement to use Siddhi streams to send notifications

On Fri, Jul 22, 2016 at 3:00 PM, Johann Nallathamby wrote: > > > On Fri, Jul 22, 2016 at 8:33 AM, Indunil Upeksha Rathnayake < > indu...@wso2.com> wrote: > >> Hi, >> >> On Fri, Jul 22, 2016 at 12:28 PM, Sriskandarajah Suhothayan < >> s...@wso2.co

Re: [Architecture] [Dev] [IS] [Analytics] Improvement to use Siddhi streams to send notifications

On Fri, Jul 22, 2016 at 12:00 PM, Indunil Upeksha Rathnayake < indu...@wso2.com> wrote: > Hi, > > Please find the meeting notes in [1]. I have following considerations > regarding the improvements we have discussed. > > (1) Even though we have configured to load the email template from > EventPub

Re: [Architecture] [ IoT Analytics] Building a sample analytics story: Smart Home Analytics

Thanks for the great use cases, we'll consider them too, as the first attempt we are trying to show what we collect in a meaningful way, then one by one we'll be adding predictions and grouped analytics on top of this. Regards Suho On Fri, Jul 22, 2016 at 10:09 AM, Malith Jayasinghe wrote: > +

Re: [Architecture] [CEP] [Siddhi] Siddhi Extension for Markov Models

On Thu, Jul 21, 2016 at 3:22 PM, Malith Jayasinghe wrote: > Hi Ashen, > Thanks for the explanation. > > Note that there are case where the state transition matrix is already > known (and fixed). People derive these metrics by analyzing very large data > sets which come from long running experimen

Re: [Architecture] [PET] Support UniqueBatchWindow(Time, Length) for Siddhi

Sorry, I miss read the mail. +1 Regards Suho On Thu, Jul 21, 2016 at 3:02 PM, Rajjaz Mohammed wrote: > Hi Suho, > > We really don't need to have both in the same implementation. But we can >> have both in common repo called UniqueBatchWindow. >> >> Both are not in same implementations. > >> >>

Re: [Architecture] [PET] Support UniqueBatchWindow(Time, Length) for Siddhi

We really don't need to have both in the same implementation. But we can have both in common repo called UniqueBatchWindow. Regards Suho On Thu, Jul 21, 2016 at 2:44 PM, Rajjaz Mohammed wrote: > Hi All, > > I have planned to develop UniqueTimeBatchWindow, UniqueLengthBatchWindow > Extension for

Re: [Architecture] [CEP] [Siddhi] Siddhi Extension for Markov Models

On Thu, Jul 21, 2016 at 12:32 PM, Malith Jayasinghe wrote: > > On Thu, Jul 21, 2016 at 11:46 AM, Ashen Weerathunga > wrote: > >> Hi all, >> >> I'm writing a siddhi extension for Markov models. It can be used to >> detect abnormal user behaviors of many real world applications such as >> detectin

Re: [Architecture] [Dev] [IS] [Analytics] Improvement to use Siddhi streams to send notifications

. I'm available from 2.30 pm at PG. Regards Suho On Tue, Jul 19, 2016 at 11:17 AM, Johann Nallathamby wrote: > Hi Suho, > > On Mon, Jul 18, 2016 at 11:44 PM, Sriskandarajah Suhothayan > wrote: > >> Hi >> >> Based on the request of IS team we have recently added

Re: [Architecture] [Dev] [IS] [Analytics] Improvement to use Siddhi streams to send notifications

Hi Based on the request of IS team we have recently added support for loading template files from the registry. I think with this feature we can do the mapping at Event Publisher side, then IS can send only the core data for the notification. I think building the whole message at IS is too much cu

Re: [Architecture] RabbitMQ Input Adopter in CEP

+1 Regards Suho On Thu, Jul 7, 2016 at 3:31 PM, Malaka Silva wrote: > I guess we can check for possibilities of reusing inbound endpoint code > here. This way we can identify what is missing to do this from both sides. > WDYT? > > On Thu, Jul 7, 2016 at 2:48 PM, Sriskandar

Re: [Architecture] RabbitMQ Input Adopter in CEP

It's better if we can avoid using Axis2 Transport if we need to restart CEP/DAS for each and every changes. Please verify. Regards Suho On Thu, Jul 7, 2016 at 2:14 PM, Yashothara Shanmugarajah < yashoth...@wso2.com> wrote: > ​​ > Hi All, > > I have planned to develop RabbitMQ Input Adapter (Rece

Re: [Architecture] Caching Real time analytics data

This is a valid case, I believe this can be added to the UI publisher. @Thilini can you implement caching at UI publisher such that it when a gadget connects during the connection time the gadget will get all the cached events, and then update itself like how it does now ? For the proper fix is, e

Re: [Architecture] Caching Support for Analytics Event Tables

Is this in line with the RDBMS implementation? Else it will be confusing to the users. Shall we have a chat and merge the caching code? @Mohan can you work with Anjana Regards Suho On Mon, Jun 20, 2016 at 12:49 PM, Anjana Fernando wrote: > Hi, > > With a chat we had with Srinath, we've decided

Re: [Architecture] [CEP] Siddhi Extension for calculate percentile values

Since p can't change during the execution, make sure to force p to be a constant value. Am I correct here ? Regards Suho On Wed, Jun 8, 2016 at 6:38 AM, Ashen Weerathunga wrote: > Hi All, > > I'm writing a siddhi extension for calculating percentile values. This > will be implemented as an Aggr

Re: [Architecture] Modification of the gadget generation wizard's extension structure

On Wed, Jun 8, 2016 at 3:31 PM, Manuranga Perera wrote: > Hi Tanya, Sinthuja, > > 1) We had a chat about how we can use gadget parameters instead of > generation, have you guys considered that approach? > > We have cases like database credentials which should not be shown to the user and should n

Re: [Architecture] Modification of the gadget generation wizard's extension structure

Gadget generation API is orthogonal to the usage API and we are not changing the usage API, hence gadget created via old generation tools will still work. Regards Suho On Tue, Jun 7, 2016 at 3:34 PM, Rajith Vitharana wrote: > Hi Tanya, > > On Tue, Jun 7, 2016 at 3:21 PM, Tanya Madurapperuma >

Re: [Architecture] Access Level Model For WSO2 Dashboard Server

Why are we not using different permissions for each dashboard than using roles. I believe using permissions will be more scalable than using roles. WDYT? Regards Suho On Tue, Jun 7, 2016 at 2:38 PM, Nisala Nanayakkara wrote: > Hi Udara, > > Since these are internal roles, they are not stored i

Re: [Architecture] [DS] Gadget Generation from REST API

Looks good please proceed. For your point #2 don't store the token in files but rather keep that in memory. Regards Suho On Wed, Jun 1, 2016 at 10:19 PM, Geesara Prathap wrote: > Hi All, > > I am to implement a new data provider which requires getting data from > some third party REST API for g

Re: [Architecture] Data Bridge Agent Publisher for C5 products

Are we going to use data bridge in C5 ? C5 have Netty based transports, cant we use one of them to publish events to DAS, since DAS have the capability to receiving from any transport protocol via extensions this will not be a problem. In my opinion we should not be depending on data publisher as

Re: [Architecture] [CEP] Extending the Regression Function to support time window

I think having batchSize & duration will be good as this will limit the number of events considered, this can help to improve performance as well. Suho On Thu, Jun 2, 2016 at 1:59 PM, Charini Nanayakkara wrote: > Hi Tishan, > > For my requirement, having time window alone is adequate. So your p

[Architecture] WSO2 IoTS Analytics v1.0.0-ALPHA Released

*WSO2 IoTS Analytics v1.0.0-ALPHA Released* We are pleased to announce the alpha release of WSO2 IOTS Analytics v1.0.0 [ 1 ] which is powered by WSO2 Data Analytics Server. IoTS Analytics can be used to monitor devices and analyze their sensor readings. Your f

Re: [Architecture] [Siddhi] Making Disruptor configurable

; again didn't give a significant gain. In CEP's case have we identified > specific use cases that we must use Disruptor configuration for gain > maximum throughput? > > Thanks, > Kasun > > > On Sun, May 15, 2016 at 3:28 AM, Sriskandarajah Suhothayan > wrote: > &

Re: [Architecture] Comments about IoTS Docs

Its in this release, users can write queries by themselves using the IoT Analytics Pack. Currently we are working on building a framework for templating common scenarios, we might need 2 more weeks to finish the work. I believe we can add this to the next IoT release. Suho On Tue, May 17, 2016 at

Re: [Architecture] [Siddhi] Making Disruptor configurable

t will be > difficult to optimise both performance metrics at the same time? > > On Mon, May 16, 2016 at 11:10 AM, Sriskandarajah Suhothayan > wrote: > >> >> >> On Mon, May 16, 2016 at 11:07 AM, Seshika Fernando >> wrote: >> >>> Hi Suho, >>>

Re: [Architecture] [Siddhi] Making Disruptor configurable

lt one is 1024. Suho > seshi > > On Sun, May 15, 2016 at 3:58 PM, Sriskandarajah Suhothayan > wrote: > >> >> Hi >> >> We have made Disruptor as optional for Siddhi[1], currently its always >> enabled and it uses PhasedBackoffWaitStrategy, event though D

[Architecture] [Siddhi] Making Disruptor configurable

Hi We have made Disruptor as optional for Siddhi[1], currently its always enabled and it uses PhasedBackoffWaitStrategy, event though Disruptor was giving high throughput there are several issues identified. 1. It is adding latency, and tuning latency is subject to use-cases hence the deployment

[Architecture] Fixing auto batching in Siddhi

Hi There are several complaints when Siddhi aggregate outputs its automatically batching the events and hence the output number of events is not consistently reproducible. E.g. when using from FooStream#window.time(100) select bar, count() as totalReq insert into FooBarStream; In order to fix t

Re: [Architecture] [DS] Gadget Generation Framework

Please see the comments inline. On Fri, Apr 29, 2016 at 7:52 PM, Tanya Madurapperuma wrote: > Hi all, > > *Introduction* > > The purpose of this feature is to provide a framework to generate gadgets > where you can plug datasource providers and chart templates. > > For an example, you will be ab

Re: [Architecture] Implementing proper security model for dashboard server

azath.com > Twitter: @farazath619 <https://twitter.com/farazath619> > > On Thu, Apr 28, 2016 at 10:28 PM, Sriskandarajah Suhothayan > wrote: > >> Thanks Sumedha for the points, to make life easy for the gadget developer >> we decided to add oAuth token retrieval to DS. &

Re: [Architecture] Implementing proper security model for dashboard server

Thanks Sumedha for the points, to make life easy for the gadget developer we decided to add oAuth token retrieval to DS. Based on the offline discussion with Johann, Sinthuja and Geesara we decided to support only the following scenarios for DS 1. If SSO is enabled, obtaining a token (OAuth2) usi

Re: [Architecture] [DS]Embeddable gadgets feature for Dashboard Server

Hi Megala I think its not necessary to communicate to DS if we are to do gadget to gadget communication, but we have to provide a js library that the web page developer need to embed in order to get the pub-sub working. Via this library we can do the pub-sub locally within that page, and who can c

Re: [Architecture] Product Integration Server thread model and implementation

in higher amount > for some requests. > > Number of Disruptors are configurable and I have used five CPU bound > Disruptors and one IO bound DIsruptor for testing which gives maximum Perf > according to testes we carried for Gateway. > > thanks > > > On Fri, Apr 22, 2016 a

Re: [Architecture] Product Integration Server thread model and implementation

Whats the waiting strategy that is being used in Disrupter? And is the maximum of Disrupter in all configuration is 2 ? Suho On Fri, Apr 22, 2016 at 8:01 PM, Chanaka Fernando wrote: > Hi Isuru, > > Have we tested on the pure passthrough scenarios? According to the > results, we cannot see much

Re: [Architecture] [analytics-esb] Summary Stat Generation Mechanism

the processing. > > Cheers, > Anjana. > > On Wed, Apr 20, 2016 at 12:11 PM, Sriskandarajah Suhothayan > wrote: > >> I think it will make more sense to run seconds and minutes from siddhi, >> and run the spark every hour, when there are lots of date on the system

Re: [Architecture] [analytics-esb] Summary Stat Generation Mechanism

I think it will make more sense to run seconds and minutes from siddhi, and run the spark every hour, when there are lots of date on the system this will be much more scalable. WDYT? Regards Suho On Wed, Apr 20, 2016 at 11:50 AM, Supun Sethunga wrote: > Hi, > > This is a follow-up mail of [1],

Re: [Architecture] Data Isolation level for Data from APIM and IoT? Tenant vs. User

Hi User level isolation is needed for the IoT server, as in the IoT server context user registers a device and use that, hence he/she should only be able to see his/her devices and not any other users devices or data. @Pabath & Sumedha correct me if I'm wrong. Regards Suho On Fri, Mar 25, 2016

Re: [Architecture] [IoTS] Is it the right thing to package "analytics" scripts with a plugin implementation?

We already have Dev Studio support for "analytics" artifacts. In this case it depends, If the plugin developer believes that he his sensor need some specialised analytics and charts then we should have the capability to provide that, this can be achieved via added the analytics in to the same cApp

Re: [Architecture] [PC][BPMN] Web based BPMN editor using D3

+1 we'll check. Suho On Thu, Mar 17, 2016 at 2:18 PM, Srinath Perera wrote: > Suho, Tharik, can you guys have a look. CEP editor is not much different. > > --Srinath > > On Mon, Mar 14, 2016 at 2:37 PM, Natasha Wijesekara > wrote: > >> Hi, >> >> I implemented a javascript-based BPMN editor for

Re: [Architecture] API Manager Throttling Design - How to notify throttling events to Gateway cluster

On Tue, Mar 1, 2016 at 11:17 PM, Pamod Sylvester wrote: > Hi Nuwan, > > AFAIU this will not require *durable* subscriptions created between the > GW and the broker, since each time the GW node starts or reconnects it will > sync/snapshot with the DB to obtain the current state. Also i assume in >

Re: [Architecture] Extending execution manager to support Batch analytics scripts

on the outcome.. >> >> Does this make sense ? >> >> >> Thanks, >> Mohan >> >> >> On Fri, Feb 26, 2016 at 2:31 PM, Sriskandarajah Suhothayan > > wrote: >> >>> We will implement the batch & realtime part of the execution ma

Re: [Architecture] Extending execution manager to support Batch analytics scripts

We will implement the batch & realtime part of the execution manager as separate backend components. And move the common aspects in the execution.manager.core. WDYT? Regards Suho On Fri, Feb 26, 2016 at 2:25 PM, Rajeev Sampath wrote: > Hi, > > Currently the execution manager supports configuri

Re: [Architecture] [Analytics for APIM] Integration Tests to cover Alerting scripts

+1 looks good, for testing prepuces we can also deploy some related executionplans, stream and publishers to tap intermediate analytics results. Regards Suho On Wed, Feb 24, 2016 at 1:44 PM, Sachith Withana wrote: > Hi all, > > We are going to implement the integration tests to cover the alerti

Re: [Architecture] Abnormal tier usage (Analytics for APIM)

Yes, I believe Mohan can guid on this implementation. He has already done for the realtime part. Unfortunately we cant get him as it delay Throttling Event Table implementation. Which is currently blocking Throttling perf test. Thanks Suho On Sat, Feb 20, 2016 at 6:24 PM, Nirmal Fernando wrote:

Re: [Architecture] Supporting Carbon Metrics on Carbon 5 based products

wrote: > HI suho, > Does this mean If someone what to see matrices in a UI they have to > run DS? (or we install what ever feature in the product by default) > regards > Ramith > > On Sat, Feb 13, 2016 at 1:17 PM, Sriskandarajah Suhothayan > wrote: > > IMHO we have to

Re: [Architecture] Supporting Carbon Metrics on Carbon 5 based products

IMHO we have to write some gadgets on DS as the way forward. We can use the inter gadget communication to select and update other charts on which hierarchy we are currently in and use that info in other gadgets to query data from the DBs. I think we still need to support RDBMs Regards Suho On Fr

Re: [Architecture] VizGrammar chart improvements

re realistic when > visualizing fast moving data points. WDYT? > > Regards, > Dunith > > On Thu, Oct 29, 2015 at 7:23 PM, Sriskandarajah Suhothayan > wrote: > >> >> >> On Thursday, October 29, 2015, Dunith Dhanushka wrote: >> >>> Hi Tharik, >>&g

Re: [Architecture] How do I override Siddhi's default sequence and pattern matching functionality?

Hi Unfortunately siddhi does not have an extension point to alter the behaviour of patterns and sequences :( If you want to do that you might have to tweak the source code [1] But as an alternative you can extend the StreamProcessor Extension of Siddhi, this gives you the full power of Siddhi que

Re: [Architecture] [Dev] WSO2 Developer Studio 3.8.0 Beta Released!

On Fri, Sep 25, 2015 at 4:26 PM, Gayan Yalpathwala wrote: > Hi All, > > We have WSO2 Developer Studio 3.8.0 Beta ready to be downloaded at [1] and > installed eclipse distributions available at [2]. This release includes > following tasks, sub-tasks, improvements and bug fixes. > > *Tasks* > >

Re: [Architecture] File Connector Version2 for WSO2 ESB.

We should be able to read a large xml file in a streaming mode and extract several xml sub elements. and read line by line Suho On Fri, Sep 4, 2015 at 2:21 PM, Vivekananthan Sivanayagam < vivekanant...@wso2.com> wrote: > Hi All, > > I am going to implement File Connector Version2, So I have plan

Re: [Architecture] [CEP, DAS]Developer Studio plug-in for Analytics Project

They will be also added as part of this Regards Suho On Thu, Aug 6, 2015 at 5:37 PM, Iranga Muthuthanthri wrote: > Are the artefacts (Scripts/EventStores/Dashboards) to be included later?, > as referred in[1] > > [1] > https://docs.wso2.com/display/DAS300/Carbon+Application+Deployment+for+DAS

Re: [Architecture] [Dev] [GSoC-2015] Proposal2 : Siddhi Editor for WSO2 CEP

ersity of Moratuwa.* > *Contact no. +94770460887 <%2B94770460887>* > > > > > On Wed, Jul 15, 2015 at 5:03 PM, Sriskandarajah Suhothayan > wrote: > >> any update one this? >> >> Whats the approach we are taking now >> >> On Mon, Jul 6, 2015

Re: [Architecture] [Dev] [GSoC-2015] Proposal2 : Siddhi Editor for WSO2 CEP

+94770460887 <%2B94770460887>* > > > > > On Sun, Jul 5, 2015 at 9:38 PM, Sriskandarajah Suhothayan > wrote: > >> The both model you are progressing are not scalable, and error prone. If >> we make any change to the grammar then we have to also fix that in sev

Re: [Architecture] [DAS] Changing the name of Message Console

+1 for "data explorer" and I believe it's inline with the primary usecase of that. Suho On Sat, Jul 11, 2015 at 10:46 PM, Iranga Muthuthanthri wrote: > +1, Since the category mostly falls under interactive analytics and more > related about to querying data , suggest "Query Analyzer" > > On S

Re: [Architecture] [Dev] [GSoC-2015] Proposal2 : Siddhi Editor for WSO2 CEP

t line 3 --->B >>>4. >>>5. from foo//execution_element : at line >>>5> C >>>6. select a >>>7. insert into bar; >>> >>> >>> If the code has no syntax errors then,it will be submi

Re: [Architecture] CEP Extension for Machine Learner Predictions

When done also add this to the Siddhi documentation at[1] Suho [1]https://docs.wso2.com/display/CEP400/Siddhi+Extensions On Thu, May 14, 2015 at 3:35 PM, Manorama Perera wrote: > Hi, > > We are in the process of implementing a CEP extension for Machine Learner > Predictions. This extension all

Re: [Architecture] Adding periodic trigger support in Siddhi

> <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab> > > On Tue, May 12, 2015 at 1:54 PM, Sriskandarajah Suhothayan > wrote: > >> >> >> On Tue, May 12, 2015 at 12:15 PM, Sajith Ravindra >> wrote: >> >>> Will it be worth to add the

Re: [Architecture] Adding periodic trigger support in Siddhi

ineer > WSO2 Inc.; http://wso2.com > lean.enterprise.middleware > > mobile: +94 77 2273550 > blog: http://sajithr.blogspot.com/ > <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab> > > On Tue, May 12, 2015 at 1:20 PM, Sriskandarajah Suhothayan > wrote: > >> >>

Re: [Architecture] Adding periodic trigger support in Siddhi

is suppose to trigger an event based on cron[1] Suho [1] http://www.quartz-scheduler.org/documentation/quartz-1.x/tutorials/crontrigger > > > Thanks, > Sachini > > > On Tue, May 12, 2015 at 11:09 AM, Sriskandarajah Suhothayan > wrote: > >> Hi >> >> Cu

[Architecture] Adding periodic trigger support in Siddhi

Hi Currently we don't have out of the box support for triggers in Siddhi, hence we are introducing trigger support as follows, Users can define triggers as follows; define trigger triggerStream at every 5 min; define trigger fooTriggerStream at '56, *, *, *, 8'; define trigger barStream at 's

Re: [Architecture] Adding Throttling support in ESB and APIM products

I think we have already done one with APIM we can refine that and make that as a generic implementation WDYT? Suho On Wed, Apr 8, 2015 at 4:01 PM, Srinath Perera wrote: > We had several discussion on doing Throttling with Siddhi or CEP, shall we > do that? > > On Tue, Apr 7, 2015 at 9:53 AM, K

Re: [Architecture] RFC: Timestamps and Ordering in CEP

Yes we have thought about this during the Siddhi rewrite and we have made necessary architectural changes to support this. Here our approach is to update Siddhi system time based on event arrival and also support event ordering at the input event handler level. We have not done a full implementati

Re: [Architecture] WSO2 Analytics Dashboard UI Overview

Data views and associated widgets need not to be in the same page, I believe when clicked on a dataview navigating to another page will be more clear, this is because If there are many data views then the current UI will not be that user friendly. Regards Suho On Sat, Mar 21, 2015 at 9:11 PM, Du

Re: [Architecture] Deployable persistency while being deployed using cApps is problematic

Yes this seems to be an issue and here we are storing stream definitions in governance registry which is accessible by many clusters, which is making this process even worse. @Regisry,ESB folks so you have any solutions for this ? Regards Suho On Thu, Feb 19, 2015 at 11:06 AM, Ayash wrote: >

  1   2   3   >