Re: [Architecture] Making IOT - APIM communication via REST api's

2016-11-03 Thread Sinthuja Ragendran
Hi Susinda, Please see my response inline. On Thu, Nov 3, 2016 at 11:58 AM, Susinda Perera wrote: > Hi All > > Currently IOT communicates with APIM components via Java/OSGI api's and > services. Therefore $subject is needed to properly decouple and make IOT > cloud ready. > Consider the followi

Re: [Architecture] Making IOT - APIM communication via REST api's

2016-11-03 Thread Sinthuja Ragendran
gt; blog : http://ruwansrants.blogspot.com/ > https://500px.com/ruwan_ace > www: :http://wso2.com > > > On Thu, Nov 3, 2016 at 1:18 PM, Sinthuja Ragendran > wrote: > >> Hi Susinda, >> >> Please see my response inline. >> >> On Thu, Nov

Re: [Architecture] Dashboard Component Permission Model

2017-01-03 Thread Sinthuja Ragendran
Hi Tanya, Small question. On Wed, Jan 4, 2017 at 10:43 AM, Tanya Madurapperuma wrote: > Hi IS Team and all, > > Purpose of this mail is to discuss about $ Subject. > > There are two main artifact types associated with the dashboard component; > Dashboards and Widgets. > > *Widgets* > According

Re: [Architecture] tenant specific MQTT receivers in DAS , not listening to topics once tenant get unloaded

2017-03-19 Thread Sinthuja Ragendran
Hi, As the receiver configurations are deployable artefacts, those will be active when the tenant is loaded. One approach is to have all tenants loaded indefinitely. I think this will have high memory. And therefore we internally discussed below approach to handling this problem. Instead of havin

Re: [Architecture] tenant specific MQTT receivers in DAS , not listening to topics once tenant get unloaded

2017-03-20 Thread Sinthuja Ragendran
Hi Ayyoob, On Mon, Mar 20, 2017 at 1:54 PM, Ayyoob Hamza wrote: > Agree that it's better to handle this in super tenant layer due to its > complexity, but I wonder whether this needs to be specific for > MQTT scenarios. Because we need the same requirement for HTTP and thrift > receivers. So for

Re: [Architecture] tenant specific MQTT receivers in DAS , not listening to topics once tenant get unloaded

2017-03-21 Thread Sinthuja Ragendran
with seperate receiver configurations per tenant, then you need to make sure, that you don't create multiple receiver configurations for same tenant. Thanks, Sinthuja. > > Thanks > /Jasintha > > On Tue, Mar 21, 2017 at 11:27 AM, Anjana Fernando wrote: > >> Hi, &g

Re: [Architecture] [IoT] Improve Performance and Reliability of Push notifications

2017-03-22 Thread Sinthuja Ragendran
Hi, +1 for the second option of handling it simply within our code level without going through the additional hop. On Wed, Mar 22, 2017 at 3:58 PM, Chathura Ekanayake wrote: > I think option 2 is better. Using a message store will also eventually > access a persistent storage (probably with mul

Re: [Architecture] [IoT] Improve Performance and Reliability of Push notifications

2017-03-22 Thread Sinthuja Ragendran
Hi Waruna, On Wed, Mar 22, 2017 at 10:41 PM, Waruna Jayaweera wrote: > Hi Chathura, > > We can not read from db , since in a clustered environment when multiple > nodes try read from same operation table will cause duplication of push > message sending. > Can't we make use of dynamic partitioni

Re: [Architecture] [IoT] Improve Performance and Reliability of Push notifications

2017-03-22 Thread Sinthuja Ragendran
Hi Geeth, On Thu, Mar 23, 2017 at 11:42 AM, Geeth Munasinghe wrote: > Hi all, > > IMO, having DB update and in-memory queues are two different methods we > can resolve this issue. Updating DB supports near reliable messaging and > this can be done only from a single server. Because we cannot ha

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-09 Thread Sinthuja Ragendran
Hi Supun, I think we could simplify the json message bit more. Instead of 'null' for the payload attributes in the events section, you could use the actual payload name directly if there is a payload for that event. And in that case, we could eliminate the 'events' section from the 'payloads' sect

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-09 Thread Sinthuja Ragendran
a convention. If the element starts with '$' then it's the reference, not the actual payload. In that case if there is a new element introduced, let's say foo and you need to access the property property1, then it will have the reference as $foo:property1. Thanks, Sinthuja. >

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-09 Thread Sinthuja Ragendran
Hi Supun, Also this json event format is being sent as event payload in wso2 event, and wso2 event is being published by the data publisher right? Correct me if i'm wrong. Thanks, Sinthuja. On Wed, Feb 10, 2016 at 11:26 AM, Sinthuja Ragendran wrote: > Hi Supun, > > > On Wed

Re: [Architecture] [Analytics] Improvements to Lucene based Aggregate functions (Installing Aggregates as OSGI components)

2016-03-19 Thread Sinthuja Ragendran
Hi Gimantha, On Thu, Mar 17, 2016 at 9:05 PM, Gimantha Bandara wrote: > Hi all, > > DAS 3.0.0 and DAS 3.0.1 has 5 built-in Aggregates[1][2] namely MIN, MAX, > SUM, AVG and COUNT which can be used in interactive analytics. Sometimes > some scenarios may require custom aggregate functions for aggr

Re: [Architecture] Incremental Processing Support in DAS

2016-03-23 Thread Sinthuja Ragendran
Hi Sachith, On Mon, Mar 21, 2016 at 5:15 PM, Sachith Withana wrote: > Hi all, > > We are adding incremental processing capability to Spark in DAS. > As the first stage, we added time slicing to Spark execution. > > Here's a quick introduction into that. > > *Execution*: > > In the first run of t

Re: [Architecture] Implementing proper security model for dashboard server

2016-04-28 Thread Sinthuja Ragendran
Hi Sumedha, On Thu, Apr 28, 2016 at 1:58 PM, Sumedha Rubasinghe wrote: > Geesara, > This is a model that should be coming out of Dashboard perspective. > > If we take a look @ basic building blocks of DS, its (similar to what you > have mentioned) > - Gadget > - Dashboard > - Wizards > - Dashboa

Re: [Architecture] Data Bridge Agent Publisher for C5 products

2016-06-02 Thread Sinthuja Ragendran
Hi IsuruP, Please find the comments inline. On Thu, Jun 2, 2016 at 12:18 PM, Isuru Perera wrote: > Hi, > > This is regarding $subject and the main problem we have is that there is > no Carbon 5 compatible feature for data bridge agent. > Data bridge agent publisher is not depends on carbon, an

Re: [Architecture] Data Bridge Agent Publisher for C5 products

2016-06-02 Thread Sinthuja Ragendran
ithout any code changes and removing >> unwanted dependencies. If we planning to write this again, we should come >> up with the minimum library that could be used in a OSGi and non-OSGi env. >> >> >> On Thu, Jun 2, 2016 at 1:40 PM, Isuru Perera wrote: >> >

Re: [Architecture] Access Level Model For WSO2 Dashboard Server

2016-06-07 Thread Sinthuja Ragendran
According to the chat I had with Johann, we have came up with this model. Basically as per now in C4 we don't have a way to add a permission dynamically, and similar requirement has been raised in IS as well and they have come up with this model. The main reason for this is, there might be some da

Re: [Architecture] Feature - Applying a custom theme for a dashboard

2016-06-07 Thread Sinthuja Ragendran
Hi Jerad et all, Let's use this approach if we want to apply some custom theme per dashboard, without modifying the default theme. I know as we have merged the theme you guys have developed for analytics effort as default theme, it should not be a issue now. :) But in case, if you come across futu

Re: [Architecture] Access Level Model For WSO2 Dashboard Server

2016-06-07 Thread Sinthuja Ragendran
signer doesn't have such privileges, he/she can only add/remove gadgets, pages etc which is related to designing the dashboard. Therefore we need to have a different role to control the access of the settings page. Thanks, Sinthuja. > On Tue, Jun 7, 2016 at 7:59 AM, Sinthuja Ragendr

Re: [Architecture] Feature - Applying a custom theme for a dashboard

2016-06-08 Thread Sinthuja Ragendran
s great. And I had some concerns about the > extension part of it. Let's schedule a review meeting, so we can share our > thoughts. :D > > Cheers! > Jerad > > > On Tue, Jun 7, 2016 at 6:51 PM, Sinthuja Ragendran > wrote: > >> Hi Jerad et all, >> >>

Re: [Architecture] Feature - Applying a custom theme for a dashboard

2016-06-08 Thread Sinthuja Ragendran
ntioned in the dashboard.json along with the car file, if the theme is already there in the pack or the environment. Ie, lets say an organization has added a theme default in their distribution, then you can just mention in the dashboard.json and use it. Thanks, Sinthuja. > > Thanks, >

Re: [Architecture] Feature - Applying a custom theme for a dashboard

2016-06-08 Thread Sinthuja Ragendran
dashboard. Now I want to >> pack this into a CApp and deploy into another PC. In that case I'll have to >> pack dashboard definition JSON + theme into the CApp. >> >> My question is how can I specify the name of the custom theme in the >> dashboard definition? W

Re: [Architecture] Access Level Model For WSO2 Dashboard Server

2016-06-09 Thread Sinthuja Ragendran
Hi Nisala, On Thu, Jun 9, 2016 at 8:13 AM, Nisala Nanayakkara wrote: > Hi Sinthuja, > > This email is to clarify several issues regarding this feature. Up-to now > I have created a four internal roles as above. All these four roles are > assigned to the user who created the dashboard initially.

Re: [Architecture] Modification of the gadget generation wizard's extension structure

2016-06-09 Thread Sinthuja Ragendran
Hi Manu, On Wed, Jun 8, 2016 at 8:40 PM, Manuranga Perera wrote: > 1) We had a chat about how we can use gadget parameters instead of >>> generation, have you guys considered that approach? >>> >>> We have cases like database credentials which should not be shown to the >> user and should not be

Re: [Architecture] [DS]Embeddable gadgets feature for Dashboard Server

2016-06-20 Thread Sinthuja Ragendran
Hi all, So far based on all the discussions above I see below facts. 1) APIM log viewer app is using portal as 'Gadget Store', and wants to embed the gadgets which are residing in the portal app. 2) Without any additional authentication process, the user should be able to embed the gadget to APIM

Re: [Architecture] [Analytics] Allowing analytics data to be published to super tenant space

2016-06-23 Thread Sinthuja Ragendran
Hi, On Thu, Jun 23, 2016 at 5:48 PM, Amila Maha Arachchi wrote: > > > On Thu, Jun 23, 2016 at 4:22 PM, Dunith Dhanushka wrote: > >> >> >> On Thu, Jun 23, 2016 at 3:46 PM, Anjana Fernando wrote: >> >>> Hi Amila, >>> >>> On Thu, Jun 23, 2016 at 11:52 AM, Amila Maha Arachchi >>> wrote: >>>

[Architecture] WSO2 Dashboard Server 2.1.0-M3 Released!

2016-06-24 Thread Sinthuja Ragendran
WSO2 Dashboard Server 2.1.0-M3 Released! WSO2 Dashboard Server team is pleased to announce the release of WSO2 Dashboard Server 2.1.0 Milestone 3. This release comes with the following bug fixes and features. You can download the distribution from [1]. Bug [UES-924] - In drill down dashboards (pu

Re: [Architecture] ESB Analytics Dashboard Memory Usage

2016-06-29 Thread Sinthuja Ragendran
Hi Chamila, I think this is specifically for analytics dashboard right, and not for simple dashboards? In that case, we need to check how the gadgets have been written, and because the actual data is being fetched from DAS into this gadgets, and I believe the fetched data to display in gadget is c

Re: [Architecture] In-Tenant Data restriction in the DAS platform

2016-06-30 Thread Sinthuja Ragendran
Hi Dulitha, On Wed, Jun 29, 2016 at 10:24 PM, Dulitha Wijewantha wrote: > Hi guys, > Below are somethings I noted when I was writing dashboards for an > analytics solution. > > 1) oAuth protected APIs should be used to retrieve data for gadgets > > 2) There should be a way to restrict data for u

Re: [Architecture] [Dev] Provide Support to run Jaggery apps in Tomcat Server

2016-07-04 Thread Sinthuja Ragendran
Hi, Anyhow ultimately when all the carbon products move to AS 6.0 based platform, we can merge all those into one. Thanks, Sinthuja. On Mon, Jul 4, 2016 at 12:38 PM, Nisala Nanayakkara wrote: > Hi Kasun, > > Yes.We can do a performance round. Currently we manage the Tomcat Jaggery/ > AS6 suppo

Re: [Architecture] Caching Real time analytics data

2016-07-06 Thread Sinthuja Ragendran
Hi Sachith, If the use-case is to display the 1 hour analytics data from CEP, then IMO the he/she need to simply store the CEP results into a persistence store (DAS or RDBMS via RDBMS event publisher), and then let the gadget read from the persistence store. I don't think caching is a good option

Re: [Architecture] Caching Real time analytics data

2016-07-06 Thread Sinthuja Ragendran
to see the last status of the real time > analytics when I log in. > > Thanks, > Sachith > > On Wed, Jul 6, 2016 at 12:09 PM, Sinthuja Ragendran > wrote: > >> Hi Sachith, >> >> If the use-case is to display the 1 hour analytics data from CEP, then >>

Re: [Architecture] ESB Analytics Dashboard Memory Usage

2016-07-14 Thread Sinthuja Ragendran
;>> >>>> Hi Sinthuja, >>>> >>>> I'm seeing around 500MB of memory usage in the DAS 3.1.0-SNAPSHOT >>>> "Generate Gadget" page as well, specially when the gadget is being >>>> previewed. At that moment, there is only one ga

Re: [Architecture] ESB Analytics Dashboard Memory Usage

2016-07-14 Thread Sinthuja Ragendran
er in this issue? Thanks, Sinthuja. On Thu, Jul 14, 2016 at 1:53 PM, Sinthuja Ragendran wrote: > Hi, > > I tried this scenario with DAS 3.1.0 beta pack, and this is only > observable for the gadgets created by the gadget generation wizard. And I > could see a fast growth of the memo

Re: [Architecture] [Arch] Adding CEP and ML samples to DAS distribution in a consistent way

2016-08-04 Thread Sinthuja Ragendran
Hi, We also need to find a consistent way to maintain the integration tests as well. CEP, and ML features are being used in DAS, and there is no integration tests for those components getting executed in the DAS product build. Similarly there are many UI tests we have in dashboard server as well,

Re: [Architecture] BAM Performance tests

2014-08-15 Thread Sinthuja Ragendran
Hi, I have completed upto puppetizing BAM Receiver configurations, and due to support priorities I wasn't able to work full time on this. Hence cassandra and analyzer confgurations are still pending. Anyhow since I have done with the base confgurations, I should be able to provide the complete pup

Re: [Architecture] [Dev] ES- Asset publisher to BAM

2014-09-29 Thread Sinthuja Ragendran
Hi, I see eventName is being used as meta data and payload data; what are these properties? If it's same property, you don't need to duplicate it and rather have it in the single place either as meta data or payload data. Also what is ES_EVENT in correlation data? Can you explain the properties o

[Architecture] WSO2 BAM 2.5.0 Released !!

2014-12-16 Thread Sinthuja Ragendran
WSO2 Business Activity Monitor 2.5.0 Release Notes *15th of December 2014* WSO2 Business Activity Monitor (WSO2 BAM) is a comprehensive framework designed to solve the problems in the wide area of business activity monitoring. WSO2 BAM comprises of many modules to give the best of performance, sca

Re: [Architecture] BAM 3.0 REST APIs for AnalyticsDataService / Indexing / Search

2015-01-18 Thread Sinthuja Ragendran
Hi gimantha, Please see the comments inline. On Sun, Jan 18, 2015 at 11:24 PM, Gimantha Bandara wrote: > Hi, > Currently, I am working on $subject. Basically the methods in > AnalyticsDataService will be exposed through REST APIs. Please refer to > Architecture mail thread "*[Architecture] BAM

Re: [Architecture] BAM 3.0 REST APIs for AnalyticsDataService / Indexing / Search

2015-01-19 Thread Sinthuja Ragendran
ost Thanks, Sinthuja. On Tue, Jan 20, 2015 at 1:29 AM, Gimantha Bandara wrote: > Hi Sinduja, > > Thank you for the feedback. > > On Mon, Jan 19, 2015 at 12:04 PM, Sinthuja Ragendran > wrote: > >> Hi gimantha, >> >> Please see the comments inline. >> >

[Architecture] BAM 3.0 Spark Script and Console UI in Dashboard

2015-03-09 Thread Sinthuja Ragendran
Hi, BAM dashboards are used so far to visualize the graphs, etc for presenting the data, but we are thinking of moving some of the operations from admin console to dashboard for a seamless user interaction. Basically in BAM 3.0, the users would like to execute some queries on the console, and then

Re: [Architecture] BAM 3.0 Spark Script and Console UI in Dashboard

2015-03-10 Thread Sinthuja Ragendran
ducted by different roles. > > Isabelle. > > - > *Isabelle Mauny* > VP, Product Management - WSO2, Inc. - http://wso2.com/ > > > On Mon, Mar 9, 2015 at 8:07 AM, Sinthuja Ragendran > wrote: > >> Hi, >> >> BAM dashboards are used so far to visualize the graphs, et

[Architecture] BAM/CEP Data Publisher refactoring

2015-03-26 Thread Sinthuja Ragendran
Hi, I have done the $subject, and this was be mainly focused to provide below objectives. - Unifying all different kind of datapublishers (LoadbalancingDatapublisher, AsyncDatapublisher, Datapublisher) currently available and provide one Datapublisher. - Implement data publisher endpo

Re: [Architecture] BAM/CEP Data Publisher refactoring

2015-03-26 Thread Sinthuja Ragendran
to BAM/CEP by > randomly provisioned unreliable clients. So using username/password would > not work. > > On Thu, Mar 26, 2015 at 1:04 PM, Sinthuja Ragendran > wrote: > >> Hi, >> >> I have done the $subject, and this was be mainly focused to pr

Re: [Architecture] Replacing BAM Toolbox Format with CAR

2015-03-30 Thread Sinthuja Ragendran
Hi, Please see my comments inline. On Mon, Mar 30, 2015 at 5:24 PM, Iranga Muthuthanthri wrote: > > Would like to seek clarifications on the following, How it would be > possible to: > > (i) Create the CAR/CApp , would it be through Dev Studio, if so i believe > tooling does not support this. >

[Architecture] WSO2 DAS 3.0 M4 Released!

2015-04-21 Thread Sinthuja Ragendran
Hi, The WSO2 DAS team is pleased to announce the fourth milestone release of WSO2 DAS v3.0. The distribution is available at [1]. The release includes the following new features, improvements, and tasks. Improvement - [BAM-1975 ] - Need to ensure that

[Architecture] Privileged user sending events to DAS/CEP as tenant

2015-05-12 Thread Sinthuja Ragendran
Hi all, We (Isabelle, Anjana, Suho, NuwanD, Mohan, Iranga, Jaminda, and Myself) had a discussion about APIM 1.9 compatibility with DAS last week, and we need $subject to support APIM with DAS in tenant mode. As per APIM stats publishing to BAM 2.5.0, the events are published from super tenant (fo

Re: [Architecture] Privileged user sending events to DAS/CEP as tenant

2015-05-12 Thread Sinthuja Ragendran
re cleaner approach, than deciding with convention of having specific 'TenantId' property name. But sending the tenantId in event payload is not going to have any difference in the analytics perspective, because once the relevant data is there fore relevant tenant space it's tenant

Re: [Architecture] Privileged user sending events to DAS/CEP as tenant

2015-05-12 Thread Sinthuja Ragendran
Hi sanjeewa, On Tue, May 12, 2015 at 7:02 PM, Sanjeewa Malalgoda wrote: > > > On Tue, May 12, 2015 at 6:07 PM, Sinthuja Ragendran > wrote: > >> Hi Nuwan, >> >> On Tue, May 12, 2015 at 5:32 PM, Nuwan Dias wrote: >> >>> Aren't we tightly

Re: [Architecture] Privileged user sending events to DAS/CEP as tenant

2015-05-12 Thread Sinthuja Ragendran
Hi sanjeewa, On Tue, May 12, 2015 at 7:39 PM, Sanjeewa Malalgoda wrote: > > > On Tue, May 12, 2015 at 7:18 PM, Sinthuja Ragendran > wrote: > >> Hi sanjeewa, >> >> On Tue, May 12, 2015 at 7:02 PM, Sanjeewa Malalgoda >> wrote: >> >>> >&

Re: [Architecture] Privileged user sending events to DAS/CEP as tenant

2015-05-13 Thread Sinthuja Ragendran
achieve the above, what should be > the recommended way of getting it done? i.e. What would be the best place > to publish the data to and where should the analytics run? > > Thanks, > NuwanD. > > On Wed, May 13, 2015 at 2:18 AM, Sinthuja Ragendran > wrote: > &

Re: [Architecture] Privileged user sending events to DAS/CEP as tenant

2015-05-13 Thread Sinthuja Ragendran
post APIM 1.9 release and properly design monitoring solution with DAS dashboard support. Thanks, Sinthuja. Thanks, NuwanD. > > On Wed, May 13, 2015 at 7:51 PM, Sinthuja Ragendran > wrote: > >> Hi all, >> >> We (anjana and me) had an internal discussion of going

Re: [Architecture] [DAS][APIM] DAS REST API evaluation for use with APIM

2015-07-27 Thread Sinthuja Ragendran
Hi, One of the main feature of DAS is being decoupled from underline datastore, basically an user should be able to configure RDBMS, cassandra, Hbase/HDFS datastore, the client applications nor analyzation scripts are not necessarily need to change. In APIM 1.9.x and before, we stored the summar

Re: [Architecture] [DAS][APIM] DAS REST API evaluation for use with APIM

2015-07-28 Thread Sinthuja Ragendran
he score function > "aggregating field") since aggregates like AVG are not supported. > > As Gihan said, I think Spark SQL will more suitable for this scenario. It > support basic aggregates and if a custom function required, we can write a > UDF. > > Thanks, > > On

Re: [Architecture] Basic WSO2 Developer Studio tooling support for BAM

2013-06-23 Thread Sinthuja Ragendran
On Mon, Jun 24, 2013 at 10:55 AM, Ayashkantha Ramasinghe < ayashkan...@wso2.com> wrote: > Hi, > > The following features are going to be added in the initial stage of > having the Developer Studio support to create toolboxes to BAM. > > 1. Hive Editor. > 2. Jaggery Editor. > 3. UI to create Stream

Re: [Architecture] Need to upgrade to new Cassandra

2013-07-01 Thread Sinthuja Ragendran
We need to upgrade the hive also. Currently in BAM we are using the hive 0.8.1, but the latest release is 0.11.0. Latest hive uses the thrift version - 0.9 but the cassandra uses thrfit version - 0.7 which may cause incompatibility of both working together in BAM. In past we had similar problem an

Re: [Architecture] Annotation scheme for Hive scripts

2013-07-08 Thread Sinthuja Ragendran
Whether the annotation variables' scope is within hive query? or it's within the hive script? or it's global scope such that all hive scripts can use it, For an example there might be situations where user is interested in defining some variables to the entire script, and some are local to the hiv

Re: [Architecture] JMX Agent Discussion Notes

2013-07-18 Thread Sinthuja Ragendran
On Thu, Jul 18, 2013 at 3:26 PM, Sriskandarajah Suhothayan wrote: > We can make this a Input Transport Adaptor that returns WSO2Events as > output, then we can have one agent common for both CEP and BAM, > > WDYT? > +1. Alerting will be incorporated with KPI monitoring feature for BAM. And during

Re: [Architecture] Mock up screens for BAM events & activity search

2013-07-25 Thread Sinthuja Ragendran
Hi, +1 for Anjana's suggestion for activity search. For the event search isn't it better that we make the UI generic for cassandra data search, rather stream's events search? Ie, instead of StreamName we can provide the Columnfamily name, so on. And version field also can be omitted, if it's req

Re: [Architecture] Mock up screens for BAM events & activity search

2013-07-25 Thread Sinthuja Ragendran
then we'll have it as event/streams based search. +1. Thanks, Sinthuja. > > Cheers, > Anjana. > > > On Thu, Jul 25, 2013 at 5:18 PM, Sinthuja Ragendran wrote: > >> Hi, >> >> +1 for Anjana's suggestion for activity search. >> >> For t

Re: [Architecture] Car File Deployer - BAM

2013-08-02 Thread Sinthuja Ragendran
Hi Ayashkantha, You should use the first approach IMO. We don't need duplicate the code for deploying the toolboxes. It'll become unmanageable and it won't be consistent also. Generally we follow the first method, as cApp will copy the artifacts in the respective servers' deployment directory, an

Re: [Architecture] [Dev][BAM] Defining stream properties to be indexed for BAM events & activity search

2013-08-07 Thread Sinthuja Ragendran
Hi Gihan, On Wed, Aug 7, 2013 at 12:07 PM, Gihan Anuruddha wrote: > Hi Inosh, > > There can be a situation that we might need to use secondary indexes > without any toolboxes. How we define secondary indexes in such a situation > ? > In the initial stages of discussion for this topic, this re

Re: [Architecture] [Dev][BAM] Defining stream properties to be indexed for BAM events & activity search

2013-08-07 Thread Sinthuja Ragendran
Hi Gokul, On Wed, Aug 7, 2013 at 1:46 PM, Balakrishnan Gokulakrishnan wrote: > Hi Inosh, > > IMO the index properties should ideally be defined at the time of the > column family creation itself, and as the column family creation takes > place based on the stream definition is it not logical to

Re: [Architecture] BAM Data Archival Feature improvements

2013-09-03 Thread Sinthuja Ragendran
Hi, On Wed, Sep 4, 2013 at 11:22 AM, Shariq Muhammed wrote: > On Wed, Sep 4, 2013 at 10:58 AM, Bhathiya Jayasekara wrote: > >> Hi all, >> >> How about deleting archived data? As I remember, this requirement came up >> recently. IMO it's good to have a archive-delete feature which can >> be sche

Re: [Architecture] Hive handler to push events to JMS queue

2013-09-17 Thread Sinthuja Ragendran
Hi Maninda, We have output transport adopters which basically converts the streams to the respective transports such as JMS, etc according the current architecture. AFAIK there is already a JMS transport adopter. And therefore we need to write a Hive handler to write to the streams, rather JMS que

[Architecture] Re-factoring BAM/CEP Datapublisher

2014-01-17 Thread Sinthuja Ragendran
Hi all, I'm in the process of merging the changes of AsyncDataPublisher with DataPublisher and hence make our DataPublisher do asynchronous calls on main operations; not only publish but also in connecting to receiver, define stream, etc. This effort is for improve performance in client side and r

Re: [Architecture] Re-factoring BAM/CEP Datapublisher

2014-01-17 Thread Sinthuja Ragendran
il if the stream is not defined. So after some processing it'll drop, not immediately. Thanks, Sinthuja > > Thanks, > Lasantha > > > On 17 January 2014 18:08, Sinthuja Ragendran > > > wrote: > >> Hi all, >> >> I'm in the process of merging th

Re: [Architecture] Re-factoring BAM/CEP Datapublisher

2014-01-19 Thread Sinthuja Ragendran
Hi lasantha, On Sun, Jan 19, 2014 at 2:16 AM, Lasantha Fernando wrote: > Hi Sinthuja, > > Thanks for the explanations. > > > On 17 January 2014 21:16, Sinthuja Ragendran wrote: > >> Hi lasantha, >> >> Thanks for your suggestions. Please see my comments

Re: [Architecture] Re-factoring BAM/CEP Datapublisher

2014-01-20 Thread Sinthuja Ragendran
Hi, Srinath, suho and myself had a discussion on above and agreed to go with approach #2 for during the publish events. Thanks, Sinthuja. On Mon, Jan 20, 2014 at 10:47 AM, Sinthuja Ragendran wrote: > Hi lasantha, > > > On Sun, Jan 19, 2014 at 2:16 AM, Lasantha Fernando wr

Re: [Architecture] Should we have one place to define event streams?

2014-01-20 Thread Sinthuja Ragendran
Hi, On Mon, Jan 20, 2014 at 5:36 PM, Maninda Edirisooriya wrote: > Already BAM can create streams with REST API. To facilitate further for a > person configuring BAM manually without a toolbox, we should provide a UI > to create streams. > CEP already has UI to create streams [1], I think it's

[Architecture] [Update] Incremental Processing for BAM

2014-02-10 Thread Sinthuja Ragendran
Hi all, I was working on providing the incremental processing support for BAM. This feature was implemented in BAM 2.4.0 [1], but it wasn't well tested in fully distributed mode during the BAM 2.4.0 release, hence it was marked as experimental feature. You can find the implementation details of th

Re: [Architecture] [Update] Incremental Processing for BAM

2014-02-10 Thread Sinthuja Ragendran
ve been changed and we can push this for later releases. :) Anjana, Please confirm. Thanks, Sinthuja. > > --Srinath > > > On Mon, Feb 10, 2014 at 2:42 PM, Sinthuja Ragendran wrote: > >> Hi all, >> >> I was working on providing the incremental processing sup