Re: [Architecture] DAS Support for Mesos

2017-02-22 Thread Sachith Withana
ay we can test this locally? How did you use it? [1] https://dcos.io/install/ Thanks, Sachith On Wed, Feb 22, 2017 at 5:14 PM, Imesh Gunaratne wrote: > Hi Sachith, > > On Wed, Feb 22, 2017 at 2:33 PM, Sachith Withana wrote: >> >> >> My question is, are we going to sup

[Architecture] DAS Support for Mesos

2017-02-22 Thread Sachith Withana
widely used. What are we planning to use in our docker deployments? This would dominate which one we choose as well. [1] https://dcos.io/ Thanks, Sachith -- Sachith Withana Software Engineer; WSO2 Inc.; http://wso2.com E-mail: sachith AT wso2.com M: +94715518127 Linked-In: <http://goog_416592

Re: [Architecture] [C5] Spark/Lucene Integration in Stream Processor

2016-10-23 Thread Sachith Withana
earner >>> Associate Technical Lead - Data Technologies Team, WSO2 Inc. >>> Mobile: +94715779733 >>> Blog: http://nirmalfdo.blogspot.com/ >>> >>> >>> >> >> >> -- >> >> *S. Suhothayan* >> Associate Director / A

Re: [Architecture] Caching Real time analytics data

2016-07-06 Thread Sachith Withana
Thanks Suho and Sinthuja. This was just a suggestion to improve upon what I experienced :) Regards, Sachith On Wed, Jul 6, 2016 at 3:20 PM, Sinthuja Ragendran wrote: > Hi Sachith, > > On Wed, Jul 6, 2016 at 11:19 PM, Sachith Withana wrote: > >> Agreed Sinthuja. >>

Re: [Architecture] Caching Real time analytics data

2016-07-06 Thread Sachith Withana
huja. > > On Wed, Jul 6, 2016 at 10:12 PM, Sachith Withana wrote: > >> Hi all, >> >> In the dashboard, the real time data is only shown if the user is logged >> into the dashboard at the time of the data is being pushed. >> >> If the data is being pushed

[Architecture] Caching Real time analytics data

2016-07-06 Thread Sachith Withana
refreshes, then has to wait another hour to see the data, and would loose the current data completely. I understand from the CEP perspective it's similar to fire and forget, but can't we add some level of caching to prevent this? Regards, Sachith -- Sachith Withana Software Engineer; WSO2

Re: [Architecture] Incremental data processing from last event onward[Without buffer]

2016-06-08 Thread Sachith Withana
ke >>>> necessary changes to back-end. >>>> >>>> *create temporary table t5 using CarbonAnalytics options (tableName >>>> "t3", schema "x INT, y INT", incrementalParams "t5, -1");* >>>> >>>> Basicall

Re: [Architecture] Data Isolation level for Data from APIM and IoT? Tenant vs. User

2016-03-28 Thread Sachith Withana
ome.apache.org/~hemapani/ >>> >>>> Photos: http://www.flickr.com/photos/hemapani/ >>> >>>> Phone: 0772360902 >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> -- >>> >

Re: [Architecture] Incremental Processing Support in DAS

2016-03-24 Thread Sachith Withana
time windows and re-calculate whole average based on values of > all time windows? Is so, I would guess we can update previously processed > time windows sum and count values. > > > On Thu, Mar 24, 2016 at 3:50 AM, Sachith Withana wrote: > >> Hi Srinath, >> >> P

Re: [Architecture] [Dev] [REST APIs][Analytics] GET request with a payload

2016-03-24 Thread Sachith Withana
t; >>> ___ >>> Dev mailing list >>> d...@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> >> *Sanjeewa Malalgoda* >> WSO2 Inc

Re: [Architecture] Incremental Processing Support in DAS

2016-03-24 Thread Sachith Withana
to improve those messages. Thanks, Sachith > > --Srinath > > On Mon, Mar 21, 2016 at 5:15 PM, Sachith Withana wrote: > >> Hi all, >> >> We are adding incremental processing capability to Spark in DAS. >> As the first stage, we added time slicing to Spark ex

Re: [Architecture] Incremental Processing Support in DAS

2016-03-23 Thread Sachith Withana
Hi Sinthuja, Please find the comments inline. On Wed, Mar 23, 2016 at 6:50 PM, Sinthuja Ragendran wrote: > Hi Sachith, > > On Mon, Mar 21, 2016 at 5:15 PM, Sachith Withana wrote: > >> Hi all, >> >> We are adding incremental processing capability to Spark in

Re: [Architecture] [Analytics for APIM] Integration Tests to cover Alerting scripts

2016-03-23 Thread Sachith Withana
t;> >>> +1 looks good, for testing prepuces we can also deploy some related >>> executionplans, stream and publishers to tap intermediate analytics >>> results. >>> >>> Regards >>> Suho >>> >>> On Wed, Feb 24, 2016 at 1:44 PM,

[Architecture] Incremental Processing Support in DAS

2016-03-21 Thread Sachith Withana
gregation function support for incremental processing Thanks, Sachith -- Sachith Withana Software Engineer; WSO2 Inc.; http://wso2.com E-mail: sachith AT wso2.com M: +94715518127 Linked-In: <http://goog_416592669>https://lk.linkedin.com/in/sachithwithana _

Re: [Architecture] [Analytics][APIM] - Implement Geo location graph in Analytics

2016-03-05 Thread Sachith Withana
y as other columns and retrieve >>> data from that table. >>> >>> >>> Please feel free to give us the most suitable way of doing this >>> solution?. >>> >>> [1] - Implementing Geographical based Analytics in API Manager mail >>> thread. >>> &g

Re: [Architecture] [Analytics for APIM] Abnormal Renewal - Access Tokens

2016-02-28 Thread Sachith Withana
Because statistically "average" is something which is > affected by an outlier (in this case, if the token has expired, user > *must* renew it, this renewal action might deviate from the usual renewal > pattern). > > Thanks. > > On Fri, Feb 26, 2016 at 3:21 PM, Sachith Witha

[Architecture] [Analytics for APIM] Abnormal Renewal - Access Tokens

2016-02-26 Thread Sachith Withana
doesn't, a pre-configured alert would be sent out. WDYT? Thanks, Sachith -- Sachith Withana Software Engineer; WSO2 Inc.; http://wso2.com E-mail: sachith AT wso2.com M: +94715518127 Linked-In: <http://goog_416592669>https://lk.linkedin.com/in/sac

[Architecture] [Analytics for APIM] Integration Tests to cover Alerting scripts

2016-02-24 Thread Sachith Withana
listening to the Alert Stream. FYI: currently we are planning to publish all the APIM analytics alerts to a single stream, which would be observed by all the tests. WDYT? Thanks, Sachith -- Sachith Withana Software Engineer; WSO2 Inc.; http://wso2.com E-mail: sachith AT wso2.com M: +94715518127

Re: [Architecture] [Analytics for APIM] Unusual request IP detection

2016-02-17 Thread Sachith Withana
u, Feb 18, 2016 at 12:17 PM, Sachith Withana > wrote: > >> Hi all, >> >> I'm working on Request source IP change alerting for APIM analytics - If >> the source IP is different from the usual IP range of a access token >> bearer, we should send an alert out

[Architecture] [Analytics for APIM] Unusual request IP detection

2016-02-17 Thread Sachith Withana
inst it. WDYT? Thanks, Sachith -- Sachith Withana Software Engineer; WSO2 Inc.; http://wso2.com E-mail: sachith AT wso2.com M: +94715518127 Linked-In: <http://goog_416592669>https://lk.linkedin.com/in/sachithwithana ___ Architecture mailing list

Re: [Architecture] [APIM][Analytics] Health monitor for APIM as a separate Java client

2016-02-15 Thread Sachith Withana
er, Apache Stratos, >>> Senior Software Engineer, >>> WSO2 Inc., http://wso2.com >>> lean.enterprise.middleware >>> >>> phone: +94773325954 >>> email: lahi...@wso2.com blog: http://lahiruwrites.blogspot.com/ >>> linked-in: http://lk.linkedi

Re: [Architecture] WSO2 Data Analytics Server 3.0.1 Released!

2016-01-18 Thread Sachith Withana
[+announce] On Tue, Jan 19, 2016 at 11:14 AM, Sachith Withana wrote: > WSO2 Data Analytics Server (DAS) v3.0.1 Released! > > WSO2 Data Analytics Server development team is pleased to announce the > release of WSO2 Data Analytics Server 3.0.1 > > WSO2 Data Analytics Server

[Architecture] WSO2 Data Analytics Server 3.0.1 Released!

2016-01-18 Thread Sachith Withana
he very same engineers who build the technology. For more details and to take advantage of this unique opportunity please visit http://wso2.com/support. For more information about WSO2 DAS please see wso2.com/products/data-analytics-server. *-- The WSO2 DAS Team --* -- Sachith Withana So

Re: [Architecture] Deploying gadgets with the same name for CApps.

2015-11-11 Thread Sachith Withana
: > Under a single tenant, what's the usage of having two X named gadgets? > > On Wed, Nov 11, 2015 at 1:56 PM, Sachith Withana wrote: > >> Hi all, >> >> Currently in the CApp deployment, the gadgets and the layout are copied >> to gadget or layout dire

Re: [Architecture] Deploying gadgets with the same name for CApps.

2015-11-11 Thread Sachith Withana
On Wed, Nov 11, 2015 at 2:10 PM, Malith Dhanushka wrote: > Does the current model shows the gadgets created by one tenant to another > tenant? > No. > > On Wed, Nov 11, 2015 at 1:56 PM, Sachith Withana wrote: > >> Hi all, >> >> Currently in the CApp deploy

[Architecture] Deploying gadgets with the same name for CApps.

2015-11-11 Thread Sachith Withana
be multiple gadgets with the same name appearing in the dashboard. Any thoughts on how we could solve this issue? -- Sachith Withana Software Engineer; WSO2 Inc.; http://wso2.com E-mail: sachith AT wso2.com M: +94715518127 Linked-In: <http://goog_416592669>https://lk

Re: [Architecture] Component level description of the log analyzer tool

2015-10-25 Thread Sachith Withana
"auth" => "-", > "timestamp" => "11/Dec/2013:00:01:45 -0800", > "verb" => "GET", >"request" => "/xampp/status.php", >"httpversion" => "1.1", &

[Architecture] [DAS] Backup Tool for backing up records + indexes

2015-09-22 Thread Sachith Withana
em and allows a backed up DAS system to be restored into a new one using the backup tool. Thanks, Sachith Withana -- Sachith Withana Software Engineer; WSO2 Inc.; http://wso2.com E-mail: sachith AT wso2.com M: +94715518127 Linked-In: <http://goog_416592669>https://lk.linkedin.

Re: [Architecture] [DAS] Modifying the migration tool to use Hector replacing CQL

2015-09-21 Thread Sachith Withana
any new development DataStax recommends using CQL > over Hector. (unsure if that's relevant here) > > On Sun, Sep 20, 2015 at 8:49 AM, Bhathiya Jayasekara > wrote: > >> Hi Sachith, >> >> On Wed, Sep 16, 2015 at 4:13 AM, Sachith Withana >> wrote: >&g

Re: [Architecture] [DAS] Modifying the migration tool to use Hector replacing CQL

2015-09-16 Thread Sachith Withana
Yes. We are shipping the tool with DAS. On Wed, Sep 16, 2015 at 1:52 PM, Malith Dhanushka wrote: > I mean are we shipping this with DAS as a default tool? > > On Wed, Sep 16, 2015 at 1:43 PM, Sachith Withana wrote: > >> @Malith >> What do you mean as a generic tool?

Re: [Architecture] [DAS] Modifying the migration tool to use Hector replacing CQL

2015-09-16 Thread Sachith Withana
s >> well. Because anyone who has Cassandra raw data can use this tool to >> persist them in any file store facilitated by DAL. Given the fact, is it >> worth the effort implementing this as a generic tool? WDUT? >> >> Thanks, >> Malith >> >> On We

Re: [Architecture] Adding/Managing Sensor information on CDMF

2015-09-15 Thread Sachith Withana
, > *Ayyoob Hamza* > *Software Engineer* > WSO2 Inc.; http://wso2.com > email: ayy...@wso2.com cell: +94 77 1681010 <%2B94%2077%207779495> > > ___ > Architecture mailing list > Architecture@wso2.org > https://mail.wso2.org/cg

[Architecture] [DAS] Modifying the migration tool to use Hector replacing CQL

2015-09-15 Thread Sachith Withana
. Thanks, Sachith -- Sachith Withana Software Engineer; WSO2 Inc.; http://wso2.com E-mail: sachith AT wso2.com M: +94715518127 Linked-In: <http://goog_416592669>https://lk.linkedin.com/in/sachithwithana ___ Architecture mailing list Architecture@wso2.org