[Architecture] [esb-analytics] Individual Message Search

2016-03-29 Thread Supun Sethunga
like to know, when we are purging the raw data in DAS (say, per-event-data came few months back), does it also clear any indexed information as well, which originated from the purged data? Regards, Supun -- *Supun Sethunga* Software Engineer WSO2, Inc. http://wso2.com/ lean | enterprise

Re: [Architecture] [esb-analytics] Individual Message Search

2016-03-29 Thread Supun Sethunga
s well will > be deleted. > > Cheers, > Anjana. > > On Tue, Mar 29, 2016 at 10:48 PM, Supun Sethunga wrote: > >> Hi all, >> >> As came-up during previous meetings, there was a requirement to do >> $subject, when we list down the messages come to a Proxy/API/

Re: [Architecture] [esb-analytics] Individual Message Search

2016-03-29 Thread Supun Sethunga
-envelope <http://www.w3.org/2003/05/soap-envelope>">* ** ** As you can see, the body is not there. So a user cannot really search for a message, at the proxy page (didn't test with a API though). Can you please have a look? Thanks, Supun On Wed, Mar 30, 2016 at 8:48 AM,

Re: [Architecture] [esb-analytics] Individual Message Search

2016-03-29 Thread Supun Sethunga
pe. For pass-through scenarios you can > observe the same. > > Thank You, > > On Wed, Mar 30, 2016 at 11:38 AM, Supun Sethunga wrote: > >> Hi Viraj/Buddhima, >> >> When doing $subject, I noticed that for a message coming to a proxy with >> some payload, at the pr

Re: [Architecture] Deployable Artifact Model

2016-03-31 Thread Supun Sethunga
adsheets/d/1Lm5xSmXOG1dDEXGPOthI7nnsjwjKt-apwj77SjxB3Fg/edit?usp=sharing > > -- > *Nethaji Chandrasiri* > *Software Engineering* *Intern; WSO2, Inc.; http://wso2.com > <http://wso2.com/>* > Mobile : +94 (0) 779171059 <%2B94%20%280%29%20778%20800570> > Email : neth...@wso2.

[Architecture] [analytics-esb] Summary Stat Generation Mechanism

2016-04-19 Thread Supun Sethunga
*. As a further improvement, we would be trying out to do summarizing upto minute/hour level (eventually do all the summarizing using siddhi). [1] [Dev] ESB Analytics - Verifying the common production use cases [2] https://wso2.org/jira/browse/ANLYESB-15 Thanks, Supun -- *Supun Sethunga* Software

[Architecture] [VOTE] Release WSO2 Machine Learner 1.1.1 RC1

2016-07-29 Thread Supun Sethunga
=13175 [3] *https://github.com/wso2/product-ml/releases/tag/v1.1.1-rc1 <https://github.com/wso2/product-ml/releases/tag/v1.1.1-rc1>* Please vote as follows. [+] Stable - go ahead and release [-] Broken - do not release (please explain why) Thanks, WSO2 ML Team -- *Supun Sethunga* Senior So

Re: [Architecture] [VOTE] Release WSO2 Machine Learner 1.1.1 RC1

2016-08-01 Thread Supun Sethunga
[-] Calling off the vote as we have encountered some issues with the ml ui jaggery app. url mappings are broken. We will start a new vote soon. Regards, Supun On Sat, Jul 30, 2016 at 8:30 AM, Supun Sethunga wrote: > Hi Devs, > > This is the 1st Release Candidate of the WSO2 Machin

[Architecture] APIM Analytics - Performance Results

2016-08-16 Thread Supun Sethunga
template, including the advanced details about the setups and the configs. [1] https://docs.google.com/spreadsheets/d/1vVRPp8b31DccJ1A6p9MRGxzmLAX2yiGAebT25kpsLzg/edit#gid=0 Regards, Supun -- *Supun Sethunga* Senior Software Engineer WSO2, Inc. http://wso2.com/ lean | enterprise | middleware

Re: [Architecture] APIM Analytics - Performance Results

2016-08-19 Thread Supun Sethunga
55 PM, Sanjeewa Malalgoda wrote: > > > On Tue, Aug 16, 2016 at 10:43 PM, Harsha Kumara wrote: > >> >> >> On Tue, Aug 16, 2016 at 5:29 PM, Supun Sethunga wrote: >> >>> Hi all, >>> >>> We carried out some performance tests for APIM

Re: [Architecture] APIM Analytics - Performance Results

2016-08-21 Thread Supun Sethunga
gt;> >> mobile: +94 77 2273550 >> blog: http://sajithr.blogspot.com/ >> <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab> >> >> On Sun, Aug 21, 2016 at 11:27 AM, Imesh Gunaratne wrote: >> >>> >>> >>> On Fri, Aug 19

[Architecture] [VOTE] Release WSO2 Machine Learner 1.2.0 RC1

2016-09-06 Thread Supun Sethunga
.org/jira/issues/?filter=13325 [3] https://github.com/wso2/product-ml/releases/tag/v1.2.0-rc1 Please vote as follows. [+] Stable - go ahead and release [-] Broken - do not release (please explain why) Thanks, WSO2 ML Team -- *Supun Sethunga* Senior Software Engineer WSO2, Inc. http://wso2.com

[Architecture] Training ML Models with Python on DAS/Analytics Tables

2016-09-14 Thread Supun Sethunga
emory, and then train sklearn algorithms on top of that. A sample python script can b found at [1]. [1] https://github.com/SupunS/play-ground/blob/master/pyspark/PySpark-Sample.ipynb -- *Supun Sethunga* Senior Software Engineer WSO2, Inc. http://wso2.com/ lean | enterprise | middleware Mobile

Re: [Architecture] Training ML Models with Python on DAS/Analytics Tables

2016-09-14 Thread Supun Sethunga
. > > On Thu, Sep 15, 2016 at 7:46 AM, Srinath Perera wrote: > >> Thanks Supun! I believe this would work. >> >> I assume same will work with python scripts ( without notebooks as well). >> >> --Srinath >> >> >> >> On Wed, Sep 14, 201

Re: [Architecture] Training ML Models with Python on DAS/Analytics Tables

2016-09-14 Thread Supun Sethunga
u, Sep 15, 2016 at 11:23 AM, Supun Sethunga wrote: > Yes, python script also works, without the notebook. > > in python script (.py) scenario, there will be no sparkContext created by > default. Can run the scipt as follows: > > > On Thu, Sep 15, 2016 at 9:55 AM, Nirmal Fernan

[Architecture] WSO2 Machine Learner (ML) 1.2.0 Released!

2016-09-15 Thread Supun Sethunga
engineers who build the technology. For more details and to take advantage of this unique opportunity please visit http://wso2.com/support. Regards, ~ WSO2 ML Team ~ -- *Supun Sethunga* Senior Software Engineer WSO2, Inc. http://wso2.com/ lean | enterprise | middleware Mobile :

Re: [Architecture] [Progress] Use Machine Learning for Predictive Maintenance

2016-09-19 Thread Supun Sethunga
0715894672 > a: No 3/56, Aluthgama Rd, Elpitiya. > e: rosh...@wso2.com > <https://web.facebook.com/alwisroshan> <https://twitter.com/rm_alwis> > <https://lk.linkedin.com/in/roshanalwis> > > > ___ > Architectur

[Architecture] Machine Learning using Apache Mahout for WSO2 BAM

2014-06-29 Thread Supun Sethunga
first step is completed for now. Any feedback is highly appreciated. Thanks, Supun -- *Supun Sethunga* Software Engineer WSO2, Inc. lean | enterprise | middleware Mobile : +94 716546324 ___ Architecture mailing list Architecture@wso2.org https://mail.wso2

Re: [Architecture] Machine Learning using Apache Mahout for WSO2 BAM

2014-07-23 Thread Supun Sethunga
anted to explore that more. >>>>> >>>>> However, It is not a simple UDF as this is a stateful op where we feed >>>>> lot of data and start a separate map reduce process. Anjana, do you have >>>>> any thoughts on how it can be done? >

Re: [Architecture] Machine Learning using Apache Mahout for WSO2 BAM

2014-07-23 Thread Supun Sethunga
s for the purpose? Can explain a bit how it's done? > > > On Wed, Jul 23, 2014 at 5:30 PM, Supun Sethunga wrote: > >> Hi, >> >> The back-end service for the $subject has been implemented. For the time >> being, it supports three algorithms (Naive Bayes, Logis

[Architecture] Sample Scenario of Machine Learning - With '0xdata'

2014-08-08 Thread Supun Sethunga
Hi, Attached is a sample end-to-end scenario on using "0xdata" for Machine Learning. ​ Machine learning with 0xData - Sample Scenario <https://docs.google.com/a/wso2.com/presentation/d/1Big1ul5Af7QA5yfycRpPMOoP7xvyoGZ3Alcf3X3Gfpc/edit?usp=drive_web> ​ Regards, Supun --

[Architecture] Machine Learning Workflow

2014-08-12 Thread Supun Sethunga
Hi Srinath, Attached is a proposed work-flow for the ML design came up by Lochana, Upul and me. Appreciate any comments. Regards, Supun -- *Supun Sethunga* Software Engineer WSO2, Inc. lean | enterprise | middleware Mobile : +94 716546324

Re: [Architecture] Machine Learning Workflow

2014-08-12 Thread Supun Sethunga
[adding Lochana] On Tue, Aug 12, 2014 at 6:05 PM, Supun Sethunga wrote: > Hi Srinath, > > Attached is a proposed work-flow for the ML design came up by Lochana, > Upul and me. > > Appreciate any comments. > > Regards, > Supun > > -- > *Supun Sethunga* >

Re: [Architecture] Machine Learning Workflow

2014-08-12 Thread Supun Sethunga
: http://en.wikipedia.org/wiki/Feature_scaling > > Regards, > Anuruddha. > > > > On Tue, Aug 12, 2014 at 8:55 PM, Supun Sethunga wrote: > >> [adding Lochana] >> >> >> On Tue, Aug 12, 2014 at 6:05 PM, Supun Sethunga wrote: >> >>> Hi S

Re: [Architecture] WSO2 Machine Learner - "Project" Concept

2014-10-29 Thread Supun Sethunga
erent colors/shapes. Such visualizations can also assist in > selecting better algorithms or tuning parameters. > > Regards, > Chathura > > > On Wed, Oct 29, 2014 at 11:54 AM, Supun Sethunga wrote: > >> Hi, >> >> Follow are the features of the "project" co

Re: [Architecture] WSO2 Machine Learner - "Project" Concept

2014-11-02 Thread Supun Sethunga
=sharing Regards, Supun On Mon, Nov 3, 2014 at 8:26 AM, Chathura Ekanayake wrote: > > > On Thu, Oct 30, 2014 at 11:22 AM, Supun Sethunga wrote: > >> Hi Chathura, >> >> Can there be a requirement to maintain subsets of the initial dataset >>> under a proje

Re: [Architecture] WSO2 Machine Learner - "Project" Concept

2014-11-04 Thread Supun Sethunga
algorithm) is finalized. Thanks, Supun On Tue, Nov 4, 2014 at 1:54 PM, Srinath Perera wrote: > This look good. > > Did we get UI feedback? > Also, ML runs should run async and send an email when done. > > --Srinath > > > On Wed, Oct 29, 2014 at 11:54 AM, Sup

[Architecture] WSO2 ML 1.0.0 Milestone 1 Released

2015-03-23 Thread Supun Sethunga
Flows - https://docs.wso2.com/display/ML100/Samples Please report any issues you may find in our Jira https://wso2.org/jira/browse/ML [1] https://github.com/wso2/product-ml/releases/download/1.0.0-m1/wso2ml-1.0.0-SNAPSHOT.zip Regards, -- *Supun Sethunga* Software Engineer WSO2, Inc. http://wso2

Re: [Architecture] ESB Mediator for WSO2 Machine Learner

2015-03-24 Thread Supun Sethunga
o the mediator >> should be configured only to mediate messages which carry data coming from >> the same domain, as the data used to train the model. >> >> Any suggestion are appreciated. >> >> Thanks. >> >> -- >> Manorama Perera >> Software Engineer >> WSO2, Inc.; http://wso2.com/ >> M

Re: [Architecture] ML Model Summary Illustration and Comparison

2015-04-30 Thread Supun Sethunga
[-strategy@, +architecture@] On Thu, Apr 30, 2015 at 5:58 PM, Srinath Perera wrote: > should go to arch@ > > On Thu, Apr 30, 2015 at 6:28 AM, Srinath Perera wrote: > >> Thanks Supun!! this looks good. >> >> --Srinath >> >> On Thu, Apr 30, 2015 at 6:2

Re: [Architecture] ML Model Summary Illustration and Comparison

2015-04-30 Thread Supun Sethunga
5 at 8:33 AM, Supun Sethunga wrote: > >> [-strategy@, +architecture@] >> >> On Thu, Apr 30, 2015 at 5:58 PM, Srinath Perera wrote: >> >>> should go to arch@ >>> >>> On Thu, Apr 30, 2015 at 6:28 AM, Srinath Perera >>> wrote: >>&g

Re: [Architecture] Time Series using Apache Spark

2015-08-12 Thread Supun Sethunga
/spark-timeseries/blob/master/src/main/scala/com/cloudera/sparkts/ARIMA.scala [2] https://docs.google.com/a/wso2.com/document/d/1pcGT620Fjms9gxmyn85mNP93oye_5xxCBhtqvE6iAAw/edit?usp=sharing Thanks, Supun On Wed, Jul 29, 2015 at 2:21 AM, Supun Sethunga wrote: > Sure Srinath. By the look of it, se

Re: [Architecture] Time Series using Apache Spark

2015-08-13 Thread Supun Sethunga
> Wizard for user to do it). However, #3 we need to do from CEP, as the data > arrives. Is that possible to take the code from the project to do #3 as > well? > > --Srinath > > > On Thu, Aug 13, 2015 at 3:39 AM, Supun Sethunga wrote: > >> [Moving the discussion to

Re: [Architecture] Implement Ensemble behaviour in CEP Extension for Machine Learner Predictions

2015-09-24 Thread Supun Sethunga
SB-ML extension. > > Thoughts are welcome! > > > -- Forwarded message -- > From: Manorama Perera > Date: Thu, May 14, 2015 at 3:35 PM > Subject: CEP Extension for Machine Learner Predictions > To: architecture > Cc: Nirmal Fernando , Srinath Perera , >

[Architecture] Spark Pipeline Support for ML

2016-01-18 Thread Supun Sethunga
ark.client_2/src/main/java/SVMClassifier.java Regards, Supun -- *Supun Sethunga* Software Engineer WSO2, Inc. http://wso2.com/ lean | enterprise | middleware Mobile : +94 716546324 ___ Architecture mailing list Architecture@wso2.org https://mail.wso2.or

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-09 Thread Supun Sethunga
: > Hi Kasun, > > On Tue, Feb 9, 2016 at 10:10 AM, Kasun Indrasiri wrote: > >> I think for trancing use case we need to publish events one by one from >> each mediator (we can't aggregate all such events as it also contains the >> message payload) >> >

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-09 Thread Supun Sethunga
tId': '222', > 'componentName': 'Proxy:TestProxy', > 'payload': '*payload1*', > 'output-payload':null > }, { > 'messageId': 'ccc', > 'componentId': '789', > 'payload': '*payload

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-09 Thread Supun Sethunga
> Thanks, > Sinthuja. > > On Wed, Feb 10, 2016 at 11:26 AM, Sinthuja Ragendran > wrote: > >> Hi Supun, >> >> >> On Wed, Feb 10, 2016 at 11:14 AM, Supun Sethunga wrote: >> >>> Hi Sinthuja, >>> >>> Agree on the possibility

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-15 Thread Supun Sethunga
forePayload": null, "afterPayload": null, "contextPropertyMap": null, "transportPropertyMap": null, "children": 0, "entryPoint": "Test Proxy" }], "payloads": [{ "payload": "http://www.w3.org/2003/05/soap-en

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-16 Thread Supun Sethunga
ON_STRING" > - Supun, according to the stream definition ""children": 1," what it >represents ? > > > On Mon, Feb 15, 2016 at 9:15 PM, Supun Sethunga wrote: > >> Hi Dunith, Gihan, >> >> As per the offline chat had with Buddhi

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-18 Thread Supun Sethunga
Will it be possible to define new type like "commpressedJSON" to achive > this? WDYT about this idea? > > Thank You, > > On Wed, Feb 17, 2016 at 9:38 AM, Supun Sethunga wrote: > >> Hi Dushan, >> >> Supun, according to the stream definition

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-24 Thread Supun Sethunga
24, 2016 at 11:25 AM, Sanjiva Weerawarana wrote: > Why are we inventing a new event format for this? Why not use a stream > definition and publish using Thrift? > > Sorry if I'm missing something here. > > On Fri, Feb 19, 2016 at 11:44 AM, Supun Sethunga wrote: > >> H

Re: [Architecture] ESB Analytics Mediation Event Publishing Mechanism

2016-02-24 Thread Supun Sethunga
M, Sanjiva Weerawarana >> wrote: >> >>> Why are we inventing a new event format for this? Why not use a stream >>> definition and publish using Thrift? >>> >>> Sorry if I'm missing something here. >>> >>> On Fri, Feb 19, 2016 a

[Architecture] [ESB Analytics] Managing stats/graphs when Proxy/API is updated

2016-02-29 Thread Supun Sethunga
. (In future, we may improve on to let the user pick which version they want to view) Please let us know whether we can go with this approach, or if there are any concerns. [1] https://docs.google.com/document/d/15BdqOkQFZFYsfF0x7x4amgaIhZGoHkIwgKOoSI83ZzI/edit#heading=h.3nul0izb3nne Rega

Re: [Architecture] [ESB Analytics] Managing stats/graphs when Proxy/API is updated

2016-03-01 Thread Supun Sethunga
upun On Mon, Feb 29, 2016 at 5:56 PM, Supun Sethunga wrote: > Hi all, > > We have run into few complications with respect to $subject. Let me > briefly explain the scenario. > > Currently ESB is sending a Unique message flow ID, Mediator index > (mediator positio