Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Maheshakya Wijewardena]

Hi Mahesh,

Can you  please share your samoa project?

On Sun, Jul 17, 2016 at 11:19 AM, Mahesh Dananjaya <
dananjayamah...@gmail.com> wrote:

>
> -- Forwarded message --
> From: Mahesh Dananjaya 
> Date: Sun, Jul 17, 2016 at 11:18 AM
> Subject: Re: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online
> data for WSO2 Machine Learner-Samoa Integration
> To: Maheshakya Wijewardena 
>
>
> Hi Maheshakaya,
> just need a little help. In Samoa when we want to run a class what is does
> it used this commands [1],
> 1. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar
> "ClusteringEvaluation"
> 2. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar
> "PrequentialEvaluation -d /tmp/dump.csv -i 100 -f 10 -l
> (classifiers.trees.VerticalHoeffdingTree -p 4) -s
> (generators.RandomTreeGenerator -c 2 -o 10 -u 10)"
>
> what is does is call a class named LocalDoTask [4] and pass this string as
> argument.After that that LocalDoTask call the relevent Tasks such as
> ClusteringEvaluation or PrequentialEvaluation. [2].
>
> Now i have add samoa dependencies to my new maven project, where i used
> original samoa source to write examples and test then earlier.Now i want to
> push them into my new java project with samoa dependencies. I added
> dependency and it was built fine. Now i am calling my local DoTask.java [3]
> file as same as i did with samoa with,
> java -cp target/streaming-1.0-SNAPSHOT.jar org.gsoc.samoa.streaming.DoTask
> "org.gsoc.samoa.streaming.ClusteringEvaluation"
> But seems to be i am incorrect in some place.
> Error: A JNI error has occurred, please check your installation and try
> again
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/samoa/topology/ComponentFactory
> at java.lang.Class.getDeclaredMethods0(Native Method)
> at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
> at java.lang.Class.privateGetMethodRecursive(Class.java:3048)
> at java.lang.Class.getMethod0(Class.java:3018)
> at java.lang.Class.getMethod(Class.java:1784)
> at
> sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:544)
> at
> sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:526)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.samoa.topology.ComponentFactory
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 7 more
>
>
> can i actually call the Task like this.
>
> BR,
> Mahesh.
>
> [1]
> https://samoa.incubator.apache.org/documentation/Prequential-Evaluation-Task.html
> [2]
> https://github.com/apache/incubator-samoa/blob/releases/0.4.0-incubating-RC0/samoa-api/src/main/java/org/apache/samoa/tasks/ClusteringEvaluation.java
> [3]
> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming
> [4]
> https://github.com/apache/incubator-samoa/tree/releases/0.4.0-incubating-RC0/samoa-local/src/main/java/org/apache/samoa
>
>
> On Thu, Jul 14, 2016 at 3:47 PM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>> Hi srinath,
>> sure.i am working on it.thank you.
>> regards,
>> Mahesh.
>>
>> On Thu, Jul 14, 2016 at 11:12 AM, Srinath Perera 
>> wrote:
>>
>>> Hi Mahesh,
>>>
>>> Let's focus on getting SAOMA work with CEP. It is OK to be limited to
>>> few algorithms.
>>>
>>> --Srinath
>>>
>>> On Thu, Jul 14, 2016 at 10:49 AM, Mahesh Dananjaya <
>>> dananjayamah...@gmail.com> wrote:
>>>
 Hi Maheshakya,
 I think we can build new tasks [1] like the one in execution plan in
 cep with samoa. I will try to build a one.
 regards,
 Mahesh.
 [1]
 https://samoa.incubator.apache.org/documentation/Developing-New-Tasks-in-SAMOA.html


 On Thu, Jul 14, 2016 at 10:35 AM, Mahesh Dananjaya <
 dananjayamah...@gmail.com> wrote:

> Hi Maheshakya,
> I am building and running samoa to see its functionality. In samoa
> still we have limited supports in algorithms. Samoa supports only
> classification and clustering with streams. It also use kind of
> StreamProcessor, like the one we use in StreamProcessor extension.  I was
> getting started with Samoa referring to this page [1]. Then i ran couple 
> of
> examples to identified the flow. Samoa use hadoop framework instead spark
> for distribution. But i am using it in a local mode. When i see the Samoa
> core there is only limited algorithms. IMO if we are going to use Samoa we
> have to limit the functionality and algorithms [2]. When i go to developer
> corner in [3], it seems to be something like CEP extension that we are
> using currenlty. SO in Samoa though the algorihtms are limited, they have
> implemented streaming support for them. Therefore if we integrate it into
> CEP we have to

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Mahesh Dananjaya]

Hi Maheshakya,
Samoa modules built as topologies that connect streams with the internal
processors. I have already written some examples to test the ML algorithms
and samoa analysis topologies. What we need to done is mostly developing a
wrapper around samoa topologies to connect their input and output streams
with our cep streams. So i am currently going through their stream
architecture to connect our streams with their streams. Couple of examples
exapaining samoa ml topologies and streaming can be found in my git hub
repo [1]. Samoa using MOA ml algorithms by wrapping them with their
classes. Initailly i am trying to develop a KMeansClustering analysis with
cep streams with samoa ml topologies.
And also i could not find a maven repo for samoa 0.4.0 incubating. So i am
currently using my local m2 repo's samoa 0..4.0 incubating for my
dependencies to work. The local one is built by original samoa source.thank
you.

regards,
Mahesh.

[1]
https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming


On Mon, Jul 18, 2016 at 8:32 AM, Maheshakya Wijewardena  wrote:

> Hi Mahesh,
>
> Can you  please share your samoa project?
>
> On Sun, Jul 17, 2016 at 11:19 AM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>>
>> -- Forwarded message --
>> From: Mahesh Dananjaya 
>> Date: Sun, Jul 17, 2016 at 11:18 AM
>> Subject: Re: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online
>> data for WSO2 Machine Learner-Samoa Integration
>> To: Maheshakya Wijewardena 
>>
>>
>> Hi Maheshakaya,
>> just need a little help. In Samoa when we want to run a class what is
>> does it used this commands [1],
>> 1. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar
>> "ClusteringEvaluation"
>> 2. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar
>> "PrequentialEvaluation -d /tmp/dump.csv -i 100 -f 10 -l
>> (classifiers.trees.VerticalHoeffdingTree -p 4) -s
>> (generators.RandomTreeGenerator -c 2 -o 10 -u 10)"
>>
>> what is does is call a class named LocalDoTask [4] and pass this string
>> as argument.After that that LocalDoTask call the relevent Tasks such as
>> ClusteringEvaluation or PrequentialEvaluation. [2].
>>
>> Now i have add samoa dependencies to my new maven project, where i used
>> original samoa source to write examples and test then earlier.Now i want to
>> push them into my new java project with samoa dependencies. I added
>> dependency and it was built fine. Now i am calling my local DoTask.java [3]
>> file as same as i did with samoa with,
>> java -cp target/streaming-1.0-SNAPSHOT.jar
>> org.gsoc.samoa.streaming.DoTask
>> "org.gsoc.samoa.streaming.ClusteringEvaluation"
>> But seems to be i am incorrect in some place.
>> Error: A JNI error has occurred, please check your installation and try
>> again
>> Exception in thread "main" java.lang.NoClassDefFoundError:
>> org/apache/samoa/topology/ComponentFactory
>> at java.lang.Class.getDeclaredMethods0(Native Method)
>> at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
>> at java.lang.Class.privateGetMethodRecursive(Class.java:3048)
>> at java.lang.Class.getMethod0(Class.java:3018)
>> at java.lang.Class.getMethod(Class.java:1784)
>> at
>> sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:544)
>> at
>> sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:526)
>> Caused by: java.lang.ClassNotFoundException:
>> org.apache.samoa.topology.ComponentFactory
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>> ... 7 more
>>
>>
>> can i actually call the Task like this.
>>
>> BR,
>> Mahesh.
>>
>> [1]
>> https://samoa.incubator.apache.org/documentation/Prequential-Evaluation-Task.html
>> [2]
>> https://github.com/apache/incubator-samoa/blob/releases/0.4.0-incubating-RC0/samoa-api/src/main/java/org/apache/samoa/tasks/ClusteringEvaluation.java
>> [3]
>> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming
>> [4]
>> https://github.com/apache/incubator-samoa/tree/releases/0.4.0-incubating-RC0/samoa-local/src/main/java/org/apache/samoa
>>
>>
>> On Thu, Jul 14, 2016 at 3:47 PM, Mahesh Dananjaya <
>> dananjayamah...@gmail.com> wrote:
>>
>>> Hi srinath,
>>> sure.i am working on it.thank you.
>>> regards,
>>> Mahesh.
>>>
>>> On Thu, Jul 14, 2016 at 11:12 AM, Srinath Perera 
>>> wrote:
>>>
 Hi Mahesh,

 Let's focus on getting SAOMA work with CEP. It is OK to be limited to
 few algorithms.

 --Srinath

 On Thu, Jul 14, 2016 at 10:49 AM, Mahesh Dananjaya <
 dananjayamah...@gmail.com> wrote:

> Hi Maheshakya,
> I think we can build new tasks [1] like the one in execution plan in
> cep with samoa. I will 

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Mahesh Dananjaya]

Hi All,
I am onto connecting cep streams with samoa streams to data analysis using
samoa framework. To connect samoa with cep siddhi event streams what i we
can do is that try to convert cep streams into samoa streams or else
writing wrpper for samoa for cep  streasm to be used. In both cases i have
to covert siddhi cep streasm into samoa streams. Samoa is using MOA to
analyse data. Moo contains ML framework to analyse stream data. Samoa is
wrapping MOA withsome of its classes.

Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see
streams as a stream of instances [1]. So if we are going to convert cep
events into samoa instances , it will take time. But if we have some
similarity between cep siddhi streams and samoa streasm we can reduce the
time.
1. What is the underlying infrastructure for cep siddhi streasm.?
2. Are there anything as Instances or InstanceStreams kind of implmentation
underlying cep streams?
3. How can i get more underestanding on CEP siddhi streams.

On the other hand i can use my cep siddhi extension and put those events
into event queue and convert them into samoa instances and feed them into
samoa streaming ml topologies. There is another option. In Samoa what they
are basically doing is that wrapping MOA ML framework and write some
classes for build streaming ml topologies. So as the other option i can
wrap samoa moa with my design and use moa ml framework directly. (No need
for Samoa extension). I have building some topologies to streaming data
analysis [2]. Main problem is that lack of documentation. Anyway i had go
through their whole samoa design.thank you.
regards,
Mahesh.

[1]
https://github.com/apache/incubator-samoa/blob/master/samoa-api/src/main/java/org/apache/samoa/streams/clustering/ClusteringStream.java
[2]
https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming

On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya <
dananjayamah...@gmail.com> wrote:

> Hi Maheshakya,
> Samoa modules built as topologies that connect streams with the internal
> processors. I have already written some examples to test the ML algorithms
> and samoa analysis topologies. What we need to done is mostly developing a
> wrapper around samoa topologies to connect their input and output streams
> with our cep streams. So i am currently going through their stream
> architecture to connect our streams with their streams. Couple of examples
> exapaining samoa ml topologies and streaming can be found in my git hub
> repo [1]. Samoa using MOA ml algorithms by wrapping them with their
> classes. Initailly i am trying to develop a KMeansClustering analysis with
> cep streams with samoa ml topologies.
> And also i could not find a maven repo for samoa 0.4.0 incubating. So i am
> currently using my local m2 repo's samoa 0..4.0 incubating for my
> dependencies to work. The local one is built by original samoa source.thank
> you.
>
> regards,
> Mahesh.
>
> [1]
> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming
>
>
> On Mon, Jul 18, 2016 at 8:32 AM, Maheshakya Wijewardena <
> mahesha...@wso2.com> wrote:
>
>> Hi Mahesh,
>>
>> Can you  please share your samoa project?
>>
>> On Sun, Jul 17, 2016 at 11:19 AM, Mahesh Dananjaya <
>> dananjayamah...@gmail.com> wrote:
>>
>>>
>>> -- Forwarded message --
>>> From: Mahesh Dananjaya 
>>> Date: Sun, Jul 17, 2016 at 11:18 AM
>>> Subject: Re: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online
>>> data for WSO2 Machine Learner-Samoa Integration
>>> To: Maheshakya Wijewardena 
>>>
>>>
>>> Hi Maheshakaya,
>>> just need a little help. In Samoa when we want to run a class what is
>>> does it used this commands [1],
>>> 1. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar
>>> "ClusteringEvaluation"
>>> 2. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar
>>> "PrequentialEvaluation -d /tmp/dump.csv -i 100 -f 10 -l
>>> (classifiers.trees.VerticalHoeffdingTree -p 4) -s
>>> (generators.RandomTreeGenerator -c 2 -o 10 -u 10)"
>>>
>>> what is does is call a class named LocalDoTask [4] and pass this string
>>> as argument.After that that LocalDoTask call the relevent Tasks such as
>>> ClusteringEvaluation or PrequentialEvaluation. [2].
>>>
>>> Now i have add samoa dependencies to my new maven project, where i used
>>> original samoa source to write examples and test then earlier.Now i want to
>>> push them into my new java project with samoa dependencies. I added
>>> dependency and it was built fine. Now i am calling my local DoTask.java [3]
>>> file as same as i did with samoa with,
>>> java -cp target/streaming-1.0-SNAPSHOT.jar
>>> org.gsoc.samoa.streaming.DoTask
>>> "org.gsoc.samoa.streaming.ClusteringEvaluation"
>>> But seems to be i am incorrect in some place.
>>> Error: A JNI error has occurred, please check your installation and try
>>> again
>>> Exception in thread "main" java.lang.NoClassDefFoundErr

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Srinath Perera]

Hi Mahesh,

On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya  wrote:

> Hi All,
> I am onto connecting cep streams with samoa streams to data analysis using
> samoa framework. To connect samoa with cep siddhi event streams what i we
> can do is that try to convert cep streams into samoa streams or else
> writing wrpper for samoa for cep  streasm to be used. In both cases i have
> to covert siddhi cep streasm into samoa streams. Samoa is using MOA to
> analyse data. Moo contains ML framework to analyse stream data. Samoa is
> wrapping MOA withsome of its classes.
>
> Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see
> streams as a stream of instances [1]. So if we are going to convert cep
> events into samoa instances , it will take time. But if we have some
> similarity between cep siddhi streams and samoa streasm we can reduce the
> time.
> 1. What is the underlying infrastructure for cep siddhi streasm.?
> 2. Are there anything as Instances or InstanceStreams kind of
> implmentation underlying cep streams?
> 3. How can i get more underestanding on CEP siddhi streams.
>
> On the other hand i can use my cep siddhi extension and put those events
> into event queue and convert them into samoa instances and feed them into
> samoa streaming ml topologies.
>
I think this is OK. I assume this is much easier. Let's do this and check
the performance.


> There is another option. In Samoa what they are basically doing is that
> wrapping MOA ML framework and write some classes for build streaming ml
> topologies. So as the other option i can wrap samoa moa with my design and
> use moa ml framework directly. (No need for Samoa extension). I have
> building some topologies to streaming data analysis [2]. Main problem is
> that lack of documentation. Anyway i had go through their whole samoa
> design.thank you.
>

If we use MOA directly, would we loose the distributed support in SAOMA.
Let's do a call when you can, so we can dsicuss this in detail.

--Srinath



> regards,
> Mahesh.
>
> [1]
> https://github.com/apache/incubator-samoa/blob/master/samoa-api/src/main/java/org/apache/samoa/streams/clustering/ClusteringStream.java
> [2]
> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming
>
> On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>> Hi Maheshakya,
>> Samoa modules built as topologies that connect streams with the internal
>> processors. I have already written some examples to test the ML algorithms
>> and samoa analysis topologies. What we need to done is mostly developing a
>> wrapper around samoa topologies to connect their input and output streams
>> with our cep streams. So i am currently going through their stream
>> architecture to connect our streams with their streams. Couple of examples
>> exapaining samoa ml topologies and streaming can be found in my git hub
>> repo [1]. Samoa using MOA ml algorithms by wrapping them with their
>> classes. Initailly i am trying to develop a KMeansClustering analysis with
>> cep streams with samoa ml topologies.
>> And also i could not find a maven repo for samoa 0.4.0 incubating. So i
>> am currently using my local m2 repo's samoa 0..4.0 incubating for my
>> dependencies to work. The local one is built by original samoa source.thank
>> you.
>>
>> regards,
>> Mahesh.
>>
>> [1]
>> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming
>>
>>
>> On Mon, Jul 18, 2016 at 8:32 AM, Maheshakya Wijewardena <
>> mahesha...@wso2.com> wrote:
>>
>>> Hi Mahesh,
>>>
>>> Can you  please share your samoa project?
>>>
>>> On Sun, Jul 17, 2016 at 11:19 AM, Mahesh Dananjaya <
>>> dananjayamah...@gmail.com> wrote:
>>>

 -- Forwarded message --
 From: Mahesh Dananjaya 
 Date: Sun, Jul 17, 2016 at 11:18 AM
 Subject: Re: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online
 data for WSO2 Machine Learner-Samoa Integration
 To: Maheshakya Wijewardena 


 Hi Maheshakaya,
 just need a little help. In Samoa when we want to run a class what is
 does it used this commands [1],
 1. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar
 "ClusteringEvaluation"
 2. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar
 "PrequentialEvaluation -d /tmp/dump.csv -i 100 -f 10 -l
 (classifiers.trees.VerticalHoeffdingTree -p 4) -s
 (generators.RandomTreeGenerator -c 2 -o 10 -u 10)"

 what is does is call a class named LocalDoTask [4] and pass this string
 as argument.After that that LocalDoTask call the relevent Tasks such as
 ClusteringEvaluation or PrequentialEvaluation. [2].

 Now i have add samoa dependencies to my new maven project, where i used
 original samoa source to write examples and test then earlier.Now i want to
 push them into my new java project with samoa dependencies. I added

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Mahesh Dananjaya]

Hi Srinath,

"I think this is OK. I assume this is much easier. Let's do this and check
the performance",
I also think so. I am currently on this and have a progress in this.for
your question,
"If we use MOA directly, would we loose the distributed support in SAOMA.
Let's do a call when you can, so we can dsicuss this in detail."
 I have to check for that.i think  if we are using MOA, we can use
distributed clusters. As i wen through their documentation MOA itself
cannot support distribution. But samoa can. What samoa does is providing
streaming and clustering support by wrapping MOA algorithms. So i think we
dont need to go for that option,directly MOA. Because now we can handle
samoa building blocks.So we had 2 options for integrating it with cep
without exploiting samoa architecture which is highly modular,scalable and
flexible.
1. Develop Samoa topologies with basic samoa building blocks which make use
of MOA algorithms.
2. Creating New streaming options with samoa stream building blocks which
can feed cep siddhi events into samoa streams and get results samoa streams
to cep back.

As 2nd option is easy and  take reasonable time i am currently developing
some modules to integrate cep streams into samoa which can be easily
further extended to 1 option as well. So i had to modify stream and
entrance modules for that and i think is has good progress.
 So now i can feed my custom input stream to samoa topologies. That means i
can easily integrate cep event stream into samoa instance stream. currently
i am verifying the streaming clustering algorithms and its results with my
custom input input streams which can be connected to samoa instance
streams. As i have already developed siddhi extension for streaming, i can
use them to feed my custom input streams now.  As the initial step i am go
with the streaming clustering algorithms. Those are in my GSOC github repo
[1].
clustering - Streaming Clustering Support with samoa and CEP
streaming - Streaming extension for samoa for cep evet streams

i am currenlty working on the verification of results with some of our
custom streams and then we will just have to integrate it with my
extensions, which are already developed for cep as my first part.thank you.
regards,
Mahesh.

[1]
https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming

On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera  wrote:

> Hi Mahesh,
>
> On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>> Hi All,
>> I am onto connecting cep streams with samoa streams to data analysis
>> using samoa framework. To connect samoa with cep siddhi event streams what
>> i we can do is that try to convert cep streams into samoa streams or else
>> writing wrpper for samoa for cep  streasm to be used. In both cases i have
>> to covert siddhi cep streasm into samoa streams. Samoa is using MOA to
>> analyse data. Moo contains ML framework to analyse stream data. Samoa is
>> wrapping MOA withsome of its classes.
>>
>> Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see
>> streams as a stream of instances [1]. So if we are going to convert cep
>> events into samoa instances , it will take time. But if we have some
>> similarity between cep siddhi streams and samoa streasm we can reduce the
>> time.
>> 1. What is the underlying infrastructure for cep siddhi streasm.?
>> 2. Are there anything as Instances or InstanceStreams kind of
>> implmentation underlying cep streams?
>> 3. How can i get more underestanding on CEP siddhi streams.
>>
>> On the other hand i can use my cep siddhi extension and put those events
>> into event queue and convert them into samoa instances and feed them into
>> samoa streaming ml topologies.
>>
> I think this is OK. I assume this is much easier. Let's do this and check
> the performance.
>
>
>> There is another option. In Samoa what they are basically doing is that
>> wrapping MOA ML framework and write some classes for build streaming ml
>> topologies. So as the other option i can wrap samoa moa with my design and
>> use moa ml framework directly. (No need for Samoa extension). I have
>> building some topologies to streaming data analysis [2]. Main problem is
>> that lack of documentation. Anyway i had go through their whole samoa
>> design.thank you.
>>
>
> If we use MOA directly, would we loose the distributed support in SAOMA.
> Let's do a call when you can, so we can dsicuss this in detail.
>
> --Srinath
>
>
>
>> regards,
>> Mahesh.
>>
>> [1]
>> https://github.com/apache/incubator-samoa/blob/master/samoa-api/src/main/java/org/apache/samoa/streams/clustering/ClusteringStream.java
>> [2]
>> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming
>>
>> On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya <
>> dananjayamah...@gmail.com> wrote:
>>
>>> Hi Maheshakya,
>>> Samoa modules built as topologies that connect streams w

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Mahesh Dananjaya]

Hi Maheshakya,
I have a small problem. As we did all the time when i build a samoa
streaming extension for the cep by providing samoa dependencies, i put that
jar into cep_home/repository/component/lib/ folder.The start cep and try to
develop the execution plan by providing my extension. i am remotely
debugging the samoa streaming extension that connected to our samoa
predictive learning topology. While on the run i get this exception.
java.lang.ClassNotFoundException:
org.apache.samoa.topology.ComponentFactory cannot be found by
streaming_1.0_SNAPSHOT_1.0.0.

But without cep my samoa core is running fine. It seems to be samoa is not
recognizing in the cep side. Is this kind of a dependency problem. In my
extension side i think nothing wrong. When i replace the streamProcessor
extension with locally build cep event stream emulation java class all the
things run fine. The probelm occurs only when this is running with cep. Do
i need to add anything on the cep side to underestand samoa in cep side.can
you please help me with this.thank you.
regards,
Mahesh.


On Wed, Jul 27, 2016 at 3:59 PM, Mahesh Dananjaya  wrote:

> Hi Srinath,
>
> "I think this is OK. I assume this is much easier. Let's do this and check
> the performance",
> I also think so. I am currently on this and have a progress in this.for
> your question,
> "If we use MOA directly, would we loose the distributed support in SAOMA.
> Let's do a call when you can, so we can dsicuss this in detail."
>  I have to check for that.i think  if we are using MOA, we can use
> distributed clusters. As i wen through their documentation MOA itself
> cannot support distribution. But samoa can. What samoa does is providing
> streaming and clustering support by wrapping MOA algorithms. So i think we
> dont need to go for that option,directly MOA. Because now we can handle
> samoa building blocks.So we had 2 options for integrating it with cep
> without exploiting samoa architecture which is highly modular,scalable and
> flexible.
> 1. Develop Samoa topologies with basic samoa building blocks which make
> use of MOA algorithms.
> 2. Creating New streaming options with samoa stream building blocks which
> can feed cep siddhi events into samoa streams and get results samoa streams
> to cep back.
>
> As 2nd option is easy and  take reasonable time i am currently developing
> some modules to integrate cep streams into samoa which can be easily
> further extended to 1 option as well. So i had to modify stream and
> entrance modules for that and i think is has good progress.
>  So now i can feed my custom input stream to samoa topologies. That means
> i can easily integrate cep event stream into samoa instance stream.
> currently i am verifying the streaming clustering algorithms and its
> results with my custom input input streams which can be connected to samoa
> instance streams. As i have already developed siddhi extension for
> streaming, i can use them to feed my custom input streams now.  As the
> initial step i am go with the streaming clustering algorithms. Those are in
> my GSOC github repo [1].
> clustering - Streaming Clustering Support with samoa and CEP
> streaming - Streaming extension for samoa for cep evet streams
>
> i am currenlty working on the verification of results with some of our
> custom streams and then we will just have to integrate it with my
> extensions, which are already developed for cep as my first part.thank you.
> regards,
> Mahesh.
>
> [1]
> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming
>
> On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera  wrote:
>
>> Hi Mahesh,
>>
>> On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya <
>> dananjayamah...@gmail.com> wrote:
>>
>>> Hi All,
>>> I am onto connecting cep streams with samoa streams to data analysis
>>> using samoa framework. To connect samoa with cep siddhi event streams what
>>> i we can do is that try to convert cep streams into samoa streams or else
>>> writing wrpper for samoa for cep  streasm to be used. In both cases i have
>>> to covert siddhi cep streasm into samoa streams. Samoa is using MOA to
>>> analyse data. Moo contains ML framework to analyse stream data. Samoa is
>>> wrapping MOA withsome of its classes.
>>>
>>> Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see
>>> streams as a stream of instances [1]. So if we are going to convert cep
>>> events into samoa instances , it will take time. But if we have some
>>> similarity between cep siddhi streams and samoa streasm we can reduce the
>>> time.
>>> 1. What is the underlying infrastructure for cep siddhi streasm.?
>>> 2. Are there anything as Instances or InstanceStreams kind of
>>> implmentation underlying cep streams?
>>> 3. How can i get more underestanding on CEP siddhi streams.
>>>
>>> On the other hand i can use my cep siddhi extension and put those events
>>> into event queue and convert them into samoa instances and feed them into

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Mahesh Dananjaya]

Hi Supun,
I just neeed a little help. I am in the process of integrating my samoa
core functions and extension into carbon-ml's siddhi extension. For samoa i
am using locally built samoa project to provide samoa 0.4.0
dependencies,since we dont have it in the maven repo or else where. But
when i build carbon-ml by adding samoa dependencies, it seems to be maven
search for remote location, not the local maven repo first. I am running
maven with -U option. But still the problems occurs. Is there any specific
thing in carbon-ml like settings to search remote before local one? I just
need to give local maven repo for the dependency. My extension seperately
working fine, so there is no problem wihat the local dependencies outside
carbon-ml. So can you please help me with this.thank you.
regards,
Mahesh.

On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera  wrote:

> Hi Mahesh,
>
> On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>> Hi All,
>> I am onto connecting cep streams with samoa streams to data analysis
>> using samoa framework. To connect samoa with cep siddhi event streams what
>> i we can do is that try to convert cep streams into samoa streams or else
>> writing wrpper for samoa for cep  streasm to be used. In both cases i have
>> to covert siddhi cep streasm into samoa streams. Samoa is using MOA to
>> analyse data. Moo contains ML framework to analyse stream data. Samoa is
>> wrapping MOA withsome of its classes.
>>
>> Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see
>> streams as a stream of instances [1]. So if we are going to convert cep
>> events into samoa instances , it will take time. But if we have some
>> similarity between cep siddhi streams and samoa streasm we can reduce the
>> time.
>> 1. What is the underlying infrastructure for cep siddhi streasm.?
>> 2. Are there anything as Instances or InstanceStreams kind of
>> implmentation underlying cep streams?
>> 3. How can i get more underestanding on CEP siddhi streams.
>>
>> On the other hand i can use my cep siddhi extension and put those events
>> into event queue and convert them into samoa instances and feed them into
>> samoa streaming ml topologies.
>>
> I think this is OK. I assume this is much easier. Let's do this and check
> the performance.
>
>
>> There is another option. In Samoa what they are basically doing is that
>> wrapping MOA ML framework and write some classes for build streaming ml
>> topologies. So as the other option i can wrap samoa moa with my design and
>> use moa ml framework directly. (No need for Samoa extension). I have
>> building some topologies to streaming data analysis [2]. Main problem is
>> that lack of documentation. Anyway i had go through their whole samoa
>> design.thank you.
>>
>
> If we use MOA directly, would we loose the distributed support in SAOMA.
> Let's do a call when you can, so we can dsicuss this in detail.
>
> --Srinath
>
>
>
>> regards,
>> Mahesh.
>>
>> [1]
>> https://github.com/apache/incubator-samoa/blob/master/samoa-api/src/main/java/org/apache/samoa/streams/clustering/ClusteringStream.java
>> [2]
>> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming
>>
>> On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya <
>> dananjayamah...@gmail.com> wrote:
>>
>>> Hi Maheshakya,
>>> Samoa modules built as topologies that connect streams with the internal
>>> processors. I have already written some examples to test the ML algorithms
>>> and samoa analysis topologies. What we need to done is mostly developing a
>>> wrapper around samoa topologies to connect their input and output streams
>>> with our cep streams. So i am currently going through their stream
>>> architecture to connect our streams with their streams. Couple of examples
>>> exapaining samoa ml topologies and streaming can be found in my git hub
>>> repo [1]. Samoa using MOA ml algorithms by wrapping them with their
>>> classes. Initailly i am trying to develop a KMeansClustering analysis with
>>> cep streams with samoa ml topologies.
>>> And also i could not find a maven repo for samoa 0.4.0 incubating. So i
>>> am currently using my local m2 repo's samoa 0..4.0 incubating for my
>>> dependencies to work. The local one is built by original samoa source.thank
>>> you.
>>>
>>> regards,
>>> Mahesh.
>>>
>>> [1]
>>> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming
>>>
>>>
>>> On Mon, Jul 18, 2016 at 8:32 AM, Maheshakya Wijewardena <
>>> mahesha...@wso2.com> wrote:
>>>
 Hi Mahesh,

 Can you  please share your samoa project?

 On Sun, Jul 17, 2016 at 11:19 AM, Mahesh Dananjaya <
 dananjayamah...@gmail.com> wrote:

>
> -- Forwarded message --
> From: Mahesh Dananjaya 
> Date: Sun, Jul 17, 2016 at 11:18 AM
> Subject: Re: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with
> online data 

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Supun Sethunga]

Hi Mahesh,

you should build carbon-ml *without *-U option. -U means you force mvn to
look for updates in remote repo. Rather run it with -o option. Also, can
you double check whether the dependencies are defined correctly (group
Id's, versions etc).

Alternatively, it seems there is a samoa released version in mvn repo.
Maybe you could try that one as well. But that's v0.3.0..

[1] https://mvnrepository.com/artifact/org.apache.samoa

On Wed, Aug 3, 2016 at 2:54 PM, Mahesh Dananjaya 
wrote:

> Hi Supun,
> I just neeed a little help. I am in the process of integrating my samoa
> core functions and extension into carbon-ml's siddhi extension. For samoa i
> am using locally built samoa project to provide samoa 0.4.0
> dependencies,since we dont have it in the maven repo or else where. But
> when i build carbon-ml by adding samoa dependencies, it seems to be maven
> search for remote location, not the local maven repo first. I am running
> maven with -U option. But still the problems occurs. Is there any specific
> thing in carbon-ml like settings to search remote before local one? I just
> need to give local maven repo for the dependency. My extension seperately
> working fine, so there is no problem wihat the local dependencies outside
> carbon-ml. So can you please help me with this.thank you.
> regards,
> Mahesh.
>
> On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera  wrote:
>
>> Hi Mahesh,
>>
>> On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya <
>> dananjayamah...@gmail.com> wrote:
>>
>>> Hi All,
>>> I am onto connecting cep streams with samoa streams to data analysis
>>> using samoa framework. To connect samoa with cep siddhi event streams what
>>> i we can do is that try to convert cep streams into samoa streams or else
>>> writing wrpper for samoa for cep  streasm to be used. In both cases i have
>>> to covert siddhi cep streasm into samoa streams. Samoa is using MOA to
>>> analyse data. Moo contains ML framework to analyse stream data. Samoa is
>>> wrapping MOA withsome of its classes.
>>>
>>> Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see
>>> streams as a stream of instances [1]. So if we are going to convert cep
>>> events into samoa instances , it will take time. But if we have some
>>> similarity between cep siddhi streams and samoa streasm we can reduce the
>>> time.
>>> 1. What is the underlying infrastructure for cep siddhi streasm.?
>>> 2. Are there anything as Instances or InstanceStreams kind of
>>> implmentation underlying cep streams?
>>> 3. How can i get more underestanding on CEP siddhi streams.
>>>
>>> On the other hand i can use my cep siddhi extension and put those events
>>> into event queue and convert them into samoa instances and feed them into
>>> samoa streaming ml topologies.
>>>
>> I think this is OK. I assume this is much easier. Let's do this and check
>> the performance.
>>
>>
>>> There is another option. In Samoa what they are basically doing is that
>>> wrapping MOA ML framework and write some classes for build streaming ml
>>> topologies. So as the other option i can wrap samoa moa with my design and
>>> use moa ml framework directly. (No need for Samoa extension). I have
>>> building some topologies to streaming data analysis [2]. Main problem is
>>> that lack of documentation. Anyway i had go through their whole samoa
>>> design.thank you.
>>>
>>
>> If we use MOA directly, would we loose the distributed support in SAOMA.
>> Let's do a call when you can, so we can dsicuss this in detail.
>>
>> --Srinath
>>
>>
>>
>>> regards,
>>> Mahesh.
>>>
>>> [1]
>>> https://github.com/apache/incubator-samoa/blob/master/samoa-api/src/main/java/org/apache/samoa/streams/clustering/ClusteringStream.java
>>> [2]
>>> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming
>>>
>>> On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya <
>>> dananjayamah...@gmail.com> wrote:
>>>
 Hi Maheshakya,
 Samoa modules built as topologies that connect streams with the
 internal processors. I have already written some examples to test the ML
 algorithms and samoa analysis topologies. What we need to done is mostly
 developing a wrapper around samoa topologies to connect their input and
 output streams with our cep streams. So i am currently going through their
 stream architecture to connect our streams with their streams. Couple of
 examples exapaining samoa ml topologies and streaming can be found in my
 git hub repo [1]. Samoa using MOA ml algorithms by wrapping them with their
 classes. Initailly i am trying to develop a KMeansClustering analysis with
 cep streams with samoa ml topologies.
 And also i could not find a maven repo for samoa 0.4.0 incubating. So i
 am currently using my local m2 repo's samoa 0..4.0 incubating for my
 dependencies to work. The local one is built by original samoa source.thank
 you.

 regards,
 Mahesh.

 [1]
 h

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Miyuru Dayarathna]

Adding Jayan to this email thread.

-- 
Thanks,
Miyuru Dayarathna
Senior Technical Lead
Mobile: +94713527783
Blog: http://miyurublog.blogspot.com

On Wed, Aug 3, 2016 at 3:11 PM, Supun Sethunga  wrote:

> Hi Mahesh,
>
> you should build carbon-ml *without *-U option. -U means you force mvn to
> look for updates in remote repo. Rather run it with -o option. Also, can
> you double check whether the dependencies are defined correctly (group
> Id's, versions etc).
>
> Alternatively, it seems there is a samoa released version in mvn repo.
> Maybe you could try that one as well. But that's v0.3.0..
>
> [1] https://mvnrepository.com/artifact/org.apache.samoa
>
> On Wed, Aug 3, 2016 at 2:54 PM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>> Hi Supun,
>> I just neeed a little help. I am in the process of integrating my samoa
>> core functions and extension into carbon-ml's siddhi extension. For samoa i
>> am using locally built samoa project to provide samoa 0.4.0
>> dependencies,since we dont have it in the maven repo or else where. But
>> when i build carbon-ml by adding samoa dependencies, it seems to be maven
>> search for remote location, not the local maven repo first. I am running
>> maven with -U option. But still the problems occurs. Is there any specific
>> thing in carbon-ml like settings to search remote before local one? I just
>> need to give local maven repo for the dependency. My extension seperately
>> working fine, so there is no problem wihat the local dependencies outside
>> carbon-ml. So can you please help me with this.thank you.
>> regards,
>> Mahesh.
>>
>> On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera  wrote:
>>
>>> Hi Mahesh,
>>>
>>> On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya <
>>> dananjayamah...@gmail.com> wrote:
>>>
 Hi All,
 I am onto connecting cep streams with samoa streams to data analysis
 using samoa framework. To connect samoa with cep siddhi event streams what
 i we can do is that try to convert cep streams into samoa streams or else
 writing wrpper for samoa for cep  streasm to be used. In both cases i have
 to covert siddhi cep streasm into samoa streams. Samoa is using MOA to
 analyse data. Moo contains ML framework to analyse stream data. Samoa is
 wrapping MOA withsome of its classes.

 Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see
 streams as a stream of instances [1]. So if we are going to convert cep
 events into samoa instances , it will take time. But if we have some
 similarity between cep siddhi streams and samoa streasm we can reduce the
 time.
 1. What is the underlying infrastructure for cep siddhi streasm.?
 2. Are there anything as Instances or InstanceStreams kind of
 implmentation underlying cep streams?
 3. How can i get more underestanding on CEP siddhi streams.

 On the other hand i can use my cep siddhi extension and put those
 events into event queue and convert them into samoa instances and feed them
 into samoa streaming ml topologies.

>>> I think this is OK. I assume this is much easier. Let's do this and
>>> check the performance.
>>>
>>>
 There is another option. In Samoa what they are basically doing is that
 wrapping MOA ML framework and write some classes for build streaming ml
 topologies. So as the other option i can wrap samoa moa with my design and
 use moa ml framework directly. (No need for Samoa extension). I have
 building some topologies to streaming data analysis [2]. Main problem is
 that lack of documentation. Anyway i had go through their whole samoa
 design.thank you.

>>>
>>> If we use MOA directly, would we loose the distributed support in SAOMA.
>>> Let's do a call when you can, so we can dsicuss this in detail.
>>>
>>> --Srinath
>>>
>>>
>>>
 regards,
 Mahesh.

 [1]
 https://github.com/apache/incubator-samoa/blob/master/samoa-api/src/main/java/org/apache/samoa/streams/clustering/ClusteringStream.java
 [2]
 https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming

 On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya <
 dananjayamah...@gmail.com> wrote:

> Hi Maheshakya,
> Samoa modules built as topologies that connect streams with the
> internal processors. I have already written some examples to test the ML
> algorithms and samoa analysis topologies. What we need to done is mostly
> developing a wrapper around samoa topologies to connect their input and
> output streams with our cep streams. So i am currently going through their
> stream architecture to connect our streams with their streams. Couple of
> examples exapaining samoa ml topologies and streaming can be found in my
> git hub repo [1]. Samoa using MOA ml algorithms by wrapping them with 
> their
> classes. Initailly i am trying to develop a KMeansClustering an

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Mahesh Dananjaya]

Hi supun,
We have been using v0.4.0 for the cep integration,since the last verstion
is pretty outdated and lack with algorithms for streaming. So i am now
using my locally built v0.4.0 for the project. dependencies are working
fine, because it has been using on the extensions that we develop outside
the carbon-ml as regular extensions. same error appears when i was not
using -U. seems to be that maven search for remote repo rather than local
one.this is the error i got.

[ERROR] Failed to execute goal on project
org.wso2.carbon.ml.siddhi.extension: Could not resolve dependencies for
project 
org.wso2.carbon.ml:org.wso2.carbon.ml.siddhi.extension:bundle:1.1.2-SNAPSHOT:
The following artifacts could not be resolved:
org.apache.samoa:samoa-api:jar:0.4.0-incubating,
org.apache.samoa:samoa-local:jar:0.4.0-incubating: Could not find artifact
org.apache.samoa:samoa-api:jar:0.4.0-incubating in wso2-nexus (
http://maven.wso2.org/nexus/content/groups/wso2-public/)

seems to be aven prefer remote one for samoa rather than local one. This is
only when i build carbon-ml adding samoa local dependencies. Other
extensions used samoa,which are outside carbon-ml are working fine.
thank you..
BR,
Mahesh.

On Wed, Aug 3, 2016 at 3:11 PM, Supun Sethunga  wrote:

> Hi Mahesh,
>
> you should build carbon-ml *without *-U option. -U means you force mvn to
> look for updates in remote repo. Rather run it with -o option. Also, can
> you double check whether the dependencies are defined correctly (group
> Id's, versions etc).
>
> Alternatively, it seems there is a samoa released version in mvn repo.
> Maybe you could try that one as well. But that's v0.3.0..
>
> [1] https://mvnrepository.com/artifact/org.apache.samoa
>
> On Wed, Aug 3, 2016 at 2:54 PM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>> Hi Supun,
>> I just neeed a little help. I am in the process of integrating my samoa
>> core functions and extension into carbon-ml's siddhi extension. For samoa i
>> am using locally built samoa project to provide samoa 0.4.0
>> dependencies,since we dont have it in the maven repo or else where. But
>> when i build carbon-ml by adding samoa dependencies, it seems to be maven
>> search for remote location, not the local maven repo first. I am running
>> maven with -U option. But still the problems occurs. Is there any specific
>> thing in carbon-ml like settings to search remote before local one? I just
>> need to give local maven repo for the dependency. My extension seperately
>> working fine, so there is no problem wihat the local dependencies outside
>> carbon-ml. So can you please help me with this.thank you.
>> regards,
>> Mahesh.
>>
>> On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera  wrote:
>>
>>> Hi Mahesh,
>>>
>>> On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya <
>>> dananjayamah...@gmail.com> wrote:
>>>
 Hi All,
 I am onto connecting cep streams with samoa streams to data analysis
 using samoa framework. To connect samoa with cep siddhi event streams what
 i we can do is that try to convert cep streams into samoa streams or else
 writing wrpper for samoa for cep  streasm to be used. In both cases i have
 to covert siddhi cep streasm into samoa streams. Samoa is using MOA to
 analyse data. Moo contains ML framework to analyse stream data. Samoa is
 wrapping MOA withsome of its classes.

 Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see
 streams as a stream of instances [1]. So if we are going to convert cep
 events into samoa instances , it will take time. But if we have some
 similarity between cep siddhi streams and samoa streasm we can reduce the
 time.
 1. What is the underlying infrastructure for cep siddhi streasm.?
 2. Are there anything as Instances or InstanceStreams kind of
 implmentation underlying cep streams?
 3. How can i get more underestanding on CEP siddhi streams.

 On the other hand i can use my cep siddhi extension and put those
 events into event queue and convert them into samoa instances and feed them
 into samoa streaming ml topologies.

>>> I think this is OK. I assume this is much easier. Let's do this and
>>> check the performance.
>>>
>>>
 There is another option. In Samoa what they are basically doing is that
 wrapping MOA ML framework and write some classes for build streaming ml
 topologies. So as the other option i can wrap samoa moa with my design and
 use moa ml framework directly. (No need for Samoa extension). I have
 building some topologies to streaming data analysis [2]. Main problem is
 that lack of documentation. Anyway i had go through their whole samoa
 design.thank you.

>>>
>>> If we use MOA directly, would we loose the distributed support in SAOMA.
>>> Let's do a call when you can, so we can dsicuss this in detail.
>>>
>>> --Srinath
>>>
>>>
>>>
 regards,
 Mahesh.

 [1]
 https://github.com/apache/incubator-sa

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Mahesh Dananjaya]

Hi all,
samoa is in my local repository and dependencies works fine with all other
extensions that add samoa 0.4.0-incubator dependencies. But only when i
build carbon-ml, it gives priority for the remote repository for looking
samoa. SO any help with this to give priority for local m2 repo before
carbon-ml building is looking for the remote one. I am getting the error
because of this. maven option -U also not seems to be working here. any
help please.

[ERROR] Failed to execute goal on project
org.wso2.carbon.ml.siddhi.extension: Could not resolve dependencies for
project 
org.wso2.carbon.ml:org.wso2.carbon.ml.siddhi.extension:bundle:1.1.2-SNAPSHOT:
The following artifacts could not be resolved:
org.apache.samoa:samoa-api:jar:0.4.0-incubating,
org.apache.samoa:samoa-local:jar:0.4.0-incubating: Could not find artifact
org.apache.samoa:samoa-api:jar:0.4.0-incubating in wso2-nexus (
http://maven.wso2.org/nexus/content/groups/wso2-public/)

Since samoa will be used for future work, is it possible to add that in the
relevant wso2 repo. Because there are still no samoa 0.4.0-incubator maven
repo. only 0.3.0. we cannot continue our work with the 0.3.0 since it is
outdated.

thank you.
regards,
Mahesh.

On Wed, Aug 3, 2016 at 4:29 PM, Miyuru Dayarathna  wrote:

> Adding Jayan to this email thread.
>
> --
> Thanks,
> Miyuru Dayarathna
> Senior Technical Lead
> Mobile: +94713527783
> Blog: http://miyurublog.blogspot.com
>
> On Wed, Aug 3, 2016 at 3:11 PM, Supun Sethunga  wrote:
>
>> Hi Mahesh,
>>
>> you should build carbon-ml *without *-U option. -U means you force mvn
>> to look for updates in remote repo. Rather run it with -o option. Also, can
>> you double check whether the dependencies are defined correctly (group
>> Id's, versions etc).
>>
>> Alternatively, it seems there is a samoa released version in mvn repo.
>> Maybe you could try that one as well. But that's v0.3.0..
>>
>> [1] https://mvnrepository.com/artifact/org.apache.samoa
>>
>> On Wed, Aug 3, 2016 at 2:54 PM, Mahesh Dananjaya <
>> dananjayamah...@gmail.com> wrote:
>>
>>> Hi Supun,
>>> I just neeed a little help. I am in the process of integrating my samoa
>>> core functions and extension into carbon-ml's siddhi extension. For samoa i
>>> am using locally built samoa project to provide samoa 0.4.0
>>> dependencies,since we dont have it in the maven repo or else where. But
>>> when i build carbon-ml by adding samoa dependencies, it seems to be maven
>>> search for remote location, not the local maven repo first. I am running
>>> maven with -U option. But still the problems occurs. Is there any specific
>>> thing in carbon-ml like settings to search remote before local one? I just
>>> need to give local maven repo for the dependency. My extension seperately
>>> working fine, so there is no problem wihat the local dependencies outside
>>> carbon-ml. So can you please help me with this.thank you.
>>> regards,
>>> Mahesh.
>>>
>>> On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera 
>>> wrote:
>>>
 Hi Mahesh,

 On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya <
 dananjayamah...@gmail.com> wrote:

> Hi All,
> I am onto connecting cep streams with samoa streams to data analysis
> using samoa framework. To connect samoa with cep siddhi event streams what
> i we can do is that try to convert cep streams into samoa streams or else
> writing wrpper for samoa for cep  streasm to be used. In both cases i have
> to covert siddhi cep streasm into samoa streams. Samoa is using MOA to
> analyse data. Moo contains ML framework to analyse stream data. Samoa is
> wrapping MOA withsome of its classes.
>
> Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see
> streams as a stream of instances [1]. So if we are going to convert cep
> events into samoa instances , it will take time. But if we have some
> similarity between cep siddhi streams and samoa streasm we can reduce the
> time.
> 1. What is the underlying infrastructure for cep siddhi streasm.?
> 2. Are there anything as Instances or InstanceStreams kind of
> implmentation underlying cep streams?
> 3. How can i get more underestanding on CEP siddhi streams.
>
> On the other hand i can use my cep siddhi extension and put those
> events into event queue and convert them into samoa instances and feed 
> them
> into samoa streaming ml topologies.
>
 I think this is OK. I assume this is much easier. Let's do this and
 check the performance.


> There is another option. In Samoa what they are basically doing is
> that wrapping MOA ML framework and write some classes for build streaming
> ml topologies. So as the other option i can wrap samoa moa with my design
> and use moa ml framework directly. (No need for Samoa extension). I have
> building some topologies to streaming data analysis [2]. Main problem is
> that lack of documentation. Anyway i had go th

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Supun Sethunga]

Hi Mahesh,

samoa dependency version in siddhi-extension should be
*0.4.0-incubating-SNAPSHOT*. That should solve the issue

Regards,
Supun

On Thu, Aug 4, 2016 at 11:50 AM, Mahesh Dananjaya  wrote:

> Hi all,
> samoa is in my local repository and dependencies works fine with all other
> extensions that add samoa 0.4.0-incubator dependencies. But only when i
> build carbon-ml, it gives priority for the remote repository for looking
> samoa. SO any help with this to give priority for local m2 repo before
> carbon-ml building is looking for the remote one. I am getting the error
> because of this. maven option -U also not seems to be working here. any
> help please.
>
> [ERROR] Failed to execute goal on project
> org.wso2.carbon.ml.siddhi.extension: Could not resolve dependencies for
> project 
> org.wso2.carbon.ml:org.wso2.carbon.ml.siddhi.extension:bundle:1.1.2-SNAPSHOT:
> The following artifacts could not be resolved:
> org.apache.samoa:samoa-api:jar:0.4.0-incubating,
> org.apache.samoa:samoa-local:jar:0.4.0-incubating: Could not find artifact
> org.apache.samoa:samoa-api:jar:0.4.0-incubating in wso2-nexus (
> http://maven.wso2.org/nexus/content/groups/wso2-public/)
>
> Since samoa will be used for future work, is it possible to add that in
> the relevant wso2 repo. Because there are still no samoa 0.4.0-incubator
> maven repo. only 0.3.0. we cannot continue our work with the 0.3.0 since it
> is outdated.
>
> thank you.
> regards,
> Mahesh.
>
> On Wed, Aug 3, 2016 at 4:29 PM, Miyuru Dayarathna 
> wrote:
>
>> Adding Jayan to this email thread.
>>
>> --
>> Thanks,
>> Miyuru Dayarathna
>> Senior Technical Lead
>> Mobile: +94713527783
>> Blog: http://miyurublog.blogspot.com
>>
>> On Wed, Aug 3, 2016 at 3:11 PM, Supun Sethunga  wrote:
>>
>>> Hi Mahesh,
>>>
>>> you should build carbon-ml *without *-U option. -U means you force mvn
>>> to look for updates in remote repo. Rather run it with -o option. Also, can
>>> you double check whether the dependencies are defined correctly (group
>>> Id's, versions etc).
>>>
>>> Alternatively, it seems there is a samoa released version in mvn repo.
>>> Maybe you could try that one as well. But that's v0.3.0..
>>>
>>> [1] https://mvnrepository.com/artifact/org.apache.samoa
>>>
>>> On Wed, Aug 3, 2016 at 2:54 PM, Mahesh Dananjaya <
>>> dananjayamah...@gmail.com> wrote:
>>>
 Hi Supun,
 I just neeed a little help. I am in the process of integrating my samoa
 core functions and extension into carbon-ml's siddhi extension. For samoa i
 am using locally built samoa project to provide samoa 0.4.0
 dependencies,since we dont have it in the maven repo or else where. But
 when i build carbon-ml by adding samoa dependencies, it seems to be maven
 search for remote location, not the local maven repo first. I am running
 maven with -U option. But still the problems occurs. Is there any specific
 thing in carbon-ml like settings to search remote before local one? I just
 need to give local maven repo for the dependency. My extension seperately
 working fine, so there is no problem wihat the local dependencies outside
 carbon-ml. So can you please help me with this.thank you.
 regards,
 Mahesh.

 On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera 
 wrote:

> Hi Mahesh,
>
> On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>> Hi All,
>> I am onto connecting cep streams with samoa streams to data analysis
>> using samoa framework. To connect samoa with cep siddhi event streams 
>> what
>> i we can do is that try to convert cep streams into samoa streams or else
>> writing wrpper for samoa for cep  streasm to be used. In both cases i 
>> have
>> to covert siddhi cep streasm into samoa streams. Samoa is using MOA to
>> analyse data. Moo contains ML framework to analyse stream data. Samoa is
>> wrapping MOA withsome of its classes.
>>
>> Samoa streams is based on MOA, Instance and InstanceStreams. Samoa
>> see streams as a stream of instances [1]. So if we are going to convert 
>> cep
>> events into samoa instances , it will take time. But if we have some
>> similarity between cep siddhi streams and samoa streasm we can reduce the
>> time.
>> 1. What is the underlying infrastructure for cep siddhi streasm.?
>> 2. Are there anything as Instances or InstanceStreams kind of
>> implmentation underlying cep streams?
>> 3. How can i get more underestanding on CEP siddhi streams.
>>
>> On the other hand i can use my cep siddhi extension and put those
>> events into event queue and convert them into samoa instances and feed 
>> them
>> into samoa streaming ml topologies.
>>
> I think this is OK. I assume this is much easier. Let's do this and
> check the performance.
>
>
>> There is another option. In Samoa what they are basically doing is
>> that

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Mahesh Dananjaya]

Hi Supun,
This is the error i am getting while run the extension in the cabon-ml side,
plase reffer to link [1] for the class.

ERROR
{org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder}
-  Fail to initialize the task

java.lang.Exception: Class not found: StreamingClusteringTask

   at
com.github.javacliparser.ClassOption.cliStringToObject(ClassOption.java:136)

   at
org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder.initClusteringTask(StreamingClusteringTaskBuilder.java:129)

   at
org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder.java:100)

   at
org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClustering.run(StreamingClustering.java:77)

   at java.lang.Thread.run(Thread.java:745)

[2016-08-04 16:23:07,437]  INFO
{org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder}
-  Fail to initialize the taskjava.lang.Exception: Class not found:
StreamingClusteringTask

+++Please refeer link [1] for the StreamingClusteringTask.

Then again for StreamingClusteringStream class while i bypass the String
query in the initTask(). please refer link [2] for the class.

Exception in thread "Thread-60" java.lang.IllegalArgumentException:
Problems with option: streamTrain

   at
com.github.javacliparser.ClassOption.setValueViaCLIString(ClassOption.java:64)

   at
com.github.javacliparser.AbstractOption.resetToDefault(AbstractOption.java:90)

   at
com.github.javacliparser.AbstractClassOption.(AbstractClassOption.java:84)

   at
com.github.javacliparser.AbstractClassOption.(AbstractClassOption.java:63)

   at com.github.javacliparser.ClassOption.(ClassOption.java:38)

   at
org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTask.(StreamingClusteringTask.java:52)

   at
org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder.initClusteringTask(StreamingClusteringTaskBuilder.java:140)

   at
org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder.java:103)

   at
org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClustering.run(StreamingClustering.java:77)

   at java.lang.Thread.run(Thread.java:745)

Caused by: java.lang.Exception: Class not found:
org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringStream

   at
com.github.javacliparser.ClassOption.cliStringToObject(ClassOption.java:136)

   at
com.github.javacliparser.ClassOption.setValueViaCLIString(ClassOption.java:61)

   ... 9 more


Those Class Not Found Exceptions are at runtime. Do i have do anything on
the carbon-ml side for this.My samoa cores can be found in [3]. Those are
working fine and no Class Not Found Exceptions arrive when running outside
the carbon-ml.


thank you.

regards,

Mahesh.



[1]
https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.extension/src/main/java/org/wso2/carbon/ml/siddhi/extension/streaming/samoa/StreamingClusteringTask.java

[2]
https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.extension/src/main/java/org/wso2/carbon/ml/siddhi/extension/streaming/samoa/StreamingClusteringTask.java

[3]
https://github.com/dananjayamahesh/carbon-ml/tree/wso2_gsoc_ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.extension/src/main/java/org/wso2/carbon/ml/siddhi/extension/streaming/samoa

On Thu, Aug 4, 2016 at 12:30 PM, Supun Sethunga  wrote:

> Hi Mahesh,
>
> samoa dependency version in siddhi-extension should be
> *0.4.0-incubating-SNAPSHOT*. That should solve the issue
>
> Regards,
> Supun
>
> On Thu, Aug 4, 2016 at 11:50 AM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>> Hi all,
>> samoa is in my local repository and dependencies works fine with all
>> other extensions that add samoa 0.4.0-incubator dependencies. But only when
>> i build carbon-ml, it gives priority for the remote repository for looking
>> samoa. SO any help with this to give priority for local m2 repo before
>> carbon-ml building is looking for the remote one. I am getting the error
>> because of this. maven option -U also not seems to be working here. any
>> help please.
>>
>> [ERROR] Failed to execute goal on project 
>> org.wso2.carbon.ml.siddhi.extension:
>> Could not resolve dependencies for project org.wso2.carbon.ml:org.wso2.
>> carbon.ml.siddhi.extension:bundle:1.1.2-SNAPSHOT: The following
>> artifacts could not be resolved: 
>> org.apache.samoa:samoa-api:jar:0.4.0-incubating,
>> org.apache.samoa:samoa-local:jar:0.4.0-incubating: Could not find
>> artifact org.apache.samoa:samoa-api:jar:0.4.0-incubating in wso2-nexus (
>> http://maven.wso2.org/nexus/content/groups/wso2-public/)
>>
>> Since samoa will be used for future work, is it possible to add that in
>> the relevant wso2 repo. Because there are

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Nirmal Fernando]

Did you add samoa jars in ML?

On Fri, Aug 5, 2016 at 12:20 PM, Mahesh Dananjaya  wrote:

> Hi Supun,
> This is the error i am getting while run the extension in the cabon-ml
> side,
> plase reffer to link [1] for the class.
>
> ERROR {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.
> StreamingClusteringTaskBuilder} -  Fail to initialize the task
>
> java.lang.Exception: Class not found: StreamingClusteringTask
>
>at com.github.javacliparser.ClassOption.cliStringToObject(
> ClassOption.java:136)
>
>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.
> StreamingClusteringTaskBuilder.initClusteringTask(
> StreamingClusteringTaskBuilder.java:129)
>
>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.
> StreamingClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder
> .java:100)
>
>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.
> StreamingClustering.run(StreamingClustering.java:77)
>
>at java.lang.Thread.run(Thread.java:745)
>
> [2016-08-04 16:23:07,437]  INFO {org.wso2.carbon.ml.siddhi.
> extension.streaming.samoa.StreamingClusteringTaskBuilder} -  Fail to
> initialize the taskjava.lang.Exception: Class not found:
> StreamingClusteringTask
>
> +++Please refeer link [1] for the StreamingClusteringTask.
>
> Then again for StreamingClusteringStream class while i bypass the String
> query in the initTask(). please refer link [2] for the class.
>
> Exception in thread "Thread-60" java.lang.IllegalArgumentException:
> Problems with option: streamTrain
>
>at com.github.javacliparser.ClassOption.setValueViaCLIString(
> ClassOption.java:64)
>
>at com.github.javacliparser.AbstractOption.resetToDefault(
> AbstractOption.java:90)
>
>at com.github.javacliparser.AbstractClassOption.(
> AbstractClassOption.java:84)
>
>at com.github.javacliparser.AbstractClassOption.(
> AbstractClassOption.java:63)
>
>at com.github.javacliparser.ClassOption.(ClassOption.java:38)
>
>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.
> StreamingClusteringTask.(StreamingClusteringTask.java:52)
>
>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.
> StreamingClusteringTaskBuilder.initClusteringTask(
> StreamingClusteringTaskBuilder.java:140)
>
>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.
> StreamingClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder
> .java:103)
>
>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.
> StreamingClustering.run(StreamingClustering.java:77)
>
>at java.lang.Thread.run(Thread.java:745)
>
> Caused by: java.lang.Exception: Class not found: org.wso2.carbon.ml.siddhi.
> extension.streaming.samoa.StreamingClusteringStream
>
>at com.github.javacliparser.ClassOption.cliStringToObject(
> ClassOption.java:136)
>
>at com.github.javacliparser.ClassOption.setValueViaCLIString(
> ClassOption.java:61)
>
>... 9 more
>
>
> Those Class Not Found Exceptions are at runtime. Do i have do anything on
> the carbon-ml side for this.My samoa cores can be found in [3]. Those are
> working fine and no Class Not Found Exceptions arrive when running outside
> the carbon-ml.
>
>
> thank you.
>
> regards,
>
> Mahesh.
>
>
>
> [1] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ml6_cml/
> components/extensions/org.wso2.carbon.ml.siddhi.
> extension/src/main/java/org/wso2/carbon/ml/siddhi/
> extension/streaming/samoa/StreamingClusteringTask.java
>
> [2]  https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ml6_cml/
> components/extensions/org.wso2.carbon.ml.siddhi.
> extension/src/main/java/org/wso2/carbon/ml/siddhi/
> extension/streaming/samoa/StreamingClusteringTask.java
>
> [3] https://github.com/dananjayamahesh/carbon-ml/tree/wso2_gsoc_ml6_cml/
> components/extensions/org.wso2.carbon.ml.siddhi.
> extension/src/main/java/org/wso2/carbon/ml/siddhi/
> extension/streaming/samoa
>
> On Thu, Aug 4, 2016 at 12:30 PM, Supun Sethunga  wrote:
>
>> Hi Mahesh,
>>
>> samoa dependency version in siddhi-extension should be
>> *0.4.0-incubating-SNAPSHOT*. That should solve the issue
>>
>> Regards,
>> Supun
>>
>> On Thu, Aug 4, 2016 at 11:50 AM, Mahesh Dananjaya <
>> dananjayamah...@gmail.com> wrote:
>>
>>> Hi all,
>>> samoa is in my local repository and dependencies works fine with all
>>> other extensions that add samoa 0.4.0-incubator dependencies. But only when
>>> i build carbon-ml, it gives priority for the remote repository for looking
>>> samoa. SO any help with this to give priority for local m2 repo before
>>> carbon-ml building is looking for the remote one. I am getting the error
>>> because of this. maven option -U also not seems to be working here. any
>>> help please.
>>>
>>> [ERROR] Failed to execute goal on project 
>>> org.wso2.carbon.ml.siddhi.extension:
>>> Could not resolve dependencies for project org.wso2.carbon.ml:o
>>> rg.wso2.carbon.ml.siddhi.extension:bundle:1.1.2-SNAPSHOT: The following
>>> artifacts could not be resolved: 
>>> org.apache.samoa:samoa-api:jar:0.4.0-incuba

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Mahesh Dananjaya]

Hi Nirmal,
Yes i have added samoa dependencies in carbon-ml and it is working fine.
These exceptions are coming for the my classes that are inside ml. when i
used classes in samoa like org.apache.samoa.tasks.ClusteringEvaluation it
is working fine and run. And also same classes that i developed are running
fine in my other extensions outside carbon-ml, which are developed as
regular extensions. i am checking this further. thank you.
regards,
Mahesh.

On Fri, Aug 5, 2016 at 5:31 PM, Nirmal Fernando  wrote:

> Did you add samoa jars in ML?
>
> On Fri, Aug 5, 2016 at 12:20 PM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>> Hi Supun,
>> This is the error i am getting while run the extension in the cabon-ml
>> side,
>> plase reffer to link [1] for the class.
>>
>> ERROR 
>> {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder}
>> -  Fail to initialize the task
>>
>> java.lang.Exception: Class not found: StreamingClusteringTask
>>
>>at com.github.javacliparser.ClassOption.cliStringToObject(Class
>> Option.java:136)
>>
>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>> gClusteringTaskBuilder.initClusteringTask(StreamingCl
>> usteringTaskBuilder.java:129)
>>
>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>> gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder.java:100)
>>
>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>> gClustering.run(StreamingClustering.java:77)
>>
>>at java.lang.Thread.run(Thread.java:745)
>>
>> [2016-08-04 16:23:07,437]  INFO {org.wso2.carbon.ml.siddhi.ext
>> ension.streaming.samoa.StreamingClusteringTaskBuilder} -  Fail to
>> initialize the taskjava.lang.Exception: Class not found:
>> StreamingClusteringTask
>>
>> +++Please refeer link [1] for the StreamingClusteringTask.
>>
>> Then again for StreamingClusteringStream class while i bypass the String
>> query in the initTask(). please refer link [2] for the class.
>>
>> Exception in thread "Thread-60" java.lang.IllegalArgumentException:
>> Problems with option: streamTrain
>>
>>at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl
>> assOption.java:64)
>>
>>at com.github.javacliparser.AbstractOption.resetToDefault(Abstr
>> actOption.java:90)
>>
>>at com.github.javacliparser.AbstractClassOption.(Abstract
>> ClassOption.java:84)
>>
>>at com.github.javacliparser.AbstractClassOption.(Abstract
>> ClassOption.java:63)
>>
>>at com.github.javacliparser.ClassOption.(ClassOption.java:38)
>>
>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>> gClusteringTask.(StreamingClusteringTask.java:52)
>>
>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>> gClusteringTaskBuilder.initClusteringTask(StreamingCl
>> usteringTaskBuilder.java:140)
>>
>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>> gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder.java:103)
>>
>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>> gClustering.run(StreamingClustering.java:77)
>>
>>at java.lang.Thread.run(Thread.java:745)
>>
>> Caused by: java.lang.Exception: Class not found:
>> org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>> gClusteringStream
>>
>>at com.github.javacliparser.ClassOption.cliStringToObject(Class
>> Option.java:136)
>>
>>at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl
>> assOption.java:61)
>>
>>... 9 more
>>
>>
>> Those Class Not Found Exceptions are at runtime. Do i have do anything on
>> the carbon-ml side for this.My samoa cores can be found in [3]. Those are
>> working fine and no Class Not Found Exceptions arrive when running outside
>> the carbon-ml.
>>
>>
>> thank you.
>>
>> regards,
>>
>> Mahesh.
>>
>>
>>
>> [1] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_
>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte
>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/
>> streaming/samoa/StreamingClusteringTask.java
>>
>> [2]  https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_
>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte
>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/
>> streaming/samoa/StreamingClusteringTask.java
>>
>> [3] https://github.com/dananjayamahesh/carbon-ml/tree/wso2_gsoc_
>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte
>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/streaming/samoa
>>
>> On Thu, Aug 4, 2016 at 12:30 PM, Supun Sethunga  wrote:
>>
>>> Hi Mahesh,
>>>
>>> samoa dependency version in siddhi-extension should be
>>> *0.4.0-incubating-SNAPSHOT*. That should solve the issue
>>>
>>> Regards,
>>> Supun
>>>
>>> On Thu, Aug 4, 2016 at 11:50 AM, Mahesh Dananjaya <
>>> dananjayamah...@gmail.com> wrote:
>>>
 Hi all,
 samoa is in my local repository and dependencies works fine with all
 other extensions that add samoa 0.4.0-incubator depen

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Mahesh Dananjaya]

Hi Nirmal,
can those things be caused by permission requirements?
BR,
Mahesh.

On Fri, Aug 5, 2016 at 5:39 PM, Mahesh Dananjaya 
wrote:

> Hi Nirmal,
> Yes i have added samoa dependencies in carbon-ml and it is working fine.
> These exceptions are coming for the my classes that are inside ml. when i
> used classes in samoa like org.apache.samoa.tasks.ClusteringEvaluation it
> is working fine and run. And also same classes that i developed are running
> fine in my other extensions outside carbon-ml, which are developed as
> regular extensions. i am checking this further. thank you.
> regards,
> Mahesh.
>
> On Fri, Aug 5, 2016 at 5:31 PM, Nirmal Fernando  wrote:
>
>> Did you add samoa jars in ML?
>>
>> On Fri, Aug 5, 2016 at 12:20 PM, Mahesh Dananjaya <
>> dananjayamah...@gmail.com> wrote:
>>
>>> Hi Supun,
>>> This is the error i am getting while run the extension in the cabon-ml
>>> side,
>>> plase reffer to link [1] for the class.
>>>
>>> ERROR 
>>> {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder}
>>> -  Fail to initialize the task
>>>
>>> java.lang.Exception: Class not found: StreamingClusteringTask
>>>
>>>at com.github.javacliparser.ClassOption.cliStringToObject(Class
>>> Option.java:136)
>>>
>>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>> gClusteringTaskBuilder.initClusteringTask(StreamingClusterin
>>> gTaskBuilder.java:129)
>>>
>>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>> gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder.java:100)
>>>
>>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>> gClustering.run(StreamingClustering.java:77)
>>>
>>>at java.lang.Thread.run(Thread.java:745)
>>>
>>> [2016-08-04 16:23:07,437]  INFO {org.wso2.carbon.ml.siddhi.ext
>>> ension.streaming.samoa.StreamingClusteringTaskBuilder} -  Fail to
>>> initialize the taskjava.lang.Exception: Class not found:
>>> StreamingClusteringTask
>>>
>>> +++Please refeer link [1] for the StreamingClusteringTask.
>>>
>>> Then again for StreamingClusteringStream class while i bypass the String
>>> query in the initTask(). please refer link [2] for the class.
>>>
>>> Exception in thread "Thread-60" java.lang.IllegalArgumentException:
>>> Problems with option: streamTrain
>>>
>>>at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl
>>> assOption.java:64)
>>>
>>>at com.github.javacliparser.AbstractOption.resetToDefault(Abstr
>>> actOption.java:90)
>>>
>>>at com.github.javacliparser.AbstractClassOption.(Abstract
>>> ClassOption.java:84)
>>>
>>>at com.github.javacliparser.AbstractClassOption.(Abstract
>>> ClassOption.java:63)
>>>
>>>at com.github.javacliparser.ClassOption.(ClassOption.java:38)
>>>
>>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>> gClusteringTask.(StreamingClusteringTask.java:52)
>>>
>>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>> gClusteringTaskBuilder.initClusteringTask(StreamingClusterin
>>> gTaskBuilder.java:140)
>>>
>>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>> gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder.java:103)
>>>
>>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>> gClustering.run(StreamingClustering.java:77)
>>>
>>>at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.Exception: Class not found:
>>> org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
>>> gClusteringStream
>>>
>>>at com.github.javacliparser.ClassOption.cliStringToObject(Class
>>> Option.java:136)
>>>
>>>at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl
>>> assOption.java:61)
>>>
>>>... 9 more
>>>
>>>
>>> Those Class Not Found Exceptions are at runtime. Do i have do anything
>>> on the carbon-ml side for this.My samoa cores can be found in [3]. Those
>>> are working fine and no Class Not Found Exceptions arrive when running
>>> outside the carbon-ml.
>>>
>>>
>>> thank you.
>>>
>>> regards,
>>>
>>> Mahesh.
>>>
>>>
>>>
>>> [1] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_
>>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte
>>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/stre
>>> aming/samoa/StreamingClusteringTask.java
>>>
>>> [2]  https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_
>>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte
>>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/stre
>>> aming/samoa/StreamingClusteringTask.java
>>>
>>> [3] https://github.com/dananjayamahesh/carbon-ml/tree/wso2_gsoc_
>>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte
>>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/streaming/samoa
>>>
>>> On Thu, Aug 4, 2016 at 12:30 PM, Supun Sethunga  wrote:
>>>
 Hi Mahesh,

 samoa dependency version in siddhi-extension should be
 *0.4.0-incubating-SNAPSHOT*. That should solve the i

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Nirmal Fernando]

Mahesh,

Your issue is not clear. What're you exactly trying ? carbon-ml is our git
repo and if you mean to say about the server you're running, please use the
term 'ML server'. Please summarize the problem and the steps you've done.
Please use the point form.

Thanks.

On Fri, Aug 5, 2016 at 6:43 PM, Mahesh Dananjaya 
wrote:

> Hi Nirmal,
> can those things be caused by permission requirements?
> BR,
> Mahesh.
>
> On Fri, Aug 5, 2016 at 5:39 PM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>> Hi Nirmal,
>> Yes i have added samoa dependencies in carbon-ml and it is working fine.
>> These exceptions are coming for the my classes that are inside ml. when i
>> used classes in samoa like org.apache.samoa.tasks.ClusteringEvaluation
>> it is working fine and run. And also same classes that i developed are
>> running fine in my other extensions outside carbon-ml, which are developed
>> as regular extensions. i am checking this further. thank you.
>> regards,
>> Mahesh.
>>
>> On Fri, Aug 5, 2016 at 5:31 PM, Nirmal Fernando  wrote:
>>
>>> Did you add samoa jars in ML?
>>>
>>> On Fri, Aug 5, 2016 at 12:20 PM, Mahesh Dananjaya <
>>> dananjayamah...@gmail.com> wrote:
>>>
 Hi Supun,
 This is the error i am getting while run the extension in the cabon-ml
 side,
 plase reffer to link [1] for the class.

 ERROR 
 {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder}
 -  Fail to initialize the task

 java.lang.Exception: Class not found: StreamingClusteringTask

at com.github.javacliparser.ClassOption.cliStringToObject(Class
 Option.java:136)

at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
 gClusteringTaskBuilder.initClusteringTask(StreamingClusterin
 gTaskBuilder.java:129)

at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
 gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuild
 er.java:100)

at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
 gClustering.run(StreamingClustering.java:77)

at java.lang.Thread.run(Thread.java:745)

 [2016-08-04 16:23:07,437]  INFO {org.wso2.carbon.ml.siddhi.ext
 ension.streaming.samoa.StreamingClusteringTaskBuilder} -  Fail to
 initialize the taskjava.lang.Exception: Class not found:
 StreamingClusteringTask

 +++Please refeer link [1] for the StreamingClusteringTask.

 Then again for StreamingClusteringStream class while i bypass the
 String query in the initTask(). please refer link [2] for the class.

 Exception in thread "Thread-60" java.lang.IllegalArgumentException:
 Problems with option: streamTrain

at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl
 assOption.java:64)

at com.github.javacliparser.AbstractOption.resetToDefault(Abstr
 actOption.java:90)

at com.github.javacliparser.AbstractClassOption.(Abstract
 ClassOption.java:84)

at com.github.javacliparser.AbstractClassOption.(Abstract
 ClassOption.java:63)

at com.github.javacliparser.ClassOption.(ClassOption.java:38)

at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
 gClusteringTask.(StreamingClusteringTask.java:52)

at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
 gClusteringTaskBuilder.initClusteringTask(StreamingClusterin
 gTaskBuilder.java:140)

at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
 gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuild
 er.java:103)

at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
 gClustering.run(StreamingClustering.java:77)

at java.lang.Thread.run(Thread.java:745)

 Caused by: java.lang.Exception: Class not found:
 org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
 gClusteringStream

at com.github.javacliparser.ClassOption.cliStringToObject(Class
 Option.java:136)

at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl
 assOption.java:61)

... 9 more


 Those Class Not Found Exceptions are at runtime. Do i have do anything
 on the carbon-ml side for this.My samoa cores can be found in [3]. Those
 are working fine and no Class Not Found Exceptions arrive when running
 outside the carbon-ml.


 thank you.

 regards,

 Mahesh.



 [1] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_
 ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte
 nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/stre
 aming/samoa/StreamingClusteringTask.java

 [2]  https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_
 ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte
 nsion/src/main/java/org

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Mahesh Dananjaya]

Hi Srinath and Nirmal,
I have integrated the my samoa predictive analysis topologies with the cep
with siddhi extension developed. As you asked me, i have verified the
output of my samoa streaming clustering topology with the previously build
Spark streaming Clustering analysis. Results are almost same and is
converging. As a example if i used two algorithms spark mini-batch
clustering and samoa kernal clustering for streaming clustering analysis
outcomes are as follows in my streaming extensions.

Spark Streaming Clustering
center 0:
440.873301276124,25.477847235065635,64.20812280377294,1010.9613963380791,67.80943221749587
center 1:
470.25742216416273,12.785760940561731,42.586181145220955,1015.9444850860008,79.6946897452645

Samoa Streaming Clustering
Center :0:
442.06527377405365,25.51594930115884,60.35312500444376,1010.624677139,61.262047085828065
Center :1:
469.66365199261037,12.6577054812157,43.59210147812603,1014.3543441369945,76.81973235658958

you can see that cluster centers are almost same.This is with 5 attributes
and two clusters. As long as we have large batch size and number of
increasing number of retraining, the results are converging. Now i am
trying to integrate this with carbon-ml and trying to fix couple of issues
in the integration. I will also prepare the documentation.thank you. And i
have create new repository [1] to put essential classes.
regards,
Mahesh.
[1] https://github.com/dananjayamahesh/streaming


On Fri, Aug 5, 2016 at 6:47 PM, Nirmal Fernando  wrote:

> Mahesh,
>
> Your issue is not clear. What're you exactly trying ? carbon-ml is our git
> repo and if you mean to say about the server you're running, please use the
> term 'ML server'. Please summarize the problem and the steps you've done.
> Please use the point form.
>
> Thanks.
>
> On Fri, Aug 5, 2016 at 6:43 PM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>> Hi Nirmal,
>> can those things be caused by permission requirements?
>> BR,
>> Mahesh.
>>
>> On Fri, Aug 5, 2016 at 5:39 PM, Mahesh Dananjaya <
>> dananjayamah...@gmail.com> wrote:
>>
>>> Hi Nirmal,
>>> Yes i have added samoa dependencies in carbon-ml and it is working fine.
>>> These exceptions are coming for the my classes that are inside ml. when i
>>> used classes in samoa like org.apache.samoa.tasks.ClusteringEvaluation
>>> it is working fine and run. And also same classes that i developed are
>>> running fine in my other extensions outside carbon-ml, which are developed
>>> as regular extensions. i am checking this further. thank you.
>>> regards,
>>> Mahesh.
>>>
>>> On Fri, Aug 5, 2016 at 5:31 PM, Nirmal Fernando  wrote:
>>>
 Did you add samoa jars in ML?

 On Fri, Aug 5, 2016 at 12:20 PM, Mahesh Dananjaya <
 dananjayamah...@gmail.com> wrote:

> Hi Supun,
> This is the error i am getting while run the extension in the cabon-ml
> side,
> plase reffer to link [1] for the class.
>
> ERROR 
> {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder}
> -  Fail to initialize the task
>
> java.lang.Exception: Class not found: StreamingClusteringTask
>
>at com.github.javacliparser.ClassOption.cliStringToObject(Class
> Option.java:136)
>
>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
> gClusteringTaskBuilder.initClusteringTask(StreamingClusterin
> gTaskBuilder.java:129)
>
>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
> gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuild
> er.java:100)
>
>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
> gClustering.run(StreamingClustering.java:77)
>
>at java.lang.Thread.run(Thread.java:745)
>
> [2016-08-04 16:23:07,437]  INFO {org.wso2.carbon.ml.siddhi.ext
> ension.streaming.samoa.StreamingClusteringTaskBuilder} -  Fail to
> initialize the taskjava.lang.Exception: Class not found:
> StreamingClusteringTask
>
> +++Please refeer link [1] for the StreamingClusteringTask.
>
> Then again for StreamingClusteringStream class while i bypass the
> String query in the initTask(). please refer link [2] for the class.
>
> Exception in thread "Thread-60" java.lang.IllegalArgumentException:
> Problems with option: streamTrain
>
>at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl
> assOption.java:64)
>
>at com.github.javacliparser.AbstractOption.resetToDefault(Abstr
> actOption.java:90)
>
>at com.github.javacliparser.AbstractClassOption.(Abstract
> ClassOption.java:84)
>
>at com.github.javacliparser.AbstractClassOption.(Abstract
> ClassOption.java:63)
>
>at com.github.javacliparser.ClassOption.(ClassOption.java:38)
>
>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
> gClusteringTask.(StreamingClusteringTask.java:52)
>

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Mahesh Dananjaya]

Hi supun,
I think i have fixed couple of previous errors. Now my samoa extension is
working fine with cep. But i am getting a exception with my spark streaming
ml extensions. It was working fine and i did not do any changes to my
previously developed streaming extensions. This error is occured in the
line,

conf = new SparkConf().setMaster("local[*]").setAppName("Linear Regression
Example").set("spark.driver.allowMultipleContexts", "true") ;
sc = new JavaSparkContext(conf);

This what i get and cep server is crashed.
ERROR {org.apache.spark.ui.SparkUI} -  Failed to bind SparkUI
javax.servlet.UnavailableException: Servlet class
com.sun.jersey.spi.container.servlet.ServletContainer is not a
javax.servlet.Servlet
at
org.spark-project.jetty.servlet.ServletHolder.checkServletType(ServletHolder.java:438)
at
org.spark-project.jetty.servlet.ServletHolder.doStart(ServletHolder.java:316)
at
org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at
org.spark-project.jetty.servlet.ServletHandler.initialize(ServletHandler.java:791)
at
org.spark-project.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:265)
at
org.spark-project.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:717)
at
org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at
org.spark-project.jetty.server.handler.HandlerCollection.doStart(HandlerCollection.java:229)
at
org.spark-project.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:172)
at
org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at
org.spark-project.jetty.server.handler.HandlerWrapper.doStart(HandlerWrapper.java:95)
at org.spark-project.jetty.server.Server.doStart(Server.java:282)
at
org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at
org.apache.spark.ui.JettyUtils$.org$apache$spark$ui$JettyUtils$$connect$1(JettyUtils.scala:228)
at org.apache.spark.ui.JettyUtils$$anonfun$2.apply(JettyUtils.scala:238)
at org.apache.spark.ui.JettyUtils$$anonfun$2.apply(JettyUtils.scala:238)
at
org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1991)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1982)
at
org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils.scala:238)
at org.apache.spark.ui.WebUI.bind(WebUI.scala:117)
at
org.apache.spark.SparkContext$$anonfun$13.apply(SparkContext.scala:448)
at
org.apache.spark.SparkContext$$anonfun$13.apply(SparkContext.scala:448)
at scala.Option.foreach(Option.scala:236)
at org.apache.spark.SparkContext.(SparkContext.scala:448)
at
org.apache.spark.api.java.JavaSparkContext.(JavaSparkContext.scala:61)
at
org.gsoc.siddhi.extension.streaming.StreamingKMeansClustering.(StreamingKMeansClustering.java:60)
at
org.gsoc.siddhi.extension.streaming.StreamingKMeansClusteringStreamProcessor.init(StreamingKMeansClusteringStreamProcessor.java:68)
at
org.wso2.siddhi.core.query.processor.stream.AbstractStreamProcessor.initProcessor(AbstractStreamProcessor.java:65)
at
org.wso2.siddhi.core.util.parser.SingleInputStreamParser.generateProcessor(SingleInputStreamParser.java:182)
at
org.wso2.siddhi.core.util.parser.SingleInputStreamParser.parseInputStream(SingleInputStreamParser.java:93)
at
org.wso2.siddhi.core.util.parser.InputStreamParser.parse(InputStreamParser.java:58)
at
org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:85)
at
org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:145)
at
org.wso2.siddhi.core.SiddhiManager.validateExecutionPlan(SiddhiManager.java:69)
at
org.wso2.siddhi.core.SiddhiManager.validateExecutionPlan(SiddhiManager.java:75)
at
org.wso2.carbon.event.processor.core.internal.util.helper.EventProcessorHelper.validateExecutionPlan(EventProcessorHelper.java:191)
at
org.wso2.carbon.event.processor.core.internal.CarbonEventProcessorService.validateExecutionPlan(CarbonEventProcessorService.java:493)
at
org.wso2.carbon.event.processor.admin.EventProcessorAdminService.validateExecutionPlan(EventProcessorAdminService.java:329)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at
org.apache.axis2.rpc.receivers.RPCUtil.invokeServiceClass(RPCUtil.java:212)
at
org.apache.axis2.rpc.receivers.RPCMessageReceiver.invokeBusinessLogic(RPCMessageReceiver.java:117)
at
org.apache.axis2.receivers.AbstractInOutMessageReceiver.invokeBusinessLogic(AbstractInOutMessageReceiver.java:40)
at
org.

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Supun Sethunga]

Hi Mahesh,

Couple of issues I noticed:

   - Your siddhi-extension is using spark 1.6.1 dependency. But in the
   logs, it says the version of spark is 1.4.1. You can see the following line
   in the logs.

*TID: [-1234] [] [2016-08-08 13:05:11,699]  INFO
{org.apache.spark.SparkContext} -  Running Spark version 1.4.1 *


   - In each of the extension, you are starting a spark-context, and a new
   spark application. But spark only allows to create one spark context per
   JVM.

Can you fix those and check whether the issue is still exists? Also please
use a fresh CEP pack when testing. For now, you can avoid the second issue
by creating only one execution plan and calling only one algorithm at a
time.

Btw, it would be easy for us to reproduce the issue and check whats
happening, if you can include all dependencies inside the jar itself.
Otherwise, it's a nightmare to find and add the missing dependencies one by
one.

Regards,
Supun


On Mon, Aug 8, 2016 at 3:43 PM, Mahesh Dananjaya 
wrote:

> Hi supun
> this is the log file.This happens only when i use the cep to invoke the
> extension.thank you.
> regards,
> Mahesh.
>
> On Mon, Aug 8, 2016 at 1:32 PM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>> Hi supun,
>> this is the cep log file.thank you.
>> Mahesh.
>>
>> On Mon, Aug 8, 2016 at 11:03 AM, Mahesh Dananjaya <
>> dananjayamah...@gmail.com> wrote:
>>
>>> Hi supun,
>>> I think i have fixed couple of previous errors. Now my samoa extension
>>> is working fine with cep. But i am getting a exception with my spark
>>> streaming ml extensions. It was working fine and i did not do any changes
>>> to my previously developed streaming extensions. This error is occured in
>>> the line,
>>>
>>> conf = new SparkConf().setMaster("local[*]").setAppName("Linear
>>> Regression Example").set("spark.driver.allowMultipleContexts", "true")
>>> ;
>>> sc = new JavaSparkContext(conf);
>>>
>>> This what i get and cep server is crashed.
>>> ERROR {org.apache.spark.ui.SparkUI} -  Failed to bind SparkUI
>>> javax.servlet.UnavailableException: Servlet class
>>> com.sun.jersey.spi.container.servlet.ServletContainer is not a
>>> javax.servlet.Servlet
>>> at org.spark-project.jetty.servlet.ServletHolder.checkServletTy
>>> pe(ServletHolder.java:438)
>>> at org.spark-project.jetty.servlet.ServletHolder.doStart(Servle
>>> tHolder.java:316)
>>> at org.spark-project.jetty.util.component.AbstractLifeCycle.sta
>>> rt(AbstractLifeCycle.java:64)
>>> at org.spark-project.jetty.servlet.ServletHandler.initialize(Se
>>> rvletHandler.java:791)
>>> at org.spark-project.jetty.servlet.ServletContextHandler.startC
>>> ontext(ServletContextHandler.java:265)
>>> at org.spark-project.jetty.server.handler.ContextHandler.doStar
>>> t(ContextHandler.java:717)
>>> at org.spark-project.jetty.util.component.AbstractLifeCycle.sta
>>> rt(AbstractLifeCycle.java:64)
>>> at org.spark-project.jetty.server.handler.HandlerCollection.doS
>>> tart(HandlerCollection.java:229)
>>> at org.spark-project.jetty.server.handler.ContextHandlerCollect
>>> ion.doStart(ContextHandlerCollection.java:172)
>>> at org.spark-project.jetty.util.component.AbstractLifeCycle.sta
>>> rt(AbstractLifeCycle.java:64)
>>> at org.spark-project.jetty.server.handler.HandlerWrapper.doStar
>>> t(HandlerWrapper.java:95)
>>> at org.spark-project.jetty.server.Server.doStart(Server.java:282)
>>> at org.spark-project.jetty.util.component.AbstractLifeCycle.sta
>>> rt(AbstractLifeCycle.java:64)
>>> at org.apache.spark.ui.JettyUtils$.org$apache$spark$ui$JettyUti
>>> ls$$connect$1(JettyUtils.scala:228)
>>> at org.apache.spark.ui.JettyUtils$$anonfun$2.apply(JettyUtils.s
>>> cala:238)
>>> at org.apache.spark.ui.JettyUtils$$anonfun$2.apply(JettyUtils.s
>>> cala:238)
>>> at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.ap
>>> ply$mcVI$sp(Utils.scala:1991)
>>> at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
>>> at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1982)
>>> at org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils.
>>> scala:238)
>>> at org.apache.spark.ui.WebUI.bind(WebUI.scala:117)
>>> at org.apache.spark.SparkContext$$anonfun$13.apply(SparkContext
>>> .scala:448)
>>> at org.apache.spark.SparkContext$$anonfun$13.apply(SparkContext
>>> .scala:448)
>>> at scala.Option.foreach(Option.scala:236)
>>> at org.apache.spark.SparkContext.(SparkContext.scala:448)
>>> at org.apache.spark.api.java.JavaSparkContext.(JavaSparkC
>>> ontext.scala:61)
>>> at org.gsoc.siddhi.extension.streaming.StreamingKMeansClusterin
>>> g.(StreamingKMeansClustering.java:60)
>>> at org.gsoc.siddhi.extension.streaming.StreamingKMeansClusterin
>>> gStreamProcessor.init(StreamingKMeansClusteringStreamProcessor.java:68)
>>> at org.wso2.siddhi.core.query.processor.stream.AbstractStreamPr
>>> ocessor.initProcessor(AbstractStreamProcessor.java:65)
>>> at org.

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Mahesh Dananjaya]

Hi supun,
Now most of the issues have been fixed. But still when i call spark and try
to invoke spark Context this error appears.still this is in the line

conf = new SparkConf().setMaster("local[*]").setAppName("Linear Regression
Example").set("spark.driver.allowMultipleContexts", "true");
sc = new JavaSparkContext(conf);
you can find this in the file [1].

com.typesafe.config.ConfigException$Missing: No configuration setting found
for key 'akka.version' in execution plan "ExecutionPlan"

ERROR {org.wso2.carbon.event.processor.admin.EventProcessorAdminService} -
Exception when validating execution plan
org.wso2.carbon.event.processor.core.exception.ExecutionPlanConfigurationException:
com.typesafe.config.ConfigException$Missing: No configuration setting found
for key 'akka.version' in execution plan "ExecutionPlan"
at
org.wso2.carbon.event.processor.core.internal.util.helper.EventProcessorHelper.validateExecutionPlan(EventProcessorHelper.java:193)
at
org.wso2.carbon.event.processor.core.internal.CarbonEventProcessorService.validateExecutionPlan(CarbonEventProcessorService.java:493)
at
org.wso2.carbon.event.processor.admin.EventProcessorAdminService.validateExecutionPlan(EventProcessorAdminService.java:329)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at
org.apache.axis2.rpc.receivers.RPCUtil.invokeServiceClass(RPCUtil.java:212)
at
org.apache.axis2.rpc.receivers.RPCMessageReceiver.invokeBusinessLogic(RPCMessageReceiver.java:117)
at
org.apache.axis2.receivers.AbstractInOutMessageReceiver.invokeBusinessLogic(AbstractInOutMessageReceiver.java:40)
at
org.apache.axis2.receivers.AbstractMessageReceiver.receive(AbstractMessageReceiver.java:110)
at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180)
at
org.apache.axis2.transport.local.LocalTransportReceiver.processMessage(LocalTransportReceiver.java:169)
at
org.apache.axis2.transport.local.LocalTransportReceiver.processMessage(LocalTransportReceiver.java:82)
at
org.wso2.carbon.core.transports.local.CarbonLocalTransportSender.finalizeSendWithToAddress(CarbonLocalTransportSender.java:45)
at
org.apache.axis2.transport.local.LocalTransportSender.invoke(LocalTransportSender.java:77)
at org.apache.axis2.engine.AxisEngine.send(AxisEngine.java:442)
at
org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:430)
at
org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225)
at
org.apache.axis2.client.OperationClient.execute(OperationClient.java:149)
at
org.wso2.carbon.event.processor.stub.EventProcessorAdminServiceStub.validateExecutionPlan(EventProcessorAdminServiceStub.java:2207)
at
org.apache.jsp.eventprocessor.validate_005fsiddhi_005fqueries_005fajaxprocessor_jsp._jspService(validate_005fsiddhi_005fqueries_005fajaxprocessor_jsp.java:73)
at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
at
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:432)
at
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:395)
at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:339)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
at org.wso2.carbon.ui.JspServlet.service(JspServlet.java:155)
at org.wso2.carbon.ui.TilesJspServlet.service(TilesJspServlet.java:80)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
at
org.eclipse.equinox.http.helper.ContextPathServletAdaptor.service(ContextPathServletAdaptor.java:37)
at
org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61)
at
org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128)
at
org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
at
org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.wso2.carbon.ui.filters.CSRFPreventionFilter.doFilter(CSRFPreventionFilter.java:88)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Supun Sethunga]

Refer:
http://stackoverflow.com/questions/31011243/no-configuration-setting-found-for-key-akka-version

Regards,
Supun

On Wed, Aug 10, 2016 at 2:45 PM, Mahesh Dananjaya  wrote:

> Hi supun,
> Now most of the issues have been fixed. But still when i call spark and
> try to invoke spark Context this error appears.still this is in the line
>
> conf = new SparkConf().setMaster("local[*]").setAppName("Linear
> Regression Example").set("spark.driver.allowMultipleContexts", "true");
> sc = new JavaSparkContext(conf);
> you can find this in the file [1].
>
> com.typesafe.config.ConfigException$Missing: No configuration setting
> found for key 'akka.version' in execution plan "ExecutionPlan"
>
> ERROR {org.wso2.carbon.event.processor.admin.EventProcessorAdminService}
> -  Exception when validating execution plan
> org.wso2.carbon.event.processor.core.exception.
> ExecutionPlanConfigurationException: 
> com.typesafe.config.ConfigException$Missing:
> No configuration setting found for key 'akka.version' in execution plan
> "ExecutionPlan"
> at org.wso2.carbon.event.processor.core.internal.util.
> helper.EventProcessorHelper.validateExecutionPlan(
> EventProcessorHelper.java:193)
>
> at org.wso2.carbon.event.processor.core.internal.
> CarbonEventProcessorService.validateExecutionPlan(
> CarbonEventProcessorService.java:493)
> at org.wso2.carbon.event.processor.admin.EventProcessorAdminService.
> validateExecutionPlan(EventProcessorAdminService.java:329)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at org.apache.axis2.rpc.receivers.RPCUtil.invokeServiceClass(RPCUtil.
> java:212)
> at org.apache.axis2.rpc.receivers.RPCMessageReceiver.
> invokeBusinessLogic(RPCMessageReceiver.java:117)
> at org.apache.axis2.receivers.AbstractInOutMessageReceiver.
> invokeBusinessLogic(AbstractInOutMessageReceiver.java:40)
> at org.apache.axis2.receivers.AbstractMessageReceiver.receive(
> AbstractMessageReceiver.java:110)
> at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180)
> at org.apache.axis2.transport.local.LocalTransportReceiver.
> processMessage(LocalTransportReceiver.java:169)
> at org.apache.axis2.transport.local.LocalTransportReceiver.
> processMessage(LocalTransportReceiver.java:82)
> at org.wso2.carbon.core.transports.local.CarbonLocalTransportSender.
> finalizeSendWithToAddress(CarbonLocalTransportSender.java:45)
> at org.apache.axis2.transport.local.LocalTransportSender.
> invoke(LocalTransportSender.java:77)
> at org.apache.axis2.engine.AxisEngine.send(AxisEngine.java:442)
> at org.apache.axis2.description.OutInAxisOperationClient.send(
> OutInAxisOperation.java:430)
> at org.apache.axis2.description.OutInAxisOperationClient.executeImpl(
> OutInAxisOperation.java:225)
> at org.apache.axis2.client.OperationClient.execute(
> OperationClient.java:149)
> at org.wso2.carbon.event.processor.stub.EventProcessorAdminServiceStub
> .validateExecutionPlan(EventProcessorAdminServiceStub.java:2207)
> at org.apache.jsp.eventprocessor.validate_005fsiddhi_
> 005fqueries_005fajaxprocessor_jsp._jspService(validate_
> 005fsiddhi_005fqueries_005fajaxprocessor_jsp.java:73)
> at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
> at org.apache.jasper.servlet.JspServletWrapper.service(
> JspServletWrapper.java:432)
> at org.apache.jasper.servlet.JspServlet.serviceJspFile(
> JspServlet.java:395)
> at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:339)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
> at org.wso2.carbon.ui.JspServlet.service(JspServlet.java:155)
> at org.wso2.carbon.ui.TilesJspServlet.service(TilesJspServlet.java:80)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
> at org.eclipse.equinox.http.helper.ContextPathServletAdaptor.service(
> ContextPathServletAdaptor.java:37)
> at org.eclipse.equinox.http.servlet.internal.
> ServletRegistration.service(ServletRegistration.java:61)
> at org.eclipse.equinox.http.servlet.internal.ProxyServlet.
> processAlias(ProxyServlet.java:128)
> at org.eclipse.equinox.http.servlet.internal.ProxyServlet.
> service(ProxyServlet.java:68)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
> at org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.
> service(DelegationServlet.java:68)
> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:303)
> at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
> at org.apache.tomcat.websocket.server.WsFilter.doFilt

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Mahesh Dananjaya]

I think this is for the StreamingRegression right. You have to check the
queryr. if there is simple mistake such as a space this can be happened. As
i remember this is coming in the execution right?check in your local maven
repository that relevant class is there first. and can you explain how you
are going to run this. with CEP?i will check.
BR,
Mahesh.

On Thu, Nov 24, 2016 at 12:11 PM, Jayan Vidanapathirana 
wrote:

> Hi Ayya,
>
> This is the exception,
>
> SLF4J: Defaulting to no-operation (NOP) logger implementation
> SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further
> details.
> Exception in thread "Thread-1" 
> org.wso2.siddhi.core.exception.ExecutionPlanRuntimeException:
> Fail to initialize the task :
> at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.
> utils.regression.StreamingRegressionTaskBuilder.initRegressionTask(
> StreamingRegressionTaskBuilder.java:91)
> at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.
> utils.regression.StreamingRegressionTaskBuilder.initTask(
> StreamingRegressionTaskBuilder.java:64)
> at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.
> utils.regression.StreamingRegression.run(StreamingRegression.java:57)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.Exception: Problem creating instance of class:
> org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.utils.regression.
> StreamingRegressionTask
> at com.github.javacliparser.ClassOption.cliStringToObject(
> ClassOption.java:143)
> at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.
> utils.regression.StreamingRegressionTaskBuilder.initRegressionTask(
> StreamingRegressionTaskBuilder.java:89)
> ... 3 more
> Caused by: java.lang.IllegalArgumentException: Problems with option:
> trainStream
> at com.github.javacliparser.ClassOption.setValueViaCLIString(
> ClassOption.java:64)
> at com.github.javacliparser.AbstractOption.resetToDefault(
> AbstractOption.java:90)
> at com.github.javacliparser.AbstractClassOption.(
> AbstractClassOption.java:84)
> at com.github.javacliparser.AbstractClassOption.(
> AbstractClassOption.java:63)
> at com.github.javacliparser.ClassOption.(
> ClassOption.java:38)
> at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.
> utils.ProcessTask.(ProcessTask.java:67)
> at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.
> utils.regression.StreamingRegressionTask.
> (StreamingRegressionTask.java:32)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(
> NativeConstructorAccessorImpl.java:62)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(
> DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
> at java.lang.Class.newInstance(Class.java:442)
> at com.github.javacliparser.ClassOption.cliStringToObject(
> ClassOption.java:141)
> ... 4 more
> Caused by: java.lang.Exception: Class not found: org.wso2.carbon.ml.siddhi.
> extension.streamingml.samoa.utils.regression.StreamingRegressionStream
> at com.github.javacliparser.ClassOption.cliStringToObject(
> ClassOption.java:136)
> at com.github.javacliparser.ClassOption.setValueViaCLIString(
> ClassOption.java:61)
> ... 16 more
>
> 
> 
> 
> TaskBuilder query
>
> query = 
> "org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.utils.regression.StreamingRegressionTask
>  -f " + batchSize + " -i " + maxInstances +
> " -s 
> (org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.utils.regression.StreamingRegressionStream
>  -A " + numberOfAttributes + " ) " +
> "-l  
> (org.apache.samoa.learners.classifiers.rules.HorizontalAMRulesRegressor " +
> "-r 9 -p " + parallelism + ")";
>
>
>
> On Wed, Nov 23, 2016 at 2:40 PM, Jayan Vidanapathirana 
> wrote:
>
>> Hi ayya,
>>
>> I got the same issue you got here. Need a help to solve this is you have
>> free time.
>>
>>
>> -- Forwarded message --
>> From: Mahesh Dananjaya 
>> Date: Fri, Aug 5, 2016 at 12:20 PM
>> Subject: Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic
>> with online data for WSO2 Machine Learner-Samoa Integration
>> To: Supun Sethunga 
>> Cc: Miyuru Dayarathna , Nir

Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration

[Jayan Vidanapathirana]

Hi Mahesh,
In my case, I got the same exception that you got before. It said
StreamingRegression classNotFound but when I debug the code that class
already loaded. The Issue happened inside the class regressionStream class
and it cannot find the Samoa Instance class(Inside the regressionStream
class I imported samoa.instance.Instance class) because I forgot to add
samoa.instance jar file path to my jvm.

Exception I got :
Exception in thread "Thread-1"
org.wso2.siddhi.core.exception.ExecutionPlanRuntimeException:
Fail to initialize the task :
at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.
utils.regression.StreamingRegressionTaskBuilder.initRegressionTask(
StreamingRegressionTaskBuilder.java:91)
at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.
utils.regression.StreamingRegressionTaskBuilder.initTask(
StreamingRegressionTaskBuilder.java:64)
at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.
utils.regression.StreamingRegression.run(StreamingRegression.java:57)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.Exception: Problem creating instance of class:
org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.utils.regression.
StreamingRegressionTask
at com.github.javacliparser.ClassOption.cliStringToObject(
ClassOption.java:143)
at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.
utils.regression.StreamingRegressionTaskBuilder.initRegressionTask(
StreamingRegressionTaskBuilder.java:89)
... 3 more
Caused by: java.lang.IllegalArgumentException: Problems with option:
trainStream
at com.github.javacliparser.ClassOption.setValueViaCLIString(
ClassOption.java:64)
at com.github.javacliparser.AbstractOption.resetToDefault(
AbstractOption.java:90)
at com.github.javacliparser.AbstractClassOption.(
AbstractClassOption.java:84)
at com.github.javacliparser.AbstractClassOption.(
AbstractClassOption.java:63)
at com.github.javacliparser.ClassOption.(ClassOption.java:38)
at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.
utils.ProcessTask.(ProcessTask.java:67)
at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.
utils.regression.StreamingRegressionTask.
(StreamingRegressionTask.java:32)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(
NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(
DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at java.lang.Class.newInstance(Class.java:442)
at com.github.javacliparser.ClassOption.cliStringToObject(
ClassOption.java:141)
... 4 more
Caused by: java.lang.Exception: Class not found: org.wso2.carbon.ml.siddhi.
extension.streamingml.samoa.utils.regression.StreamingRegressionStream
at com.github.javacliparser.ClassOption.cliStringToObject(
ClassOption.java:136)
at com.github.javacliparser.ClassOption.setValueViaCLIString(
ClassOption.java:61)

On Thu, Nov 24, 2016 at 1:09 PM, Jayan Vidanapathirana 
wrote:

> Hi Supun Ayya,
>
> I got this same exception.
> My project github link : https://github.com/Jayancv/
> streamingML/tree/master/src/main/java/org/wso2/carbon/ml/
> siddhi/extension/streamingml/samoa/utils/regression
>
>
> -- Forwarded message --
> From: Mahesh Dananjaya 
> Date: Fri, Aug 5, 2016 at 12:20 PM
> Subject: Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic
> with online data for WSO2 Machine Learner-Samoa Integration
> To: Supun Sethunga 
> Cc: Miyuru Dayarathna , Nirmal Fernando ,
> Maheshakya Wijewardena , Srinath Perera <
> srin...@wso2.com>, Jayan Vidanapathirana , WSO2
> Developers' List 
>
>
> Hi Supun,
> This is the error i am getting while run the extension in the cabon-ml
> side,
> plase reffer to link [1] for the class.
>
> ERROR 
> {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder}
> -  Fail to initialize the task
>
> java.lang.Exception: Class not found: StreamingClusteringTask
>
>at com.github.javacliparser.ClassOption.cliStringToObject(Class
> Option.java:136)
>
>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
> gClusteringTaskBuilder.initClusteringTask(StreamingCl
> usteringTaskBuilder.java:129)
>
>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
> gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder.java:100)
>
>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin
> gClustering.run(StreamingClustering.java:77)
>
>at java.lang.Thread.run(Thread.java:745)
>
> [2016-08-04 16:23:07,437]  INFO {org.wso2.carbon.ml.siddhi.ext
> ension.streaming.samoa.