Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi Mahesh, Can you please share your samoa project? On Sun, Jul 17, 2016 at 11:19 AM, Mahesh Dananjaya < dananjayamah...@gmail.com> wrote: > > -- Forwarded message -- > From: Mahesh Dananjaya > Date: Sun, Jul 17, 2016 at 11:18 AM > Subject: Re: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online > data for WSO2 Machine Learner-Samoa Integration > To: Maheshakya Wijewardena > > > Hi Maheshakaya, > just need a little help. In Samoa when we want to run a class what is does > it used this commands [1], > 1. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar > "ClusteringEvaluation" > 2. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar > "PrequentialEvaluation -d /tmp/dump.csv -i 100 -f 10 -l > (classifiers.trees.VerticalHoeffdingTree -p 4) -s > (generators.RandomTreeGenerator -c 2 -o 10 -u 10)" > > what is does is call a class named LocalDoTask [4] and pass this string as > argument.After that that LocalDoTask call the relevent Tasks such as > ClusteringEvaluation or PrequentialEvaluation. [2]. > > Now i have add samoa dependencies to my new maven project, where i used > original samoa source to write examples and test then earlier.Now i want to > push them into my new java project with samoa dependencies. I added > dependency and it was built fine. Now i am calling my local DoTask.java [3] > file as same as i did with samoa with, > java -cp target/streaming-1.0-SNAPSHOT.jar org.gsoc.samoa.streaming.DoTask > "org.gsoc.samoa.streaming.ClusteringEvaluation" > But seems to be i am incorrect in some place. > Error: A JNI error has occurred, please check your installation and try > again > Exception in thread "main" java.lang.NoClassDefFoundError: > org/apache/samoa/topology/ComponentFactory > at java.lang.Class.getDeclaredMethods0(Native Method) > at java.lang.Class.privateGetDeclaredMethods(Class.java:2701) > at java.lang.Class.privateGetMethodRecursive(Class.java:3048) > at java.lang.Class.getMethod0(Class.java:3018) > at java.lang.Class.getMethod(Class.java:1784) > at > sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:544) > at > sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:526) > Caused by: java.lang.ClassNotFoundException: > org.apache.samoa.topology.ComponentFactory > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 7 more > > > can i actually call the Task like this. > > BR, > Mahesh. > > [1] > https://samoa.incubator.apache.org/documentation/Prequential-Evaluation-Task.html > [2] > https://github.com/apache/incubator-samoa/blob/releases/0.4.0-incubating-RC0/samoa-api/src/main/java/org/apache/samoa/tasks/ClusteringEvaluation.java > [3] > https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming > [4] > https://github.com/apache/incubator-samoa/tree/releases/0.4.0-incubating-RC0/samoa-local/src/main/java/org/apache/samoa > > > On Thu, Jul 14, 2016 at 3:47 PM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> Hi srinath, >> sure.i am working on it.thank you. >> regards, >> Mahesh. >> >> On Thu, Jul 14, 2016 at 11:12 AM, Srinath Perera >> wrote: >> >>> Hi Mahesh, >>> >>> Let's focus on getting SAOMA work with CEP. It is OK to be limited to >>> few algorithms. >>> >>> --Srinath >>> >>> On Thu, Jul 14, 2016 at 10:49 AM, Mahesh Dananjaya < >>> dananjayamah...@gmail.com> wrote: >>> Hi Maheshakya, I think we can build new tasks [1] like the one in execution plan in cep with samoa. I will try to build a one. regards, Mahesh. [1] https://samoa.incubator.apache.org/documentation/Developing-New-Tasks-in-SAMOA.html On Thu, Jul 14, 2016 at 10:35 AM, Mahesh Dananjaya < dananjayamah...@gmail.com> wrote: > Hi Maheshakya, > I am building and running samoa to see its functionality. In samoa > still we have limited supports in algorithms. Samoa supports only > classification and clustering with streams. It also use kind of > StreamProcessor, like the one we use in StreamProcessor extension. I was > getting started with Samoa referring to this page [1]. Then i ran couple > of > examples to identified the flow. Samoa use hadoop framework instead spark > for distribution. But i am using it in a local mode. When i see the Samoa > core there is only limited algorithms. IMO if we are going to use Samoa we > have to limit the functionality and algorithms [2]. When i go to developer > corner in [3], it seems to be something like CEP extension that we are > using currenlty. SO in Samoa though the algorihtms are limited, they have > implemented streaming support for them. Therefore if we integrate it into > CEP we have to
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi Maheshakya, Samoa modules built as topologies that connect streams with the internal processors. I have already written some examples to test the ML algorithms and samoa analysis topologies. What we need to done is mostly developing a wrapper around samoa topologies to connect their input and output streams with our cep streams. So i am currently going through their stream architecture to connect our streams with their streams. Couple of examples exapaining samoa ml topologies and streaming can be found in my git hub repo [1]. Samoa using MOA ml algorithms by wrapping them with their classes. Initailly i am trying to develop a KMeansClustering analysis with cep streams with samoa ml topologies. And also i could not find a maven repo for samoa 0.4.0 incubating. So i am currently using my local m2 repo's samoa 0..4.0 incubating for my dependencies to work. The local one is built by original samoa source.thank you. regards, Mahesh. [1] https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming On Mon, Jul 18, 2016 at 8:32 AM, Maheshakya Wijewardena wrote: > Hi Mahesh, > > Can you please share your samoa project? > > On Sun, Jul 17, 2016 at 11:19 AM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> >> -- Forwarded message -- >> From: Mahesh Dananjaya >> Date: Sun, Jul 17, 2016 at 11:18 AM >> Subject: Re: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online >> data for WSO2 Machine Learner-Samoa Integration >> To: Maheshakya Wijewardena >> >> >> Hi Maheshakaya, >> just need a little help. In Samoa when we want to run a class what is >> does it used this commands [1], >> 1. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar >> "ClusteringEvaluation" >> 2. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar >> "PrequentialEvaluation -d /tmp/dump.csv -i 100 -f 10 -l >> (classifiers.trees.VerticalHoeffdingTree -p 4) -s >> (generators.RandomTreeGenerator -c 2 -o 10 -u 10)" >> >> what is does is call a class named LocalDoTask [4] and pass this string >> as argument.After that that LocalDoTask call the relevent Tasks such as >> ClusteringEvaluation or PrequentialEvaluation. [2]. >> >> Now i have add samoa dependencies to my new maven project, where i used >> original samoa source to write examples and test then earlier.Now i want to >> push them into my new java project with samoa dependencies. I added >> dependency and it was built fine. Now i am calling my local DoTask.java [3] >> file as same as i did with samoa with, >> java -cp target/streaming-1.0-SNAPSHOT.jar >> org.gsoc.samoa.streaming.DoTask >> "org.gsoc.samoa.streaming.ClusteringEvaluation" >> But seems to be i am incorrect in some place. >> Error: A JNI error has occurred, please check your installation and try >> again >> Exception in thread "main" java.lang.NoClassDefFoundError: >> org/apache/samoa/topology/ComponentFactory >> at java.lang.Class.getDeclaredMethods0(Native Method) >> at java.lang.Class.privateGetDeclaredMethods(Class.java:2701) >> at java.lang.Class.privateGetMethodRecursive(Class.java:3048) >> at java.lang.Class.getMethod0(Class.java:3018) >> at java.lang.Class.getMethod(Class.java:1784) >> at >> sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:544) >> at >> sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:526) >> Caused by: java.lang.ClassNotFoundException: >> org.apache.samoa.topology.ComponentFactory >> at java.net.URLClassLoader.findClass(URLClassLoader.java:381) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:424) >> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:357) >> ... 7 more >> >> >> can i actually call the Task like this. >> >> BR, >> Mahesh. >> >> [1] >> https://samoa.incubator.apache.org/documentation/Prequential-Evaluation-Task.html >> [2] >> https://github.com/apache/incubator-samoa/blob/releases/0.4.0-incubating-RC0/samoa-api/src/main/java/org/apache/samoa/tasks/ClusteringEvaluation.java >> [3] >> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming >> [4] >> https://github.com/apache/incubator-samoa/tree/releases/0.4.0-incubating-RC0/samoa-local/src/main/java/org/apache/samoa >> >> >> On Thu, Jul 14, 2016 at 3:47 PM, Mahesh Dananjaya < >> dananjayamah...@gmail.com> wrote: >> >>> Hi srinath, >>> sure.i am working on it.thank you. >>> regards, >>> Mahesh. >>> >>> On Thu, Jul 14, 2016 at 11:12 AM, Srinath Perera >>> wrote: >>> Hi Mahesh, Let's focus on getting SAOMA work with CEP. It is OK to be limited to few algorithms. --Srinath On Thu, Jul 14, 2016 at 10:49 AM, Mahesh Dananjaya < dananjayamah...@gmail.com> wrote: > Hi Maheshakya, > I think we can build new tasks [1] like the one in execution plan in > cep with samoa. I will
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi All, I am onto connecting cep streams with samoa streams to data analysis using samoa framework. To connect samoa with cep siddhi event streams what i we can do is that try to convert cep streams into samoa streams or else writing wrpper for samoa for cep streasm to be used. In both cases i have to covert siddhi cep streasm into samoa streams. Samoa is using MOA to analyse data. Moo contains ML framework to analyse stream data. Samoa is wrapping MOA withsome of its classes. Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see streams as a stream of instances [1]. So if we are going to convert cep events into samoa instances , it will take time. But if we have some similarity between cep siddhi streams and samoa streasm we can reduce the time. 1. What is the underlying infrastructure for cep siddhi streasm.? 2. Are there anything as Instances or InstanceStreams kind of implmentation underlying cep streams? 3. How can i get more underestanding on CEP siddhi streams. On the other hand i can use my cep siddhi extension and put those events into event queue and convert them into samoa instances and feed them into samoa streaming ml topologies. There is another option. In Samoa what they are basically doing is that wrapping MOA ML framework and write some classes for build streaming ml topologies. So as the other option i can wrap samoa moa with my design and use moa ml framework directly. (No need for Samoa extension). I have building some topologies to streaming data analysis [2]. Main problem is that lack of documentation. Anyway i had go through their whole samoa design.thank you. regards, Mahesh. [1] https://github.com/apache/incubator-samoa/blob/master/samoa-api/src/main/java/org/apache/samoa/streams/clustering/ClusteringStream.java [2] https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya < dananjayamah...@gmail.com> wrote: > Hi Maheshakya, > Samoa modules built as topologies that connect streams with the internal > processors. I have already written some examples to test the ML algorithms > and samoa analysis topologies. What we need to done is mostly developing a > wrapper around samoa topologies to connect their input and output streams > with our cep streams. So i am currently going through their stream > architecture to connect our streams with their streams. Couple of examples > exapaining samoa ml topologies and streaming can be found in my git hub > repo [1]. Samoa using MOA ml algorithms by wrapping them with their > classes. Initailly i am trying to develop a KMeansClustering analysis with > cep streams with samoa ml topologies. > And also i could not find a maven repo for samoa 0.4.0 incubating. So i am > currently using my local m2 repo's samoa 0..4.0 incubating for my > dependencies to work. The local one is built by original samoa source.thank > you. > > regards, > Mahesh. > > [1] > https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming > > > On Mon, Jul 18, 2016 at 8:32 AM, Maheshakya Wijewardena < > mahesha...@wso2.com> wrote: > >> Hi Mahesh, >> >> Can you please share your samoa project? >> >> On Sun, Jul 17, 2016 at 11:19 AM, Mahesh Dananjaya < >> dananjayamah...@gmail.com> wrote: >> >>> >>> -- Forwarded message -- >>> From: Mahesh Dananjaya >>> Date: Sun, Jul 17, 2016 at 11:18 AM >>> Subject: Re: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online >>> data for WSO2 Machine Learner-Samoa Integration >>> To: Maheshakya Wijewardena >>> >>> >>> Hi Maheshakaya, >>> just need a little help. In Samoa when we want to run a class what is >>> does it used this commands [1], >>> 1. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar >>> "ClusteringEvaluation" >>> 2. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar >>> "PrequentialEvaluation -d /tmp/dump.csv -i 100 -f 10 -l >>> (classifiers.trees.VerticalHoeffdingTree -p 4) -s >>> (generators.RandomTreeGenerator -c 2 -o 10 -u 10)" >>> >>> what is does is call a class named LocalDoTask [4] and pass this string >>> as argument.After that that LocalDoTask call the relevent Tasks such as >>> ClusteringEvaluation or PrequentialEvaluation. [2]. >>> >>> Now i have add samoa dependencies to my new maven project, where i used >>> original samoa source to write examples and test then earlier.Now i want to >>> push them into my new java project with samoa dependencies. I added >>> dependency and it was built fine. Now i am calling my local DoTask.java [3] >>> file as same as i did with samoa with, >>> java -cp target/streaming-1.0-SNAPSHOT.jar >>> org.gsoc.samoa.streaming.DoTask >>> "org.gsoc.samoa.streaming.ClusteringEvaluation" >>> But seems to be i am incorrect in some place. >>> Error: A JNI error has occurred, please check your installation and try >>> again >>> Exception in thread "main" java.lang.NoClassDefFoundErr
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi Mahesh, On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya wrote: > Hi All, > I am onto connecting cep streams with samoa streams to data analysis using > samoa framework. To connect samoa with cep siddhi event streams what i we > can do is that try to convert cep streams into samoa streams or else > writing wrpper for samoa for cep streasm to be used. In both cases i have > to covert siddhi cep streasm into samoa streams. Samoa is using MOA to > analyse data. Moo contains ML framework to analyse stream data. Samoa is > wrapping MOA withsome of its classes. > > Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see > streams as a stream of instances [1]. So if we are going to convert cep > events into samoa instances , it will take time. But if we have some > similarity between cep siddhi streams and samoa streasm we can reduce the > time. > 1. What is the underlying infrastructure for cep siddhi streasm.? > 2. Are there anything as Instances or InstanceStreams kind of > implmentation underlying cep streams? > 3. How can i get more underestanding on CEP siddhi streams. > > On the other hand i can use my cep siddhi extension and put those events > into event queue and convert them into samoa instances and feed them into > samoa streaming ml topologies. > I think this is OK. I assume this is much easier. Let's do this and check the performance. > There is another option. In Samoa what they are basically doing is that > wrapping MOA ML framework and write some classes for build streaming ml > topologies. So as the other option i can wrap samoa moa with my design and > use moa ml framework directly. (No need for Samoa extension). I have > building some topologies to streaming data analysis [2]. Main problem is > that lack of documentation. Anyway i had go through their whole samoa > design.thank you. > If we use MOA directly, would we loose the distributed support in SAOMA. Let's do a call when you can, so we can dsicuss this in detail. --Srinath > regards, > Mahesh. > > [1] > https://github.com/apache/incubator-samoa/blob/master/samoa-api/src/main/java/org/apache/samoa/streams/clustering/ClusteringStream.java > [2] > https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming > > On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> Hi Maheshakya, >> Samoa modules built as topologies that connect streams with the internal >> processors. I have already written some examples to test the ML algorithms >> and samoa analysis topologies. What we need to done is mostly developing a >> wrapper around samoa topologies to connect their input and output streams >> with our cep streams. So i am currently going through their stream >> architecture to connect our streams with their streams. Couple of examples >> exapaining samoa ml topologies and streaming can be found in my git hub >> repo [1]. Samoa using MOA ml algorithms by wrapping them with their >> classes. Initailly i am trying to develop a KMeansClustering analysis with >> cep streams with samoa ml topologies. >> And also i could not find a maven repo for samoa 0.4.0 incubating. So i >> am currently using my local m2 repo's samoa 0..4.0 incubating for my >> dependencies to work. The local one is built by original samoa source.thank >> you. >> >> regards, >> Mahesh. >> >> [1] >> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming >> >> >> On Mon, Jul 18, 2016 at 8:32 AM, Maheshakya Wijewardena < >> mahesha...@wso2.com> wrote: >> >>> Hi Mahesh, >>> >>> Can you please share your samoa project? >>> >>> On Sun, Jul 17, 2016 at 11:19 AM, Mahesh Dananjaya < >>> dananjayamah...@gmail.com> wrote: >>> -- Forwarded message -- From: Mahesh Dananjaya Date: Sun, Jul 17, 2016 at 11:18 AM Subject: Re: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration To: Maheshakya Wijewardena Hi Maheshakaya, just need a little help. In Samoa when we want to run a class what is does it used this commands [1], 1. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar "ClusteringEvaluation" 2. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar "PrequentialEvaluation -d /tmp/dump.csv -i 100 -f 10 -l (classifiers.trees.VerticalHoeffdingTree -p 4) -s (generators.RandomTreeGenerator -c 2 -o 10 -u 10)" what is does is call a class named LocalDoTask [4] and pass this string as argument.After that that LocalDoTask call the relevent Tasks such as ClusteringEvaluation or PrequentialEvaluation. [2]. Now i have add samoa dependencies to my new maven project, where i used original samoa source to write examples and test then earlier.Now i want to push them into my new java project with samoa dependencies. I added
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi Srinath, "I think this is OK. I assume this is much easier. Let's do this and check the performance", I also think so. I am currently on this and have a progress in this.for your question, "If we use MOA directly, would we loose the distributed support in SAOMA. Let's do a call when you can, so we can dsicuss this in detail." I have to check for that.i think if we are using MOA, we can use distributed clusters. As i wen through their documentation MOA itself cannot support distribution. But samoa can. What samoa does is providing streaming and clustering support by wrapping MOA algorithms. So i think we dont need to go for that option,directly MOA. Because now we can handle samoa building blocks.So we had 2 options for integrating it with cep without exploiting samoa architecture which is highly modular,scalable and flexible. 1. Develop Samoa topologies with basic samoa building blocks which make use of MOA algorithms. 2. Creating New streaming options with samoa stream building blocks which can feed cep siddhi events into samoa streams and get results samoa streams to cep back. As 2nd option is easy and take reasonable time i am currently developing some modules to integrate cep streams into samoa which can be easily further extended to 1 option as well. So i had to modify stream and entrance modules for that and i think is has good progress. So now i can feed my custom input stream to samoa topologies. That means i can easily integrate cep event stream into samoa instance stream. currently i am verifying the streaming clustering algorithms and its results with my custom input input streams which can be connected to samoa instance streams. As i have already developed siddhi extension for streaming, i can use them to feed my custom input streams now. As the initial step i am go with the streaming clustering algorithms. Those are in my GSOC github repo [1]. clustering - Streaming Clustering Support with samoa and CEP streaming - Streaming extension for samoa for cep evet streams i am currenlty working on the verification of results with some of our custom streams and then we will just have to integrate it with my extensions, which are already developed for cep as my first part.thank you. regards, Mahesh. [1] https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera wrote: > Hi Mahesh, > > On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> Hi All, >> I am onto connecting cep streams with samoa streams to data analysis >> using samoa framework. To connect samoa with cep siddhi event streams what >> i we can do is that try to convert cep streams into samoa streams or else >> writing wrpper for samoa for cep streasm to be used. In both cases i have >> to covert siddhi cep streasm into samoa streams. Samoa is using MOA to >> analyse data. Moo contains ML framework to analyse stream data. Samoa is >> wrapping MOA withsome of its classes. >> >> Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see >> streams as a stream of instances [1]. So if we are going to convert cep >> events into samoa instances , it will take time. But if we have some >> similarity between cep siddhi streams and samoa streasm we can reduce the >> time. >> 1. What is the underlying infrastructure for cep siddhi streasm.? >> 2. Are there anything as Instances or InstanceStreams kind of >> implmentation underlying cep streams? >> 3. How can i get more underestanding on CEP siddhi streams. >> >> On the other hand i can use my cep siddhi extension and put those events >> into event queue and convert them into samoa instances and feed them into >> samoa streaming ml topologies. >> > I think this is OK. I assume this is much easier. Let's do this and check > the performance. > > >> There is another option. In Samoa what they are basically doing is that >> wrapping MOA ML framework and write some classes for build streaming ml >> topologies. So as the other option i can wrap samoa moa with my design and >> use moa ml framework directly. (No need for Samoa extension). I have >> building some topologies to streaming data analysis [2]. Main problem is >> that lack of documentation. Anyway i had go through their whole samoa >> design.thank you. >> > > If we use MOA directly, would we loose the distributed support in SAOMA. > Let's do a call when you can, so we can dsicuss this in detail. > > --Srinath > > > >> regards, >> Mahesh. >> >> [1] >> https://github.com/apache/incubator-samoa/blob/master/samoa-api/src/main/java/org/apache/samoa/streams/clustering/ClusteringStream.java >> [2] >> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming >> >> On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya < >> dananjayamah...@gmail.com> wrote: >> >>> Hi Maheshakya, >>> Samoa modules built as topologies that connect streams w
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi Maheshakya, I have a small problem. As we did all the time when i build a samoa streaming extension for the cep by providing samoa dependencies, i put that jar into cep_home/repository/component/lib/ folder.The start cep and try to develop the execution plan by providing my extension. i am remotely debugging the samoa streaming extension that connected to our samoa predictive learning topology. While on the run i get this exception. java.lang.ClassNotFoundException: org.apache.samoa.topology.ComponentFactory cannot be found by streaming_1.0_SNAPSHOT_1.0.0. But without cep my samoa core is running fine. It seems to be samoa is not recognizing in the cep side. Is this kind of a dependency problem. In my extension side i think nothing wrong. When i replace the streamProcessor extension with locally build cep event stream emulation java class all the things run fine. The probelm occurs only when this is running with cep. Do i need to add anything on the cep side to underestand samoa in cep side.can you please help me with this.thank you. regards, Mahesh. On Wed, Jul 27, 2016 at 3:59 PM, Mahesh Dananjaya wrote: > Hi Srinath, > > "I think this is OK. I assume this is much easier. Let's do this and check > the performance", > I also think so. I am currently on this and have a progress in this.for > your question, > "If we use MOA directly, would we loose the distributed support in SAOMA. > Let's do a call when you can, so we can dsicuss this in detail." > I have to check for that.i think if we are using MOA, we can use > distributed clusters. As i wen through their documentation MOA itself > cannot support distribution. But samoa can. What samoa does is providing > streaming and clustering support by wrapping MOA algorithms. So i think we > dont need to go for that option,directly MOA. Because now we can handle > samoa building blocks.So we had 2 options for integrating it with cep > without exploiting samoa architecture which is highly modular,scalable and > flexible. > 1. Develop Samoa topologies with basic samoa building blocks which make > use of MOA algorithms. > 2. Creating New streaming options with samoa stream building blocks which > can feed cep siddhi events into samoa streams and get results samoa streams > to cep back. > > As 2nd option is easy and take reasonable time i am currently developing > some modules to integrate cep streams into samoa which can be easily > further extended to 1 option as well. So i had to modify stream and > entrance modules for that and i think is has good progress. > So now i can feed my custom input stream to samoa topologies. That means > i can easily integrate cep event stream into samoa instance stream. > currently i am verifying the streaming clustering algorithms and its > results with my custom input input streams which can be connected to samoa > instance streams. As i have already developed siddhi extension for > streaming, i can use them to feed my custom input streams now. As the > initial step i am go with the streaming clustering algorithms. Those are in > my GSOC github repo [1]. > clustering - Streaming Clustering Support with samoa and CEP > streaming - Streaming extension for samoa for cep evet streams > > i am currenlty working on the verification of results with some of our > custom streams and then we will just have to integrate it with my > extensions, which are already developed for cep as my first part.thank you. > regards, > Mahesh. > > [1] > https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming > > On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera wrote: > >> Hi Mahesh, >> >> On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya < >> dananjayamah...@gmail.com> wrote: >> >>> Hi All, >>> I am onto connecting cep streams with samoa streams to data analysis >>> using samoa framework. To connect samoa with cep siddhi event streams what >>> i we can do is that try to convert cep streams into samoa streams or else >>> writing wrpper for samoa for cep streasm to be used. In both cases i have >>> to covert siddhi cep streasm into samoa streams. Samoa is using MOA to >>> analyse data. Moo contains ML framework to analyse stream data. Samoa is >>> wrapping MOA withsome of its classes. >>> >>> Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see >>> streams as a stream of instances [1]. So if we are going to convert cep >>> events into samoa instances , it will take time. But if we have some >>> similarity between cep siddhi streams and samoa streasm we can reduce the >>> time. >>> 1. What is the underlying infrastructure for cep siddhi streasm.? >>> 2. Are there anything as Instances or InstanceStreams kind of >>> implmentation underlying cep streams? >>> 3. How can i get more underestanding on CEP siddhi streams. >>> >>> On the other hand i can use my cep siddhi extension and put those events >>> into event queue and convert them into samoa instances and feed them into
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi Supun, I just neeed a little help. I am in the process of integrating my samoa core functions and extension into carbon-ml's siddhi extension. For samoa i am using locally built samoa project to provide samoa 0.4.0 dependencies,since we dont have it in the maven repo or else where. But when i build carbon-ml by adding samoa dependencies, it seems to be maven search for remote location, not the local maven repo first. I am running maven with -U option. But still the problems occurs. Is there any specific thing in carbon-ml like settings to search remote before local one? I just need to give local maven repo for the dependency. My extension seperately working fine, so there is no problem wihat the local dependencies outside carbon-ml. So can you please help me with this.thank you. regards, Mahesh. On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera wrote: > Hi Mahesh, > > On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> Hi All, >> I am onto connecting cep streams with samoa streams to data analysis >> using samoa framework. To connect samoa with cep siddhi event streams what >> i we can do is that try to convert cep streams into samoa streams or else >> writing wrpper for samoa for cep streasm to be used. In both cases i have >> to covert siddhi cep streasm into samoa streams. Samoa is using MOA to >> analyse data. Moo contains ML framework to analyse stream data. Samoa is >> wrapping MOA withsome of its classes. >> >> Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see >> streams as a stream of instances [1]. So if we are going to convert cep >> events into samoa instances , it will take time. But if we have some >> similarity between cep siddhi streams and samoa streasm we can reduce the >> time. >> 1. What is the underlying infrastructure for cep siddhi streasm.? >> 2. Are there anything as Instances or InstanceStreams kind of >> implmentation underlying cep streams? >> 3. How can i get more underestanding on CEP siddhi streams. >> >> On the other hand i can use my cep siddhi extension and put those events >> into event queue and convert them into samoa instances and feed them into >> samoa streaming ml topologies. >> > I think this is OK. I assume this is much easier. Let's do this and check > the performance. > > >> There is another option. In Samoa what they are basically doing is that >> wrapping MOA ML framework and write some classes for build streaming ml >> topologies. So as the other option i can wrap samoa moa with my design and >> use moa ml framework directly. (No need for Samoa extension). I have >> building some topologies to streaming data analysis [2]. Main problem is >> that lack of documentation. Anyway i had go through their whole samoa >> design.thank you. >> > > If we use MOA directly, would we loose the distributed support in SAOMA. > Let's do a call when you can, so we can dsicuss this in detail. > > --Srinath > > > >> regards, >> Mahesh. >> >> [1] >> https://github.com/apache/incubator-samoa/blob/master/samoa-api/src/main/java/org/apache/samoa/streams/clustering/ClusteringStream.java >> [2] >> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming >> >> On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya < >> dananjayamah...@gmail.com> wrote: >> >>> Hi Maheshakya, >>> Samoa modules built as topologies that connect streams with the internal >>> processors. I have already written some examples to test the ML algorithms >>> and samoa analysis topologies. What we need to done is mostly developing a >>> wrapper around samoa topologies to connect their input and output streams >>> with our cep streams. So i am currently going through their stream >>> architecture to connect our streams with their streams. Couple of examples >>> exapaining samoa ml topologies and streaming can be found in my git hub >>> repo [1]. Samoa using MOA ml algorithms by wrapping them with their >>> classes. Initailly i am trying to develop a KMeansClustering analysis with >>> cep streams with samoa ml topologies. >>> And also i could not find a maven repo for samoa 0.4.0 incubating. So i >>> am currently using my local m2 repo's samoa 0..4.0 incubating for my >>> dependencies to work. The local one is built by original samoa source.thank >>> you. >>> >>> regards, >>> Mahesh. >>> >>> [1] >>> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming >>> >>> >>> On Mon, Jul 18, 2016 at 8:32 AM, Maheshakya Wijewardena < >>> mahesha...@wso2.com> wrote: >>> Hi Mahesh, Can you please share your samoa project? On Sun, Jul 17, 2016 at 11:19 AM, Mahesh Dananjaya < dananjayamah...@gmail.com> wrote: > > -- Forwarded message -- > From: Mahesh Dananjaya > Date: Sun, Jul 17, 2016 at 11:18 AM > Subject: Re: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with > online data
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi Mahesh, you should build carbon-ml *without *-U option. -U means you force mvn to look for updates in remote repo. Rather run it with -o option. Also, can you double check whether the dependencies are defined correctly (group Id's, versions etc). Alternatively, it seems there is a samoa released version in mvn repo. Maybe you could try that one as well. But that's v0.3.0.. [1] https://mvnrepository.com/artifact/org.apache.samoa On Wed, Aug 3, 2016 at 2:54 PM, Mahesh Dananjaya wrote: > Hi Supun, > I just neeed a little help. I am in the process of integrating my samoa > core functions and extension into carbon-ml's siddhi extension. For samoa i > am using locally built samoa project to provide samoa 0.4.0 > dependencies,since we dont have it in the maven repo or else where. But > when i build carbon-ml by adding samoa dependencies, it seems to be maven > search for remote location, not the local maven repo first. I am running > maven with -U option. But still the problems occurs. Is there any specific > thing in carbon-ml like settings to search remote before local one? I just > need to give local maven repo for the dependency. My extension seperately > working fine, so there is no problem wihat the local dependencies outside > carbon-ml. So can you please help me with this.thank you. > regards, > Mahesh. > > On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera wrote: > >> Hi Mahesh, >> >> On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya < >> dananjayamah...@gmail.com> wrote: >> >>> Hi All, >>> I am onto connecting cep streams with samoa streams to data analysis >>> using samoa framework. To connect samoa with cep siddhi event streams what >>> i we can do is that try to convert cep streams into samoa streams or else >>> writing wrpper for samoa for cep streasm to be used. In both cases i have >>> to covert siddhi cep streasm into samoa streams. Samoa is using MOA to >>> analyse data. Moo contains ML framework to analyse stream data. Samoa is >>> wrapping MOA withsome of its classes. >>> >>> Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see >>> streams as a stream of instances [1]. So if we are going to convert cep >>> events into samoa instances , it will take time. But if we have some >>> similarity between cep siddhi streams and samoa streasm we can reduce the >>> time. >>> 1. What is the underlying infrastructure for cep siddhi streasm.? >>> 2. Are there anything as Instances or InstanceStreams kind of >>> implmentation underlying cep streams? >>> 3. How can i get more underestanding on CEP siddhi streams. >>> >>> On the other hand i can use my cep siddhi extension and put those events >>> into event queue and convert them into samoa instances and feed them into >>> samoa streaming ml topologies. >>> >> I think this is OK. I assume this is much easier. Let's do this and check >> the performance. >> >> >>> There is another option. In Samoa what they are basically doing is that >>> wrapping MOA ML framework and write some classes for build streaming ml >>> topologies. So as the other option i can wrap samoa moa with my design and >>> use moa ml framework directly. (No need for Samoa extension). I have >>> building some topologies to streaming data analysis [2]. Main problem is >>> that lack of documentation. Anyway i had go through their whole samoa >>> design.thank you. >>> >> >> If we use MOA directly, would we loose the distributed support in SAOMA. >> Let's do a call when you can, so we can dsicuss this in detail. >> >> --Srinath >> >> >> >>> regards, >>> Mahesh. >>> >>> [1] >>> https://github.com/apache/incubator-samoa/blob/master/samoa-api/src/main/java/org/apache/samoa/streams/clustering/ClusteringStream.java >>> [2] >>> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming >>> >>> On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya < >>> dananjayamah...@gmail.com> wrote: >>> Hi Maheshakya, Samoa modules built as topologies that connect streams with the internal processors. I have already written some examples to test the ML algorithms and samoa analysis topologies. What we need to done is mostly developing a wrapper around samoa topologies to connect their input and output streams with our cep streams. So i am currently going through their stream architecture to connect our streams with their streams. Couple of examples exapaining samoa ml topologies and streaming can be found in my git hub repo [1]. Samoa using MOA ml algorithms by wrapping them with their classes. Initailly i am trying to develop a KMeansClustering analysis with cep streams with samoa ml topologies. And also i could not find a maven repo for samoa 0.4.0 incubating. So i am currently using my local m2 repo's samoa 0..4.0 incubating for my dependencies to work. The local one is built by original samoa source.thank you. regards, Mahesh. [1] h
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Adding Jayan to this email thread. -- Thanks, Miyuru Dayarathna Senior Technical Lead Mobile: +94713527783 Blog: http://miyurublog.blogspot.com On Wed, Aug 3, 2016 at 3:11 PM, Supun Sethunga wrote: > Hi Mahesh, > > you should build carbon-ml *without *-U option. -U means you force mvn to > look for updates in remote repo. Rather run it with -o option. Also, can > you double check whether the dependencies are defined correctly (group > Id's, versions etc). > > Alternatively, it seems there is a samoa released version in mvn repo. > Maybe you could try that one as well. But that's v0.3.0.. > > [1] https://mvnrepository.com/artifact/org.apache.samoa > > On Wed, Aug 3, 2016 at 2:54 PM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> Hi Supun, >> I just neeed a little help. I am in the process of integrating my samoa >> core functions and extension into carbon-ml's siddhi extension. For samoa i >> am using locally built samoa project to provide samoa 0.4.0 >> dependencies,since we dont have it in the maven repo or else where. But >> when i build carbon-ml by adding samoa dependencies, it seems to be maven >> search for remote location, not the local maven repo first. I am running >> maven with -U option. But still the problems occurs. Is there any specific >> thing in carbon-ml like settings to search remote before local one? I just >> need to give local maven repo for the dependency. My extension seperately >> working fine, so there is no problem wihat the local dependencies outside >> carbon-ml. So can you please help me with this.thank you. >> regards, >> Mahesh. >> >> On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera wrote: >> >>> Hi Mahesh, >>> >>> On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya < >>> dananjayamah...@gmail.com> wrote: >>> Hi All, I am onto connecting cep streams with samoa streams to data analysis using samoa framework. To connect samoa with cep siddhi event streams what i we can do is that try to convert cep streams into samoa streams or else writing wrpper for samoa for cep streasm to be used. In both cases i have to covert siddhi cep streasm into samoa streams. Samoa is using MOA to analyse data. Moo contains ML framework to analyse stream data. Samoa is wrapping MOA withsome of its classes. Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see streams as a stream of instances [1]. So if we are going to convert cep events into samoa instances , it will take time. But if we have some similarity between cep siddhi streams and samoa streasm we can reduce the time. 1. What is the underlying infrastructure for cep siddhi streasm.? 2. Are there anything as Instances or InstanceStreams kind of implmentation underlying cep streams? 3. How can i get more underestanding on CEP siddhi streams. On the other hand i can use my cep siddhi extension and put those events into event queue and convert them into samoa instances and feed them into samoa streaming ml topologies. >>> I think this is OK. I assume this is much easier. Let's do this and >>> check the performance. >>> >>> There is another option. In Samoa what they are basically doing is that wrapping MOA ML framework and write some classes for build streaming ml topologies. So as the other option i can wrap samoa moa with my design and use moa ml framework directly. (No need for Samoa extension). I have building some topologies to streaming data analysis [2]. Main problem is that lack of documentation. Anyway i had go through their whole samoa design.thank you. >>> >>> If we use MOA directly, would we loose the distributed support in SAOMA. >>> Let's do a call when you can, so we can dsicuss this in detail. >>> >>> --Srinath >>> >>> >>> regards, Mahesh. [1] https://github.com/apache/incubator-samoa/blob/master/samoa-api/src/main/java/org/apache/samoa/streams/clustering/ClusteringStream.java [2] https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya < dananjayamah...@gmail.com> wrote: > Hi Maheshakya, > Samoa modules built as topologies that connect streams with the > internal processors. I have already written some examples to test the ML > algorithms and samoa analysis topologies. What we need to done is mostly > developing a wrapper around samoa topologies to connect their input and > output streams with our cep streams. So i am currently going through their > stream architecture to connect our streams with their streams. Couple of > examples exapaining samoa ml topologies and streaming can be found in my > git hub repo [1]. Samoa using MOA ml algorithms by wrapping them with > their > classes. Initailly i am trying to develop a KMeansClustering an
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi supun, We have been using v0.4.0 for the cep integration,since the last verstion is pretty outdated and lack with algorithms for streaming. So i am now using my locally built v0.4.0 for the project. dependencies are working fine, because it has been using on the extensions that we develop outside the carbon-ml as regular extensions. same error appears when i was not using -U. seems to be that maven search for remote repo rather than local one.this is the error i got. [ERROR] Failed to execute goal on project org.wso2.carbon.ml.siddhi.extension: Could not resolve dependencies for project org.wso2.carbon.ml:org.wso2.carbon.ml.siddhi.extension:bundle:1.1.2-SNAPSHOT: The following artifacts could not be resolved: org.apache.samoa:samoa-api:jar:0.4.0-incubating, org.apache.samoa:samoa-local:jar:0.4.0-incubating: Could not find artifact org.apache.samoa:samoa-api:jar:0.4.0-incubating in wso2-nexus ( http://maven.wso2.org/nexus/content/groups/wso2-public/) seems to be aven prefer remote one for samoa rather than local one. This is only when i build carbon-ml adding samoa local dependencies. Other extensions used samoa,which are outside carbon-ml are working fine. thank you.. BR, Mahesh. On Wed, Aug 3, 2016 at 3:11 PM, Supun Sethunga wrote: > Hi Mahesh, > > you should build carbon-ml *without *-U option. -U means you force mvn to > look for updates in remote repo. Rather run it with -o option. Also, can > you double check whether the dependencies are defined correctly (group > Id's, versions etc). > > Alternatively, it seems there is a samoa released version in mvn repo. > Maybe you could try that one as well. But that's v0.3.0.. > > [1] https://mvnrepository.com/artifact/org.apache.samoa > > On Wed, Aug 3, 2016 at 2:54 PM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> Hi Supun, >> I just neeed a little help. I am in the process of integrating my samoa >> core functions and extension into carbon-ml's siddhi extension. For samoa i >> am using locally built samoa project to provide samoa 0.4.0 >> dependencies,since we dont have it in the maven repo or else where. But >> when i build carbon-ml by adding samoa dependencies, it seems to be maven >> search for remote location, not the local maven repo first. I am running >> maven with -U option. But still the problems occurs. Is there any specific >> thing in carbon-ml like settings to search remote before local one? I just >> need to give local maven repo for the dependency. My extension seperately >> working fine, so there is no problem wihat the local dependencies outside >> carbon-ml. So can you please help me with this.thank you. >> regards, >> Mahesh. >> >> On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera wrote: >> >>> Hi Mahesh, >>> >>> On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya < >>> dananjayamah...@gmail.com> wrote: >>> Hi All, I am onto connecting cep streams with samoa streams to data analysis using samoa framework. To connect samoa with cep siddhi event streams what i we can do is that try to convert cep streams into samoa streams or else writing wrpper for samoa for cep streasm to be used. In both cases i have to covert siddhi cep streasm into samoa streams. Samoa is using MOA to analyse data. Moo contains ML framework to analyse stream data. Samoa is wrapping MOA withsome of its classes. Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see streams as a stream of instances [1]. So if we are going to convert cep events into samoa instances , it will take time. But if we have some similarity between cep siddhi streams and samoa streasm we can reduce the time. 1. What is the underlying infrastructure for cep siddhi streasm.? 2. Are there anything as Instances or InstanceStreams kind of implmentation underlying cep streams? 3. How can i get more underestanding on CEP siddhi streams. On the other hand i can use my cep siddhi extension and put those events into event queue and convert them into samoa instances and feed them into samoa streaming ml topologies. >>> I think this is OK. I assume this is much easier. Let's do this and >>> check the performance. >>> >>> There is another option. In Samoa what they are basically doing is that wrapping MOA ML framework and write some classes for build streaming ml topologies. So as the other option i can wrap samoa moa with my design and use moa ml framework directly. (No need for Samoa extension). I have building some topologies to streaming data analysis [2]. Main problem is that lack of documentation. Anyway i had go through their whole samoa design.thank you. >>> >>> If we use MOA directly, would we loose the distributed support in SAOMA. >>> Let's do a call when you can, so we can dsicuss this in detail. >>> >>> --Srinath >>> >>> >>> regards, Mahesh. [1] https://github.com/apache/incubator-sa
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi all, samoa is in my local repository and dependencies works fine with all other extensions that add samoa 0.4.0-incubator dependencies. But only when i build carbon-ml, it gives priority for the remote repository for looking samoa. SO any help with this to give priority for local m2 repo before carbon-ml building is looking for the remote one. I am getting the error because of this. maven option -U also not seems to be working here. any help please. [ERROR] Failed to execute goal on project org.wso2.carbon.ml.siddhi.extension: Could not resolve dependencies for project org.wso2.carbon.ml:org.wso2.carbon.ml.siddhi.extension:bundle:1.1.2-SNAPSHOT: The following artifacts could not be resolved: org.apache.samoa:samoa-api:jar:0.4.0-incubating, org.apache.samoa:samoa-local:jar:0.4.0-incubating: Could not find artifact org.apache.samoa:samoa-api:jar:0.4.0-incubating in wso2-nexus ( http://maven.wso2.org/nexus/content/groups/wso2-public/) Since samoa will be used for future work, is it possible to add that in the relevant wso2 repo. Because there are still no samoa 0.4.0-incubator maven repo. only 0.3.0. we cannot continue our work with the 0.3.0 since it is outdated. thank you. regards, Mahesh. On Wed, Aug 3, 2016 at 4:29 PM, Miyuru Dayarathna wrote: > Adding Jayan to this email thread. > > -- > Thanks, > Miyuru Dayarathna > Senior Technical Lead > Mobile: +94713527783 > Blog: http://miyurublog.blogspot.com > > On Wed, Aug 3, 2016 at 3:11 PM, Supun Sethunga wrote: > >> Hi Mahesh, >> >> you should build carbon-ml *without *-U option. -U means you force mvn >> to look for updates in remote repo. Rather run it with -o option. Also, can >> you double check whether the dependencies are defined correctly (group >> Id's, versions etc). >> >> Alternatively, it seems there is a samoa released version in mvn repo. >> Maybe you could try that one as well. But that's v0.3.0.. >> >> [1] https://mvnrepository.com/artifact/org.apache.samoa >> >> On Wed, Aug 3, 2016 at 2:54 PM, Mahesh Dananjaya < >> dananjayamah...@gmail.com> wrote: >> >>> Hi Supun, >>> I just neeed a little help. I am in the process of integrating my samoa >>> core functions and extension into carbon-ml's siddhi extension. For samoa i >>> am using locally built samoa project to provide samoa 0.4.0 >>> dependencies,since we dont have it in the maven repo or else where. But >>> when i build carbon-ml by adding samoa dependencies, it seems to be maven >>> search for remote location, not the local maven repo first. I am running >>> maven with -U option. But still the problems occurs. Is there any specific >>> thing in carbon-ml like settings to search remote before local one? I just >>> need to give local maven repo for the dependency. My extension seperately >>> working fine, so there is no problem wihat the local dependencies outside >>> carbon-ml. So can you please help me with this.thank you. >>> regards, >>> Mahesh. >>> >>> On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera >>> wrote: >>> Hi Mahesh, On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya < dananjayamah...@gmail.com> wrote: > Hi All, > I am onto connecting cep streams with samoa streams to data analysis > using samoa framework. To connect samoa with cep siddhi event streams what > i we can do is that try to convert cep streams into samoa streams or else > writing wrpper for samoa for cep streasm to be used. In both cases i have > to covert siddhi cep streasm into samoa streams. Samoa is using MOA to > analyse data. Moo contains ML framework to analyse stream data. Samoa is > wrapping MOA withsome of its classes. > > Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see > streams as a stream of instances [1]. So if we are going to convert cep > events into samoa instances , it will take time. But if we have some > similarity between cep siddhi streams and samoa streasm we can reduce the > time. > 1. What is the underlying infrastructure for cep siddhi streasm.? > 2. Are there anything as Instances or InstanceStreams kind of > implmentation underlying cep streams? > 3. How can i get more underestanding on CEP siddhi streams. > > On the other hand i can use my cep siddhi extension and put those > events into event queue and convert them into samoa instances and feed > them > into samoa streaming ml topologies. > I think this is OK. I assume this is much easier. Let's do this and check the performance. > There is another option. In Samoa what they are basically doing is > that wrapping MOA ML framework and write some classes for build streaming > ml topologies. So as the other option i can wrap samoa moa with my design > and use moa ml framework directly. (No need for Samoa extension). I have > building some topologies to streaming data analysis [2]. Main problem is > that lack of documentation. Anyway i had go th
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi Mahesh, samoa dependency version in siddhi-extension should be *0.4.0-incubating-SNAPSHOT*. That should solve the issue Regards, Supun On Thu, Aug 4, 2016 at 11:50 AM, Mahesh Dananjaya wrote: > Hi all, > samoa is in my local repository and dependencies works fine with all other > extensions that add samoa 0.4.0-incubator dependencies. But only when i > build carbon-ml, it gives priority for the remote repository for looking > samoa. SO any help with this to give priority for local m2 repo before > carbon-ml building is looking for the remote one. I am getting the error > because of this. maven option -U also not seems to be working here. any > help please. > > [ERROR] Failed to execute goal on project > org.wso2.carbon.ml.siddhi.extension: Could not resolve dependencies for > project > org.wso2.carbon.ml:org.wso2.carbon.ml.siddhi.extension:bundle:1.1.2-SNAPSHOT: > The following artifacts could not be resolved: > org.apache.samoa:samoa-api:jar:0.4.0-incubating, > org.apache.samoa:samoa-local:jar:0.4.0-incubating: Could not find artifact > org.apache.samoa:samoa-api:jar:0.4.0-incubating in wso2-nexus ( > http://maven.wso2.org/nexus/content/groups/wso2-public/) > > Since samoa will be used for future work, is it possible to add that in > the relevant wso2 repo. Because there are still no samoa 0.4.0-incubator > maven repo. only 0.3.0. we cannot continue our work with the 0.3.0 since it > is outdated. > > thank you. > regards, > Mahesh. > > On Wed, Aug 3, 2016 at 4:29 PM, Miyuru Dayarathna > wrote: > >> Adding Jayan to this email thread. >> >> -- >> Thanks, >> Miyuru Dayarathna >> Senior Technical Lead >> Mobile: +94713527783 >> Blog: http://miyurublog.blogspot.com >> >> On Wed, Aug 3, 2016 at 3:11 PM, Supun Sethunga wrote: >> >>> Hi Mahesh, >>> >>> you should build carbon-ml *without *-U option. -U means you force mvn >>> to look for updates in remote repo. Rather run it with -o option. Also, can >>> you double check whether the dependencies are defined correctly (group >>> Id's, versions etc). >>> >>> Alternatively, it seems there is a samoa released version in mvn repo. >>> Maybe you could try that one as well. But that's v0.3.0.. >>> >>> [1] https://mvnrepository.com/artifact/org.apache.samoa >>> >>> On Wed, Aug 3, 2016 at 2:54 PM, Mahesh Dananjaya < >>> dananjayamah...@gmail.com> wrote: >>> Hi Supun, I just neeed a little help. I am in the process of integrating my samoa core functions and extension into carbon-ml's siddhi extension. For samoa i am using locally built samoa project to provide samoa 0.4.0 dependencies,since we dont have it in the maven repo or else where. But when i build carbon-ml by adding samoa dependencies, it seems to be maven search for remote location, not the local maven repo first. I am running maven with -U option. But still the problems occurs. Is there any specific thing in carbon-ml like settings to search remote before local one? I just need to give local maven repo for the dependency. My extension seperately working fine, so there is no problem wihat the local dependencies outside carbon-ml. So can you please help me with this.thank you. regards, Mahesh. On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera wrote: > Hi Mahesh, > > On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> Hi All, >> I am onto connecting cep streams with samoa streams to data analysis >> using samoa framework. To connect samoa with cep siddhi event streams >> what >> i we can do is that try to convert cep streams into samoa streams or else >> writing wrpper for samoa for cep streasm to be used. In both cases i >> have >> to covert siddhi cep streasm into samoa streams. Samoa is using MOA to >> analyse data. Moo contains ML framework to analyse stream data. Samoa is >> wrapping MOA withsome of its classes. >> >> Samoa streams is based on MOA, Instance and InstanceStreams. Samoa >> see streams as a stream of instances [1]. So if we are going to convert >> cep >> events into samoa instances , it will take time. But if we have some >> similarity between cep siddhi streams and samoa streasm we can reduce the >> time. >> 1. What is the underlying infrastructure for cep siddhi streasm.? >> 2. Are there anything as Instances or InstanceStreams kind of >> implmentation underlying cep streams? >> 3. How can i get more underestanding on CEP siddhi streams. >> >> On the other hand i can use my cep siddhi extension and put those >> events into event queue and convert them into samoa instances and feed >> them >> into samoa streaming ml topologies. >> > I think this is OK. I assume this is much easier. Let's do this and > check the performance. > > >> There is another option. In Samoa what they are basically doing is >> that
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi Supun, This is the error i am getting while run the extension in the cabon-ml side, plase reffer to link [1] for the class. ERROR {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder} - Fail to initialize the task java.lang.Exception: Class not found: StreamingClusteringTask at com.github.javacliparser.ClassOption.cliStringToObject(ClassOption.java:136) at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder.initClusteringTask(StreamingClusteringTaskBuilder.java:129) at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder.java:100) at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClustering.run(StreamingClustering.java:77) at java.lang.Thread.run(Thread.java:745) [2016-08-04 16:23:07,437] INFO {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder} - Fail to initialize the taskjava.lang.Exception: Class not found: StreamingClusteringTask +++Please refeer link [1] for the StreamingClusteringTask. Then again for StreamingClusteringStream class while i bypass the String query in the initTask(). please refer link [2] for the class. Exception in thread "Thread-60" java.lang.IllegalArgumentException: Problems with option: streamTrain at com.github.javacliparser.ClassOption.setValueViaCLIString(ClassOption.java:64) at com.github.javacliparser.AbstractOption.resetToDefault(AbstractOption.java:90) at com.github.javacliparser.AbstractClassOption.(AbstractClassOption.java:84) at com.github.javacliparser.AbstractClassOption.(AbstractClassOption.java:63) at com.github.javacliparser.ClassOption.(ClassOption.java:38) at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTask.(StreamingClusteringTask.java:52) at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder.initClusteringTask(StreamingClusteringTaskBuilder.java:140) at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder.java:103) at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClustering.run(StreamingClustering.java:77) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.Exception: Class not found: org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringStream at com.github.javacliparser.ClassOption.cliStringToObject(ClassOption.java:136) at com.github.javacliparser.ClassOption.setValueViaCLIString(ClassOption.java:61) ... 9 more Those Class Not Found Exceptions are at runtime. Do i have do anything on the carbon-ml side for this.My samoa cores can be found in [3]. Those are working fine and no Class Not Found Exceptions arrive when running outside the carbon-ml. thank you. regards, Mahesh. [1] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.extension/src/main/java/org/wso2/carbon/ml/siddhi/extension/streaming/samoa/StreamingClusteringTask.java [2] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.extension/src/main/java/org/wso2/carbon/ml/siddhi/extension/streaming/samoa/StreamingClusteringTask.java [3] https://github.com/dananjayamahesh/carbon-ml/tree/wso2_gsoc_ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.extension/src/main/java/org/wso2/carbon/ml/siddhi/extension/streaming/samoa On Thu, Aug 4, 2016 at 12:30 PM, Supun Sethunga wrote: > Hi Mahesh, > > samoa dependency version in siddhi-extension should be > *0.4.0-incubating-SNAPSHOT*. That should solve the issue > > Regards, > Supun > > On Thu, Aug 4, 2016 at 11:50 AM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> Hi all, >> samoa is in my local repository and dependencies works fine with all >> other extensions that add samoa 0.4.0-incubator dependencies. But only when >> i build carbon-ml, it gives priority for the remote repository for looking >> samoa. SO any help with this to give priority for local m2 repo before >> carbon-ml building is looking for the remote one. I am getting the error >> because of this. maven option -U also not seems to be working here. any >> help please. >> >> [ERROR] Failed to execute goal on project >> org.wso2.carbon.ml.siddhi.extension: >> Could not resolve dependencies for project org.wso2.carbon.ml:org.wso2. >> carbon.ml.siddhi.extension:bundle:1.1.2-SNAPSHOT: The following >> artifacts could not be resolved: >> org.apache.samoa:samoa-api:jar:0.4.0-incubating, >> org.apache.samoa:samoa-local:jar:0.4.0-incubating: Could not find >> artifact org.apache.samoa:samoa-api:jar:0.4.0-incubating in wso2-nexus ( >> http://maven.wso2.org/nexus/content/groups/wso2-public/) >> >> Since samoa will be used for future work, is it possible to add that in >> the relevant wso2 repo. Because there are
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Did you add samoa jars in ML? On Fri, Aug 5, 2016 at 12:20 PM, Mahesh Dananjaya wrote: > Hi Supun, > This is the error i am getting while run the extension in the cabon-ml > side, > plase reffer to link [1] for the class. > > ERROR {org.wso2.carbon.ml.siddhi.extension.streaming.samoa. > StreamingClusteringTaskBuilder} - Fail to initialize the task > > java.lang.Exception: Class not found: StreamingClusteringTask > >at com.github.javacliparser.ClassOption.cliStringToObject( > ClassOption.java:136) > >at org.wso2.carbon.ml.siddhi.extension.streaming.samoa. > StreamingClusteringTaskBuilder.initClusteringTask( > StreamingClusteringTaskBuilder.java:129) > >at org.wso2.carbon.ml.siddhi.extension.streaming.samoa. > StreamingClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder > .java:100) > >at org.wso2.carbon.ml.siddhi.extension.streaming.samoa. > StreamingClustering.run(StreamingClustering.java:77) > >at java.lang.Thread.run(Thread.java:745) > > [2016-08-04 16:23:07,437] INFO {org.wso2.carbon.ml.siddhi. > extension.streaming.samoa.StreamingClusteringTaskBuilder} - Fail to > initialize the taskjava.lang.Exception: Class not found: > StreamingClusteringTask > > +++Please refeer link [1] for the StreamingClusteringTask. > > Then again for StreamingClusteringStream class while i bypass the String > query in the initTask(). please refer link [2] for the class. > > Exception in thread "Thread-60" java.lang.IllegalArgumentException: > Problems with option: streamTrain > >at com.github.javacliparser.ClassOption.setValueViaCLIString( > ClassOption.java:64) > >at com.github.javacliparser.AbstractOption.resetToDefault( > AbstractOption.java:90) > >at com.github.javacliparser.AbstractClassOption.( > AbstractClassOption.java:84) > >at com.github.javacliparser.AbstractClassOption.( > AbstractClassOption.java:63) > >at com.github.javacliparser.ClassOption.(ClassOption.java:38) > >at org.wso2.carbon.ml.siddhi.extension.streaming.samoa. > StreamingClusteringTask.(StreamingClusteringTask.java:52) > >at org.wso2.carbon.ml.siddhi.extension.streaming.samoa. > StreamingClusteringTaskBuilder.initClusteringTask( > StreamingClusteringTaskBuilder.java:140) > >at org.wso2.carbon.ml.siddhi.extension.streaming.samoa. > StreamingClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder > .java:103) > >at org.wso2.carbon.ml.siddhi.extension.streaming.samoa. > StreamingClustering.run(StreamingClustering.java:77) > >at java.lang.Thread.run(Thread.java:745) > > Caused by: java.lang.Exception: Class not found: org.wso2.carbon.ml.siddhi. > extension.streaming.samoa.StreamingClusteringStream > >at com.github.javacliparser.ClassOption.cliStringToObject( > ClassOption.java:136) > >at com.github.javacliparser.ClassOption.setValueViaCLIString( > ClassOption.java:61) > >... 9 more > > > Those Class Not Found Exceptions are at runtime. Do i have do anything on > the carbon-ml side for this.My samoa cores can be found in [3]. Those are > working fine and no Class Not Found Exceptions arrive when running outside > the carbon-ml. > > > thank you. > > regards, > > Mahesh. > > > > [1] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ml6_cml/ > components/extensions/org.wso2.carbon.ml.siddhi. > extension/src/main/java/org/wso2/carbon/ml/siddhi/ > extension/streaming/samoa/StreamingClusteringTask.java > > [2] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ml6_cml/ > components/extensions/org.wso2.carbon.ml.siddhi. > extension/src/main/java/org/wso2/carbon/ml/siddhi/ > extension/streaming/samoa/StreamingClusteringTask.java > > [3] https://github.com/dananjayamahesh/carbon-ml/tree/wso2_gsoc_ml6_cml/ > components/extensions/org.wso2.carbon.ml.siddhi. > extension/src/main/java/org/wso2/carbon/ml/siddhi/ > extension/streaming/samoa > > On Thu, Aug 4, 2016 at 12:30 PM, Supun Sethunga wrote: > >> Hi Mahesh, >> >> samoa dependency version in siddhi-extension should be >> *0.4.0-incubating-SNAPSHOT*. That should solve the issue >> >> Regards, >> Supun >> >> On Thu, Aug 4, 2016 at 11:50 AM, Mahesh Dananjaya < >> dananjayamah...@gmail.com> wrote: >> >>> Hi all, >>> samoa is in my local repository and dependencies works fine with all >>> other extensions that add samoa 0.4.0-incubator dependencies. But only when >>> i build carbon-ml, it gives priority for the remote repository for looking >>> samoa. SO any help with this to give priority for local m2 repo before >>> carbon-ml building is looking for the remote one. I am getting the error >>> because of this. maven option -U also not seems to be working here. any >>> help please. >>> >>> [ERROR] Failed to execute goal on project >>> org.wso2.carbon.ml.siddhi.extension: >>> Could not resolve dependencies for project org.wso2.carbon.ml:o >>> rg.wso2.carbon.ml.siddhi.extension:bundle:1.1.2-SNAPSHOT: The following >>> artifacts could not be resolved: >>> org.apache.samoa:samoa-api:jar:0.4.0-incuba
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi Nirmal, Yes i have added samoa dependencies in carbon-ml and it is working fine. These exceptions are coming for the my classes that are inside ml. when i used classes in samoa like org.apache.samoa.tasks.ClusteringEvaluation it is working fine and run. And also same classes that i developed are running fine in my other extensions outside carbon-ml, which are developed as regular extensions. i am checking this further. thank you. regards, Mahesh. On Fri, Aug 5, 2016 at 5:31 PM, Nirmal Fernando wrote: > Did you add samoa jars in ML? > > On Fri, Aug 5, 2016 at 12:20 PM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> Hi Supun, >> This is the error i am getting while run the extension in the cabon-ml >> side, >> plase reffer to link [1] for the class. >> >> ERROR >> {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder} >> - Fail to initialize the task >> >> java.lang.Exception: Class not found: StreamingClusteringTask >> >>at com.github.javacliparser.ClassOption.cliStringToObject(Class >> Option.java:136) >> >>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >> gClusteringTaskBuilder.initClusteringTask(StreamingCl >> usteringTaskBuilder.java:129) >> >>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >> gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder.java:100) >> >>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >> gClustering.run(StreamingClustering.java:77) >> >>at java.lang.Thread.run(Thread.java:745) >> >> [2016-08-04 16:23:07,437] INFO {org.wso2.carbon.ml.siddhi.ext >> ension.streaming.samoa.StreamingClusteringTaskBuilder} - Fail to >> initialize the taskjava.lang.Exception: Class not found: >> StreamingClusteringTask >> >> +++Please refeer link [1] for the StreamingClusteringTask. >> >> Then again for StreamingClusteringStream class while i bypass the String >> query in the initTask(). please refer link [2] for the class. >> >> Exception in thread "Thread-60" java.lang.IllegalArgumentException: >> Problems with option: streamTrain >> >>at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl >> assOption.java:64) >> >>at com.github.javacliparser.AbstractOption.resetToDefault(Abstr >> actOption.java:90) >> >>at com.github.javacliparser.AbstractClassOption.(Abstract >> ClassOption.java:84) >> >>at com.github.javacliparser.AbstractClassOption.(Abstract >> ClassOption.java:63) >> >>at com.github.javacliparser.ClassOption.(ClassOption.java:38) >> >>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >> gClusteringTask.(StreamingClusteringTask.java:52) >> >>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >> gClusteringTaskBuilder.initClusteringTask(StreamingCl >> usteringTaskBuilder.java:140) >> >>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >> gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder.java:103) >> >>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >> gClustering.run(StreamingClustering.java:77) >> >>at java.lang.Thread.run(Thread.java:745) >> >> Caused by: java.lang.Exception: Class not found: >> org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >> gClusteringStream >> >>at com.github.javacliparser.ClassOption.cliStringToObject(Class >> Option.java:136) >> >>at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl >> assOption.java:61) >> >>... 9 more >> >> >> Those Class Not Found Exceptions are at runtime. Do i have do anything on >> the carbon-ml side for this.My samoa cores can be found in [3]. Those are >> working fine and no Class Not Found Exceptions arrive when running outside >> the carbon-ml. >> >> >> thank you. >> >> regards, >> >> Mahesh. >> >> >> >> [1] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ >> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte >> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/ >> streaming/samoa/StreamingClusteringTask.java >> >> [2] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ >> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte >> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/ >> streaming/samoa/StreamingClusteringTask.java >> >> [3] https://github.com/dananjayamahesh/carbon-ml/tree/wso2_gsoc_ >> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte >> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/streaming/samoa >> >> On Thu, Aug 4, 2016 at 12:30 PM, Supun Sethunga wrote: >> >>> Hi Mahesh, >>> >>> samoa dependency version in siddhi-extension should be >>> *0.4.0-incubating-SNAPSHOT*. That should solve the issue >>> >>> Regards, >>> Supun >>> >>> On Thu, Aug 4, 2016 at 11:50 AM, Mahesh Dananjaya < >>> dananjayamah...@gmail.com> wrote: >>> Hi all, samoa is in my local repository and dependencies works fine with all other extensions that add samoa 0.4.0-incubator depen
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi Nirmal, can those things be caused by permission requirements? BR, Mahesh. On Fri, Aug 5, 2016 at 5:39 PM, Mahesh Dananjaya wrote: > Hi Nirmal, > Yes i have added samoa dependencies in carbon-ml and it is working fine. > These exceptions are coming for the my classes that are inside ml. when i > used classes in samoa like org.apache.samoa.tasks.ClusteringEvaluation it > is working fine and run. And also same classes that i developed are running > fine in my other extensions outside carbon-ml, which are developed as > regular extensions. i am checking this further. thank you. > regards, > Mahesh. > > On Fri, Aug 5, 2016 at 5:31 PM, Nirmal Fernando wrote: > >> Did you add samoa jars in ML? >> >> On Fri, Aug 5, 2016 at 12:20 PM, Mahesh Dananjaya < >> dananjayamah...@gmail.com> wrote: >> >>> Hi Supun, >>> This is the error i am getting while run the extension in the cabon-ml >>> side, >>> plase reffer to link [1] for the class. >>> >>> ERROR >>> {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder} >>> - Fail to initialize the task >>> >>> java.lang.Exception: Class not found: StreamingClusteringTask >>> >>>at com.github.javacliparser.ClassOption.cliStringToObject(Class >>> Option.java:136) >>> >>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>> gClusteringTaskBuilder.initClusteringTask(StreamingClusterin >>> gTaskBuilder.java:129) >>> >>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>> gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder.java:100) >>> >>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>> gClustering.run(StreamingClustering.java:77) >>> >>>at java.lang.Thread.run(Thread.java:745) >>> >>> [2016-08-04 16:23:07,437] INFO {org.wso2.carbon.ml.siddhi.ext >>> ension.streaming.samoa.StreamingClusteringTaskBuilder} - Fail to >>> initialize the taskjava.lang.Exception: Class not found: >>> StreamingClusteringTask >>> >>> +++Please refeer link [1] for the StreamingClusteringTask. >>> >>> Then again for StreamingClusteringStream class while i bypass the String >>> query in the initTask(). please refer link [2] for the class. >>> >>> Exception in thread "Thread-60" java.lang.IllegalArgumentException: >>> Problems with option: streamTrain >>> >>>at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl >>> assOption.java:64) >>> >>>at com.github.javacliparser.AbstractOption.resetToDefault(Abstr >>> actOption.java:90) >>> >>>at com.github.javacliparser.AbstractClassOption.(Abstract >>> ClassOption.java:84) >>> >>>at com.github.javacliparser.AbstractClassOption.(Abstract >>> ClassOption.java:63) >>> >>>at com.github.javacliparser.ClassOption.(ClassOption.java:38) >>> >>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>> gClusteringTask.(StreamingClusteringTask.java:52) >>> >>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>> gClusteringTaskBuilder.initClusteringTask(StreamingClusterin >>> gTaskBuilder.java:140) >>> >>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>> gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder.java:103) >>> >>>at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>> gClustering.run(StreamingClustering.java:77) >>> >>>at java.lang.Thread.run(Thread.java:745) >>> >>> Caused by: java.lang.Exception: Class not found: >>> org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin >>> gClusteringStream >>> >>>at com.github.javacliparser.ClassOption.cliStringToObject(Class >>> Option.java:136) >>> >>>at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl >>> assOption.java:61) >>> >>>... 9 more >>> >>> >>> Those Class Not Found Exceptions are at runtime. Do i have do anything >>> on the carbon-ml side for this.My samoa cores can be found in [3]. Those >>> are working fine and no Class Not Found Exceptions arrive when running >>> outside the carbon-ml. >>> >>> >>> thank you. >>> >>> regards, >>> >>> Mahesh. >>> >>> >>> >>> [1] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ >>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte >>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/stre >>> aming/samoa/StreamingClusteringTask.java >>> >>> [2] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ >>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte >>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/stre >>> aming/samoa/StreamingClusteringTask.java >>> >>> [3] https://github.com/dananjayamahesh/carbon-ml/tree/wso2_gsoc_ >>> ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte >>> nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/streaming/samoa >>> >>> On Thu, Aug 4, 2016 at 12:30 PM, Supun Sethunga wrote: >>> Hi Mahesh, samoa dependency version in siddhi-extension should be *0.4.0-incubating-SNAPSHOT*. That should solve the i
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Mahesh, Your issue is not clear. What're you exactly trying ? carbon-ml is our git repo and if you mean to say about the server you're running, please use the term 'ML server'. Please summarize the problem and the steps you've done. Please use the point form. Thanks. On Fri, Aug 5, 2016 at 6:43 PM, Mahesh Dananjaya wrote: > Hi Nirmal, > can those things be caused by permission requirements? > BR, > Mahesh. > > On Fri, Aug 5, 2016 at 5:39 PM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> Hi Nirmal, >> Yes i have added samoa dependencies in carbon-ml and it is working fine. >> These exceptions are coming for the my classes that are inside ml. when i >> used classes in samoa like org.apache.samoa.tasks.ClusteringEvaluation >> it is working fine and run. And also same classes that i developed are >> running fine in my other extensions outside carbon-ml, which are developed >> as regular extensions. i am checking this further. thank you. >> regards, >> Mahesh. >> >> On Fri, Aug 5, 2016 at 5:31 PM, Nirmal Fernando wrote: >> >>> Did you add samoa jars in ML? >>> >>> On Fri, Aug 5, 2016 at 12:20 PM, Mahesh Dananjaya < >>> dananjayamah...@gmail.com> wrote: >>> Hi Supun, This is the error i am getting while run the extension in the cabon-ml side, plase reffer to link [1] for the class. ERROR {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder} - Fail to initialize the task java.lang.Exception: Class not found: StreamingClusteringTask at com.github.javacliparser.ClassOption.cliStringToObject(Class Option.java:136) at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin gClusteringTaskBuilder.initClusteringTask(StreamingClusterin gTaskBuilder.java:129) at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuild er.java:100) at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin gClustering.run(StreamingClustering.java:77) at java.lang.Thread.run(Thread.java:745) [2016-08-04 16:23:07,437] INFO {org.wso2.carbon.ml.siddhi.ext ension.streaming.samoa.StreamingClusteringTaskBuilder} - Fail to initialize the taskjava.lang.Exception: Class not found: StreamingClusteringTask +++Please refeer link [1] for the StreamingClusteringTask. Then again for StreamingClusteringStream class while i bypass the String query in the initTask(). please refer link [2] for the class. Exception in thread "Thread-60" java.lang.IllegalArgumentException: Problems with option: streamTrain at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl assOption.java:64) at com.github.javacliparser.AbstractOption.resetToDefault(Abstr actOption.java:90) at com.github.javacliparser.AbstractClassOption.(Abstract ClassOption.java:84) at com.github.javacliparser.AbstractClassOption.(Abstract ClassOption.java:63) at com.github.javacliparser.ClassOption.(ClassOption.java:38) at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin gClusteringTask.(StreamingClusteringTask.java:52) at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin gClusteringTaskBuilder.initClusteringTask(StreamingClusterin gTaskBuilder.java:140) at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuild er.java:103) at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin gClustering.run(StreamingClustering.java:77) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.Exception: Class not found: org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin gClusteringStream at com.github.javacliparser.ClassOption.cliStringToObject(Class Option.java:136) at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl assOption.java:61) ... 9 more Those Class Not Found Exceptions are at runtime. Do i have do anything on the carbon-ml side for this.My samoa cores can be found in [3]. Those are working fine and no Class Not Found Exceptions arrive when running outside the carbon-ml. thank you. regards, Mahesh. [1] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte nsion/src/main/java/org/wso2/carbon/ml/siddhi/extension/stre aming/samoa/StreamingClusteringTask.java [2] https://github.com/dananjayamahesh/carbon-ml/blob/wso2_gsoc_ ml6_cml/components/extensions/org.wso2.carbon.ml.siddhi.exte nsion/src/main/java/org
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi Srinath and Nirmal, I have integrated the my samoa predictive analysis topologies with the cep with siddhi extension developed. As you asked me, i have verified the output of my samoa streaming clustering topology with the previously build Spark streaming Clustering analysis. Results are almost same and is converging. As a example if i used two algorithms spark mini-batch clustering and samoa kernal clustering for streaming clustering analysis outcomes are as follows in my streaming extensions. Spark Streaming Clustering center 0: 440.873301276124,25.477847235065635,64.20812280377294,1010.9613963380791,67.80943221749587 center 1: 470.25742216416273,12.785760940561731,42.586181145220955,1015.9444850860008,79.6946897452645 Samoa Streaming Clustering Center :0: 442.06527377405365,25.51594930115884,60.35312500444376,1010.624677139,61.262047085828065 Center :1: 469.66365199261037,12.6577054812157,43.59210147812603,1014.3543441369945,76.81973235658958 you can see that cluster centers are almost same.This is with 5 attributes and two clusters. As long as we have large batch size and number of increasing number of retraining, the results are converging. Now i am trying to integrate this with carbon-ml and trying to fix couple of issues in the integration. I will also prepare the documentation.thank you. And i have create new repository [1] to put essential classes. regards, Mahesh. [1] https://github.com/dananjayamahesh/streaming On Fri, Aug 5, 2016 at 6:47 PM, Nirmal Fernando wrote: > Mahesh, > > Your issue is not clear. What're you exactly trying ? carbon-ml is our git > repo and if you mean to say about the server you're running, please use the > term 'ML server'. Please summarize the problem and the steps you've done. > Please use the point form. > > Thanks. > > On Fri, Aug 5, 2016 at 6:43 PM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> Hi Nirmal, >> can those things be caused by permission requirements? >> BR, >> Mahesh. >> >> On Fri, Aug 5, 2016 at 5:39 PM, Mahesh Dananjaya < >> dananjayamah...@gmail.com> wrote: >> >>> Hi Nirmal, >>> Yes i have added samoa dependencies in carbon-ml and it is working fine. >>> These exceptions are coming for the my classes that are inside ml. when i >>> used classes in samoa like org.apache.samoa.tasks.ClusteringEvaluation >>> it is working fine and run. And also same classes that i developed are >>> running fine in my other extensions outside carbon-ml, which are developed >>> as regular extensions. i am checking this further. thank you. >>> regards, >>> Mahesh. >>> >>> On Fri, Aug 5, 2016 at 5:31 PM, Nirmal Fernando wrote: >>> Did you add samoa jars in ML? On Fri, Aug 5, 2016 at 12:20 PM, Mahesh Dananjaya < dananjayamah...@gmail.com> wrote: > Hi Supun, > This is the error i am getting while run the extension in the cabon-ml > side, > plase reffer to link [1] for the class. > > ERROR > {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder} > - Fail to initialize the task > > java.lang.Exception: Class not found: StreamingClusteringTask > >at com.github.javacliparser.ClassOption.cliStringToObject(Class > Option.java:136) > >at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin > gClusteringTaskBuilder.initClusteringTask(StreamingClusterin > gTaskBuilder.java:129) > >at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin > gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuild > er.java:100) > >at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin > gClustering.run(StreamingClustering.java:77) > >at java.lang.Thread.run(Thread.java:745) > > [2016-08-04 16:23:07,437] INFO {org.wso2.carbon.ml.siddhi.ext > ension.streaming.samoa.StreamingClusteringTaskBuilder} - Fail to > initialize the taskjava.lang.Exception: Class not found: > StreamingClusteringTask > > +++Please refeer link [1] for the StreamingClusteringTask. > > Then again for StreamingClusteringStream class while i bypass the > String query in the initTask(). please refer link [2] for the class. > > Exception in thread "Thread-60" java.lang.IllegalArgumentException: > Problems with option: streamTrain > >at com.github.javacliparser.ClassOption.setValueViaCLIString(Cl > assOption.java:64) > >at com.github.javacliparser.AbstractOption.resetToDefault(Abstr > actOption.java:90) > >at com.github.javacliparser.AbstractClassOption.(Abstract > ClassOption.java:84) > >at com.github.javacliparser.AbstractClassOption.(Abstract > ClassOption.java:63) > >at com.github.javacliparser.ClassOption.(ClassOption.java:38) > >at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin > gClusteringTask.(StreamingClusteringTask.java:52) >
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi supun, I think i have fixed couple of previous errors. Now my samoa extension is working fine with cep. But i am getting a exception with my spark streaming ml extensions. It was working fine and i did not do any changes to my previously developed streaming extensions. This error is occured in the line, conf = new SparkConf().setMaster("local[*]").setAppName("Linear Regression Example").set("spark.driver.allowMultipleContexts", "true") ; sc = new JavaSparkContext(conf); This what i get and cep server is crashed. ERROR {org.apache.spark.ui.SparkUI} - Failed to bind SparkUI javax.servlet.UnavailableException: Servlet class com.sun.jersey.spi.container.servlet.ServletContainer is not a javax.servlet.Servlet at org.spark-project.jetty.servlet.ServletHolder.checkServletType(ServletHolder.java:438) at org.spark-project.jetty.servlet.ServletHolder.doStart(ServletHolder.java:316) at org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64) at org.spark-project.jetty.servlet.ServletHandler.initialize(ServletHandler.java:791) at org.spark-project.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:265) at org.spark-project.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:717) at org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64) at org.spark-project.jetty.server.handler.HandlerCollection.doStart(HandlerCollection.java:229) at org.spark-project.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:172) at org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64) at org.spark-project.jetty.server.handler.HandlerWrapper.doStart(HandlerWrapper.java:95) at org.spark-project.jetty.server.Server.doStart(Server.java:282) at org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64) at org.apache.spark.ui.JettyUtils$.org$apache$spark$ui$JettyUtils$$connect$1(JettyUtils.scala:228) at org.apache.spark.ui.JettyUtils$$anonfun$2.apply(JettyUtils.scala:238) at org.apache.spark.ui.JettyUtils$$anonfun$2.apply(JettyUtils.scala:238) at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1991) at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141) at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1982) at org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils.scala:238) at org.apache.spark.ui.WebUI.bind(WebUI.scala:117) at org.apache.spark.SparkContext$$anonfun$13.apply(SparkContext.scala:448) at org.apache.spark.SparkContext$$anonfun$13.apply(SparkContext.scala:448) at scala.Option.foreach(Option.scala:236) at org.apache.spark.SparkContext.(SparkContext.scala:448) at org.apache.spark.api.java.JavaSparkContext.(JavaSparkContext.scala:61) at org.gsoc.siddhi.extension.streaming.StreamingKMeansClustering.(StreamingKMeansClustering.java:60) at org.gsoc.siddhi.extension.streaming.StreamingKMeansClusteringStreamProcessor.init(StreamingKMeansClusteringStreamProcessor.java:68) at org.wso2.siddhi.core.query.processor.stream.AbstractStreamProcessor.initProcessor(AbstractStreamProcessor.java:65) at org.wso2.siddhi.core.util.parser.SingleInputStreamParser.generateProcessor(SingleInputStreamParser.java:182) at org.wso2.siddhi.core.util.parser.SingleInputStreamParser.parseInputStream(SingleInputStreamParser.java:93) at org.wso2.siddhi.core.util.parser.InputStreamParser.parse(InputStreamParser.java:58) at org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:85) at org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:145) at org.wso2.siddhi.core.SiddhiManager.validateExecutionPlan(SiddhiManager.java:69) at org.wso2.siddhi.core.SiddhiManager.validateExecutionPlan(SiddhiManager.java:75) at org.wso2.carbon.event.processor.core.internal.util.helper.EventProcessorHelper.validateExecutionPlan(EventProcessorHelper.java:191) at org.wso2.carbon.event.processor.core.internal.CarbonEventProcessorService.validateExecutionPlan(CarbonEventProcessorService.java:493) at org.wso2.carbon.event.processor.admin.EventProcessorAdminService.validateExecutionPlan(EventProcessorAdminService.java:329) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.axis2.rpc.receivers.RPCUtil.invokeServiceClass(RPCUtil.java:212) at org.apache.axis2.rpc.receivers.RPCMessageReceiver.invokeBusinessLogic(RPCMessageReceiver.java:117) at org.apache.axis2.receivers.AbstractInOutMessageReceiver.invokeBusinessLogic(AbstractInOutMessageReceiver.java:40) at org.
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi Mahesh, Couple of issues I noticed: - Your siddhi-extension is using spark 1.6.1 dependency. But in the logs, it says the version of spark is 1.4.1. You can see the following line in the logs. *TID: [-1234] [] [2016-08-08 13:05:11,699] INFO {org.apache.spark.SparkContext} - Running Spark version 1.4.1 * - In each of the extension, you are starting a spark-context, and a new spark application. But spark only allows to create one spark context per JVM. Can you fix those and check whether the issue is still exists? Also please use a fresh CEP pack when testing. For now, you can avoid the second issue by creating only one execution plan and calling only one algorithm at a time. Btw, it would be easy for us to reproduce the issue and check whats happening, if you can include all dependencies inside the jar itself. Otherwise, it's a nightmare to find and add the missing dependencies one by one. Regards, Supun On Mon, Aug 8, 2016 at 3:43 PM, Mahesh Dananjaya wrote: > Hi supun > this is the log file.This happens only when i use the cep to invoke the > extension.thank you. > regards, > Mahesh. > > On Mon, Aug 8, 2016 at 1:32 PM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> Hi supun, >> this is the cep log file.thank you. >> Mahesh. >> >> On Mon, Aug 8, 2016 at 11:03 AM, Mahesh Dananjaya < >> dananjayamah...@gmail.com> wrote: >> >>> Hi supun, >>> I think i have fixed couple of previous errors. Now my samoa extension >>> is working fine with cep. But i am getting a exception with my spark >>> streaming ml extensions. It was working fine and i did not do any changes >>> to my previously developed streaming extensions. This error is occured in >>> the line, >>> >>> conf = new SparkConf().setMaster("local[*]").setAppName("Linear >>> Regression Example").set("spark.driver.allowMultipleContexts", "true") >>> ; >>> sc = new JavaSparkContext(conf); >>> >>> This what i get and cep server is crashed. >>> ERROR {org.apache.spark.ui.SparkUI} - Failed to bind SparkUI >>> javax.servlet.UnavailableException: Servlet class >>> com.sun.jersey.spi.container.servlet.ServletContainer is not a >>> javax.servlet.Servlet >>> at org.spark-project.jetty.servlet.ServletHolder.checkServletTy >>> pe(ServletHolder.java:438) >>> at org.spark-project.jetty.servlet.ServletHolder.doStart(Servle >>> tHolder.java:316) >>> at org.spark-project.jetty.util.component.AbstractLifeCycle.sta >>> rt(AbstractLifeCycle.java:64) >>> at org.spark-project.jetty.servlet.ServletHandler.initialize(Se >>> rvletHandler.java:791) >>> at org.spark-project.jetty.servlet.ServletContextHandler.startC >>> ontext(ServletContextHandler.java:265) >>> at org.spark-project.jetty.server.handler.ContextHandler.doStar >>> t(ContextHandler.java:717) >>> at org.spark-project.jetty.util.component.AbstractLifeCycle.sta >>> rt(AbstractLifeCycle.java:64) >>> at org.spark-project.jetty.server.handler.HandlerCollection.doS >>> tart(HandlerCollection.java:229) >>> at org.spark-project.jetty.server.handler.ContextHandlerCollect >>> ion.doStart(ContextHandlerCollection.java:172) >>> at org.spark-project.jetty.util.component.AbstractLifeCycle.sta >>> rt(AbstractLifeCycle.java:64) >>> at org.spark-project.jetty.server.handler.HandlerWrapper.doStar >>> t(HandlerWrapper.java:95) >>> at org.spark-project.jetty.server.Server.doStart(Server.java:282) >>> at org.spark-project.jetty.util.component.AbstractLifeCycle.sta >>> rt(AbstractLifeCycle.java:64) >>> at org.apache.spark.ui.JettyUtils$.org$apache$spark$ui$JettyUti >>> ls$$connect$1(JettyUtils.scala:228) >>> at org.apache.spark.ui.JettyUtils$$anonfun$2.apply(JettyUtils.s >>> cala:238) >>> at org.apache.spark.ui.JettyUtils$$anonfun$2.apply(JettyUtils.s >>> cala:238) >>> at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.ap >>> ply$mcVI$sp(Utils.scala:1991) >>> at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141) >>> at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1982) >>> at org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils. >>> scala:238) >>> at org.apache.spark.ui.WebUI.bind(WebUI.scala:117) >>> at org.apache.spark.SparkContext$$anonfun$13.apply(SparkContext >>> .scala:448) >>> at org.apache.spark.SparkContext$$anonfun$13.apply(SparkContext >>> .scala:448) >>> at scala.Option.foreach(Option.scala:236) >>> at org.apache.spark.SparkContext.(SparkContext.scala:448) >>> at org.apache.spark.api.java.JavaSparkContext.(JavaSparkC >>> ontext.scala:61) >>> at org.gsoc.siddhi.extension.streaming.StreamingKMeansClusterin >>> g.(StreamingKMeansClustering.java:60) >>> at org.gsoc.siddhi.extension.streaming.StreamingKMeansClusterin >>> gStreamProcessor.init(StreamingKMeansClusteringStreamProcessor.java:68) >>> at org.wso2.siddhi.core.query.processor.stream.AbstractStreamPr >>> ocessor.initProcessor(AbstractStreamProcessor.java:65) >>> at org.
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi supun, Now most of the issues have been fixed. But still when i call spark and try to invoke spark Context this error appears.still this is in the line conf = new SparkConf().setMaster("local[*]").setAppName("Linear Regression Example").set("spark.driver.allowMultipleContexts", "true"); sc = new JavaSparkContext(conf); you can find this in the file [1]. com.typesafe.config.ConfigException$Missing: No configuration setting found for key 'akka.version' in execution plan "ExecutionPlan" ERROR {org.wso2.carbon.event.processor.admin.EventProcessorAdminService} - Exception when validating execution plan org.wso2.carbon.event.processor.core.exception.ExecutionPlanConfigurationException: com.typesafe.config.ConfigException$Missing: No configuration setting found for key 'akka.version' in execution plan "ExecutionPlan" at org.wso2.carbon.event.processor.core.internal.util.helper.EventProcessorHelper.validateExecutionPlan(EventProcessorHelper.java:193) at org.wso2.carbon.event.processor.core.internal.CarbonEventProcessorService.validateExecutionPlan(CarbonEventProcessorService.java:493) at org.wso2.carbon.event.processor.admin.EventProcessorAdminService.validateExecutionPlan(EventProcessorAdminService.java:329) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.axis2.rpc.receivers.RPCUtil.invokeServiceClass(RPCUtil.java:212) at org.apache.axis2.rpc.receivers.RPCMessageReceiver.invokeBusinessLogic(RPCMessageReceiver.java:117) at org.apache.axis2.receivers.AbstractInOutMessageReceiver.invokeBusinessLogic(AbstractInOutMessageReceiver.java:40) at org.apache.axis2.receivers.AbstractMessageReceiver.receive(AbstractMessageReceiver.java:110) at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180) at org.apache.axis2.transport.local.LocalTransportReceiver.processMessage(LocalTransportReceiver.java:169) at org.apache.axis2.transport.local.LocalTransportReceiver.processMessage(LocalTransportReceiver.java:82) at org.wso2.carbon.core.transports.local.CarbonLocalTransportSender.finalizeSendWithToAddress(CarbonLocalTransportSender.java:45) at org.apache.axis2.transport.local.LocalTransportSender.invoke(LocalTransportSender.java:77) at org.apache.axis2.engine.AxisEngine.send(AxisEngine.java:442) at org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:430) at org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225) at org.apache.axis2.client.OperationClient.execute(OperationClient.java:149) at org.wso2.carbon.event.processor.stub.EventProcessorAdminServiceStub.validateExecutionPlan(EventProcessorAdminServiceStub.java:2207) at org.apache.jsp.eventprocessor.validate_005fsiddhi_005fqueries_005fajaxprocessor_jsp._jspService(validate_005fsiddhi_005fqueries_005fajaxprocessor_jsp.java:73) at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:432) at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:395) at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:339) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.wso2.carbon.ui.JspServlet.service(JspServlet.java:155) at org.wso2.carbon.ui.TilesJspServlet.service(TilesJspServlet.java:80) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.eclipse.equinox.http.helper.ContextPathServletAdaptor.service(ContextPathServletAdaptor.java:37) at org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61) at org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128) at org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.wso2.carbon.ui.filters.CSRFPreventionFilter.doFilter(CSRFPreventionFilter.java:88) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Refer: http://stackoverflow.com/questions/31011243/no-configuration-setting-found-for-key-akka-version Regards, Supun On Wed, Aug 10, 2016 at 2:45 PM, Mahesh Dananjaya wrote: > Hi supun, > Now most of the issues have been fixed. But still when i call spark and > try to invoke spark Context this error appears.still this is in the line > > conf = new SparkConf().setMaster("local[*]").setAppName("Linear > Regression Example").set("spark.driver.allowMultipleContexts", "true"); > sc = new JavaSparkContext(conf); > you can find this in the file [1]. > > com.typesafe.config.ConfigException$Missing: No configuration setting > found for key 'akka.version' in execution plan "ExecutionPlan" > > ERROR {org.wso2.carbon.event.processor.admin.EventProcessorAdminService} > - Exception when validating execution plan > org.wso2.carbon.event.processor.core.exception. > ExecutionPlanConfigurationException: > com.typesafe.config.ConfigException$Missing: > No configuration setting found for key 'akka.version' in execution plan > "ExecutionPlan" > at org.wso2.carbon.event.processor.core.internal.util. > helper.EventProcessorHelper.validateExecutionPlan( > EventProcessorHelper.java:193) > > at org.wso2.carbon.event.processor.core.internal. > CarbonEventProcessorService.validateExecutionPlan( > CarbonEventProcessorService.java:493) > at org.wso2.carbon.event.processor.admin.EventProcessorAdminService. > validateExecutionPlan(EventProcessorAdminService.java:329) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke( > NativeMethodAccessorImpl.java:62) > at sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at org.apache.axis2.rpc.receivers.RPCUtil.invokeServiceClass(RPCUtil. > java:212) > at org.apache.axis2.rpc.receivers.RPCMessageReceiver. > invokeBusinessLogic(RPCMessageReceiver.java:117) > at org.apache.axis2.receivers.AbstractInOutMessageReceiver. > invokeBusinessLogic(AbstractInOutMessageReceiver.java:40) > at org.apache.axis2.receivers.AbstractMessageReceiver.receive( > AbstractMessageReceiver.java:110) > at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180) > at org.apache.axis2.transport.local.LocalTransportReceiver. > processMessage(LocalTransportReceiver.java:169) > at org.apache.axis2.transport.local.LocalTransportReceiver. > processMessage(LocalTransportReceiver.java:82) > at org.wso2.carbon.core.transports.local.CarbonLocalTransportSender. > finalizeSendWithToAddress(CarbonLocalTransportSender.java:45) > at org.apache.axis2.transport.local.LocalTransportSender. > invoke(LocalTransportSender.java:77) > at org.apache.axis2.engine.AxisEngine.send(AxisEngine.java:442) > at org.apache.axis2.description.OutInAxisOperationClient.send( > OutInAxisOperation.java:430) > at org.apache.axis2.description.OutInAxisOperationClient.executeImpl( > OutInAxisOperation.java:225) > at org.apache.axis2.client.OperationClient.execute( > OperationClient.java:149) > at org.wso2.carbon.event.processor.stub.EventProcessorAdminServiceStub > .validateExecutionPlan(EventProcessorAdminServiceStub.java:2207) > at org.apache.jsp.eventprocessor.validate_005fsiddhi_ > 005fqueries_005fajaxprocessor_jsp._jspService(validate_ > 005fsiddhi_005fqueries_005fajaxprocessor_jsp.java:73) > at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) > at org.apache.jasper.servlet.JspServletWrapper.service( > JspServletWrapper.java:432) > at org.apache.jasper.servlet.JspServlet.serviceJspFile( > JspServlet.java:395) > at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:339) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) > at org.wso2.carbon.ui.JspServlet.service(JspServlet.java:155) > at org.wso2.carbon.ui.TilesJspServlet.service(TilesJspServlet.java:80) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) > at org.eclipse.equinox.http.helper.ContextPathServletAdaptor.service( > ContextPathServletAdaptor.java:37) > at org.eclipse.equinox.http.servlet.internal. > ServletRegistration.service(ServletRegistration.java:61) > at org.eclipse.equinox.http.servlet.internal.ProxyServlet. > processAlias(ProxyServlet.java:128) > at org.eclipse.equinox.http.servlet.internal.ProxyServlet. > service(ProxyServlet.java:68) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) > at org.wso2.carbon.tomcat.ext.servlet.DelegationServlet. > service(DelegationServlet.java:68) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter( > ApplicationFilterChain.java:303) > at org.apache.catalina.core.ApplicationFilterChain.doFilter( > ApplicationFilterChain.java:208) > at org.apache.tomcat.websocket.server.WsFilter.doFilt
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
I think this is for the StreamingRegression right. You have to check the queryr. if there is simple mistake such as a space this can be happened. As i remember this is coming in the execution right?check in your local maven repository that relevant class is there first. and can you explain how you are going to run this. with CEP?i will check. BR, Mahesh. On Thu, Nov 24, 2016 at 12:11 PM, Jayan Vidanapathirana wrote: > Hi Ayya, > > This is the exception, > > SLF4J: Defaulting to no-operation (NOP) logger implementation > SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further > details. > Exception in thread "Thread-1" > org.wso2.siddhi.core.exception.ExecutionPlanRuntimeException: > Fail to initialize the task : > at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa. > utils.regression.StreamingRegressionTaskBuilder.initRegressionTask( > StreamingRegressionTaskBuilder.java:91) > at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa. > utils.regression.StreamingRegressionTaskBuilder.initTask( > StreamingRegressionTaskBuilder.java:64) > at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa. > utils.regression.StreamingRegression.run(StreamingRegression.java:57) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.Exception: Problem creating instance of class: > org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.utils.regression. > StreamingRegressionTask > at com.github.javacliparser.ClassOption.cliStringToObject( > ClassOption.java:143) > at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa. > utils.regression.StreamingRegressionTaskBuilder.initRegressionTask( > StreamingRegressionTaskBuilder.java:89) > ... 3 more > Caused by: java.lang.IllegalArgumentException: Problems with option: > trainStream > at com.github.javacliparser.ClassOption.setValueViaCLIString( > ClassOption.java:64) > at com.github.javacliparser.AbstractOption.resetToDefault( > AbstractOption.java:90) > at com.github.javacliparser.AbstractClassOption.( > AbstractClassOption.java:84) > at com.github.javacliparser.AbstractClassOption.( > AbstractClassOption.java:63) > at com.github.javacliparser.ClassOption.( > ClassOption.java:38) > at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa. > utils.ProcessTask.(ProcessTask.java:67) > at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa. > utils.regression.StreamingRegressionTask. > (StreamingRegressionTask.java:32) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at sun.reflect.NativeConstructorAccessorImpl.newInstance( > NativeConstructorAccessorImpl.java:62) > at sun.reflect.DelegatingConstructorAccessorImpl.newInstance( > DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:422) > at java.lang.Class.newInstance(Class.java:442) > at com.github.javacliparser.ClassOption.cliStringToObject( > ClassOption.java:141) > ... 4 more > Caused by: java.lang.Exception: Class not found: org.wso2.carbon.ml.siddhi. > extension.streamingml.samoa.utils.regression.StreamingRegressionStream > at com.github.javacliparser.ClassOption.cliStringToObject( > ClassOption.java:136) > at com.github.javacliparser.ClassOption.setValueViaCLIString( > ClassOption.java:61) > ... 16 more > > > > > TaskBuilder query > > query = > "org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.utils.regression.StreamingRegressionTask > -f " + batchSize + " -i " + maxInstances + > " -s > (org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.utils.regression.StreamingRegressionStream > -A " + numberOfAttributes + " ) " + > "-l > (org.apache.samoa.learners.classifiers.rules.HorizontalAMRulesRegressor " + > "-r 9 -p " + parallelism + ")"; > > > > On Wed, Nov 23, 2016 at 2:40 PM, Jayan Vidanapathirana > wrote: > >> Hi ayya, >> >> I got the same issue you got here. Need a help to solve this is you have >> free time. >> >> >> -- Forwarded message -- >> From: Mahesh Dananjaya >> Date: Fri, Aug 5, 2016 at 12:20 PM >> Subject: Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic >> with online data for WSO2 Machine Learner-Samoa Integration >> To: Supun Sethunga >> Cc: Miyuru Dayarathna , Nir
Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with online data for WSO2 Machine Learner-Samoa Integration
Hi Mahesh, In my case, I got the same exception that you got before. It said StreamingRegression classNotFound but when I debug the code that class already loaded. The Issue happened inside the class regressionStream class and it cannot find the Samoa Instance class(Inside the regressionStream class I imported samoa.instance.Instance class) because I forgot to add samoa.instance jar file path to my jvm. Exception I got : Exception in thread "Thread-1" org.wso2.siddhi.core.exception.ExecutionPlanRuntimeException: Fail to initialize the task : at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa. utils.regression.StreamingRegressionTaskBuilder.initRegressionTask( StreamingRegressionTaskBuilder.java:91) at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa. utils.regression.StreamingRegressionTaskBuilder.initTask( StreamingRegressionTaskBuilder.java:64) at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa. utils.regression.StreamingRegression.run(StreamingRegression.java:57) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.Exception: Problem creating instance of class: org.wso2.carbon.ml.siddhi.extension.streamingml.samoa.utils.regression. StreamingRegressionTask at com.github.javacliparser.ClassOption.cliStringToObject( ClassOption.java:143) at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa. utils.regression.StreamingRegressionTaskBuilder.initRegressionTask( StreamingRegressionTaskBuilder.java:89) ... 3 more Caused by: java.lang.IllegalArgumentException: Problems with option: trainStream at com.github.javacliparser.ClassOption.setValueViaCLIString( ClassOption.java:64) at com.github.javacliparser.AbstractOption.resetToDefault( AbstractOption.java:90) at com.github.javacliparser.AbstractClassOption.( AbstractClassOption.java:84) at com.github.javacliparser.AbstractClassOption.( AbstractClassOption.java:63) at com.github.javacliparser.ClassOption.(ClassOption.java:38) at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa. utils.ProcessTask.(ProcessTask.java:67) at org.wso2.carbon.ml.siddhi.extension.streamingml.samoa. utils.regression.StreamingRegressionTask. (StreamingRegressionTask.java:32) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance( NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance( DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:422) at java.lang.Class.newInstance(Class.java:442) at com.github.javacliparser.ClassOption.cliStringToObject( ClassOption.java:141) ... 4 more Caused by: java.lang.Exception: Class not found: org.wso2.carbon.ml.siddhi. extension.streamingml.samoa.utils.regression.StreamingRegressionStream at com.github.javacliparser.ClassOption.cliStringToObject( ClassOption.java:136) at com.github.javacliparser.ClassOption.setValueViaCLIString( ClassOption.java:61) On Thu, Nov 24, 2016 at 1:09 PM, Jayan Vidanapathirana wrote: > Hi Supun Ayya, > > I got this same exception. > My project github link : https://github.com/Jayancv/ > streamingML/tree/master/src/main/java/org/wso2/carbon/ml/ > siddhi/extension/streamingml/samoa/utils/regression > > > -- Forwarded message -- > From: Mahesh Dananjaya > Date: Fri, Aug 5, 2016 at 12:20 PM > Subject: Re: [Dev] Fwd: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic > with online data for WSO2 Machine Learner-Samoa Integration > To: Supun Sethunga > Cc: Miyuru Dayarathna , Nirmal Fernando , > Maheshakya Wijewardena , Srinath Perera < > srin...@wso2.com>, Jayan Vidanapathirana , WSO2 > Developers' List > > > Hi Supun, > This is the error i am getting while run the extension in the cabon-ml > side, > plase reffer to link [1] for the class. > > ERROR > {org.wso2.carbon.ml.siddhi.extension.streaming.samoa.StreamingClusteringTaskBuilder} > - Fail to initialize the task > > java.lang.Exception: Class not found: StreamingClusteringTask > >at com.github.javacliparser.ClassOption.cliStringToObject(Class > Option.java:136) > >at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin > gClusteringTaskBuilder.initClusteringTask(StreamingCl > usteringTaskBuilder.java:129) > >at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin > gClusteringTaskBuilder.initTask(StreamingClusteringTaskBuilder.java:100) > >at org.wso2.carbon.ml.siddhi.extension.streaming.samoa.Streamin > gClustering.run(StreamingClustering.java:77) > >at java.lang.Thread.run(Thread.java:745) > > [2016-08-04 16:23:07,437] INFO {org.wso2.carbon.ml.siddhi.ext > ension.streaming.samoa.