Adding Jayan to this email thread. -- Thanks, Miyuru Dayarathna Senior Technical Lead Mobile: +94713527783 Blog: http://miyurublog.blogspot.com
On Wed, Aug 3, 2016 at 3:11 PM, Supun Sethunga <sup...@wso2.com> wrote: > Hi Mahesh, > > you should build carbon-ml *without *-U option. -U means you force mvn to > look for updates in remote repo. Rather run it with -o option. Also, can > you double check whether the dependencies are defined correctly (group > Id's, versions etc). > > Alternatively, it seems there is a samoa released version in mvn repo. > Maybe you could try that one as well. But that's v0.3.0.. > > [1] https://mvnrepository.com/artifact/org.apache.samoa > > On Wed, Aug 3, 2016 at 2:54 PM, Mahesh Dananjaya < > dananjayamah...@gmail.com> wrote: > >> Hi Supun, >> I just neeed a little help. I am in the process of integrating my samoa >> core functions and extension into carbon-ml's siddhi extension. For samoa i >> am using locally built samoa project to provide samoa 0.4.0 >> dependencies,since we dont have it in the maven repo or else where. But >> when i build carbon-ml by adding samoa dependencies, it seems to be maven >> search for remote location, not the local maven repo first. I am running >> maven with -U option. But still the problems occurs. Is there any specific >> thing in carbon-ml like settings to search remote before local one? I just >> need to give local maven repo for the dependency. My extension seperately >> working fine, so there is no problem wihat the local dependencies outside >> carbon-ml. So can you please help me with this.thank you. >> regards, >> Mahesh. >> >> On Fri, Jul 22, 2016 at 3:17 PM, Srinath Perera <srin...@wso2.com> wrote: >> >>> Hi Mahesh, >>> >>> On Thu, Jul 21, 2016 at 2:10 PM, Mahesh Dananjaya < >>> dananjayamah...@gmail.com> wrote: >>> >>>> Hi All, >>>> I am onto connecting cep streams with samoa streams to data analysis >>>> using samoa framework. To connect samoa with cep siddhi event streams what >>>> i we can do is that try to convert cep streams into samoa streams or else >>>> writing wrpper for samoa for cep streasm to be used. In both cases i have >>>> to covert siddhi cep streasm into samoa streams. Samoa is using MOA to >>>> analyse data. Moo contains ML framework to analyse stream data. Samoa is >>>> wrapping MOA withsome of its classes. >>>> >>>> Samoa streams is based on MOA, Instance and InstanceStreams. Samoa see >>>> streams as a stream of instances [1]. So if we are going to convert cep >>>> events into samoa instances , it will take time. But if we have some >>>> similarity between cep siddhi streams and samoa streasm we can reduce the >>>> time. >>>> 1. What is the underlying infrastructure for cep siddhi streasm.? >>>> 2. Are there anything as Instances or InstanceStreams kind of >>>> implmentation underlying cep streams? >>>> 3. How can i get more underestanding on CEP siddhi streams. >>>> >>>> On the other hand i can use my cep siddhi extension and put those >>>> events into event queue and convert them into samoa instances and feed them >>>> into samoa streaming ml topologies. >>>> >>> I think this is OK. I assume this is much easier. Let's do this and >>> check the performance. >>> >>> >>>> There is another option. In Samoa what they are basically doing is that >>>> wrapping MOA ML framework and write some classes for build streaming ml >>>> topologies. So as the other option i can wrap samoa moa with my design and >>>> use moa ml framework directly. (No need for Samoa extension). I have >>>> building some topologies to streaming data analysis [2]. Main problem is >>>> that lack of documentation. Anyway i had go through their whole samoa >>>> design.thank you. >>>> >>> >>> If we use MOA directly, would we loose the distributed support in SAOMA. >>> Let's do a call when you can, so we can dsicuss this in detail. >>> >>> --Srinath >>> >>> >>> >>>> regards, >>>> Mahesh. >>>> >>>> [1] >>>> https://github.com/apache/incubator-samoa/blob/master/samoa-api/src/main/java/org/apache/samoa/streams/clustering/ClusteringStream.java >>>> [2] >>>> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming >>>> >>>> On Mon, Jul 18, 2016 at 11:40 AM, Mahesh Dananjaya < >>>> dananjayamah...@gmail.com> wrote: >>>> >>>>> Hi Maheshakya, >>>>> Samoa modules built as topologies that connect streams with the >>>>> internal processors. I have already written some examples to test the ML >>>>> algorithms and samoa analysis topologies. What we need to done is mostly >>>>> developing a wrapper around samoa topologies to connect their input and >>>>> output streams with our cep streams. So i am currently going through their >>>>> stream architecture to connect our streams with their streams. Couple of >>>>> examples exapaining samoa ml topologies and streaming can be found in my >>>>> git hub repo [1]. Samoa using MOA ml algorithms by wrapping them with >>>>> their >>>>> classes. Initailly i am trying to develop a KMeansClustering analysis with >>>>> cep streams with samoa ml topologies. >>>>> And also i could not find a maven repo for samoa 0.4.0 incubating. So >>>>> i am currently using my local m2 repo's samoa 0..4.0 incubating for my >>>>> dependencies to work. The local one is built by original samoa >>>>> source.thank >>>>> you. >>>>> >>>>> regards, >>>>> Mahesh. >>>>> >>>>> [1] >>>>> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming >>>>> >>>>> >>>>> On Mon, Jul 18, 2016 at 8:32 AM, Maheshakya Wijewardena < >>>>> mahesha...@wso2.com> wrote: >>>>> >>>>>> Hi Mahesh, >>>>>> >>>>>> Can you please share your samoa project? >>>>>> >>>>>> On Sun, Jul 17, 2016 at 11:19 AM, Mahesh Dananjaya < >>>>>> dananjayamah...@gmail.com> wrote: >>>>>> >>>>>>> >>>>>>> ---------- Forwarded message ---------- >>>>>>> From: Mahesh Dananjaya <dananjayamah...@gmail.com> >>>>>>> Date: Sun, Jul 17, 2016 at 11:18 AM >>>>>>> Subject: Re: GSOC2016: [ML][CEP] [SAMOA]Predictive analytic with >>>>>>> online data for WSO2 Machine Learner-Samoa Integration >>>>>>> To: Maheshakya Wijewardena <mahesha...@wso2.com> >>>>>>> >>>>>>> >>>>>>> Hi Maheshakaya, >>>>>>> just need a little help. In Samoa when we want to run a class what >>>>>>> is does it used this commands [1], >>>>>>> 1. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar >>>>>>> "ClusteringEvaluation" >>>>>>> 2. bin/samoa storm target/SAMOA-Storm-0.0.1-SNAPSHOT.jar >>>>>>> "PrequentialEvaluation -d /tmp/dump.csv -i 1000000 -f 100000 -l >>>>>>> (classifiers.trees.VerticalHoeffdingTree -p 4) -s >>>>>>> (generators.RandomTreeGenerator -c 2 -o 10 -u 10)" >>>>>>> >>>>>>> what is does is call a class named LocalDoTask [4] and pass this >>>>>>> string as argument.After that that LocalDoTask call the relevent Tasks >>>>>>> such >>>>>>> as ClusteringEvaluation or PrequentialEvaluation. [2]. >>>>>>> >>>>>>> Now i have add samoa dependencies to my new maven project, where i >>>>>>> used original samoa source to write examples and test then earlier.Now i >>>>>>> want to push them into my new java project with samoa dependencies. I >>>>>>> added >>>>>>> dependency and it was built fine. Now i am calling my local DoTask.java >>>>>>> [3] >>>>>>> file as same as i did with samoa with, >>>>>>> java -cp target/streaming-1.0-SNAPSHOT.jar >>>>>>> org.gsoc.samoa.streaming.DoTask >>>>>>> "org.gsoc.samoa.streaming.ClusteringEvaluation" >>>>>>> But seems to be i am incorrect in some place. >>>>>>> Error: A JNI error has occurred, please check your installation and >>>>>>> try again >>>>>>> Exception in thread "main" java.lang.NoClassDefFoundError: >>>>>>> org/apache/samoa/topology/ComponentFactory >>>>>>> at java.lang.Class.getDeclaredMethods0(Native Method) >>>>>>> at java.lang.Class.privateGetDeclaredMethods(Class.java:2701) >>>>>>> at java.lang.Class.privateGetMethodRecursive(Class.java:3048) >>>>>>> at java.lang.Class.getMethod0(Class.java:3018) >>>>>>> at java.lang.Class.getMethod(Class.java:1784) >>>>>>> at >>>>>>> sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:544) >>>>>>> at >>>>>>> sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:526) >>>>>>> Caused by: java.lang.ClassNotFoundException: >>>>>>> org.apache.samoa.topology.ComponentFactory >>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:381) >>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424) >>>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) >>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357) >>>>>>> ... 7 more >>>>>>> >>>>>>> >>>>>>> can i actually call the Task like this. >>>>>>> >>>>>>> BR, >>>>>>> Mahesh. >>>>>>> >>>>>>> [1] >>>>>>> https://samoa.incubator.apache.org/documentation/Prequential-Evaluation-Task.html >>>>>>> [2] >>>>>>> https://github.com/apache/incubator-samoa/blob/releases/0.4.0-incubating-RC0/samoa-api/src/main/java/org/apache/samoa/tasks/ClusteringEvaluation.java >>>>>>> [3] >>>>>>> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/samoa/streaming/src/main/java/org/gsoc/samoa/streaming >>>>>>> [4] >>>>>>> https://github.com/apache/incubator-samoa/tree/releases/0.4.0-incubating-RC0/samoa-local/src/main/java/org/apache/samoa >>>>>>> >>>>>>> >>>>>>> On Thu, Jul 14, 2016 at 3:47 PM, Mahesh Dananjaya < >>>>>>> dananjayamah...@gmail.com> wrote: >>>>>>> >>>>>>>> Hi srinath, >>>>>>>> sure.i am working on it.thank you. >>>>>>>> regards, >>>>>>>> Mahesh. >>>>>>>> >>>>>>>> On Thu, Jul 14, 2016 at 11:12 AM, Srinath Perera <srin...@wso2.com> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> Hi Mahesh, >>>>>>>>> >>>>>>>>> Let's focus on getting SAOMA work with CEP. It is OK to be limited >>>>>>>>> to few algorithms. >>>>>>>>> >>>>>>>>> --Srinath >>>>>>>>> >>>>>>>>> On Thu, Jul 14, 2016 at 10:49 AM, Mahesh Dananjaya < >>>>>>>>> dananjayamah...@gmail.com> wrote: >>>>>>>>> >>>>>>>>>> Hi Maheshakya, >>>>>>>>>> I think we can build new tasks [1] like the one in execution plan >>>>>>>>>> in cep with samoa. I will try to build a one. >>>>>>>>>> regards, >>>>>>>>>> Mahesh. >>>>>>>>>> [1] >>>>>>>>>> https://samoa.incubator.apache.org/documentation/Developing-New-Tasks-in-SAMOA.html >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Thu, Jul 14, 2016 at 10:35 AM, Mahesh Dananjaya < >>>>>>>>>> dananjayamah...@gmail.com> wrote: >>>>>>>>>> >>>>>>>>>>> Hi Maheshakya, >>>>>>>>>>> I am building and running samoa to see its functionality. In >>>>>>>>>>> samoa still we have limited supports in algorithms. Samoa supports >>>>>>>>>>> only >>>>>>>>>>> classification and clustering with streams. It also use kind of >>>>>>>>>>> StreamProcessor, like the one we use in StreamProcessor extension. >>>>>>>>>>> I was >>>>>>>>>>> getting started with Samoa referring to this page [1]. Then i ran >>>>>>>>>>> couple of >>>>>>>>>>> examples to identified the flow. Samoa use hadoop framework instead >>>>>>>>>>> spark >>>>>>>>>>> for distribution. But i am using it in a local mode. When i see the >>>>>>>>>>> Samoa >>>>>>>>>>> core there is only limited algorithms. IMO if we are going to use >>>>>>>>>>> Samoa we >>>>>>>>>>> have to limit the functionality and algorithms [2]. When i go to >>>>>>>>>>> developer >>>>>>>>>>> corner in [3], it seems to be something like CEP extension that we >>>>>>>>>>> are >>>>>>>>>>> using currenlty. SO in Samoa though the algorihtms are limited, >>>>>>>>>>> they have >>>>>>>>>>> implemented streaming support for them. Therefore if we integrate >>>>>>>>>>> it into >>>>>>>>>>> CEP we have to look for how to handle streams and algorithms in >>>>>>>>>>> Samoa side. >>>>>>>>>>> Is it good for your side to have both hadoop and spark running >>>>>>>>>>> background.thank you. >>>>>>>>>>> regards, >>>>>>>>>>> Mahesh. >>>>>>>>>>> >>>>>>>>>>> [1] https://samoa.incubator.apache.org/documentation/Home.html >>>>>>>>>>> [2] >>>>>>>>>>> https://samoa.incubator.apache.org/documentation/api/current/index.html >>>>>>>>>>> [3] >>>>>>>>>>> https://samoa.incubator.apache.org/documentation/SAMOA-Topology.html >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> ============================ >>>>>>>>> Srinath Perera, Ph.D. >>>>>>>>> http://people.apache.org/~hemapani/ >>>>>>>>> http://srinathsview.blogspot.com/ >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Dev mailing list >>>>>>> Dev@wso2.org >>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Pruthuvi Maheshakya Wijewardena >>>>>> >>>>>> mahesha...@wso2.com >>>>>> +94711228855 >>>>>> >>>>>> >>>>>> >>>>> >>>> >>> >>> >>> -- >>> ============================ >>> Srinath Perera, Ph.D. >>> http://people.apache.org/~hemapani/ >>> http://srinathsview.blogspot.com/ >>> >> >> > > > -- > *Supun Sethunga* > Senior Software Engineer > WSO2, Inc. > http://wso2.com/ > lean | enterprise | middleware > Mobile : +94 716546324 > Blog: http://supunsetunga.blogspot.com > -- Thanks, Miyuru Dayarathna Senior Technical Lead Mobile: +94713527783 Blog: http://miyurublog.blogspot.com
_______________________________________________ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
