Hi Maheshakya, I have updated the repo [2] and upto date documents can be found at [1].thank you. regards, Mahesh. [1] https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/siddhi/extension/streaming [2] https://github.com/dananjayamahesh/carbon-ml/tree/wso2_gsoc_ml6_cml
On Tue, Jun 21, 2016 at 5:08 PM, Mahesh Dananjaya <[email protected] > wrote: > > ---------- Forwarded message ---------- > From: Mahesh Dananjaya <[email protected]> > Date: Tue, Jun 21, 2016 at 5:08 PM > Subject: Re: [Dev] Fwd: GSOC2016: [ML][CEP] Predictive analytic with > online data for WSO2 Machine Learner > To: Maheshakya Wijewardena <[email protected]> > > > Hi Maheshakya, > new query is like this adding spport for moving window methods. > > > @Import('LinRegInput:1.0.1') > define stream LinRegInput (salary double, rbi double, walks double, > strikeouts double, errors double); > > @Export('LinRegOutput:1.0.1') > define stream LinRegOutput (mse double); > > from LinRegInput#ml:streamlinreg(1, 2, 4, 100, 0.00000001, 1.0, 0.95, > salary, rbi, walks, strikeouts, errors) > select * > insert into mse; > 1=learnType > 2=windowShift > 4=batchSize....... > > windowShift is added to configure the amount of shift. i have added > log.infe(mse) to view the MSE. > Mahesh. > > On Tue, Jun 21, 2016 at 2:33 PM, Maheshakya Wijewardena < > [email protected]> wrote: > >> Hi Mahesh, >> >> If you are installing features from new p2 repo into a new CEP pack, >> then you wont need to replace those jars. >> If you have already installed those in the CEP from a previous p2-repo, >> then you have to un-install those features and reinstall with new p2 repo. >> But you don't need to do this because you can just replace the jar. It's >> easy. >> >> Best regards. >> >> On Tue, Jun 21, 2016 at 2:26 PM, Mahesh Dananjaya < >> [email protected]> wrote: >> >>> Hi Maheshakya, >>> If i built the carbon-ml then product-ml and point new p2 repository to >>> cep features, do i need to copy that >>> org.wso2.carbon.ml.siddhi.extension1.1..... thing into >>> cep_home/repository/component/... place. >>> regards, >>> Mahesh. >>> >>> On Thu, Jun 16, 2016 at 6:39 PM, Mahesh Dananjaya < >>> [email protected]> wrote: >>> >>>> In MLModelhandler there's persistModel method >>>> debug that method while trying to train a model from ML >>>> you can see the steps it takes >>>> don't use deep learning algorithm >>>> any other algorithm would work >>>> from line 777 is the section for creating the serializable object from >>>> trained model and saving it >>>> >>>> >>>> I think you don't need to directly use ML model handler >>>> you need to use the code in that for persisting models in the streaming >>>> algorithm >>>> so you can add a utils class in the streaming folder >>>> then add the persisting logic there >>>> ignore the deeplearning section in that >>>> only forcus on persisting spark mod >>>> >>>> On Wed, Jun 15, 2016 at 4:11 PM, Mahesh Dananjaya < >>>> [email protected]> wrote: >>>> >>>>> Hi Maheshakya, >>>>> I pushed the StreamingLinearRegression modules into my forked >>>>> carbon-ml repo at branch wso2_gsoc_ml6_cml [1]. I am working on persisting >>>>> model.thank you. >>>>> Mahesh. >>>>> [1] https://github.com/dananjayamahesh/carbon-ml >>>>> >>>>> On Tue, Jun 14, 2016 at 5:56 PM, Mahesh Dananjaya < >>>>> [email protected]> wrote: >>>>> >>>>>> yes >>>>>> you should develop in tha fork repo >>>>>> clone your forked repo >>>>>> then go into that >>>>>> then add upstream repo as original wso2 repo >>>>>> see the remote tracking branchs by >>>>>> git remote -v >>>>>> you will see the origin as your forked repo >>>>>> to add upstream >>>>>> git remote add upstream <wso2 repo> >>>>>> when you change something create a new branch by >>>>>> git checkout -b new_branch_name >>>>>> then add and commit to this branch >>>>>> after that push to the forked by >>>>>> git push origin new_branch_name >>>>>> >>>>>> On Tue, Jun 14, 2016 at 5:32 PM, Mahesh Dananjaya < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Hi Maheshakya, >>>>>>> the above error is due to a simple mistake of not providing my local >>>>>>> p2 repo.Now it is working and i debugged the StreamingLinearRegression >>>>>>> model cep. >>>>>>> regards, >>>>>>> Mahesh. >>>>>>> >>>>>>> On Tue, Jun 14, 2016 at 3:19 PM, Mahesh Dananjaya < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> Hi Maheshakya, >>>>>>>> I did what you recommend. But when i am adding the query the >>>>>>>> following error is appearing. >>>>>>>> No extension exist for StreamFunctionExtension{namespace='ml'} in >>>>>>>> execution plan "NewExecutionPlan" >>>>>>>> >>>>>>>> *My query is as follows, >>>>>>>> @Import('LinRegInput:1.0.0') >>>>>>>> define stream LinRegInput (salary double, rbi double, walks double, >>>>>>>> strikeouts double, errors double); >>>>>>>> >>>>>>>> @Export('LinRegOutput:1.0.0') >>>>>>>> define stream LinRegOutput (mse double); >>>>>>>> >>>>>>>> from LinRegInput#ml:streamlinreg(0, 2, 100, 0.00000001, 1.0, 0.95, >>>>>>>> salary, rbi, walks, strikeouts, errors) >>>>>>>> select * >>>>>>>> insert into mse; >>>>>>>> >>>>>>>> I have added my files as follows, >>>>>>>> >>>>>>>> org.wso2.carbon.ml.siddhi.extension.streaming.StreamingLinearRegression; >>>>>>>> org.wso2.carbon.ml.siddhi.extension.streaming.algorithm.StreamingLinearModel; >>>>>>>> >>>>>>>> and add following lines to ml.siddhiext >>>>>>>> >>>>>>>> streamlinreg=org.wso2.carbon.ml.siddhi.extension.streaming.StreamingLinearRegressionStreamProcessor >>>>>>>> >>>>>>>> .Then i build the carbon-ml. The replace the jar file you asked me >>>>>>>> replace with the name changed.any thoughts? >>>>>>>> regards, >>>>>>>> Mahesh. >>>>>>>> >>>>>>>> On Tue, Jun 14, 2016 at 2:43 PM, Maheshakya Wijewardena < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> Hi Mahesh, >>>>>>>>> >>>>>>>>> You don't need to add new p2 repo. >>>>>>>>> In the <CEP_HOME>/repository/components/plugins folder, you will >>>>>>>>> find org.wso2.carbon.ml.siddhi.extension_some_version.jar. Replace >>>>>>>>> this >>>>>>>>> with >>>>>>>>> carbon-ml/components/extensions/org.wso2.carbon.ml.siddhi.extension/target/org.wso2.carbon.ml.siddhi.extension-1.1.2-SNAPSHOT.jar. >>>>>>>>> First rename this jar in the target folder to the jar name in the >>>>>>>>> plugins >>>>>>>>> folder then replace (Make sure, otherwise will not work). >>>>>>>>> Your updates will be there in the CEP after this. >>>>>>>>> >>>>>>>>> Best regards. >>>>>>>>> >>>>>>>>> On Tue, Jun 14, 2016 at 2:37 PM, Mahesh Dananjaya < >>>>>>>>> [email protected]> wrote: >>>>>>>>> >>>>>>>>>> Hi Maheshakya, >>>>>>>>>> Do i need to add p2 local repos of ML into CEP after i made >>>>>>>>>> changes to ml extensions. Or will it be automatically updated. I am >>>>>>>>>> trying >>>>>>>>>> to debug my extension with the cep.thank you. >>>>>>>>>> regards, >>>>>>>>>> Mahesh. >>>>>>>>>> >>>>>>>>>> On Tue, Jun 14, 2016 at 1:57 PM, Maheshakya Wijewardena < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>> >>>>>>>>>>> Mahesh when you add your work to carbon-ml follow the bellow >>>>>>>>>>> guidelines, it will help to keep the code clean. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> - Add only the sources code file you have newly added or >>>>>>>>>>> changed. >>>>>>>>>>> - Do not use add . (add all) command in git. Only use add >>>>>>>>>>> filename >>>>>>>>>>> >>>>>>>>>>> I have seen in your gsoc repo that there are gitignore files, >>>>>>>>>>> idea related files and the target folder is there. These should not >>>>>>>>>>> be in >>>>>>>>>>> the source code, only the source files you add. >>>>>>>>>>> >>>>>>>>>>> - Commit when you have done some major activity. Do not add >>>>>>>>>>> commits always when you make a change. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Tue, Jun 14, 2016 at 12:22 PM, Mahesh Dananjaya < >>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi Maheshakya, >>>>>>>>>>>> May i seperately put the classes to ml and extensions in >>>>>>>>>>>> carbon-core. I can put Streaming Extensions to extensions and >>>>>>>>>>>> Algorithms/StreamingLinear Regression and StreamingKMeans in ml >>>>>>>>>>>> core. what >>>>>>>>>>>> is the suitable format. I will commit my changes today as seperate >>>>>>>>>>>> branch >>>>>>>>>>>> in my forked carbon-ml local repo.thank you. >>>>>>>>>>>> regards, >>>>>>>>>>>> Mahesh. >>>>>>>>>>>> p.s: better if you can meet me via hangout. >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> Pruthuvi Maheshakya Wijewardena >>>>>>>>>>> [email protected] >>>>>>>>>>> +94711228855 >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Pruthuvi Maheshakya Wijewardena >>>>>>>>> [email protected] >>>>>>>>> +94711228855 >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>> >> >> >> -- >> Pruthuvi Maheshakya Wijewardena >> [email protected] >> +94711228855 >> >> >> > >
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
