Hi Heshani, Please add WSO2 developers list as well when you are inquiring about projects because the community is interested in these projects and their input is vital and the decisions are made collaboratively.
That said, about your request; this projects is targeted to be a GSoC project so the scope and the time line of the project should comply with the GSoC official time lines. So there should be a concrete goal and associated tasks that can be completed within that time frame. These tasks should be properly discussed with the community and finalized, so that they can go into the project proposal. If you want to continue this as your final year project, you should discuss about what more can be done (in addition to the components added in GSoC project) and also find a supervisor. But this should be done independently from the GSoC and you need to get approval from WSO2 for that. As a starting point (considering GSoC), you can download Machine Learner product, go through examples and quick start guide. Then you can try developing small ML applications with Spark ML lib and play around with Spark streaming as well. After getting some concrete idea, try to write a program using Spark Streaming and ML lib streaming linear regression, streaming k-means to train models with streaming data and share your you experience with us. Best regards. On Thu, Mar 3, 2016 at 12:23 PM, Heshani Herath <heshani7.her...@gmail.com> wrote: > Hi Maheshakya, > > I went through WSO2 ML details,as I'm doing this as the 4th year research > project I need more requirements to fit for the whole year, If there are > any requirements to be done please be kind enough to share with me. > > Thank you! > > On Mon, Feb 29, 2016 at 3:19 PM, Maheshakya Wijewardena < > mahesha...@wso2.com> wrote: > >> Hi Heshani, >> >> Thank you for the interest for this project. >> >> WSO2 Machine Learner supports several learning algorithms at the >> moment[1]. This project intends is to leverage the existing algorithms in >> WSO2 Machine Learner to support streaming data. As an initiative, first you >> can get an idea about what WSO2 Machine Learner does and how it operates. >> You can download WSO2 Machine Learner from product page[2] and the the >> source code [3]. ML is using Apache Spark MLLib[4] for its' algorithms so >> it's better to read and understand what it does as well. >> >> In order to get an idea about the deliverables and the scope of this >> project, try to understand how Spark streaming[5] (see examples) handles >> streaming data. Also, have a look in the streaming algorithms[6][7] >> supported by MLLib. There are two approaches discussed to employ >> incremental learning in ML in the project proposals page. These streaming >> algorithms can be directly used in the first approach. For the other >> approach, the your implementation should contain a procedure to create mini >> batches from streaming data with relevant sizes (i.e. a moving window) and >> do periodic retraining of the same algorithm. >> >> To start with the project, you will need to come up with a suitable plan >> and an architecture first. >> >> Please watch the video referenced in the proposal (reference: 5). It will >> help you getting a better idea about machine learning algorithms with >> streaming data. >> >> Let us know if you need any help with these. >> >> Best regards >> >> [1] https://docs.wso2.com/display/ML110/Machine+Learner+Algorithms >> [2] http://wso2.com/products/machine-learner/ >> [3] >> https://docs.wso2.com/display/ML110/Building+from+Source#BuildingfromSource-Downloadingthesourcecheckout >> [4] https://spark.apache.org/docs/1.4.1/mllib-guide.html >> [5] https://spark.apache.org/docs/1.4.1/streaming-programming-guide.html >> [6] >> https://spark.apache.org/docs/1.4.1/mllib-linear-methods.html#streaming-linear-regression >> [7] >> https://spark.apache.org/docs/1.4.1/mllib-clustering.html#streaming-k-means >> >> On Mon, Feb 29, 2016 at 2:54 PM, Heshani Herath < >> heshani7.her...@gmail.com> wrote: >> >>> Hi, >>> >>> >>> https://docs.wso2.com/display/GSoC/Project+Proposals+for+2016#ProjectProposalsfor2016-Proposal6:[ML]PredictiveanalyticswithonlinedataforWSO2MachineLearner >>> >>> I'm a 4th year undergraduate from SLIIT faculty of >>> computing(specializing in Software Engineering) who is interested in doing >>> the aforementioned project as the final year research. I would like to know >>> more details on this topic and the procedure to be followed when >>> implementing it. Please be kind enough to reply as soon as possible. >>> >>> Thank you >>> >>> -- >>> Best Regards, >>> Heshani Herath >>> >> >> >> >> -- >> Pruthuvi Maheshakya Wijewardena >> mahesha...@wso2.com >> +94711228855 >> >> >> > > > -- > Best Regards, > Heshani Herath > -- Pruthuvi Maheshakya Wijewardena mahesha...@wso2.com +94711228855
_______________________________________________ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
