Re: [Architecture] Adding RNN to WSO2 Machine Learner

2016-04-21 Thread Thamali Wijewardhana
Hi Imesh, Thanks a lot for the comments and it was really helpful. On Fri, Apr 22, 2016 at 6:33 AM, Nirmal Fernando wrote: > [Removed architecture@] > Will do. > > On Fri, Apr 22, 2016 at 12:05 AM, Yudhanjaya Wijeratne < > yudhanj...@wso2.com> wrote: > >> Hi Nirmal, Thamali has

Re: [Architecture] Adding RNN to WSO2 Machine Learner

2016-04-08 Thread Thamali Wijewardhana
Hi, I have used a dataset with 25000 rows and the size is 80 MB. The link to the dataset is: http://ai.stanford.edu/~amaas/data/sentiment/aclImdb_v1.tar.gz On Fri, Apr 8, 2016 at 3:07 PM, Srinath Perera wrote: > Thamali, how big is the data set you are using? ( give me

Re: [Architecture] Adding RNN to WSO2 Machine Learner

2016-04-08 Thread Srinath Perera
Thamali, how big is the data set you are using? ( give me a link to the data set as well). Nirmal, shall we compare the accuracy of RNN vs. Upul's rolling window method? --Srinath On Fri, Apr 8, 2016 at 9:23 AM, Thamali Wijewardhana wrote: > Hi, > > I run the RNN algorithm

Re: [Architecture] Adding RNN to WSO2 Machine Learner

2016-04-07 Thread Thamali Wijewardhana
Hi, I run the RNN algorithm using deeplearning4j library and the Keras python library. The dataset, hyper parameters, network architecture and the hardware platform are the same. Given below is the time comparison Deeplearning4j library-40 minutes per 1 epoch Keras library- 4 minutes per 1 epoch

Re: [Architecture] Adding RNN to WSO2 Machine Learner

2016-03-31 Thread Thamali Wijewardhana
Hi, I have organized a review on Monday (4th of April). Thanks On Thu, Mar 31, 2016 at 3:21 PM, Srinath Perera wrote: > Please setup a review. Shall we do it monday? > > On Thu, Mar 31, 2016 at 2:15 PM, Thamali Wijewardhana > wrote: > >> Hi, >> >> we have

Re: [Architecture] Adding RNN to WSO2 Machine Learner

2016-03-31 Thread Thamali Wijewardhana
Hi, we have created a spark program to prove the feasibility of adding the RNN algorithm to machine learner. This program demonstrates all the steps in machine learner: Uploading a dataset Selecting the hyper parameters for the model Creating a RNN model using data and training the model

Re: [Architecture] Adding RNN to WSO2 Machine Learner

2016-03-24 Thread Thamali Wijewardhana
Hi all, One of the most important obstacles in machine learning and deep learning is getting data into a format that neural nets can understand. Neural nets understand vectors. Therefore, vectorization is an important part in building neural network algorithms. Canova is a Vectorization library

Re: [Architecture] Adding RNN to WSO2 Machine Learner

2016-03-02 Thread Thamali Wijewardhana
Hi Srinath, We have decided to implement only classification first. Once we complete the classification, we hope to do next value prediction too. We are basically trying to implement a program to make sure that the deeplearning4j library we are using is compatible with apache spark pipeline. And

Re: [Architecture] Adding RNN to WSO2 Machine Learner

2016-03-01 Thread Srinath Perera
Hi Thamali, 1. RNN can do both classification and predict next value. Are we trying to do both? 2. When Upul played with it, he had trouble getting deeplearning4j implementation work with predict next value scenario. Is it fixed? 3. What are the data sets we will use to verify the

[Architecture] Adding RNN to WSO2 Machine Learner

2016-03-01 Thread Thamali Wijewardhana
Hi, Currently we are working on a project to add Recurrent Neural Network(RNN) algorithm to machine learner. RNN is one of deep learning algorithms with record breaking accuracy. For more information on RNN please refer link[1]. We have decided to use deeplearning4j which is an open source deep