Re: Neural Network in hadoop

2015-02-12 Thread unmesha sreeveni
On Thu, Feb 12, 2015 at 4:13 PM, Alpha Bagus Sunggono wrote: > In my opinion, > - This is just for 1 iteration. Then, batch gradient means find all delta, > then updates all weight. So , I think its improperly if each have weight > updated. Weight updated should be after Reduced. > - Backpropagat

Re: Neural Network in hadoop

2015-02-12 Thread Ted Dunning
That is a really old paper that basically pre-dates all of the recent important work in neural networks. You should look for works on Rectified Linear Units (ReLU), drop-out regularization, parameter servers (downpour sgd) and deep learning. Map-reduce as you have used it will not produce interes

Re: Neural Network in hadoop

2015-02-12 Thread Alpha Bagus Sunggono
In my opinion, - This is just for 1 iteration. Then, batch gradient means find all delta, then updates all weight. So , I think its improperly if each have weight updated. Weight updated should be after Reduced. - Backpropagation can be found after Reduced. - This iteration should be repeat and rep

Neural Network in hadoop

2015-02-12 Thread unmesha sreeveni
I am trying to implement Neural Network in MapReduce. Apache mahout is reffering this paper Neural Network (NN) We focus on backpropagation By defining a network structure (we use a three layer network with two output neu