[ 
https://issues.apache.org/jira/browse/HAMA-681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13651974#comment-13651974
 ] 

Yu Lee commented on HAMA-681:
-----------------------------

Edward,

Great to hear from you!

I have just created my wiki account (name: "Yu Lee"). Could you please go ahead 
to add me to ContributorsGroup?

Yexi and I would be happy to contribute to Hama with the implementation of this 
issue.

BTW, the ml directory is empty as Yexi pointed out. Thanks for forwarding this 
to Apache Infra team!

Best,
                
> Multi Layer Perceptron 
> -----------------------
>
>                 Key: HAMA-681
>                 URL: https://issues.apache.org/jira/browse/HAMA-681
>             Project: Hama
>          Issue Type: New Feature
>          Components: machine learning
>            Reporter: Christian Herta
>
> Implementation of a Multilayer Perceptron (Neural Network)
>  - Learning by Backpropagation 
>  - Distributed Learning
> The implementation should be the basis for the long range goals:
>  - more efficent learning (Adagrad, L-BFGS)
>  - High efficient distributed Learning
>  - Autoencoder - Sparse (denoising) Autoencoder
>  - Deep Learning
>  
> ---
> Due to the overhead of Map-Reduce(MR) MR didn't seem to be the best strategy 
> to distribute the learning of MLPs.
> Therefore the current implementation of the MLP (see MAHOUT-976) should be 
> migrated to Hama. First all dependencies to Mahout (Matrix-Library) must be 
> removed to get a standalone MLP Implementation. Then the Hama BSP programming 
> model should be used to realize distributed learning.
> Different strategies of efficient synchronized weight updates has to be 
> evaluated.
> Resources:
>  Videos:
>     - http://www.youtube.com/watch?v=ZmNOAtZIgIk
>     - http://techtalks.tv/talks/57639/
>  MLP and Deep Learning Tutorial:
>  - http://www.stanford.edu/class/cs294a/
>  Scientific Papers:
>  - Google's "Brain" project: 
> http://research.google.com/archive/large_deep_networks_nips2012.html
>  - Neural Networks and BSP: http://ipdps.cc.gatech.edu/1998/biosp3/bispp4.pdf
>  - http://jmlr.csail.mit.edu/papers/volume11/vincent10a/vincent10a.pdf

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to