[ 
https://issues.apache.org/jira/browse/SINGA-123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

wangwei closed SINGA-123.
-------------------------
    Resolution: Fixed
      Assignee: Wang Ji

> Add RMSProp method for Updater
> ------------------------------
>
>                 Key: SINGA-123
>                 URL: https://issues.apache.org/jira/browse/SINGA-123
>             Project: Singa
>          Issue Type: New Feature
>            Reporter: Wang Ji
>            Assignee: Wang Ji
>            Priority: Minor
>
> RMSProp 
> [tieleman2012rmsprop](http://www.cs.toronto.edu/~tijmen/csc321/slides/lecture_slides_lec6.pdf)
>  is an optimizer that utilizes the magnitude of recent gradients to normalize 
> the gradients.
> This ticket adds some codes in updater.cc to implement this optimizing method.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to