[
https://issues.apache.org/jira/browse/SINGA-387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16582207#comment-16582207
]
ASF subversion and git services commented on SINGA-387:
-------------------------------------------------------
Commit 2fea345cf13df1e3a2511c5bb80732647abc4b45 in incubator-singa's branch
refs/heads/master from xuewanqi
[ https://git-wip-us.apache.org/repos/asf?p=incubator-singa.git;h=2fea345 ]
SINGA-387 Modified the design of autograd backward engine and correct some
mistakes in it
another solution:
- let Dummy involved in dependency counting system
- modified former backward function
> Modified the design of autograd backward engine and correct some mistakes in
> it
> -------------------------------------------------------------------------------
>
> Key: SINGA-387
> URL: https://issues.apache.org/jira/browse/SINGA-387
> Project: Singa
> Issue Type: Improvement
> Reporter: Xue Wanqi
> Priority: Major
>
> Old design of autograd engine will return intermediate gradients. We should
> avoid the happen of that. For the parameters(tensors) need to store
> gradients, they or their creator should know whether the gradients are
> calculated readily. and only when gradients are prepared then they can be
> output.
> Old design of autograd engine will store some unused gradient in dictionary
> not_ready. this should be avoid as well in the new design.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
