Hopefully the original graphics can be committed. On Fri, Jun 16, 2017 at 11:24 AM, Ly Nguyen <nguyen...@gmail.com> wrote:
> I've posted an issue here: https://github.com/dmlc/mxnet/issues/6721 > > As soon as I get access to the original graphic I can make the change. > > On Thu, Jun 15, 2017 at 9:09 AM, Ly Nguyen <nguyen...@gmail.com> wrote: > > > Hi Sebastian. Thank you for spotting this. We will be looking into this > > and send an update later today. > > > > Ly > > > > On Thu, Jun 15, 2017 at 12:41 AM, Sebastian Schelter <s...@apache.org> > > wrote: > > > >> Hi, > >> > >> I think I found an typo in the documentation under > >> http://mxnet.io/architecture/note_engine.html, in the pseudo code for > the > >> multiple GPU network: > >> > >> # aggregate gradient and update > >> fc1_wgrad[cpu] = fc1_wgrad[gpu0] + fc1_wgrad[gpu1] > >> fc2_wgrad[cpu] = fc2_wgrad[gpu0] + fc2_wgrad[gpu1] > >> fc1_weight[cpu] -= lr * fc1_wgrad[gpu0] > >> fc2_weight[cpu] -= lr * fc2_wgrad[gpu0] > >> > >> I think the last two lines should refer to the weights on the 'cpu' > >> instead > >> of weights on 'gpu0', and these wrong lines have also been copied to the > >> picture below the code. > >> > >> Best, > >> Sebastian > >> > > > > >
