I've posted an issue here: https://github.com/dmlc/mxnet/issues/6721
As soon as I get access to the original graphic I can make the change.
On Thu, Jun 15, 2017 at 9:09 AM, Ly Nguyen <nguyen...@gmail.com> wrote:
> Hi Sebastian. Thank you for spotting this. We will be looking into this
> and send an update later today.
>
> Ly
>
> On Thu, Jun 15, 2017 at 12:41 AM, Sebastian Schelter <s...@apache.org>
> wrote:
>
>> Hi,
>>
>> I think I found an typo in the documentation under
>> http://mxnet.io/architecture/note_engine.html, in the pseudo code for the
>> multiple GPU network:
>>
>> # aggregate gradient and update
>> fc1_wgrad[cpu] = fc1_wgrad[gpu0] + fc1_wgrad[gpu1]
>> fc2_wgrad[cpu] = fc2_wgrad[gpu0] + fc2_wgrad[gpu1]
>> fc1_weight[cpu] -= lr * fc1_wgrad[gpu0]
>> fc2_weight[cpu] -= lr * fc2_wgrad[gpu0]
>>
>> I think the last two lines should refer to the weights on the 'cpu'
>> instead
>> of weights on 'gpu0', and these wrong lines have also been copied to the
>> picture below the code.
>>
>> Best,
>> Sebastian
>>
>
>
