Hello All,

We are trying to implement an adaptive learning rate for an item embedding 
model, so newer items get assigned a larger learning rate and vice versa. I 
wonder if there is a way to do so? I'm aware of the set_lr_mult method but that 
can only give different learning rates to different layers, not different rows 
within the same layer.
Any help is appreciated!





---
[Visit 
Topic](https://discuss.mxnet.io/t/is-there-a-way-to-set-variable-lr-for-each-row-of-an-embedding-matrix/6470/1)
 or reply to this email to respond.

You are receiving this because you enabled mailing list mode.

To unsubscribe from these emails, [click 
here](https://discuss.mxnet.io/email/unsubscribe/2ddacf448274b15c6bc340f87b1431ec37a0eaea6fd0fc520882de0ad3bf4891).

Reply via email to