[GitHub] [incubator-tvm] sergei-grechanik commented on issue #1996: [RFC][WIP] Tensor Expression level automatic differentiation

sergei-grechanik commented on issue #1996: [RFC][WIP] Tensor Expression level automatic differentiation URL: https://github.com/apache/incubator-tvm/issues/1996#issuecomment-596172921 @MarisaKirisame What do you think about adding a scatter-like reduction to TVM's tensor expressions? (I me

[GitHub] [incubator-tvm] sergei-grechanik commented on issue #1996: [RFC][WIP] Tensor Expression level automatic differentiation

sergei-grechanik commented on issue #1996: [RFC][WIP] Tensor Expression level automatic differentiation URL: https://github.com/apache/incubator-tvm/issues/1996#issuecomment-596043488 @MarisaKirisame Yes, I think you are right. I guess implementing this approach requires extending tensor e

[GitHub] [incubator-tvm] sergei-grechanik commented on issue #1996: [RFC][WIP] Tensor Expression level automatic differentiation

sergei-grechanik commented on issue #1996: [RFC][WIP] Tensor Expression level automatic differentiation URL: https://github.com/apache/incubator-tvm/issues/1996#issuecomment-595981655 @MarisaKirisame One approach that I know of is to differentiate by literally reversing the computation, re