[GitHub] [tvm] masahi edited a comment on pull request #9261: [BYOC] CUTLASS integration

2021-10-21 Thread GitBox
masahi edited a comment on pull request #9261: URL: https://github.com/apache/tvm/pull/9261#issuecomment-948543423 This is ready for review. The bulk of PR is a kernel generator taken from cutlass, simplified for our purpose + more epilogue support. The followings are supported: *

[GitHub] [tvm] masahi edited a comment on pull request #9261: [BYOC] CUTLASS integration

2021-10-13 Thread GitBox
masahi edited a comment on pull request #9261: URL: https://github.com/apache/tvm/pull/9261#issuecomment-942895664 I think it is reasonable to ask users for an estimate of a range of dynamism. Without such estimate, or if the estimate turns out to be off, we just fallback to a default kern

[GitHub] [tvm] masahi edited a comment on pull request #9261: [BYOC] CUTLASS integration

2021-10-13 Thread GitBox
masahi edited a comment on pull request #9261: URL: https://github.com/apache/tvm/pull/9261#issuecomment-942895664 I think it is reasonable to ask users for an estimate of a range of dynamism. Without such estimate, or if the estimate turns out to be off, we just fallback to a default kern

[GitHub] [tvm] masahi edited a comment on pull request #9261: [BYOC] CUTLASS integration

2021-10-13 Thread GitBox
masahi edited a comment on pull request #9261: URL: https://github.com/apache/tvm/pull/9261#issuecomment-941990346 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

[GitHub] [tvm] masahi edited a comment on pull request #9261: [BYOC] CUTLASS integration

2021-10-13 Thread GitBox
masahi edited a comment on pull request #9261: URL: https://github.com/apache/tvm/pull/9261#issuecomment-942254874 > I think even C source code should be able to handle dynamic shapes as well since it only expects tensors at the runtime Exactly, I've looked at the code a bit and it s

[GitHub] [tvm] masahi edited a comment on pull request #9261: [BYOC] CUTLASS integration

2021-10-13 Thread GitBox
masahi edited a comment on pull request #9261: URL: https://github.com/apache/tvm/pull/9261#issuecomment-941990346 One question for @comaniac: Currently, this integration is implemented with C source backend. But one big use case for cutlass BYOC is for dynamic workloads, for which we cann

[GitHub] [tvm] masahi edited a comment on pull request #9261: [BYOC] CUTLASS integration

2021-10-13 Thread GitBox
masahi edited a comment on pull request #9261: URL: https://github.com/apache/tvm/pull/9261#issuecomment-941990346 One question for @comaniac: Currently, this integration is implemented with C source backend. But one big use case for cutlass BYOC is for dynamic workloads, for which we cann