manupa-arm opened a new pull request #10785: URL: https://github.com/apache/tvm/pull/10785
This commit adds support for placing I/O tensors within the workspace buffer. This is enabled using PassConfig option tir.usmp.use_workspace_io. Once it is enabled, it will remove the I/O tensors from the TIR main PrimFunc and replace them with Allocate nodes that is annotated to contain Input and Output tensors. The USMP will plan memory for them accordingly. (i.e. it will re-use space used by them for intermediaries depending on the liveness). This will only be supported with C Interface API. Thus, this commit produces two functions to the metadata sources to obtain input and output structs that points to location inside the workspace struct. Change-Id: I4c7e750ead9a880ba900602c17f53a125f97dbf9 Thanks for contributing to TVM! Please refer to guideline https://tvm.apache.org/docs/contribute/ for useful information and tips. After the pull request is submitted, please request code reviews from [Reviewers](https://github.com/apache/incubator-tvm/blob/master/CONTRIBUTORS.md#reviewers) by @ them in the pull request thread. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
