masahi commented on code in PR #15028:
URL: https://github.com/apache/tvm/pull/15028#discussion_r1220479717
##########
python/tvm/relax/backend/contrib/cutlass.py:
##########
@@ -412,6 +412,10 @@ def visit_function_(self, f):
out_size_1d = _shape_1d(f.ret_struct_info.shape)
# This needs to be in sync with the actual value that the kernel
expects.
workspace_size_bytes = out_size_1d * {"float16": 2, "float32":
4}[out_dtype]
+ if not isinstance(workspace_size_bytes, (int,
tvm.tir.expr.IntImm)):
+ # Tempororay workaround for dynamic shape workload. Will be
removed when
+ # workspace for dynamic shape workload is implemented.
+ workspace_size_bytes = 8
Review Comment:
> workspace_size_bytes = 8
It is just for a temp workaround, it will case `cudaMalloc` to be always
called.
##########
python/tvm/relax/backend/contrib/cutlass.py:
##########
@@ -412,6 +412,10 @@ def visit_function_(self, f):
out_size_1d = _shape_1d(f.ret_struct_info.shape)
# This needs to be in sync with the actual value that the kernel
expects.
workspace_size_bytes = out_size_1d * {"float16": 2, "float32":
4}[out_dtype]
+ if not isinstance(workspace_size_bytes, (int,
tvm.tir.expr.IntImm)):
+ # Tempororay workaround for dynamic shape workload. Will be
removed when
+ # workspace for dynamic shape workload is implemented.
+ workspace_size_bytes = 8
Review Comment:
> workspace_size_bytes = 8
It is just for a temp workaround, it will cause `cudaMalloc` to be always
called.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
