jpf888 commented on issue #17176:
URL: https://github.com/apache/tvm/issues/17176#issuecomment-2260732685
@Lunderberg @Cookiee235
hi, When I try to use cudnn dispatch, I encounter the same problem as you
during runtime. After replacing with the code changes you submitted, I still
have the same problem. Could you please give me some suggestions?
1、Actual behavior：
`vm::runtime::Optional<tvm::runtime::Session> const&,
bool&>(tvm::runtime::String&, tvm::runtime::String&,
picojson::object_with_ordered_keys const&, DLDevice&,
tvm::runtime::Optional<tvm::runtime::Session> const&, bool&) at
mlc-llm/3rdparty/tvm/include/tvm/runtime/memory.h:196 5:
tvm::runtime::ObjectPtr<mlc::llm::serve::ModelImpl>
tvm::runtime::ObjAllocatorBase<tvm::runtime::SimpleObjAllocator>::make_object<mlc::llm::serve::ModelImpl,
tvm::runtime::String&, tvm::runtime::String&,
picojson::object_with_ordered_keys const&, DLDevice&,
tvm::runtime::Optional<tvm::runtime::Session> const&,
bool&>(tvm::runtime::String&, tvm::runtime::String&,
picojson::object_with_ordered_keys const&, DLDevice&,
tvm::runtime::Optional<tvm::runtime::Session> const&, bool&) at
mlc-llm/3rdparty/tvm/include/tvm/runtime/memory.h:72 4:
mlc::llm::serve::ModelImpl*
tvm::runtime::SimpleObjAllocator::Handler<mlc::llm::serve::ModelImpl>::New<tvm::runtime::String&,
tvm::runtime::String&, picojson::object_with_ord
ered_keys const&, DLDevice&, tvm::runtime::Optional<tvm::runtime::Session>
const&, bool&>(tvm::runtime::SimpleObjAllocator*, tvm::runtime::String&,
tvm::runtime::String&, picojson::object_with_ordered_keys const&, DLDevice&,
tvm::runtime::Optional<tvm::runtime::Session> const&, bool&) at
mlc-llm/3rdparty/tvm/include/tvm/runtime/memory.h:122 3:
mlc::llm::serve::ModelImpl::ModelImpl(tvm::runtime::String,
tvm::runtime::String, picojson::object_with_ordered_keys, DLDevice,
tvm::runtime::Optional<tvm::runtime::Session> const&, bool) at
/mlc-llm/cpp/serve/model.cc:66 2:
mlc::llm::serve::FunctionTable::Init(tvm::runtime::String, DLDevice,
picojson::object_with_ordered_keys,
tvm::runtime::Optional<tvm::runtime::Session>) at
/mlc-llm/cpp/serve/function_table.cc:133 1:
tvm::runtime::relax_vm::VirtualMachineImpl::_Init(tvm::runtime::TVMArgs,
tvm::runtime::TVMRetValue*) 0:
tvm::runtime::relax_vm::VirtualMachineImpl::InitFuncPool() File
"/mlc-llm/3rdparty/tvm/src/runtime/relax_vm/vm.cc", line 70
7 InternalError:`
**Check failed: (func.defined()) is false: Error: Cannot find PackedFunc
fused_relax_nn_conv2d_cudnn in either Relax VM kernel library, or in TVM
runtime PackedFunc registry, or in global Relax functions of the VM executable**
2、But when I run the test case of TVM's cudnn conv2d separately, it works
normally, and I can find 'fused_relax_nn_conv2d_cudnn'.
3、I printed out the mod before and after the cudnn conv2d patten processing,
and the names are all the same, such as fused_relax_nn_conv2d_cudnn."
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@tvm.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
