[I] [Bug] [Relay] [ONNX] Incorrect shape inference of `Squeeze` in `DynamicToStatic` [tvm]

2024-05-30 Thread via GitHub
shaoyuyoung opened a new issue, #17050: URL: https://github.com/apache/tvm/issues/17050 Description This torch model has only two ops: `ReflectionPad3d` and `squeeze` Firstly, I try to export the ``torch model`` to ``onnx model``. Then I get the below. ![model

(tvm) branch nightly updated (71f7af7985 -> 1eac17857f)

2024-05-30 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch nightly in repository https://gitbox.apache.org/repos/asf/tvm.git from 71f7af7985 [Runtime] Use preferred host memory (pinned memory) in KV cache (#17036) add 291c04770a [TIR] Fix

Re: [PR] [WebGPU] Support `dot4I8Packed(int8x4, int8x4)` as a pure extern method [tvm]

2024-05-30 Thread via GitHub
Jiawei-Shao commented on code in PR #16976: URL: https://github.com/apache/tvm/pull/16976#discussion_r1621718939 ## src/target/source/intrin_rule_webgpu.cc: ## @@ -113,6 +113,8 @@ TVM_REGISTER_OP("tir.trunc") // extra dispatch

Re: [PR] [RFC] Add NNEF frontend [tvm-rfcs]

2024-05-30 Thread via GitHub
tqchen merged PR #108: URL: https://github.com/apache/tvm-rfcs/pull/108 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(tvm-rfcs) branch main updated: [RFC] Add NNEF frontend (#108)

2024-05-30 Thread tqchen
This is an automated email from the ASF dual-hosted git repository. tqchen pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm-rfcs.git The following commit(s) were added to refs/heads/main by this push: new f0f982f [RFC] Add NNEF frontend (#108) f0f982f

Re: [PR] [Codegen, CUDA] Enable emitting SyncWarp [tvm]

2024-05-30 Thread via GitHub
github-actions[bot] commented on PR #16918: URL: https://github.com/apache/tvm/pull/16918#issuecomment-2141040292 Failed to re-run CI in https://github.com/apache/tvm/actions/runs/9310962176 ``` Traceback (most recent call last): File

Re: [PR] [Codegen, CUDA] Enable emitting SyncWarp [tvm]

2024-05-30 Thread via GitHub
tqchen commented on PR #16918: URL: https://github.com/apache/tvm/pull/16918#issuecomment-2141039924 @tvm-bot rerun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [CUBLAS][FP8] Enable fusing astype operation for matmul multiply pattern [tvm]

2024-05-30 Thread via GitHub
vinx13 commented on PR #17006: URL: https://github.com/apache/tvm/pull/17006#issuecomment-2140985551 do we need to update cublas codegen or runtime to support the cast? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] [DOC] Update Model Links to Include Commit [tvm]

2024-05-30 Thread via GitHub
lhutton1 commented on PR #17015: URL: https://github.com/apache/tvm/pull/17015#issuecomment-2140825657 I've just completed the manual step for [mobilenetv2-7.onnx](https://github.com/apache/tvm/actions/runs/9308682386). It seems resnet-v2-7.onnx from the same commit hash has already been

Re: [PR] [Arith][SVE] Add rewrite rules for indices split by scalable expressions [tvm]

2024-05-30 Thread via GitHub
lhutton1 commented on PR #17046: URL: https://github.com/apache/tvm/pull/17046#issuecomment-2140783866 cc @Lunderberg -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

(tvm) branch main updated: [Runtime] Fix PagedKVCache for PopN and enhance tests (#17045)

2024-05-30 Thread tqchen
This is an automated email from the ASF dual-hosted git repository. tqchen pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/main by this push: new 1eac17857f [Runtime] Fix PagedKVCache for PopN and

Re: [PR] [Runtime] Fix PagedKVCache for PopN and enhance tests [tvm]

2024-05-30 Thread via GitHub
tqchen merged PR #17045: URL: https://github.com/apache/tvm/pull/17045 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [WebGPU] Support `dot4I8Packed(int8x4, int8x4)` as a pure extern method [tvm]

2024-05-30 Thread via GitHub
tqchen commented on code in PR #16976: URL: https://github.com/apache/tvm/pull/16976#discussion_r1621072494 ## src/target/source/intrin_rule_webgpu.cc: ## @@ -113,6 +113,8 @@ TVM_REGISTER_OP("tir.trunc") // extra dispatch

(tvm) branch main updated: [Runtime] Compatibility with dmlc::Stream API changes (#16998)

2024-05-30 Thread tqchen
This is an automated email from the ASF dual-hosted git repository. tqchen pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/main by this push: new 820f1b617a [Runtime] Compatibility with dmlc::Stream

Re: [PR] [Runtime] Compatibility with dmlc::Stream API changes [tvm]

2024-05-30 Thread via GitHub
tqchen merged PR #16998: URL: https://github.com/apache/tvm/pull/16998 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [Arith][SVE] Add rewrite rules for indices split by scalable expressions [tvm]

2024-05-30 Thread via GitHub
ekalda commented on code in PR #17046: URL: https://github.com/apache/tvm/pull/17046#discussion_r1621054729 ## src/arith/rewrite_simplify.cc: ## @@ -1136,8 +1136,15 @@ PrimExpr RewriteSimplifier::Impl::VisitExpr_(const FloorDivNode* op) { x +

Re: [PR] [autoTVM] Update link for onnx resnet in documentation [tvm]

2024-05-30 Thread via GitHub
lhutton1 commented on PR #17015: URL: https://github.com/apache/tvm/pull/17015#issuecomment-2140165408 No problem, I think we can just rewrite them with the updated paths (both the key and value of the URL_MAP) -- This is an automated message from the Apache Git Service. To respond to

Re: [PR] [Arith][SVE] Add rewrite rules for indices split by scalable expressions [tvm]

2024-05-30 Thread via GitHub
ekalda commented on code in PR #17046: URL: https://github.com/apache/tvm/pull/17046#discussion_r1621053987 ## src/arith/rewrite_simplify.cc: ## @@ -1136,8 +1136,15 @@ PrimExpr RewriteSimplifier::Impl::VisitExpr_(const FloorDivNode* op) { x +

Re: [PR] [autoTVM] Update link for onnx resnet in documentation [tvm]

2024-05-30 Thread via GitHub
jhong92-pro commented on PR #17015: URL: https://github.com/apache/tvm/pull/17015#issuecomment-2140151992 @lhutton1 Thank you! Additionally, the original links will no longer be used. Please let me know if I can delete or comment them out.

Re: [PR] [autoTVM] Update link for onnx resnet in documentation [tvm]

2024-05-30 Thread via GitHub
lhutton1 commented on PR #17015: URL: https://github.com/apache/tvm/pull/17015#issuecomment-2140141704 Thanks for the update, quick reminder that we'd still need to add these new links to

[PR] [SME][TOPI] Add conv2d NHWC SME fp16->fp32 schedule [tvm]

2024-05-30 Thread via GitHub
Anndrey24 opened a new pull request, #17048: URL: https://github.com/apache/tvm/pull/17048 This commit extends the SME conv2d NHWC schedule to support convolutions with float16 inputs (data and kernel) and a float32 output using the tensor intrinsics added in #16981. cc @ekalda

Re: [PR] [autoTVM] Update link for onnx resnet in documentation [tvm]

2024-05-30 Thread via GitHub
lhutton1 commented on PR #17015: URL: https://github.com/apache/tvm/pull/17015#issuecomment-2139995443 Happy to do whichever works best for you :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [autoTVM] Update link for onnx resnet in documentation [tvm]

2024-05-30 Thread via GitHub
jhong92-pro commented on PR #17015: URL: https://github.com/apache/tvm/pull/17015#issuecomment-2139970797 @lhutton1 Thank you for your answer. I will update the links for resnet.onnx and mobilenet.onnx to include the commit hash. I will force push updates to the patch-1 branch to

Re: [PR] [Arith][SVE] Add rewrite rules for indices split by scalable expressions [tvm]

2024-05-30 Thread via GitHub
Anndrey24 commented on code in PR #17046: URL: https://github.com/apache/tvm/pull/17046#discussion_r1620884856 ## src/arith/rewrite_simplify.cc: ## @@ -1136,8 +1136,15 @@ PrimExpr RewriteSimplifier::Impl::VisitExpr_(const FloorDivNode* op) { x +

[I] [Bug] Generate executable file issue [tvm]

2024-05-30 Thread via GitHub
2448900355 opened a new issue, #17047: URL: https://github.com/apache/tvm/issues/17047 I would like to ask what configuration causes the generated file types to be different? ![捕获](https://github.com/apache/tvm/assets/122245479/a66ee8e1-30be-4449-b66d-6157345c4d8c) --

Re: [PR] [Arith][SVE] Add rewrite rules for indices split by scalable expressions [tvm]

2024-05-30 Thread via GitHub
Anndrey24 commented on code in PR #17046: URL: https://github.com/apache/tvm/pull/17046#discussion_r1620763529 ## src/arith/rewrite_simplify.cc: ## @@ -1136,8 +1136,15 @@ PrimExpr RewriteSimplifier::Impl::VisitExpr_(const FloorDivNode* op) { x +

Re: [PR] [Arith][SVE] Add rewrite rules for indices split by scalable expressions [tvm]

2024-05-30 Thread via GitHub
ekalda commented on code in PR #17046: URL: https://github.com/apache/tvm/pull/17046#discussion_r1620642225 ## src/arith/rewrite_simplify.cc: ## @@ -1136,8 +1136,15 @@ PrimExpr RewriteSimplifier::Impl::VisitExpr_(const FloorDivNode* op) { x +

(tvm) branch main updated: [Disco][QoL] Implement broadcast/scatter methods for Session (#17035)

2024-05-30 Thread tqchen
This is an automated email from the ASF dual-hosted git repository. tqchen pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/main by this push: new 7c2c0d9337 [Disco][QoL] Implement broadcast/scatter

Re: [PR] [Disco][QoL] Implement broadcast/scatter methods for Session [tvm]

2024-05-30 Thread via GitHub
tqchen merged PR #17035: URL: https://github.com/apache/tvm/pull/17035 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(tvm) branch main updated: [Bugfix][Support] Fix copy constructor for support::OrderedSet (#17044)

2024-05-30 Thread tqchen
This is an automated email from the ASF dual-hosted git repository. tqchen pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/main by this push: new f6aab98ace [Bugfix][Support] Fix copy constructor for

Re: [PR] [Bugfix][Support] Fix copy constructor for support::OrderedSet [tvm]

2024-05-30 Thread via GitHub
tqchen merged PR #17044: URL: https://github.com/apache/tvm/pull/17044 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(tvm) branch main updated: [Runtime][ROCm] Enable ROCm host memory support (#17037)

2024-05-30 Thread tqchen
This is an automated email from the ASF dual-hosted git repository. tqchen pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/main by this push: new 08b32a7976 [Runtime][ROCm] Enable ROCm host memory

Re: [PR] [Runtime][ROCm] Enable ROCm host memory support [tvm]

2024-05-30 Thread via GitHub
tqchen merged PR #17037: URL: https://github.com/apache/tvm/pull/17037 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] [Arith][SVE] Add rewrite rules for indices split by scalable expressions [tvm]

2024-05-30 Thread via GitHub
Anndrey24 opened a new pull request, #17046: URL: https://github.com/apache/tvm/pull/17046 This commit introduces rewrite rules for indices which can arise from splitting axes by scalable factors (e.g. `xo, xi = sch.split(x, factors = [None, 8 * T.vscale()])`): ``` (v_x_o *

Re: [PR] [autoTVM] Update link for onnx resnet in documentation [tvm]

2024-05-30 Thread via GitHub
lhutton1 commented on PR #17015: URL: https://github.com/apache/tvm/pull/17015#issuecomment-2139136824 > I reviewed the links in `request_hook.py` and found that other links include the commit hash in the URL to ensure they remain unchanged. I think it would be beneficial to update the

Re: [PR] [autoTVM] Update link for onnx resnet in documentation [tvm]

2024-05-30 Thread via GitHub
lhutton1 commented on PR #17015: URL: https://github.com/apache/tvm/pull/17015#issuecomment-2139129118 @tvm-bot rerun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [TIR] Fix Bug in VectorizeLoop [tvm]

2024-05-30 Thread via GitHub
ekalda commented on PR #17039: URL: https://github.com/apache/tvm/pull/17039#issuecomment-2138921470 Thanks @tqchen and @CharlieFRuan for the fix! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

(tvm) branch main updated: [TIR] Fix Bug in VectorizeLoop (#17039)

2024-05-30 Thread ekalda
This is an automated email from the ASF dual-hosted git repository. ekalda pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/main by this push: new 291c04770a [TIR] Fix Bug in VectorizeLoop (#17039)

Re: [PR] [TIR] Fix Bug in VectorizeLoop [tvm]

2024-05-30 Thread via GitHub
ekalda merged PR #17039: URL: https://github.com/apache/tvm/pull/17039 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: