[tvm] branch main updated: [Target][CI] Add LLVM functions for current system info (#15903)

2023-10-11 Thread masahi
This is an automated email from the ASF dual-hosted git repository. masahi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/main by this push: new ab1aef962a [Target][CI] Add LLVM functions for current

Re: [PR] [Target][CI] Add LLVM functions for current system info [tvm]

2023-10-11 Thread via GitHub
masahi merged PR #15903: URL: https://github.com/apache/tvm/pull/15903 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@tvm.apache.or

[tvm] branch main updated: [TIR] Fix offset_factor in cuda tensor core intrins (#15913)

2023-10-11 Thread masahi
This is an automated email from the ASF dual-hosted git repository. masahi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/main by this push: new 486513ae16 [TIR] Fix offset_factor in cuda tensor core

Re: [PR] [TIR] Fix offset_factor in cuda tensor core intrins [tvm]

2023-10-11 Thread via GitHub
masahi merged PR #15913: URL: https://github.com/apache/tvm/pull/15913 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@tvm.apache.or

[tvm] branch nightly updated (eb2a4bc8e2 -> 13b487fa2d)

2023-10-11 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch nightly in repository https://gitbox.apache.org/repos/asf/tvm.git from eb2a4bc8e2 [TFLite][Frontend] Fix test failures caused by div-by-zero (#15844) add 4e9866fef2 [TIR] Fix the er

Re: [PR] [release] Update version to 0.14.0 and 0.15.0.dev on main branch [tvm]

2023-10-11 Thread via GitHub
ysh329 commented on PR #15847: URL: https://github.com/apache/tvm/pull/15847#issuecomment-1758800449 Hi all, I found only one commit left: ```shell commit 13b487fa2d3c06a12cd9d76ec2e5a392b5eeb778 (HEAD -> main, origin/main, origin/HEAD) Author: Tlopex <68688494+tlo...@users.nore

Re: [PR] [Unity] Paged KV Cache as LM Support [tvm]

2023-10-11 Thread via GitHub
MasterJH5574 commented on PR #15910: URL: https://github.com/apache/tvm/pull/15910#issuecomment-1758733578 Documented the paged KV cache and updated some of the interfaces. It's ready for review now. -- This is an automated message from the Apache Git Service. To respond to the message, p

[PR] [TOPI][TIR][TE][x86] Extend x86 SIMD (u)int8 coverage for dense & conv2d [tvm]

2023-10-11 Thread via GitHub
cbalint13 opened a new pull request, #15918: URL: https://github.com/apache/tvm/pull/15918 This PR enhance x86 SIMD (u)int8 coverage for dense and conv2d operators. It extends current SIMD support with avx2 & ssse3, and adds a new set of non-overflowing SIMD methods. --- ###

Re: [PR] [VM] modify the date pointer of tensor to point to the buffer [tvm]

2023-10-11 Thread via GitHub
yongwww commented on PR #15912: URL: https://github.com/apache/tvm/pull/15912#issuecomment-1758548237 Thanks for the review! I am going to close this pr due to the concern. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] [VM] modify the date pointer of tensor to point to the buffer [tvm]

2023-10-11 Thread via GitHub
yongwww closed pull request #15912: [VM] modify the date pointer of tensor to point to the buffer URL: https://github.com/apache/tvm/pull/15912 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[PR] support torch.arange()+ (int) in dynamo [tvm]

2023-10-11 Thread via GitHub
guoyaol opened a new pull request, #15917: URL: https://github.com/apache/tvm/pull/15917 In Stable Diffusion XL, there are some structures, like `a = torch.arange(b) +1` by output the emmited relax.Var, we can support them -- This is an automated message from the Apache Git Se

Re: [PR] [Unity][Schedule] Prototype of peeling tail iterations [tvm]

2023-10-11 Thread via GitHub
kparzysz-quic commented on code in PR #15901: URL: https://github.com/apache/tvm/pull/15901#discussion_r1355671093 ## src/tir/schedule/primitive/loop_transformation.cc: ## @@ -454,6 +454,56 @@ Array Split(ScheduleState self, const StmtSRef& loop_sref, const Array return resu

[PR] [Unity][Transform] Handle relax.Var as call_tir args when lowering [tvm]

2023-10-11 Thread via GitHub
Lunderberg opened a new pull request, #15916: URL: https://github.com/apache/tvm/pull/15916 Prior to this commit, several transforms assumed that the arguments passed to a `call_tir` builtin were provided as in-line `relax::Tuple` objects. Because it would be equally valid for the argument

Re: [I] [Bug] StringImm Object Can't Be Pass to C++ Side from Python Side [tvm]

2023-10-11 Thread via GitHub
junrushao commented on issue #15716: URL: https://github.com/apache/tvm/issues/15716#issuecomment-1758184178 Yeah it doesn't do anything concrete to the object system... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[PR] [TFLite][Frontend] Support quantized Reverse sequence [tvm]

2023-10-11 Thread via GitHub
tlopex opened a new pull request, #15915: URL: https://github.com/apache/tvm/pull/15915 Support Reverse sequence quantization operation as part of #15148 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] [TFLite][Frontend] Support quantized ELU [tvm]

2023-10-11 Thread via GitHub
leandron merged PR #15821: URL: https://github.com/apache/tvm/pull/15821 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@tvm.apache.

[tvm] branch main updated: [TFLite][Frontend] Support quantized ELU (#15821)

2023-10-11 Thread leandron
This is an automated email from the ASF dual-hosted git repository. leandron pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/main by this push: new 13b487fa2d [TFLite][Frontend] Support quantized ELU (

Re: [PR] [Unity] Paged KV Cache as LM Support [tvm]

2023-10-11 Thread via GitHub
MasterJH5574 commented on PR #15910: URL: https://github.com/apache/tvm/pull/15910#issuecomment-1757929983 Mark as draft for an update of docstring and APIs. Sorry that it is not mature enough. -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [VM] modify the date pointer of tensor to point to the buffer [tvm]

2023-10-11 Thread via GitHub
tqchen commented on PR #15912: URL: https://github.com/apache/tvm/pull/15912#issuecomment-1757926404 Would be great to cross check kv to see if we can work with the offset parameter in DLTensor. The main reason is that the data ptr may not points to an addressable location (it is not an iss

Re: [PR] [RFC] Scalable vectors in TIR [tvm-rfcs]

2023-10-11 Thread via GitHub
tqchen commented on PR #104: URL: https://github.com/apache/tvm-rfcs/pull/104#issuecomment-1757910627 I think assuming a single vector width(vscale) and use `kScalableVectorMark=-1` to mark it would be a good tradeoff, given it may not be that useful to create vectors with multiple vector w

Re: [PR] [Unity][Relax] Support Dynamic Tensor as Index, torch frontend [tvm]

2023-10-11 Thread via GitHub
Hzfengsy merged PR #15884: URL: https://github.com/apache/tvm/pull/15884 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@tvm.apache.

[tvm] branch unity updated: [Unity] Fix wrong variable name in test_optimize_layout_transform (#15893)

2023-10-11 Thread syfeng
This is an automated email from the ASF dual-hosted git repository. syfeng pushed a commit to branch unity in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/unity by this push: new 95a89d2b13 [Unity] Fix wrong variable name in test_o

Re: [PR] [Unity] Fix wrong variable name in test_optimize_layout_transform [tvm]

2023-10-11 Thread via GitHub
Hzfengsy merged PR #15893: URL: https://github.com/apache/tvm/pull/15893 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@tvm.apache.

[tvm] branch unity updated: [Unity][Relax] Support Dynamic Tensor as Index, torch frontend (#15884)

2023-10-11 Thread syfeng
This is an automated email from the ASF dual-hosted git repository. syfeng pushed a commit to branch unity in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/unity by this push: new bde8a87381 [Unity][Relax] Support Dynamic Tensor as I

Re: [PR] [Unity][Relax] Support Dynamic Tensor as Index, torch frontend [tvm]

2023-10-11 Thread via GitHub
guoyaol commented on PR #15884: URL: https://github.com/apache/tvm/pull/15884#issuecomment-1757864541 @junrushao @MasterJH5574 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [I] [Bug] [Unity] TypeError encountered when converting ONNX model with MaxPool operator [tvm]

2023-10-11 Thread via GitHub
Thrsu closed issue #15895: [Bug] [Unity] TypeError encountered when converting ONNX model with MaxPool operator URL: https://github.com/apache/tvm/issues/15895 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] [RFC] Scalable vectors in TIR [tvm-rfcs]

2023-10-11 Thread via GitHub
ekalda commented on PR #104: URL: https://github.com/apache/tvm-rfcs/pull/104#issuecomment-1757833764 Regarding to changing the `DLDataType`, I can see how it could have a wide disruptive impact. Scalable vectors are here to stay though, so could be a way to future proof `DLPack` standard?

Re: [PR] [RFC] Scalable vectors in TIR [tvm-rfcs]

2023-10-11 Thread via GitHub
ekalda commented on PR #104: URL: https://github.com/apache/tvm-rfcs/pull/104#issuecomment-1757817798 > I guess we could pass an argument to the vectorizer whether to generate SVE-friendly code. If this is limited to emitting additional TIR builtins, then I'm ok with that. I just want to be

Re: [PR] [Unity] Paged KV Cache as LM Support [tvm]

2023-10-11 Thread via GitHub
tqchen commented on code in PR #15910: URL: https://github.com/apache/tvm/pull/15910#discussion_r1355092130 ## src/runtime/relax_vm/lm_support.cc: ## @@ -472,6 +472,430 @@ void ApplySoftmaxWithTemperature(NDArray logits, double temperature) { TVM_REGISTER_GLOBAL("vm.builtin.ap

Re: [PR] [Unity] Replace relax_vm/memory_manager with memory/memory_manager [tvm]

2023-10-11 Thread via GitHub
yongwww commented on PR #15882: URL: https://github.com/apache/tvm/pull/15882#issuecomment-1757764486 cc: @tqchen @srkreddy1238 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] [Do Not Merge][Unity] Replace relax_vm/memory_manager with memory/memory_manager [tvm]

2023-10-11 Thread via GitHub
yongwww commented on code in PR #15882: URL: https://github.com/apache/tvm/pull/15882#discussion_r1355061713 ## src/runtime/memory/memory_manager.cc: ## @@ -101,6 +100,11 @@ NDArray StorageObj::AllocNDArray(size_t offset, ShapeTuple shape, DLDataType dty // buffer intact.

Re: [PR] [VM] modify the date pointer of tensor to point to the buffer [tvm]

2023-10-11 Thread via GitHub
yongwww commented on PR #15912: URL: https://github.com/apache/tvm/pull/15912#issuecomment-1757760365 cc @tqchen @srkreddy1238 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[tvm] branch main updated (4e9866fef2 -> 9f562b0c72)

2023-10-11 Thread tqchen
This is an automated email from the ASF dual-hosted git repository. tqchen pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/tvm.git from 4e9866fef2 [TIR] Fix the error example in the documentation for pad_einsum (#15906) add 9f562b0c72 [release] Update v

Re: [PR] [release] Update version to 0.14.0 and 0.15.0.dev on main branch [tvm]

2023-10-11 Thread via GitHub
tqchen merged PR #15847: URL: https://github.com/apache/tvm/pull/15847 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@tvm.apache.or

[PR] [TFLite][Frontend] Support quantized SQUARE [tvm]

2023-10-11 Thread via GitHub
tlopex opened a new pull request, #15914: URL: https://github.com/apache/tvm/pull/15914 Support SQUARE quantization operation as part of #15148 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [I] [Bug] StringImm Object Can't Be Pass to C++ Side from Python Side [tvm]

2023-10-11 Thread via GitHub
ysh329 commented on issue #15716: URL: https://github.com/apache/tvm/issues/15716#issuecomment-1757342185 Hi all, with `git bisect`, I locate the commit below which from error message `Could not convert TVM object of type runtime.Closure to a string` to error message `Unknown type index 8`.

[tvm] branch unity updated: [Unity] Ignore R.ExternFunc in EliminateCommonSubexpr (#15900)

2023-10-11 Thread syfeng
This is an automated email from the ASF dual-hosted git repository. syfeng pushed a commit to branch unity in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/unity by this push: new 465d691e66 [Unity] Ignore R.ExternFunc in EliminateCo

Re: [PR] [Unity] Improve FuseOps error messages [tvm]

2023-10-11 Thread via GitHub
Hzfengsy merged PR #15899: URL: https://github.com/apache/tvm/pull/15899 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@tvm.apache.

[tvm] branch main updated: [TIR] Fix the error example in the documentation for pad_einsum (#15906)

2023-10-11 Thread syfeng
This is an automated email from the ASF dual-hosted git repository. syfeng pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/main by this push: new 4e9866fef2 [TIR] Fix the error example in the documenta

Re: [PR] [Unity]Add FastMathTransform pass to Relax [tvm]

2023-10-11 Thread via GitHub
Hzfengsy merged PR #15814: URL: https://github.com/apache/tvm/pull/15814 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@tvm.apache.

Re: [PR] [Unity] Ignore R.ExternFunc in EliminateCommonSubexpr [tvm]

2023-10-11 Thread via GitHub
Hzfengsy merged PR #15900: URL: https://github.com/apache/tvm/pull/15900 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@tvm.apache.

[tvm] branch unity updated: [Unity] Improve FuseOps error messages (#15899)

2023-10-11 Thread syfeng
This is an automated email from the ASF dual-hosted git repository. syfeng pushed a commit to branch unity in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/unity by this push: new f154026db1 [Unity] Improve FuseOps error messages (#1

Re: [PR] [TIR] Fix the error example in the documentation for pad_einsum [tvm]

2023-10-11 Thread via GitHub
Hzfengsy merged PR #15906: URL: https://github.com/apache/tvm/pull/15906 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@tvm.apache.

[tvm] branch unity updated: [Unity]Add FastMathTransform pass to Relax (#15814)

2023-10-11 Thread syfeng
This is an automated email from the ASF dual-hosted git repository. syfeng pushed a commit to branch unity in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/unity by this push: new 58e00f3267 [Unity]Add FastMathTransform pass to Relax