Archermmt opened a new pull request, #16228:
URL: https://github.com/apache/tvm/pull/16228

   This is a pull request for MSC(Multi-System Compile)
   RFC: 
https://discuss.tvm.apache.org/t/rfc-unity-msc-introduction-to-multi-system-compiler/15251/5
   Tracking issue: https://github.com/apache/tvm/issues/15233
   
   This is the Milestone 2 for MSC: Use msc.runtime.Manager to manage the 
compiling pipeline && tools.
   To limit each PR in reviewable size, the Milestone 2 will be split into some 
steps:
   M2.1 Add Manager for compile pipeline
   M2.2 Add pruner for model pruning
   M2.3 Add tracker for track layer datas
   **M2.4 Add quantizer for quantize model**
   
   Quantization is widely used as model optimization methods. MSC 
implementation of quantizer differs from other frameworks. The quantization 
process is described as a tool and dispatched to torch/tvm/tensorrt when 
needed. In this way, the quantization of tvm can be "simulated" in torch 
(essential for QAT).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to