Onnxruntime [reasoning framework, which users can easily use to run an onnx model]

ONNXRuntime It is a reasoning framework launched by Microsoft , Users can easily use it to run a onnx Model .ONNXRuntime Support a variety of running backend, including CPU,GPU,TensorRT,DML etc. . so to speak ONNXRuntime It's right ONNX The most native support of the model .

Although we use ONNX It is more as an intermediate expression , from pytorch go to onnx Feed directly to TensorRT or MNN And other back-end frameworks = =, But this cannot be denied ONNXRuntime Is a very good reasoning framework （ From Microsoft , It must be a boutique. ）.

And because it only contains reasoning function （1.2 edition , Abreast of the times ONNXRuntime You can even train , It can be seen that Microsoft still has some ambitions ）, Compared with the mainstream framework source code, it seems not so complicated , By reading its source code, you can clearly understand some core functions and principles of the deep learning framework （op register , memory management , Operation logic, etc ）.

The next series of articles try to ONNXRuntime Source code for reading and learning , It is very helpful to understand the working principle of the deep learning framework .

---

ONNXRuntime Overall overview
OnnxRunTime Deployment process of