"Write once, run at all ends", Qualcomm released AI software stack!

Arrangement | Su mi

Produce | CSDN（ID：CSDNnews）

“ Once programming , Run anywhere ” This dream of , We start with programming languages Java Talking about cross platform tools  Flutter , We also explored the operating system HarmonyOS and Fuchsia, Now, we are gradually embarking on a large-scale AI field , And whether there is such a scheme , It can string all intelligent network edge devices ？

6 month 22 Japan , Qualcomm announces a new AI Software stack （Qualcomm AI Stack）, Designed to help developers and enterprises achieve “ A development , Operation at each end ” Vision . The software stack is oriented to OEM A complete set of for vendors and developers AI Solution , This is also the first time Qualcomm has passed a single AI Software Portfolio , Enable free migration across Qualcomm's broad product portfolio and tiers .

Cover hardware 、 Three dimensions of software and tools , high through AI Software stack release ！

Nowadays, the era of digital economy is coming , The underlying tools used by developers have changed dramatically , Some traditional cross platform tools are not enough to support the iteration of the whole field .

The reason for developing this software stack , Vice president of product management, Qualcomm technologies Ziad Asghar  In an interview with CSDN In an interview , The reason is simple .“ From the outside , Many partners' products will not only run in the cloud , It will also run on the edge side . For some models that have invested a lot of work to develop , We want to ensure that these models are used to the fullest , Make it suitable for different types of products , And this can obviously bring huge advantages . For Qualcomm internal , Introducing Qualcomm  AI  The starting point of software stack is actually very simple , That is to make our development work easier 、 Simple .”

The specific term , around AI technology , As the market continues to expand from mobile to other areas , Many enterprises are also facing many challenges . for example , Compared with the current Internet of things, the past hot Smartphone Application development 、 There are many differences in the automotive business , In different scenes , Power demand analysis 、 Model type 、 Models are deployed in different ways , Different businesses are critical to accuracy 、 The balance requirements of power consumption and delay are also different . Besides , Used in different business areas AI The model is also different from the neural network model .

In the trend of integrating hardware and software , today , Gao Ge AI  The software stack program has submitted an answer sheet . According to the official introduction , qualcomm AI Software stack mainly includes three key components ： Hardware 、 Software and tools .

On hardware , We were pleasantly surprised to see , This solution can run on almost all Qualcomm supported end products , It covers a wide range of intelligent networking edge products , Including smartphones 、 automobile 、XR、 Calculation 、 Internet of things and cloud platform , In this way, the investment in a certain business line can be easily extended to other different fields .

It can be clearly seen from the figure below , From the bottom to the front , qualcomm AI The software stack also supports different operating systems used by different products , Include Android、Windows、Linux And the Internet connected vehicles QNX etc. . At the system software level , The scheme can completely support the system interface 、 Accelerator drive 、 Simulation support, etc .

At a higher level of developer libraries and services , qualcomm AI  The software stack also supports math libraries 、 Compilers and virtual platforms , And the parser and debugger , It can help developers know which part of neural network processing is used in the development process , What kind of model is used in this part of neural network processing , And what kind of weight should be used in the hardware end for analysis .

Besides , The program can also support programming languages and core libraries . The compiler mentioned earlier , It can be customized for specific content , use Python You can do more with just a few lines of code , It provides a lot of convenience for developers .

In addition to the above , This set of AI The software stack solution also integrates Qualcomm in AI  R & D achievements in the field for more than ten years , Such as support qualcomm AI Model synergy toolkit （AIMET）, It provides model quantization and model compression techniques , Be able to conduct quantitative perception training （Quantization Aware Training） And no data training , Convert floating-point operation model to integer operation model , For example, will 32 Bit floating point model is converted to 8 Bit integer model , Improve the energy efficiency of the model by 4 Twice as many ; It also provides Open source AI Model efficiency toolkit model library , It is convenient for industry developers to evaluate the energy efficiency and accuracy of the model by themselves , Find the best solution ; meanwhile , qualcomm AI The software stack also provides neural network architecture search （NAS） Ability , Ensure low delay and high precision AI Calculation , Ensure low memory and high energy efficiency at the same time .

On infrastructure , That we use a lot  Prometheus、Kubernetes and Docker Within the scope of support .

On the use ,OEM  Vendors and developers will receive Qualcomm  AI  Software stack access , Through a single  AI  The software package can achieve higher performance , Unlock your smartphone 、 The Internet of things 、 automobile 、XR、 Cloud and movement  PC  And other intelligent networking edge products  AI  Ability . Based on this , Whether it's a business , Or personal developers , Can focus their work on exploring innovative AI On the use case , There is no need to pay attention to the repeated development of the model .

How to realize one-time development , Operation at each end ？

meanwhile , Qualcomm also provides many unified SDK, Such as facing the car ADAS solution-based Snapdragon Ride SDK、 Qualcomm intelligent multimedia for the Internet of things SDK, as well as Snapdragon Spaces XR Developer Platform .

Really want to realize the vision of one-time development , Qualcomm integrates all relevant technologies , The unified model thus provided can be used in both audio devices 、 Wearable device or cloud , Can realize free migration across platforms and product lines .

Now? , Developers only need to develop once , The development results can be used in other product lines . Besides , Based on Qualcomm AI Software stack , Many enterprises are also able to achieve the same goal in different products 、 Extensions between different platforms , For example, as mentioned above, the relevant development experience in the mobile terminal is applied to the software development of other platforms such as automobiles , It can also make today's cars 、XR  And other complex model development experience of the platform will be brought back to the mobile terminal .

Regarding this , Vice president of product management, Qualcomm technologies  Ziad Asghar  Express ：“ Complete Qualcomm  AI  The software stack portfolio is undoubtedly a huge breakthrough , It will push  OEM  Vendors and developers  AI  Development , Bring high performance to Qualcomm technologies' broad product portfolio . We are pleased to further expand the company's unified technology roadmap with this new product portfolio , And expand the leading edge at the edge of intelligent networking .”

— Recommended reading  —

《 New programmers 001-004》 Fully listed

Welcome to scan the QR code below or click to subscribe now

You can enjoy e-books and exquisite paper books .

*AI  Help write code  67  element / month ！GitHub Copilot  Collect fees “ Double label ”, Dissuade a large number of programmers 
* Move Tencent to the cloud , Cured their technical anxiety 
*M2  Chip analysis ： It seems to be an enhanced version  A15？

One key, three links 「 Share 」「 give the thumbs-up 」「 Looking at 」

100 million technical people