More, faster, better and cheaper. Here comes the fastdeploy beta of the low threshold AI deployment tool!

This article has been published on the official account of the flying oar , Please check the link ;
Achieve greater, faster, better and more economical results , Low threshold AI Deployment tools FastDeploy Here comes the beta

The application of artificial intelligence industry is developing faster and faster , The adaptation deployment that developers need to face is becoming more and more complex . One side , New algorithm models emerge in endlessly , On the other hand , Various AI Hardware chips are also emerging . meanwhile , In the actual algorithm implementation , It also needs to deal with different scenarios （ Server deployment 、 Service deployment 、 Embedded deployment 、 Mobile terminal deployment, etc ）, Different operating systems （Linux、Windows、Android、iOS etc. ）, Different programming languages （Python、C++ etc. ）, These are AI The implementation of the developer project brings no small challenge .

For the above pain points , We began to try a new product FastDeploy, It can aim at the important in the industrial landing scenario AI Model , In different hardware environments , Support developers to download a variety of precompiled SDK, Developer reference documentation , It can be done in a few simple steps AI Model deployment , Greatly reduce deployment difficulty and time cost .

Now? ,FastDeploy Released 0.1 edition , This version has three types of features ：

• Low threshold ： One line command download SDK, One line of command to experience deployment Demo; Consistent code experience on different hardware platforms , Reduce the difficulty of secondary development based on business model and business logic ; Officially verified , The model accuracy and reasoning robustness of the algorithm are guaranteed .

• Multi scene ： Support the cloud 、 edge 、 End （ Including mobile end ） Enrich the software and hardware environment deployment , Support image 、 Video streaming 、 One click Service and other deployment methods , Meet the needs of different scenarios AI Deployment appeal .

• Multiple algorithms ： Support image classification 、 object detection 、 Image segmentation 、 Face detection 、 Detection of key points of human body 、 Text recognition, etc 30 Model selection of several mainstream algorithms .

Click to get the project portal

https://github.com/PaddlePaddle/FastDeploy

Low threshold use

One line command to quickly experience deployment

FastDeploy By way of configuration file , Realization AI Pre and post processing of the algorithm , Novice developers can also easily deploy . Different platform API The interface definition style is unified , It is convenient for developers to carry out flexible secondary development based on business model and business logic . For deployment and compilation challenges in the development environment ,FastDeploy It provides developers with an officially validated compilation environment and compilation scripts , Reduce AI The threshold for deployment and landing . at present FastDeploy Two types are available SDK Download mode ：

• Page experience , Available for download .

• GitHub Command line experience , With a simple line of command , You can download the corresponding SDK. Developers can refer to the documentation , Quickly download the SDK Deploy to the actual project .

Multi scene coverage

Multiple platforms at the edge of the cloud can be caught in one net

FastDeploy v0.1 At present, we support Intel X86_64 CPU、NVIDIA GPU X86、ARM CPU（v7、v8）、Jetson Nano、Jetson TX2、Jetson Xavier Series hardware , And support Windows、Linux、Android、iOS Four operating systems ; Support image 、 Video streaming （ Include RTSP、RTMP、HLS、HTTP And other common network protocols ） Input reasoning deployment , And it can be deployed and experienced as a service ; In most scenarios, it supports C++ Deployment and Python Deploy , It meets the different deployment demands of different developers .

Multi algorithm support

Enabling different industries AI to ground

FastDeploy v0.1 Cover 7 Large class algorithms （ Image classification 、 object detection 、 Semantic segmentation 、 Instance segmentation 、 Face detection 、 Detection of key points of human body 、 Text recognition ）, Provide access to 300 individual SDK. meanwhile ,FastDeploy It can quickly realize personalized model replacement , The developer only needs to replace the trained model with the deployment SDK in , You can complete the rapid deployment of your own business model .

Get started quickly

Developers only need to download the corresponding model 、 Hardware 、 Operating system SDK, One line of code to experience FastDeploy Rich deployment capabilities .

We use YOLOv5 For example , Take a look FastDeploy On different platforms （Linux System 、Windows System 、Android System 、iOS System ） Of SDK Engineering examples .

• YOLOv5 stay NVIDIA GPU / X86 CPU Windows Engineering examples under ：

• YOLOv5 stay NVIDIA GPU / X86 CPU Linux Engineering examples under （ Include C++ and python Language ）：

• YOLOv5 stay ARM CPU Android Engineering examples under ：

• YOLOv5 stay ARM CPU iOS Engineering examples under ：

FastDeploy There are two ways to use , Graphical interface mode and command line mode . The detailed operation steps are shown in the figure below .

• Graphical interface mode ：

• Command line mode ：

Learn more about

Want to learn more about how to use FastDeploy Fast reasoning , Sure ：

• Refer to the corresponding documentation ：

Slide down to see everything

• more FastDeploy Product information , You can see GitHub Learn more about ：

https://github.com/PaddlePaddle/FastDeploy

• More participation is welcome AI Developers of model deployment , Join in FastDeploy Community communication .

Private online communication meeting

In order to fully communicate with developers about the problems encountered in the use of the product ,6 month 30 Friday night 20:30,FastDeploy The core members of the production research team will hold an online Tencent conference with the group developers , Discuss the current problems and future needs , Welcome to scan the code into the group , obtain 6 month 30 Daily online meeting link ！ limit 200 mat , Until the report is full .

Official account of flying propeller , Sign up for an online exchange

Focus on 【 Flying propeller PaddlePaddle】 official account

Get more technical content ~