Rk1126 platform project summary

The general flow of the project is Read data from the camera and pass ai analysis Output ai The analysis result is encoded as 2 road venc The flow of then Make one rtsp The server For subsequent modules Handle

But from the perspective of demand, it's actually very simple

But in fact, when doing it, you will still encounter some pits

After the program is up, a http service Wait for various instructions issued by the master  

These instructions include the setting of video parameters   ai Whether the function is turned on or off rtsp Opening and closing of services

Upload and download model files ,jpeg Image upload do ai analysis wait  

Based on the previous 3531 Development experience ,

Than 3531 One more place Namely 3531 It does not involve uploading files  

1126 One that needs to support file uploading is ai Upload model files The other is jpeg Upload pictures .

Then the program listens http event Do the corresponding treatment

Mainly to do ai Handling and not doing ai The process is different

Do not do ai The assistant's words are direct vi rga venc come out

If you do ai To deal with it is vi rknn Because it needs two flows So you need to yuv Scale the data , And if you don't do ai What to do Call directly rga No need to scale manually yuv data It has been realized What is called is actually rga Provided api imresize And so on. , The main thing is to understand the relevant data interfaces and api That's all right.

because ai analysis Another engineer did it   I need to call his module I'll give him yuv data Do it naturally AI After analysis give AI Analyze the results and in yuv Frame the data .

Then what is needed is OSD function , Put it before the mays platform OSD Take it directly and It is found that nothing is normal At present, there is no time to study this piece carefully Here's the picture RK Platform support only ARGB8888 One pixel 4 Bytes

The original Hisilicon can be set to ARGB565 Many formats of what One pixel can only occupy 2 Bytes The principle is through FreeType load ttf Font then change the font to bitmap Structure Then render to venc Above the passage   After taking the same code It can be found that there are two main problems  

1, only one osd But it shows two lines  

2. The font color is set to white, but I don't know why some areas turn red

 

At present, it is just a framework Many detailed functions have not been completed When it's done Update here