RTMP streaming +rtmp playback low delay solution in unity environment

Before this article , We released Unity In the environment RTMP Push flow （Windows platform +Android platform ） and RTMP|RTSP Pull flow （Windows platform +Android platform +iOS platform ） Low latency solutions , Make an overall summary today , It is right to draw a brick to draw a stone .

1. Unity In the environment RTMP Push flow

Unity In the environment , Whether it's camera Or form data , The main thing is to get the original data efficiently , The data format available at the acquisition end is RGB Of , After getting it , Through efficient data transmission , Send it to the encapsulated native SDK, Complete data coding and RTMP push .

There are several points to note ：

1. Data collection and delivery , Ensure high efficiency ;

2. Screen resolution changes , It can be adapted in real time ;

3. Unity And native SDK Communication between , such as event Correction etc. ;

4. If the screen data is flipped horizontally or vertically , Need some correction .

Related blog ：

Windows Platform implementation Unity Lower form | camera | Screen acquisition push

https://blog.csdn.net/renhui1112/article/details/117785180

Android Platform implementation Unity3D Next RTMP push

https://blog.csdn.net/renhui1112/article/details/117669587

2. Unity In the environment RTMP|RTSP player

Unity In the environment RTMP or RTSP Live broadcast, we released it a few years ago , It has been applied in many traditional industries , For example, educational or industrial simulation or some low delay control scenarios .

The relevant implementation logic is as follows ：

1. Native RTSP or RTSP Live broadcast SDK Callback RGB/YUV420/NV12 One of the uncompressed image formats ;

2. Unity3D Create the corresponding RGB/YUV420 etc. Shader;

3.Unity3D Image data is obtained from each platform to fill the texture ;

There are a few things to note ：

1. Multi instance support ： The player is different from the push , For example, smart city , There are multiple scenes at the playback end , Therefore, multi instance support is a necessary function , In a multi instance environment , Need to be able to make a good distinction event Status callback, etc ;

2. Data transfer as efficiently as possible , Ensure that resource occupancy is minimized ;

3. After the video resolution changes , Can automatically adapt ;

4. Unity And native SDK Communication between , such as event Correction etc. ;

5. Long running stability .

Related blog ：

Windows platform Unity3d How to play multiple channels at the same time RTSP or RTMP flow

https://blog.csdn.net/renhui1112/article/details/114674572

How to be in Unity3d Low latency playback under the platform RTMP or RTSP flow

https://blog.csdn.net/renhui1112/article/details/104154788