Embedded audio and video solutions webrtc vs metartc

Preface

After the epidemic , The field of audio and video has led to a new take-off , Videoconferencing , Cloud desktop , Cloud games and other applications emerge in endlessly . real time , Efficient , Collaboration has become a synonym for enterprises , There are no such points , I feel that the enterprise can not keep up with the pace of the times .

A few days ago , Brush up friends “ Sky class ”, Astronaut Zhai Zhigang of Shenzhou 13 crew 、 Wang Yaping 、 Yeguangfu will give lectures in space on the space station , China Manned Space Engineering Office in conjunction with the Ministry of education 、 Ministry of Science and Technology 、 China Association for science and technology 、 Co sponsored by China Central Radio and television . The Central Radio and television station will broadcast the whole process live .

We can see that with 5G Maturity of Technology , People are interested in real-time , Interactivity puts forward higher requirements .

big-name Webrtc

When it comes to audio and video , I have to mention Google Webrtc, A lot of people who haven't touched the audio and video field before , With the development of enterprises and the needs of customers , And began to touch Webrtc technology , We're here 2 I saw many new people in , Into this industry , This is a good thing , But we've also seen a lot of newcomers to Google Webrtc The complaints of .

1. It's hard to compile , Difficult to download
2. There are many third-party libraries
3. Algorithm is complicated
4. The system is huge , Complex code , The second development is very difficult
5. Not suitable for embedded systems , Embedded computing power is limited ,webrtc Too heavy
6. Fewer documents , I don't know how to solve the problem

Despite the above shortcomings , But Google Webrtc, Still an excellent open source project

MetaRTC

MetaRTC Is an embedded system / Created by the Internet of things RTC library , For the third generation Internet The universe provides RTC Ability .
MetaRTC Realized webrtc agreement , Support webrtc/srt/rtmp, Available with Google webrtc Interconnection .

MetaRTC And Webrtc The difference between

1. MetaRTC Easy to compile

• webrtc It's hard to compile , You need to go online scientifically , Dozens of warehouses G.
  and metartc stay B standing There are complete compilation tutorials and videos

2. Small volume

• webrtc Use c++ Development , Large size , Not suitable for embedded systems .
  metartc Most use c Language development , Naturally suitable for embedded systems .

3. Easy secondary development

• webrtc It was developed by Google , A lot of code , The second development is very difficult .
  meta Small amount of code , The difficulty of secondary development is small , And there is a complete Chinese community .

4. Create an ecological environment for Chinese people

• webrtc yes p2p Of , There is no server , And the open source server , multifarious , High learning cost , Developers often struggle to use that webrtc Open source services .metartc Recommended srs Yang set up an open source server for the boss （ People write ）, Of course, if you have your own streaming media server, it also supports docking .

5. More open

• metartc More local , Have independent development rights , The required functions and suggestions can be mentioned issue, The iteration will be updated according to the suggestions of the developer metartc

6. Provide a full range of solutions

• metartc Provide a full range of solutions , For example, developers want to use H265, and srs I won't support it 265, We are in srs On the expansion of H265 Support for , Provide a complete solution from client to server

7. More controllable

• In the near future Java log4j Security vulnerability , Swipe the whole Internet ,log4j It's pierced Java Most of the day , about RTC For this underlying application , What's more, we need an autonomous and controllable RTC library

MetaRTC The function of

Video coding 8bit:x264、x265、vaapi、nvenc etc. , Increase in phase II AV1 And a variety of hardware coding .
Video coding 10bit:x265、vaapi、nvenc etc. .
Video decoding ：ffmpeg and yangh264decoder.
VR: Realize the interaction and recording of virtual video based on matting 、 Live broadcast, etc .
8bit and 10bit Web player ：yangplayer
Audio ：Opus、Aac、Speex、Mp3 Wait for audio codec .
Audio ：AEC、AGC、ANS And sound synthesis .
transmission ：webrtc、rtmp、srt,webrtc For yourself , Not using Google lib library .
live broadcast ：rtmp、srt、webrtc、HLS、HTTP-FLV.
8bit Recording ：h264、h265 Of mp4 and flv.
10bit Recording ：h265 Of mp4
Realize screen sharing and control .
Realize a variety of sound and image processing .
PTZ control of professional camera and multi lens guide switching .
Support 32 Bit and 64 Bit programming .

MetaRTC Usage scenarios of

MetaRTC Can be used for Videoconferencing 、 HD recording and broadcasting live 、 Live interaction 、 Cloud games 、 cloud 3D And other video and audio applications . It can be used for distance education 、 telemedicine 、 Command and dispatch 、 Security monitoring 、 Film and television recording and broadcasting 、 Cooperative Office 、 Live interactive and other industry applications .

Delay test

An enthusiastic netizen tested the situation , The end-to-end delay time is 40ms.

summary

For China RTC Come on , Need an autonomous and controllable RTC library , We sincerely invite all developers to experience MetaRTC, welcome star and fork.