How does webrtc obtain video stream data on the C ++ side?

WebRTC Is an open source technology , It can realize voice and video communication through web pages , Without having to install any plug-ins in the browser . Now ,WebRTC The technology is mature , It integrates the best sound / Video Engine , This technology has been widely used in video calls .

stay WebRTC Development process , Will be far away sdp Once you set it up , Then you can get the video data stream . If it is js End , So the operation is actually relatively simple . however C++ The end is a little troublesome . because WebRTC With a... On the top Javascript API layer , You can use it in your browser . This makes it easier to develop and integrate real-time communications anywhere . In the internal ,WebRTC Still mainly used C / C ++ Realization .

Some developers don't know how to get WebRTC C++ Video stream data at the end . Today we will share this development skill with you ：WebRTC How to get C ++ Video stream data at the end .

1、 First , stay WebRTC in src/api/create_peerconnection_factory.h There is a function to create a peer-to-peer connection factory , And return an instance interface . The code is as follows ：

2、 After the peer factory is created , stay src/api/peer_connection_interface There are peer connections in , Use a peer factory to create this peer connection instance . The code is as follows ：

3、 See here , We just need to pay attention CreatePeerConnection The last argument to the function . This parameter needs to be overridden , There are many virtual functions that need to be rewritten . Roughly rewritten ICE、 Track and connection status, etc .

4、 At this step, you should find out how to obtain video data stream . There is a method of audio rewriting OnTrack function , This function is responsible for monitoring the video stream instance .

5、 Responsible for rewriting webrtc::PeerConnectionObserver The virtual function in the function , The implementation can monitor the transmitted stream information . Get video stream data , Just pay attention OnTrack function ：

webrtc::RtpTransceiverInterface Interface found receiver() Method , In from receiver() Method track() Method ,track() The method is to get the information of the video stream .

WebRTC Not just voice and video , It's powerful and versatile , That's why WebRTC Because technology is becoming more and more popular .

Based on open source WebRTC Technical development EasyRTC Video conferencing cloud services , It's widely used in education 、 Finance 、 Health care 、 Enterprise training 、 Telecommuting, etc , All browsers that support current technology include Google Chrome,Mozilla Firefox,Apple Safari and Microsoft Edge. Not just browsers ,EasyRTC It can also support wechat applet 、H5 page 、APP、PC Interworking between client and other access methods , Building real-time audio and video communication from scratch ; Support video calls from multiple to one million people , Meet voice and video social .