Touring band: a 5g based multi camera remote distributed video production experiment

source ：IBC2021 Speaker ：Luca Vignaroli Content arrangement ： Wang Qiuwen This work introduces and analyzes the implementation of the 5G-TOURS technology “ Touring band ” Application example , That is, it is performed by the concert hall performers and the performers walking on the street , Real time audio and video processing and mixing , And show it to the audience . This paper mainly introduces the implementation process of remote TV production in this application example 、5G Network deployment 、 Specific experimental setup and measurement and analysis of relevant data .

Catalog

• brief introduction
• Implementation structure
  • Remote performer
  • The photographer
  • Program production control room
• Indoor and outdoor 5G Network deployment
• Experiments and results
• summary

brief introduction

“ Touring band ” Is a use of 5G-TOURS Technology to achieve remote high-quality real-time TV program production . In this case , The performers in the music hall of the maderma palace cooperate with the performers walking towards the music hall in the street outside the maderma palace . The studio mixes local and remote audio and video signals in real time 、 Process and broadcast . among , Every remote performer will have at least one photographer to follow and record their performances . In addition , The photographer will also give corresponding signal prompts to the remote performers to ensure that they perform synchronously with the performers in the concert hall . The audio and video signals collected by the photographer pass through 5G The network sends it to the main editing station . In the concert hall, the audience can see the videos of the performers walking on the street in real time , And hear the music played by the performers on the stage of the concert hall and other performers walking on the street . In this project , TIM and Ericsson According to the interior and exterior of the Madema palace area 5G Network coverage deployed .Rai and LiveU Design and provide the technical scheme of TV remote production .

chart 1 “ Touring band ” Overall concept map ：“ Touring band ” Performers inside and outside the concert hall will perform together and conduct real-time processing and broadcasting

Implementation structure

In the process of remote TV program production , In order to meet the real-time of the whole process from shooting to broadcasting , Acquisition of audio and video signals and AC commands 、 The process of delivery is particularly important . Take this project as an example , The following will be about remote musicians 、 The process of signal acquisition and transmission involved in the photographer and program production control room and the specific equipment used are introduced one by one .

Remote performer

Each remote performer has the following equipment ：

• Wireless microphone ： Used to transmit audio to cameraman
• Wireless walkie talkie ： It is used for real-time communication with the control room of program production , And receive the synchronization signal when playing

The photographer

Each photographer has the following equipment ：

• Full HD 4K The camera ： Video recording of musicians , And transmit the signal to the program control room
• Wireless walkie talkie ： It is used for real-time communication with the director in the program control room
• Audio receiver ： Used to receive audio signals from performers
• LiveU company-made 5G Video device ： Used with others 5G Unit connection , And exchange audio and video signals

Through 5G When the network transmits audio and video signals , Full HD video usage HEVC code , Bit rate 20Mbps; Audio signal use AAC, Bit rate 192kbps And embedded into the video stream . meanwhile , The real-time intercom system mentioned above uses LiveU Provided IFBv2.

Program production control room

The program production control room is equipped with the following equipment ：

• Video hardware and software server ： Receive video from remote transmission
• Intercom management system
• Video mixer and equipment for managing different signals
• Delay processor ： Used to align synchronous local signals and remote signals . In this project , Low latency is important for real-time ensemble , But it is more important to set the same fixed delay at different remote sites .

chart 2 “ Touring band ” Composition diagram of signal transmission ： Remote musicians 、 There is a division of labor between the photographer and the program production control room , And the corresponding signals are collected 、 Communication and exchange

Indoor and outdoor 5G Network deployment

The project involves the transmission and exchange of a large number of indoor and outdoor signals , Therefore, it is necessary to deploy inside and outside the Madema palace 5G The Internet .5G-TOURS Network technology is 5G The extension of commercial networks . In this project ,TIM and Ericsson Deployed based on NSA Option 3 Architecture solutions . among , The wireless access network consists of LTE Layer as “ Anchoring layer ”（ stay 1800 MHz Work under the , The bandwidth is 20 MHz）,5G Layer as the second layer （ stay 3.7 GHz Work under the , The bandwidth is 80 MHz）. In this schema ,LTE be responsible for control plane,LTE and NR be used for data plane. The wireless access network is connected to EPC . On the concrete implementation , Indoor network deployment uses Kathrein 80010922 Antenna Ericsson 4422 radio . In order to meet the required indoor coverage , Four different radios are mounted on special poles , And installed a radio 、 All components required for the antenna , Power supply and wiring . According to the above scheme , The interior of the maderma palace is divided into four parts , Pictured 3 Shown .5G The baseband units deployed indoors are Ericsson 6630 baseband , Located at a distance from Madama palace 2.8 Kilometers of network switching points . For the radio installation in the madeima palace and TIM The baseband of the base provides 5G Front end connection , A special optical fiber connection is installed , from 8 For optical fiber composition , among 4 For connecting 4 individual 4422 radio ,1 Yes LiveU The server provides broadband Internet connection ,3 Yes, as a backup .5G Indoor coverage LTE By two outdoor LTE Commercial sites provide .

chart 3 indoor 5G Network deployment map ： Divide the scene of Madema palace into four areas for network deployment

5G The outdoor deployment of the network is based on TIM Site , Installed on it Ericsson 6630 Baseband and and advanced antenna system Ericsson AIR 6488 To provide the same site 5G unit .

Experiments and results

During the experiment , In this paper, the mixed signal oscillograph is used to analyze the glass Delay （ The total time required for a frame in the video from the camera to the display ） and LiveU The throughput of the backpack was measured . The experimental setup in the experiment is shown in the figure 4 Shown .

chart 4 Experimental setup diagram ： Use the metronome signal as a reference comparison signal embedded in the video for testing

In this experiment , Embed the sound track of the metronome into the video signal , As a reference signal to measure glass Delay . This method provides a wide range of measuring probes in the system chain , chart 5 Is an example of a measurement signal , among , The Yellow peak is the reference signal , The pink peak is passing through 5G Signal after the system .

chart 5 Schematic diagram of delay measurement ： The Yellow peak is the reference signal , The pink peak is passing through 5G Signal after the system

Through the above methods , For the whole system glass Delay testing , The results obtained are compared with TIM Compare the results in the laboratory , Pictured 6 Shown . From the results, it can be seen that the actual field results are the same as the results in the laboratory and have relatively stable results , At the same time, the values obtained are approximately consistent .

chart 6 Delay measurement result diagram ： Compare the actual test results of the Madema palace with TIM The results of the laboratory are compared , The results are stable and similar

Based on this result , In order to enable remote musicians to play with live musicians in the concert hall , The control room delayed the start signal of live performance in the concert hall 960 millisecond . Because this experiment involves several remote cameras , Therefore, this paper also tests whether there are delays in the backpack and whether there are differences between them . The results are shown in Fig 7 Shown , You can see the biggest difference between different backpacks 150 Millisecond difference and the difference is stable , Analysis of the cause may be related to UDP The routing of .

chart 7 Knapsack delay comparison diagram ： In the figure, four different backpacks are tested for delay , Results there was a stable delay between backpacks , Maximum 150 millisecond

During the experiment, the bandwidth 、 The delay and packet loss rate are recorded in real time .

chart 8 Test real-time recording diagram

summary

“ Touring band ” The realization process of is a double challenge in technology and art , In this paper, we mainly discuss the TIM and Ericsson Provide indoor and outdoor 5G Internet service and Italian radio and television company LiveU Technical solutions for TV remote production , And has carried on the correlation index measurement and the analysis . Last , The project team is in 2021 year 11 month 9 Day was held “ Touring band ” The concert of “The Garden of Forking Paths”, At the end of the speech video .

Finally, the video of the speech is attached ：

http://mpvideo.qpic.cn/0bc3q4abgaaaoqaeizpkbzqvbb6dcodqaeya.f10002.mp4?dis_k=6e6b24bd420fe81c7684dbcc718e8ba6&dis_t=1645150828&vid=wxv_2233980599344693252&format_id=10002&support_redirect=0&mmversion=false