Video content production and consumption innovation

”

8 month 5 Japan -6 Japan ,LiveVideoStackCon 2022 Audio and Video Technology Conference Shanghai Station , Open the door to the future with you .

Video content production and consumption innovation

Audio and video technology under the influence of the overall environment , In recent years, it has shown a rapid development trend , With more new concepts 、 The emergence of new technologies , Like the meta universe 、 Virtual immersive 、VR/AR etc. , Ultra HD video 、 Live broadcast of events, etc , In the future, from production to consumption, audio and video will be What new businesses 、 It is an urgent problem for us to think that products and scenarios can create more new value .

Lecturers and topics

In recent years , The diversified presentation form of video has been recognized by more industries , Application of video technology in cross industry , Given more possibilities and fun . The diversity and differentiation of production content among different industries further enhance the demand for video content upgrading , As a professional audio and video technology service provider , A film and television level cross platform video production technology solution is proposed , And applied to the actual case scenario .

With artificial intelligence 、 Cloud rendering 、AI Advances in automatic modeling, intelligent driving and other related technologies , The technical threshold of digital people is gradually lowering , And in the degree of refinement 、 Rendering quality and other key experience quality are also improving . Hua Wei Yun MetaStudio Cloud based desktop 、 Cloud rendering 、 video AI Technology , Provide the whole process 、 Scenario based digital human services . This speech will combine the practical experience of Huawei cloud in the digital human industry , Introduce Huawei cloud in detail MetaStudio How to help realize the freedom of digital people .

Ultra high definition video development and artificial intelligence 、 Virtual reality and other new generation technologies are deeply integrated , Spawned a large number of new applications 、 New scene 、 New content 、 And new ways of interacting . The evolution of UHD video technology has changed from the pursuit of clearer 、 More colorful 、 Smoother, higher picture quality, more realistic 、 More immersive immersive experience . These are driving Alibaba cloud's technological innovation in ultra-high definition video production and intelligent interaction .

This sharing will be divided into three parts , The first part introduces Alibaba cloud's new concept of UHD and its exploration of innovative technologies , Including image quality enhancement 、 Coding optimization 、 And end-to-side processing technology . The second part is based on the pursuit of reality and immersion in UHD , The development of digital virtual human and intelligent interaction . The third part , We will share the application examples of Alibaba cloud video cloud combination scene in ultra-high definition content production and intelligent interaction .

After the production of video program content , May face some unpredictable changes , Including changes in content review 、 Additional advertising, etc , The video content needs to be edited again , Including blocking related content or embedding new content . The edited content is required to be in motion with the original video 、 Achieve high fidelity in terms of environmental integration , At the same time, there are strict requirements for timeliness . All these require the application of video content editing technology to meet the challenges .

This sharing will be divided into five parts , The first part introduces the specific reasons for the post editing demand of video program content and the timeliness requirements , The second part introduces the difficulties and challenges in technical practice , Includes an uncalibrated camera with strong lens zoom 、 Extreme narrow baseline motion 、 High motion scenes, etc , The third part introduces the core technology solutions , Including micro motion modeling 、 Feature tracking strategy optimization 、 sliding window BA、 Initialization based on homography , The fourth part is displayed in mango TV Practical application effect in popular variety shows , The fifth part introduces our innovative application in TV series content editing . Through the above five parts, we will systematically introduce the application of video content editing technology in mango TV Innovative practice of .

Ctrip daily puts a lot of video marketing advertisements , Manual video production is expensive . Ctrip foundation AI The team has developed a fully automated algorithm platform from image understanding to video . First, classify according to the image 、 object detection 、 Text detection 、 The image segmentation algorithm understands the constituent elements of the image , Then adaptively add different special effects for different image elements , Including changing the background 、 Image flow 、 Three dimensional reconstruction 、 Add special effects and so on to generate high-quality video ; At the same time, text is generated according to the scene content , Finally, the text will be broadcast through speech synthesis .

The platform can support various customized video generation tasks , Basically achieve wide coverage 、 Flexible and easy to use , Can solve most problems in the business ; In terms of performance , The platform can do real-time and efficient work , Process millions of images every day .

Epidemic Era , We are facing more emergencies than ever before , Our manpower may be short at any time ,A A plan always needs to have B The plan even C plan , The lack of audience makes it very important for the Olympic Games to be presented to the global TV audience .

This sharing will be roughly divided into three parts , Firstly, we will introduce how to simplify the complex acquisition transcoding process into “ Lego blocks ”. It mainly uses the way of building blocks to customize the workflow they have learned , After the process is customized, it runs automatically , Minimize reliance on manpower ; secondly , During filming , Filming HDR At the same time SDR And realize the editing of both at almost the same time , Provide a richer choice of color presentation and dark details , So as to immerse the audience ; Last , Will introduce when the production team is not on site , How to make the event gags and highlights remotely and present them in real time .

As the cost of equipment on which music production depends continues to decrease , The boundary between music consumers and creators is gradually melting . We propose a new music creation engine . With the help of artificial intelligence and real-time calculus Technology , The process of music creation and experience can be integrated ： Music will no longer be a static resource in the visual scene , And become an interactive element that can respond to users' improvisation inspiration in real time . This gives more music consumers the opportunity to experience the fun of being in an interactive music scene .

This speech mainly introduces the research results and technical practice of this new music creation engine .

 

---

In the scan QR code Or click on Read the original

Learn more about the conference

If you like our content, just order “ Looking at ” Well ！

This article is from WeChat official account. - LiveVideoStack（livevideostack）.
If there is any infringement , Please contact the [email protected] Delete .
Participation of this paper “OSC Source creation plan ”, You are welcome to join us , share .