Performance optimization and implementation of video codec

”

8 month 5 Japan -6 Japan ,LiveVideoStackCon 2022 Audio and Video Technology Conference Shanghai Station , Open the door to the future with you .

Video codec performance optimization and implementation

Behind the continuous iteration of video codec technology , It comes from people's higher definition of interactive experience 、 More immersive 、 Higher requirements for lower latency . In order to meet people's demand for video , Major manufacturers are right H.266、AV1 And other standard encoders for continuous research, development and optimization ; besides , Due to different video content and different bandwidth characteristics , Video coding technology workers are also deepening their efforts in coding optimization for special scenes . people 、 video 、 coding standard , In this demand closed loop , Video codec technology undoubtedly plays an important role in the whole closed loop , How to optimize the performance of video codec ？ What are the actual landing applications ？ Will be the focus of this topic .

Lecturers and topics

With Shopee E-commerce business is rapidly expanding in Southeast Asia and other markets , The application of the combination of video and e-commerce has landed rapidly . such as feeds flow 、 buy / Seller show 、 Live delivery 、 Digital bank account opening and short video, etc . Most mobile phone users in Southeast Asia use domestic mobile phones 2010 1000 yuan machine model popularized around , These phones are encoding and decoding video 、 There are serious performance bottlenecks in image processing . also , The construction of local network infrastructure is not perfect , It is not easy to transmit media data under such network conditions . in addition , Massive video files and live video processing Shopee The backstage has brought great pressure . that Shopee How to solve this series of problems through technical means ？

This sharing will start from 3 Solve the mystery for everyone in three aspects . First of all , HD low code .Shopee Adopt self-developed high-speed HD transcoding , Through encoder optimization and image processing technology , Bit rate reduction 40% Under the circumstances , Try to maintain the image quality , The platform serves Shopee Short video 、 Live delivery 、feeds、rating Flow and other services . second , Since the research SVC Encoder , Combined time domain SVC And airspace SVC, Make it easier for real-time video streaming to adapt to various network conditions . The encoder is integrated in Shopee Even wheat with goods SDK、 Digital bank account opening SDK in . Third , Performance optimization . One input multiple output coding , End-to-end fast algorithm ,SIMD Instruction set optimization , Serving on-demand multi definition transcoding platform , Terminal coding SDK etc. .

Virtual reality 、 The rapid development of new industries such as augmented reality gave birth to panoramic video 、 Light field image 、 High dimensional visual data such as dynamic point cloud . High dimensional visual data can generate video by projection and other means , And use video coding technology for compression . However, the video produced by projection of high-dimensional visual data presents different characteristics from natural video , for example , Panoramic video has obvious geometric deformation and spatial discontinuity , The existing video coding technology for natural video is no longer efficient . This speech intends to introduce a series of video coding technologies for high-dimensional visual data , It can significantly improve the compression efficiency of high-dimensional visual data , For virtual reality 、 The development of augmented reality and other industries has laid a solid foundation .

With AI And the development of multimedia technology , Intelligent security 、 Smart city 、 Autopilot 、 Industrial Internet and other scenarios Intelligent back-end task performance is more concerned , The coding method will be very different from human eye oriented visual coding .2020 year 1 month , The multimedia sub committee of the national beacon Committee has established a data coding system for machine intelligence DCM Standard group .

Authorized data sets can be used for this sharing 、 Application scenario coding requirements 、 Privacy protection requirements 、 Draft of national standard project 、 Exploring experiments 、 Technical solution 、 Reference test platform 、 Intellectual property policy 、 Introduction to external liaison and other aspects DCM standard 、 The latest development and application exploration of Technology .

There are many types of video in Kwai Tai platform. , And there are great differences in the picture quality of video sources .“ How to target multiple types of videos with large quality differences , Let users consume more clearly 、 Smoother viewing experience ？” In the face of this problem , The Kwai team has in-depth research on intelligent audio and video restoration and enhancement technologies. , Build up “ Quality video ”, Provide immersive viewing experience for the majority of users .

This sharing will be divided into three parts , The first part introduces Kwai Tai platform's multiple video types and significant quality differences. , And how to identify and detect Kwai Fu automatically. ; The second part introduces how Kwai's intelligent audio and video algorithms can effectively repair and enhance different types of videos. , Specifically, it includes repair algorithms such as multiple transcoding compression damage and old film scratch film noise , Intelligent super resolution ,HDR High dynamic range generation , High frame rate interpolation generation , as well as 3D Surround sound field enhancement algorithm . The third part will introduce the successful landing plan and effect of Kwai Chi, audio and video related intelligent restoration and enhancement technology. .

 

---

In the scan QR code Or click on Read the original

Learn more about the conference

If you like our content, just order “ Looking at ” Well ！

This article is from WeChat official account. - LiveVideoStack（livevideostack）.
If there is any infringement , Please contact the [email protected] Delete .
Participation of this paper “OSC Source creation plan ”, You are welcome to join us , share .