Digital people anchor 618 sign language with goods, convenient for 27.8 million people with hearing impairment

As the core node of mid year marketing ,618 Become a live broadcast carrier for major businesses 、 A stage for upgrading playing methods . In the lively live broadcasting room , The anchor shouted “ Buy it, buy it ”“ Lowest price in the whole network ”, Quickly broadcast product information and discounts to the audience .

But outside the excitement , There is also such a “ Quiet studio ”, The anchor is not a real star , It's a “ Sign language broadcasts numbers ”, She can use standard sign language , Cordially introduce products to people with hearing impairment , Bring more product information into the silent world .

She is Zhipu AI To launch the “ Sign language broadcasts numbers ”, Can reduce communication costs , Provide sign language broadcasting services for hearing impaired people , It is convenient for people with hearing impairment to watch the live broadcast 、 Get product information , Improve participation in social activities .

【1】 Sign language broadcast digital people live with goods

【2】 Sign language broadcast digital human introduction AI Painting products “CogView”

【3】 Sign language broadcast digital human introduction AI Poetic products “ Enlightenment workshop ”

According to the data of the second national sample survey of the disabled , China has more than 2700 Ten thousand people with disabled hearing impairment . However , Manual sign language broadcasting workload , And sign language translation professionals are very scarce .

How to make professional and universal sign language benefit everyone with hearing impairment ？ The team decided to give full play to its core technological advantages , Give Way “ Sign language broadcasts numbers ” Take this “ Silent warmth ” To more distant people .

This is not “ Sign language broadcasts numbers ” For the first time . As early as during the Winter Olympics this year , She is on Beijing Satellite TV 《 Good morning to Beijing 》 Right in the program “ Winter Olympics highlights ” and “ Watch the Winter Olympics together ” Sign language broadcast ,3 month 4 The date of , During the winter Paralympic Games, she continued to provide sign language broadcasting services for hearing-impaired people . Besides , She also provided sign language broadcasting support for the Paralympic science popularization programs on the science and education channel of Beijing Television , The total service time exceeds 500 minute , It is still used in many programs after the game .


“ Winter Olympics sign language broadcast digital people ” stay 《 Good morning to Beijing 》 Put the program into use

Build the largest multimodal sign language corpus in China

In order to achieve high-precision sign language broadcasting ,“ Sign language broadcasts numbers ” The system is finished 《 National General sign language dictionary 》 Included in the 8214 Acquisition and recording of general sign language , And the grammar is based on the habitual playing method of hearing-impaired groups , To ensure the accuracy and professionalism of sign language broadcast results , Better serve people with hearing impairment .

Due to the lack of perfect sign language corpus data in China , The R & D personnel are supported by the Beijing Disabled Persons' Federation and the Deaf Association of the Beijing Disabled Persons' Federation , Invite more than 40 More than deaf teachers and sign language experts provide sign language text transcription and technical guidance , And conduct a large-scale evaluation of hearing-impaired groups , Finally, the largest multimodal sign language corpus in China that meets the national standard of general sign language is constructed , The total scale of vocabulary and sentences exceeds 10 ten thousand .

Create sign language broadcast “ Intelligent digital brain ”

To build understanding 、 An intelligent digital brain that translates speech and sign language ,“ Sign language broadcasts numbers ” The system takes the super large-scale pre training model as the core technology , Through semantic distillation and sign language translation, quickly compile the model , Realize the distillation of news broadcast voice and sign language text with highly similar idioms , And translate it into a word order in line with sign language habits . Final , Sign language digital brain can imitate the brain of hearing impaired people through computer , Sign language broadcast drive .

It is reported that ,“ Sign language broadcasts numbers ” By Beijing Municipal Science and Technology Commission 、 Zhongguancun Management Committee supports , Wisdom spectrum AI、 Ling Yunguang and Beijing Radio and television jointly created , Professor Jia Jia of Tsinghua University and researcher Chen Yiqiang of Institute of computing of Chinese Academy of Sciences also actively participated in the research and development of relevant key technologies , It has also received the help and support of the Beijing Disabled Persons' Federation and the Deaf Association of the Beijing Disabled Persons' Federation .

The promotion of sign language digital people will accelerate the promotion of national general sign language , Promote the popularization of national general sign language standards , Create an accessible environment for the disabled to participate in social life on an equal basis , Pass the temperature of science and technology to every silent corner .

future , Driven by the new generation of cognitive intelligence engine , Digital people are not just the gospel of the disabled , It will also have broader application prospects , He can be a virtual assistant 、 Virtual interviewer 、 Virtual wealth manager 、 Virtual anchor 、 Virtual idol …… Enabling government 、 Internet 、 Finance 、 education 、 Live broadcast and other industries , Let's wait and see .