Gospel of audio and video developers, rapid integration of AI dubbing capability

The creator of audio and video content has great influence on the editing application AI The demand for dubbing is increasing day by day . It has many advantages , It can not only solve the cost of employing human dubbing, but also the creator's own accent 、 Language and other restrictions , It can also greatly improve production efficiency . such as , The playing time of short video is as short as tens of seconds , Long vlog Types of videos are 4-5 minute , Use AI The dubbing function can realize multiple editing needs in a short time .

​ ​HMS Core Audio editing service ​​（Audio Editor Kit） Provide AI Dubbing service , Help developers easily build speech synthesis functions in applications , One key output text can convert voice . It supports cute children's voice , Kind female voice , Sunshine male voice , English male voice 、 Female voice and other styles and timbres , You can also customize the timbre you want . The tone is natural and smooth , Emotional , Meet the needs of audio reading 、 Audio content production 、 Clips and other popular scenes concerned by developers .

Developing actual combat

1. The development of preparation

For detailed preparation steps, please refer to the official website of Huawei developer alliance ：

​ ​https://developer.huawei.com/consumer/cn/doc/development/Media-Guides/config-agc-0000001154009063?ha_source=hms1​​

2. Edit project integration

2.1 Set the authentication information of the application

Developers need to go through api_key perhaps Access Token To set the application authentication information .

• （ recommend ） adopt setAccessToken Method setting Access Token, Initialize settings when the application starts

Log in and copy

      
      

       
       HAEApplication.getInstance().setAccessToken("your access token");
      
      
      
      

       
       
1.
      
      

• adopt setApiKey Method setting api_key, You can initialize the settings once when the application starts , There is no need to set it more than once .
Log in and copy

       
       

        
        HAEApplication.getInstance().setApiKey("your ApiKey");
       
       
       
       

        
        
1.
       
       

2.2 Initialization environment

Initialize the audio editing management class 、 Create a timeline and the required lanes .

Log in and copy

      
      

       
       //  Create audio editing management class 
       
       
HuaweiAudioEditor mEditor = HuaweiAudioEditor.create(mContext);
       
       
//  initialization Editor Operating environment 
       
       
mEditor.initEnvironment();
       
       
//  Create a timeline 
       
       
HAETimeLine mTimeLine = mEditor.getTimeLine();
       
       
//  Create Lane 
       
       
HAEAudioLane audioLane = mTimeLine.appendAudioLane();
      
      
      
      

       
       
1.
       
       
2.
       
       
3.
       
       
4.
       
       
5.
       
       
6.
       
       
7.
       
       
8.
      
      

Import music .

Log in and copy

      
      

       
       //  Add audio resources at the end of the lane 
       
       
HAEAudioAsset audioAsset = audioLane.appendAudioAsset("/sdcard/download/test.mp3", mTimeLine.getCurrentTime());
      
      
      
      

       
       
1.
       
       
2.
      
      

3. AI Dubbing function integration

call HAEAiDubbingEngine Realization AI Dubbing function .

Log in and copy

      
      

       
       //  Use this configuration class to configure AI Configure the dubbing engine 
       
       
HAEAiDubbingConfig haeAiDubbingConfig = new HAEAiDubbingConfig()
       
       
//  set volume 
       
       
.setVolume(volumeVal)
       
       
//  Set the speed of sound 
       
       
.setSpeed(speedVal)
       
       
//  Set the speaker 
       
       
.setType(defaultSpeakerType);
       
       
//  Single AI Dubbing task callback 
       
       
HAEAiDubbingCallback callback = new HAEAiDubbingCallback() {
       
       
    @Override
       
       
    public void onError(String taskId, HAEAiDubbingError err) {
       
       
        // error Handle 
       
       
    }
       
       
    @Override
       
       
    public void onWarn(String taskId, HAEAiDubbingWarn warn) {}
       
       
    @Override
       
       
    public void onRangeStart(String taskId, int start, int end) {}
       
       
    @Override
       
       
    public void onAudioAvailable(String taskId, HAEAiDubbingAudioInfo haeAiDubbingAudioFragment, int i, Pair<Integer, Integer> pair, Bundle bundle) {
       
       
        //  Start receiving files , Save as file 
       
       
    }
       
       
    @Override
       
       
    public void onEvent(String taskId, int eventID, Bundle bundle) {
       
       
        // The synthesis is complete.
       
       
        if (eventID == HAEAiDubbingConstants.EVENT_SYNTHESIS_COMPLETE) {
       
       
            // AI End of dubbing task processing , That is, all the synthesized audio data are processed 
       
       
        }
       
       
    }
       
       
    @Override
       
       
    public void onSpeakerUpdate(List<HAEAiDubbingSpeaker> speakerList, List<String> lanList,
       
       
         List<String> lanDescList) { }
       
       
};
       
       
// AI Dubbing engine 
       
       
HAEAiDubbingEngine mHAEAiDubbingEngine = new HAEAiDubbingEngine(haeAiDubbingConfig);
       
       
//  Set up AI Listen during the playback of dubbing task 
       
       
mHAEAiDubbingEngine.setAiDubbingCallback(callback);
       
       
//  real time AI Dubbing and playing API,text Pass in the text of the voice to be transferred ,modeAI Dubbing task playback mode 
       
       
String taskId = mHAEAiDubbingEngine.speak(text, mode);
       
       
//  Pause play 
       
       
mHAEAiDubbingEngine.pause();
       
       
//  Resume playback 
       
       
mHAEAiDubbingEngine.resume();
       
       
//  Turn off synthesis 
       
       
mHAEAiDubbingEngine.stop();
      
      
      
      

       
       
1.
       
       
2.
       
       
3.
       
       
4.
       
       
5.
       
       
6.
       
       
7.
       
       
8.
       
       
9.
       
       
10.
       
       
11.
       
       
12.
       
       
13.
       
       
14.
       
       
15.
       
       
16.
       
       
17.
       
       
18.
       
       
19.
       
       
20.
       
       
21.
       
       
22.
       
       
23.
       
       
24.
       
       
25.
       
       
26.
       
       
27.
       
       
28.
       
       
29.
       
       
30.
       
       
31.
       
       
32.
       
       
33.
       
       
34.
       
       
35.
       
       
36.
       
       
37.
       
       
38.
       
       
39.
       
       
40.
       
       
41.
       
       
42.
       
       
43.
       
       
44.
       
       
45.
      
      

Demo demonstration

< nice to meet you >

More details of Huawei audio editing service , Please refer to ： Service website ：​ ​https://developer.huawei.com/consumer/cn/hms/huawei-audio-editor/?ha_source=hms1​​​ Get guidance documents ：​​ ​https://developer.huawei.com/consumer/cn/doc/development/Media-Guides/client-dev-0000001107465102?ha_source=hms1​​

​ Learn more >>​

visit ​ ​ Official website of Huawei developer Alliance ​​

obtain ​ ​ Development guidance document ​​

Huawei mobile service open source warehouse address ：​ ​GitHub​​​、​ ​Gitee​​

​ Pay attention to our , The first time to understand HMS Core Latest technical information ~​