emoTag

emoTag helps you train emotion detection model for Chinese audios.

Environment

pip install -r requirement.txt

Data

We used Emotional Speech Dataset (ESD) for Speech Synthesis and Voice Conversion from HLT Singapore.

Train Emotion Classifier

Use this command to train a classifier. Adjust training setups in conf/logfbank_train-emo.json.

python train.py --config conf/logfbank_train-emo.json --name task_trial_1

Models and logs will be find in exp/.

usage: train.py [-h] [-c CONFIG] [-r RESUME] [-n NAME] [--lr LR] [--bs BS]
                [--train_utt2wav TRAIN_UTT2WAV] [--val_utt2wav VAL_UTT2WAV]
                [--blocks BLOCKS] [--optimizer OPTIMIZER]
                [--train_pad0 TRAIN_PAD0] [--devel_pad0 DEVEL_PAD0]
                [--pretrain PRETRAIN]

PyTorch Template

optional arguments:
  -h, --help            show this help message and exit
  -c CONFIG, --config CONFIG
                        config file path (default: None)
  -r RESUME, --resume RESUME
                        path to latest checkpoint (default: None)
  -n NAME, --name NAME
  --lr LR, --learning_rate LR
  --bs BS, --batch_size BS
  --train_utt2wav TRAIN_UTT2WAV
  --val_utt2wav VAL_UTT2WAV
  --blocks BLOCKS
  --optimizer OPTIMIZER
  --train_pad0 TRAIN_PAD0
  --devel_pad0 DEVEL_PAD0
  --pretrain PRETRAIN

Infer labels

python infer_label.py

Adjust the vad_file param and code if necessary to adapt to new tasks. infer_label.py adopted multiprocessing, increased cpu utilities rate and inference efficiency. See usage details below.

usage: infer_label.py [-h] [--vad_file VAD_FILE] [--model_dir MODEL_DIR]
                      [--output_dir OUTPUT_DIR]

parse model info

optional arguments:
  -h, --help            show this help message and exit
  --vad_file VAD_FILE
  --model_dir MODEL_DIR
  --output_dir OUTPUT_DIR

EmoTag helps you train emotion detection model for Chinese audios

Related tags

Overview

emoTag

Environment

Data

Train Emotion Classifier

Infer labels

Owner

_zza

RuDOLPH: One Hyper-Modal Transformer can be creative as DALL-E and smart as CLIP

Implementation of paper "DeepTag: A General Framework for Fiducial Marker Design and Detection"

This is an official implementation of the High-Resolution Transformer for Dense Prediction.

Reinforcement learning framework and algorithms implemented in PyTorch.

A set of tools for creating and testing machine learning features, with a scikit-learn compatible API

Spatial-Location-Constraint-Prototype-Loss-for-Open-Set-Recognition

FeTaQA: Free-form Table Question Answering

[IROS2021] NYU-VPR: Long-Term Visual Place Recognition Benchmark with View Direction and Data Anonymization Influences

Code for the IJCAI 2021 paper "Structure Guided Lane Detection"

Demo for Real-time RGBD-based Extended Body Pose Estimation paper

Face Mask Detection System built with OpenCV, TensorFlow using Computer Vision concepts

House_prices_kaggle - Predict sales prices and practice feature engineering, RFs, and gradient boosting

A modular, open and non-proprietary toolkit for core robotic functionalities by harnessing deep learning

Code for Paper Predicting Osteoarthritis Progression via Unsupervised Adversarial Representation Learning

A PyTorch Lightning solution to training OpenAI's CLIP from scratch.

MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images

The Empirical Investigation of Representation Learning for Imitation (EIRLI)

A denoising autoencoder + adversarial losses and attention mechanisms for face swapping.

DTCN IJCAI - Sequential prediction learning framework and algorithm