Signterpreter

American Sign Language (ASL) to Text Converter

Recommendations

Although there is grayscale and gaussian blur, we recommend that you use this application with a wall or greenscreen right behind you. It is not perfect at distinguishing behind hand gestures and different objects in the background.

Packages

You will need to download a few packages with the latest version of pip. By running the following code segment in command prompt, you should be able to run the application perfectly:

1. Latest pip -> pip install --upgrade pip

2. numpy -> pip install numpy

3. string -> pip install strings

4. os-sys -> pip install os-sys

5. opencv -> pip install opencv-python

6. tensorFlow -> i) pip install tensorflow 
                 ii) pip3 install --upgrade https://storage.googleapis.com/tensorflow/linux/cpu/tensorflow-0.8.0-cp34-cp34m-linux_x86_64.whl
7. keras -> pip install keras

8. tkinter -> pip install tk

9. PIL -> pip install Pillow

10. enchant -> pip install pyenchant (Python bindings for the Enchant spellchecking system)

11. hunspell -> pip install cyhunspell (A wrapper on hunspell for use in Python)

What is not Included

We have not attached our training and testing dataset due to the sheer amount of files. To create your own dataset to train and test the model, you will need to run the following applications by opening them or using command prompt:

1. FoldersCreation.py -> python FoldersCreation.py

2. TestingDataCollection.py -> python TestingDataCollection.py

3. TrainingDataCollection.py -> python TrainingDataCollection.py

American Sign Language (ASL) to Text Converter

Related tags

Overview

Signterpreter

Recommendations

Packages

What is not Included

Owner

SAINT PyTorch implementation

NLP Core Library and Model Zoo based on PaddlePaddle 2.0

Live Speech Portraits: Real-Time Photorealistic Talking-Head Animation (SIGGRAPH Asia 2021)

Text Analysis & Topic Extraction on Android App user reviews

Text to speech is a process to convert any text into voice. Text to speech project takes words on digital devices and convert them into audio. Here I have used Google-text-to-speech library popularly known as gTTS library to convert text file to .mp3 file. Hope you like my project!

Code for Findings at EMNLP 2021 paper: "Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learning"

Write Python in Urdu - اردو میں کوڈ لکھیں

Under the hood working of transformers, fine-tuning GPT-3 models, DeBERTa, vision models, and the start of Metaverse, using a variety of NLP platforms: Hugging Face, OpenAI API, Trax, and AllenNLP

A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models

Malware-Related Sentence Classification

Extract rooms type, door, neibour rooms, rooms corners nad bounding boxes, and generate graph from rplan dataset

Deep Learning Topics with Computer Vision & NLP

pytorch-kaldi is a project for developing state-of-the-art DNN/RNN hybrid speech recognition systems. The DNN part is managed by pytorch, while feature extraction, label computation, and decoding are performed with the kaldi toolkit.

Composed Image Retrieval using Pretrained LANguage Transformers (CIRPLANT)

Silero Models: pre-trained speech-to-text, text-to-speech models and benchmarks made embarrassingly simple

RuCLIP-SB (Russian Contrastive Language–Image Pretraining SWIN-BERT) is a multimodal model for obtaining images and text similarities and rearranging captions and pictures. Unlike other versions of the model we use BERT for text encoder and SWIN transformer for image encoder.

A natural language processing model for sequential sentence classification in medical abstracts.

English loanwords in the world's languages

COVID-19 Chatbot with Rasa 2.0: open source conversational AI

Code for the ACL 2021 paper "Structural Guidance for Transformer Language Models"