In this repository we have tested 3 VQA models on the ImageCLEF-2019 dataset.

Last update: Apr 14, 2022

Related tags

Overview

Med-VQA

In this repository we have tested 3 VQA models on the ImageCLEF-2019 dataset. Two of these are made on top of Facebook AI Reasearch's Multi-Modal Framework (MMF).

Model Name	Accuracy	Number of Epochs
Hierarchical Question-Image Co-attention	48.32%	42
MMF Transformer	51.76%	30
MMBT	86.78%	30

Test them for yourself !

Download the dataset from here and place it in a directory named /dataset/med-vqa-data/ in the directory where this repository is cloned.

MMF Transformer:

mmf_run config=projects/hateful_memes/configs/mmf_transformer/defaults.yaml     model=mmf_transformer     dataset=hateful_memes training.checkpoint_interval=100 training.max_updates=3000

MMBT :

mmf_run config=projects/hateful_memes/configs/mmbt/defaults.yaml     model=mmbt     dataset=hateful_memes training.checkpoint_interval=100 training.max_updates=3000

Heirarchical Question-Image Co-attention:

cd hierarchical \ 
python main.py

Owner

Kshitij Ambilduke

GitHub Repository

PyTorch Implementation of VAENAR-TTS: Variational Auto-Encoder based Non-AutoRegressive Text-to-Speech Synthesis.

VAENAR-TTS - PyTorch Implementation PyTorch Implementation of VAENAR-TTS: Variational Auto-Encoder based Non-AutoRegressive Text-to-Speech Synthesis.

67 Nov 14, 2022

Sentiment Analysis Project using Count Vectorizer and TF-IDF Vectorizer

Sentiment Analysis Project This project contains two sentiment analysis programs for Hotel Reviews using a Hotel Reviews dataset from Datafiniti. The

0 Mar 28, 2022

This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"

Pattern-Exploiting Training (PET) This repository contains the code for Exploiting Cloze Questions for Few-Shot Text Classification and Natural Langua

1.4k Dec 30, 2022

In this repository we have tested 3 VQA models on the ImageCLEF-2019 dataset.

Related tags

Overview

Med-VQA

Test them for yourself !

MMF Transformer:

MMBT :

Heirarchical Question-Image Co-attention:

Owner

Kshitij Ambilduke

PyTorch Implementation of VAENAR-TTS: Variational Auto-Encoder based Non-AutoRegressive Text-to-Speech Synthesis.

Sentiment Analysis Project using Count Vectorizer and TF-IDF Vectorizer

This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"

LV-BERT: Exploiting Layer Variety for BERT (Findings of ACL 2021)

👄 The most accurate natural language detection library for Python, suitable for long and short text alike

DziriBERT: a Pre-trained Language Model for the Algerian Dialect

SNCSE: Contrastive Learning for Unsupervised Sentence Embedding with Soft Negative Samples

내부 작업용 django + vue(vuetify) boilerplate. 짠 하면 돌아감.

Prompt tuning toolkit for GPT-2 and GPT-Neo

A framework for cleaning Chinese dialog data

This repository structures data in title, summary, tags, sentiment given a fragment of a conversation

Chinese named entity recognization (bert/roberta/macbert/bert_wwm with Keras)

Korean stereoypte detector with TUNiB-Electra and K-StereoSet

Dope Wars game engine on StarkNet L2 roll-up

Syntax-aware Multi-spans Generation for Reading Comprehension (TASLP 2022)

:id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.

A versatile token stream for handwritten parsers.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Python utility library for compositing PDF documents with reportlab.

Using BERT-based models for toxic span detection