Code for "Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments".

Last update: Nov 08, 2022

Overview

crfsrl

Yu Zhang, Qingrong Xia, Shilin Zhou, Yong Jiang, Zhenghua Li, Guohong Fu, Min Zhang. Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments. 2021. [arxiv]

Setup

The following packages should be installed:

SuPar: == 1.1.3
PyTorch: >= 1.7
Transformers: >= 4.0

Run the following scripts to obtain the training data. Please make sure PTB and OntoNotes are available:

bash scripts/conll05.sh PTB=<path-to-ptb>             SRL=data
bash scripts/conll12.sh ONTONOTES=<path-to-ontonotes> SRL=data

Run

Try the following commands to train first-order CRF and second-order CRF2o models:

# LSTM
# CRF
python -u crf.py   train -b -c configs/conll05.crf.srl.lstm.char-lemma.ini   -d 0 -f char lemma -p exp/conll05.crf.srl.lstm.char-lemma/model
# CRF2o
python -u crf2o.py train -b -c configs/conll05.crf2o.srl.lstm.char-lemma.ini -d 0 -f char lemma -p exp/conll05.crf2o.srl.lstm.char-lemma/model
# BERT finetuning
# CRF
python -u crf.py   train -b -c configs/conll05.crf.srl.bert.ini   -d 0 -p exp/conll05.crf.srl.bert/model   --batch-size=1000 --encoder bert --bert bert-large-cased 
# CRF2o
python -u crf2o.py train -b -c configs/conll05.crf2o.srl.bert.ini -d 0 -p exp/conll05.crf2o.srl.bert/model --batch-size=1000 --encoder bert --bert bert-large-cased

To do evaluation:

# end-to-end
python -u crf.py   evaluate -c configs/conll05.crf.srl.bert.ini  -d 0 -p exp/conll05.crf.srl.bert/model    --data data/conll05/test.conllu
# w/ gold predicates
python -u crf.py   evaluate -c configs/conll05.crf.srl.bert.ini  -d 0 -p exp/conll05.crf.srl.bert/model    --data data/conll05/test.conllu --prd

To make predictions:

python -u crf.py   predict  -c configs/conll05.crf.srl.bert.ini   -d 0 -p exp/conll05.crf.srl.bert/model   --data data/conll05/test.conllu --pred pred.conllu
bash scripts/eval.sh pred=pred.conllu gold=data/conll05/test.conllu

Contact

If you have any questions, feel free to contact me via emails.

Code for "Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments".

Related tags

Overview

crfsrl

Setup

Run

Contact

Owner

Yu Zhang

Translators - is a library which aims to bring free, multiple, enjoyable translation to individuals and students in Python

Finding Label and Model Errors in Perception Data With Learned Observation Assertions

Th2En & Th2Zh: The large-scale datasets for Thai text cross-lingual summarization

Chinese segmentation library

This is an incredibly powerful calculator that is capable of many useful day-to-day functions.

This is my reading list for my PhD in AI, NLP, Deep Learning and more.

A number of methods in order to perform Natural Language Processing on live data derived from Twitter

🤗🖼️ HuggingPics: Fine-tune Vision Transformers for anything using images found on the web.

[ICCV 2021] Instance-level Image Retrieval using Reranking Transformers

Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.

A python package to fine-tune transformer-based models for named entity recognition (NER).

Beyond Masking: Demystifying Token-Based Pre-Training for Vision Transformers

Journalism AI – Quotes extraction for modular journalism

🦆 Contextually-keyed word vectors

Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.

wxPython app for converting encodings, modifying and fixing SRT files

Telegram AI chat bot written in Python using Pyrogram

Sentence Embeddings with BERT & XLNet

Transformers and related deep network architectures are summarized and implemented here.

Ελληνικά νέα (Python script) / Greek News Feed (Python script)