CONditionals for Ordinal Regression and classification in PyTorch

Last update: Jul 25, 2022

Related tags

Deep Learning condor_pytorch

Overview

CONDOR pytorch implementation for ordinal regression with deep neural networks.

Documentation: https://GarrettJenkinson.github.io/condor_pytorch

About

CONDOR, short for CONDitionals for Ordinal Regression, is a method for ordinal regression with deep neural networks, which addresses the rank inconsistency issue of other ordinal regression frameworks.

It is compatible with any state-of-the-art deep neural network architecture, requiring only modification of the output layer, the labels, the loss function.

This repository implements the CONDOR functionality (neural network layer, loss function, and dataset utilities) for convenient use. Examples are provided via the "Tutorials" that can be found on the documentation website at https://GarrettJenkinson.github.io/condor_pytorch.

We also have CONDOR implemented for Tensorflow.

Installation or Docker

You can install the latest stable release of condor_pytorch directly from Python's package index via pip by executing the following code from your command line:

pip install condor-pytorch

We also provide Dockerfile's to help get up and started quickly with condor_pytorch. The cpu image can be built and ran as follows, with tutorial jupyter notebooks built in.

# Create a docker image, only done once
docker build -t cpu_pytorch -f cpu.Dockerfile ./

# run image to serve a jupyter notebook
docker run -it -p 8888:8888 --rm cpu_pytorch

# how to run bash inside container (with python that will have deps)
docker run -u $(id -u):$(id -g) -it -p 8888:8888 --rm cpu_pytorch bash

An NVIDIA based gpu optimized container can be built and run as follows (without interactive ipynb capabilities).

# only needs to be built once
docker build -t gpu_pytorch -f gpu.Dockerfile ./

# use the image after building it
docker run -it -p 8888:8888 --rm gpu_pytorch

Cite as

If you use CONDOR as part of your workflow in a scientific publication, please consider citing the CONDOR repository with the following DOI:

Jenkinson, Khezeli, Oliver, Kalantari, Klee. Universally rank consistent ordinal regression in neural networks, arXiv:2110.07470, 2021.

@article{condor2021,
title = "Universally rank consistent ordinal regression in neural networks",
journal = "arXiv",
volume = "2110.07470",
year = "2021",
url = "https://arxiv.org/abs/2110.07470",
author = "Garrett Jenkinson and Kia Khezeli and Gavin R. Oliver and John Kalantari and Eric W. Klee",
keywords = "Deep learning, Ordinal regression, neural networks, Machine learning, Biometrics"
}

To Design and Implement Logistic Regression to Classify Between Benign and Malignant Cancer Types

To Design and Implement Logistic Regression to Classify Between Benign and Malignant Cancer Types, from a Database Taken From Dr. Wolberg reports his Clinic Cases.

1 Jul 31, 2022

Machine Learning From Scratch. Bare bones NumPy implementations of machine learning models and algorithms with a focus on accessibility. Aims to cover everything from linear regression to deep learning.

Machine Learning From Scratch About Python implementations of some of the fundamental Machine Learning models and algorithms from scratch. The purpose

21.8k Jan 9, 2023

Code for "3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop"

PyMAF This repository contains the code for the following paper: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop Hongwe

450 Dec 28, 2022

A very short and easy implementation of Quantile Regression DQN

Quantile Regression DQN Quantile Regression DQN a Minimal Working Example, Distributional Reinforcement Learning with Quantile Regression (https://arx

80 Sep 17, 2022

Source code and Dataset creation for the paper "Neural Symbolic Regression That Scales"

NeuralSymbolicRegressionThatScales Pytorch implementation and pretrained models for the paper "Neural Symbolic Regression That Scales", presented at I

35 Nov 25, 2022

[TIP 2021] SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

SADRNet Paper link: SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction Requirements python

Multimedia Computing Group, Nanjing University

99 Dec 30, 2022

Regression Metrics Calculation Made easy for tensorflow2 and scikit-learn

Regression Metrics Installation To install the package from the PyPi repository you can execute the following command: pip install regressionmetrics I

11 Dec 16, 2022

Implementation of Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learning

advantage-weighted-regression Implementation of Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learning, by Peng et al. (

1 Dec 2, 2021

Python script that analyses the given datasets and comes up with the best polynomial regression representation with the smallest polynomial degree possible

Python script that analyses the given datasets and comes up with the best polynomial regression representation with the smallest polynomial degree possible, to be the most reliable with the least complexity possible

2 Aug 1, 2022

Comments

src edits
Summary of edits:

added device as an argument of the functions to make them compatible when GPUs are used.

replaced torch.tile with repeat as it is unavailable in some versions of PyTorch.

worked with log probabilities and cumulative sum instead of product for numerical stability of ordinal_softmax
opened by kolmogorov01 0

Releases(v1.1.0)

v1.1.0(Feb 19, 2022)

This release includes the condor_negloglikeloss function that allows for maximum likelihood estimation of the network parameters.
Source code(tar.gz)
Source code(zip)
v1.0.1(Nov 1, 2021)

Source code(tar.gz)
Source code(zip)

CONditionals for Ordinal Regression and classification in PyTorch

Related tags

Overview

About

Installation or Docker

Cite as

You might also like...

To Design and Implement Logistic Regression to Classify Between Benign and Malignant Cancer Types

Machine Learning From Scratch. Bare bones NumPy implementations of machine learning models and algorithms with a focus on accessibility. Aims to cover everything from linear regression to deep learning.

Code for "3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop"

A very short and easy implementation of Quantile Regression DQN

Source code and Dataset creation for the paper "Neural Symbolic Regression That Scales"

[TIP 2021] SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Regression Metrics Calculation Made easy for tensorflow2 and scikit-learn

Implementation of Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learning

Python script that analyses the given datasets and comes up with the best polynomial regression representation with the smallest polynomial degree possible

Comments

src edits

Releases(v1.1.0)

v1.1.0(Feb 19, 2022)

v1.0.1(Nov 1, 2021)

Owner

The official implementation of the Hybrid Self-Attention NEAT algorithm

Robust fine-tuning of zero-shot models

High level network definitions with pre-trained weights in TensorFlow

Using Clinical Drug Representations for Improving Mortality and Length of Stay Predictions

Calling Julia from Python - an experiment on data loading

Pytorch implementation for Semantic Segmentation/Scene Parsing on MIT ADE20K dataset

LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentation (NeurIPS2021 Benchmark and Dataset Track)

Stock-history-display - something like a easy yearly review for your stock performance

The code for "Deep Level Set for Box-supervised Instance Segmentation in Aerial Images".

Heterogeneous Temporal Graph Neural Network

Shape Matching of Real 3D Object Data to Synthetic 3D CADs (3DV project @ ETHZ)

Code of our paper "Contrastive Object-level Pre-training with Spatial Noise Curriculum Learning"

Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch

EMNLP'2021: Simple Entity-centric Questions Challenge Dense Retrievers

[ICML 2021, Long Talk] Delving into Deep Imbalanced Regression

BisQue is a web-based platform designed to provide researchers with organizational and quantitative analysis tools for 5D image data. Users can extend BisQue by implementing containerized ML workflows.

Code for the paper "Training GANs with Stronger Augmentations via Contrastive Discriminator" (ICLR 2021)

Select, weight and analyze complex sample data

implementation of paper - You Only Learn One Representation: Unified Network for Multiple Tasks

This repository contains the database and code used in the paper Embedding Arithmetic for Text-driven Image Transformation