Using OpenAI's CLIP to upscale and enhance images

Last update: Jun 14, 2022

Overview

CLIP Upscaler and Enhancer

Using OpenAI's CLIP to upscale and enhance images

Based on nshepperd's JAX CLIP Guided Diffusion v2.4

Sample Results

Viewport	Original Image (512x512)	Using This Repo (scaled to 1024x1024 in 45 minutes)	Using Waifu2x (scaled to 1024x1024 in a few seconds)
Full Image
Zoomed In

How it works

Start with any image.
Find CLIP's embeddings of the image.
Resize the image to the desired resolution and add some noise.
Optimize the resized image for the original image's embeddings (using nshepperd's JAX CLIP Guided Diffusion v2.4).

Owner

Tripp Lyons

Blockchain/Ethereum/Solidity, Web Dev, Security

GitHub Repository

Subnet Replacement Attack: Towards Practical Deployment-Stage Backdoor Attack on Deep Neural Networks

Subnet Replacement Attack: Towards Practical Deployment-Stage Backdoor Attack on Deep Neural Networks Official implementation of paper Towards Practic

8 Dec 30, 2022

Confident Semantic Ranking Loss for Part Parsing

5 Oct 22, 2022

This is the official code of L2G, Unrolling and Recurrent Unrolling in Learning to Learn Graph Topologies.

Learning to Learn Graph Topologies This is the official code of L2G, Unrolling and Recurrent Unrolling in Learning to Learn Graph Topologies. Requirem

16 Dec 09, 2022

This package implements THOR: Transformer with Stochastic Experts.

THOR: Transformer with Stochastic Experts This PyTorch package implements Taming Sparsely Activated Transformer with Stochastic Experts. Installation

45 Nov 22, 2022

Code for EMNLP 2021 paper: "Learning Implicit Sentiment in Aspect-based Sentiment Analysis with Supervised Contrastive Pre-Training"

SCAPT-ABSA Code for EMNLP2021 paper: "Learning Implicit Sentiment in Aspect-based Sentiment Analysis with Supervised Contrastive Pre-Training" Overvie

66 Dec 04, 2022

Code to accompany the paper "Finding Bipartite Components in Hypergraphs", which is published in NeurIPS'21.

Finding Bipartite Components in Hypergraphs This repository contains code to accompany the paper "Finding Bipartite Components in Hypergraphs", publis

5 May 06, 2022

[CVPR'21] FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Space

FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Space by Quande Liu, Cheng Chen, Ji

178 Jan 06, 2023

PyTorch implementation for the paper Pseudo Numerical Methods for Diffusion Models on Manifolds

Pseudo Numerical Methods for Diffusion Models on Manifolds (PNDM) This repo is the official PyTorch implementation for the paper Pseudo Numerical Meth

196 Jan 05, 2023

「PyTorch Implementation of AnimeGANv2」を用いて、生成した顔画像を元の画像に上書きするデモ

AnimeGANv2-Face-Overlay-Demo PyTorch Implementation of AnimeGANv2を用いて、生成した顔画像を元の画像に上書きするデモです。

21 Oct 18, 2022

Tensors and neural networks in Haskell

Hasktorch Hasktorch is a library for tensors and neural networks in Haskell. It is an independent open source community project which leverages the co

920 Jan 04, 2023

Code for IntraQ, PyTorch implementation of our paper under review

IntraQ: Learning Synthetic Images with Intra-Class Heterogeneity for Zero-Shot Network Quantization paper Requirements Python = 3.7.10 Pytorch == 1.7

1 Nov 19, 2021

DeLighT: Very Deep and Light-Weight Transformers

DeLighT: Very Deep and Light-weight Transformers This repository contains the source code of our work on building efficient sequence models: DeFINE (I

440 Dec 18, 2022

CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation

CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation [arxiv] This is the official repository for CDTrans: Cross-domain Transformer for

238 Dec 22, 2022

StocksMA is a package to facilitate access to financial and economic data of Moroccan stocks.

Creating easier access to the Moroccan stock market data What is StocksMA ? StocksMA is a package to facilitate access to financial and economic data

28 Jan 04, 2023

Real-ESRGAN aims at developing Practical Algorithms for General Image Restoration.

Real-ESRGAN Colab Demo for Real-ESRGAN . Portable Windows executable file. You can find more information here. Real-ESRGAN aims at developing Practica

17.2k Jan 02, 2023

Company clustering with K-means/GMM and visualization with PCA, t-SNE, using SSAN relation extraction

RE results graph visualization and company clustering Installation pip install -r requirements.txt python -m nltk.downloader stopwords python3.7 main.

1 Oct 06, 2022

A Planar RGB-D SLAM which utilizes Manhattan World structure to provide optimal camera pose trajectory while also providing a sparse reconstruction containing points, lines and planes, and a dense surfel-based reconstruction.

ManhattanSLAM Authors: Raza Yunus, Yanyan Li and Federico Tombari ManhattanSLAM is a real-time SLAM library for RGB-D cameras that computes the camera

117 Dec 28, 2022

Using OpenAI's CLIP to upscale and enhance images

Related tags

Overview

CLIP Upscaler and Enhancer

Sample Results

How it works

Owner

Tripp Lyons

Subnet Replacement Attack: Towards Practical Deployment-Stage Backdoor Attack on Deep Neural Networks

Confident Semantic Ranking Loss for Part Parsing

This is the official code of L2G, Unrolling and Recurrent Unrolling in Learning to Learn Graph Topologies.

This package implements THOR: Transformer with Stochastic Experts.

Code for EMNLP 2021 paper: "Learning Implicit Sentiment in Aspect-based Sentiment Analysis with Supervised Contrastive Pre-Training"

Code to accompany the paper "Finding Bipartite Components in Hypergraphs", which is published in NeurIPS'21.

[CVPR'21] FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Space

PyTorch implementation for the paper Pseudo Numerical Methods for Diffusion Models on Manifolds

「PyTorch Implementation of AnimeGANv2」を用いて、生成した顔画像を元の画像に上書きするデモ

Tensors and neural networks in Haskell

Code for IntraQ, PyTorch implementation of our paper under review

DeLighT: Very Deep and Light-Weight Transformers

CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation

StocksMA is a package to facilitate access to financial and economic data of Moroccan stocks.

Real-ESRGAN aims at developing Practical Algorithms for General Image Restoration.

Company clustering with K-means/GMM and visualization with PCA, t-SNE, using SSAN relation extraction

A Planar RGB-D SLAM which utilizes Manhattan World structure to provide optimal camera pose trajectory while also providing a sparse reconstruction containing points, lines and planes, and a dense surfel-based reconstruction.

Fast algorithms to compute an approximation of the minimal volume oriented bounding box of a point cloud in 3D.

Attentive Implicit Representation Networks (AIR-Nets)

Training deep models using anime, illustration images.