Open source video recolor code

Recolor is a hot research field in visual media editing , It is widely used in film production and art design , It plays an important role in color editing of image and video .

At present, there are two kinds of palette based image recolor methods ： The first method extracts the image palette by clustering , And then through RBF Interpolation obtains the weight of each pixel about the cluster center for image recolor editing . The second method extracts the image palette by computing the convex hull . This kind of method regards the image as RGB Point set of color space , The convex hull of the point set is calculated and further simplified . And then through MVC The weight of each pixel about the palette is obtained by interpolation , Finally, the color palette is modified to realize the recolor of the image .

According to research , At present, most palette based color editing mainly focuses on the image field , No palette based video recolor algorithm has been proposed . Some classic methods, such as edit propagation and color migration, can edit the color of images or videos , But these methods only support very limited user editing . Because this kind of method can automatically calculate the target image （ video ） And reference image （ video ） Correlation at the color and semantic levels and automatic migration .

In this paper, we propose a method based on 4D Video recolor algorithm of Geometric Palette , This method treats video as RGBT The set of points in space , To build the point set 4D Polyhedron as the geometry palette for this video . A lot of experiments show that , The palette generated by this method has high reconstruction accuracy and compactness , The geometry of the palette corresponds well to the color changes of the video . meanwhile , This method supports simple 、 Efficient 、 Natural video recolor editing .

The article was published in ：ACM SIGGRAPH 2021
Address of thesis ：Video Recoloring via Spatial-Temporal Geometric Palettes
Project code ：https://github.com/Zhengjun-Du/GeometricPaletteBasedVideoRecoloring