An Overview of Controllable Image Synthesis: Current Challenges and Future Trends

41 Pages Posted: 10 Aug 2022

See all articles by Shanshan Huang

Shanshan Huang

Chongqing University

Qingsong Li

Chongqing University

Jun Liao

Chongqing University

Li Liu

Chongqing University

Lian Li

Hefei University of Technology

Abstract

Controllable image synthesis is a method by which users can manipulate a particular attribute in an image in a semantically meaningful way without affecting other attributes. This research has been a hot topic in image processing, with significant advances in visual authenticity, diversity, and controllability over the past few years. However, there are still some challenges in this field, such as the controllability and interpretability of synthesis images. This paper is the first comprehensive and systematic discussion of controllable image synthesis, from problem definition, taxonomy and evaluation systems to existing challenges and future research directions. Firstly, the definition of controllable image synthesis is given, and several representative deep generative models are introduced in detail. Secondly, the existing controllable image synthesis methods are divided into three categories according to the different control manners used and discuss the typical work in each category critically. Next, this paper introduces the public datasets and evaluation metrics commonly used in image synthesis and analyzes the representative controllable image synthesis methods. Finally, we summarize the whole literature, and some open topics and future development direction of controllable image synthesis are discussed.

Keywords: Controllable Image Synthesis, Generative adversarial networks, Causal Inference, GAN Inversion

Suggested Citation

Huang, Shanshan and Li, Qingsong and Liao, Jun and Liu, Li and Li, Lian, An Overview of Controllable Image Synthesis: Current Challenges and Future Trends. Available at SSRN: https://ssrn.com/abstract=4187269

Shanshan Huang

Chongqing University ( email )

Shazheng Str 174, Shapingba District
Shazheng street, Shapingba district
Chongqing 400044, 400030
China

Qingsong Li

Chongqing University ( email )

Shazheng Str 174, Shapingba District
Shazheng street, Shapingba district
Chongqing 400044, 400030
China

Jun Liao

Chongqing University ( email )

Shazheng Str 174, Shapingba District
Shazheng street, Shapingba district
Chongqing 400044, 400030
China

Li Liu (Contact Author)

Chongqing University ( email )

Shazheng Str 174, Shapingba District
Shazheng street, Shapingba district
Chongqing 400044, 400030
China

Lian Li

Hefei University of Technology ( email )

193 Tunxi Rd
Baohe
Hefei
China

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
220
Abstract Views
469
Rank
259,435
PlumX Metrics