D2F: Description to Face Synthesis Using GAN

8 Pages Posted: 8 Oct 2020 Last revised: 13 Oct 2020

See all articles by Chintan Kotian

Chintan Kotian

Atharva College Of Engineering

Samiksha Lokhande

Atharva College Of Engineering

Mohit Jain

Atharva College Of Engineering

Aruna Pavate

Atharva College Of Engineering

Date Written: June 26, 2020

Abstract

All the recent breakthroughs in the field of deep learning have enabled us to extract lower dimension knowledge from higher dimension data, this has led to state of the art utilization of tremendous data. At the same time, the generative aspect of deep learning models are rapidly emerging, out of all the generative models Generative Adversarial Networks (GANs) are immensely popular due to its ease of implementation and enhanced performance. Tasks like mapping textual data to visual data (i.e. lower dimension to higher dimension) is a feat which is still not easily achievable even by experts. The challenge here is extracting every possible information from lower dimension data to generate comparatively higher dimension data. This work collaborates GANs and Natural Language Processing (NLP) to come up with a model which will effectively translate human facial features from characters to pixels. In other words the model will generate realistic human faces given the description of the faces. This paper compares different architectures of GANs trained on different datasets. It also specifies dataset collection method using crowd intelligence and also proposes a deep learning model for description to face synthesis.

Keywords: NLP, GAN, Face2Text ,Transfer learning, Generative model

Suggested Citation

Kotian, Chintan and Lokhande, Samiksha and Jain, Mohit and Pavate, Aruna, D2F: Description to Face Synthesis Using GAN (June 26, 2020). Available at SSRN: https://ssrn.com/abstract=3697374 or http://dx.doi.org/10.2139/ssrn.3697374

Chintan Kotian (Contact Author)

Atharva College Of Engineering ( email )

Mumbai
India

Samiksha Lokhande

Atharva College Of Engineering ( email )

Mumbai
India

Mohit Jain

Atharva College Of Engineering ( email )

Mumbai
India

Aruna Pavate

Atharva College Of Engineering ( email )

Mumbai
India

Here is the Coronavirus
related research on SSRN

Paper statistics

Downloads
112
Abstract Views
284
rank
279,503
PlumX Metrics