A Survey: Optimization Algorithms In Deep Learning

9 Pages Posted: 1 Apr 2020

See all articles by Anshul Tripathi

Anshul Tripathi

UIT RGPV Bhopal

Uday Chourasia

UIT RGPV Bhopal

Shivendra Dubey

UIT RGPV Bhopal

Arundhati Arjaria

UIT RGPV Bhopal

Priyanka Dixit

UIT RGPV Bhopal

Date Written: March 31, 2020

Abstract

Intelligent Systems or Smart Systems plays an important role in our day to day life. Deep learning (DL) is portray day by day a key role in our lives. It makes our work easier and efficient. It has already made a colossal impression in different areas, like cancer treatment diagnosis, in the quality of inventing new antibiotic, self-driving cars, foretelling of precognition and speech recognition. The meticulous domestic characteristics remover used in conventional knowledge, classification, and pattern recognition systems are not adaptable for massive-sized data sets. In many situations, confide in on the problem complication, DL can also beat the shortcomings of prior trivial networks that hindered productive training and thinking of hierarchical portrayal of multi-dimensional training data. A lot of parts of units comprised with enhanced algorithm and architecture used by DNN. The current survey retrospect’s a few optimization methods to boost the perfection of the training and to decrease time of training. We leave no stone unturn into the math back of training algorithms used in current deep networks. We define current shortcomings, enhancements, and implementations. The survey also canvas distant types of planning like intricacy networks, deep learning networks, frequent neural networks, increase learning areas & patterns variation auto encoders that aims to learn depiction for a set of data, typically for dimensionality contraction, by practicing the network to avoid signal “noise’’ and others.

Keywords: Intelligent system, deep learning, classification, optimization methods

Suggested Citation

Tripathi, Anshul and Chourasia, Uday and Dubey, Shivendra and Arjaria, Arundhati and Dixit, Priyanka, A Survey: Optimization Algorithms In Deep Learning (March 31, 2020). Proceedings of the International Conference on Innovative Computing & Communications (ICICC) 2020, Available at SSRN: https://ssrn.com/abstract=3564978 or http://dx.doi.org/10.2139/ssrn.3564978

Anshul Tripathi (Contact Author)

UIT RGPV Bhopal ( email )

RGPV
Bhopal
Bhopal, CO MP 374889
India

Uday Chourasia

UIT RGPV Bhopal ( email )

RGPV
Bhopal
Bhopal, CO MP 374889
India

Shivendra Dubey

UIT RGPV Bhopal ( email )

RGPV
Bhopal
Bhopal, CO MP 374889
India

Arundhati Arjaria

UIT RGPV Bhopal ( email )

RGPV
Bhopal
Bhopal, CO MP 374889
India

Priyanka Dixit

UIT RGPV Bhopal ( email )

RGPV
Bhopal
Bhopal, CO MP 374889
India

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
211
Abstract Views
1,358
Rank
310,425
PlumX Metrics