Analysis of Big Data using Apache Spark

6 Pages Posted: 28 May 2020

See all articles by Ankur Saxena

Ankur Saxena

Amity University

Monika Chand

affiliation not provided to SSRN

Chetna Shakya

Amity University

Gagandeep Singh Gagandeep Singh Saggu

affiliation not provided to SSRN

Deepesh Saha

IBS Hyderabad (A Constituent of the ICFAI Foundation for Higher Education, a Deemed University)

Inish Krishna Shreshtha

Amity University

Date Written: April 4, 2020

Abstract

Data analysis is concerned with the automatic extraction of data related information from variety of sources. Although most analytical model addresses commercial tasks, such as product reviews, there is increasing interest in the affective dimension of the social media websites and various other sources. The current analytical models are not ideally suited for real time analysis of data. This model will collect data from sources of structured and un-structured data; it will filter the relevant data from the raw data in real time or stored data and make it useful for analysis and process it. Hence, such model will be successful in the sense of performing real time analysis than the current ones.

Keywords: Big Data; Large Dataset; Hadoop; HDFS; Spark; SparkSQL; RDD; Python; Java

Suggested Citation

Saxena, Ankur and Chand, Monika and Shakya, Chetna and Singh Gagandeep Singh Saggu, Gagandeep and Saha, Deepesh and Shreshtha, Inish Krishna, Analysis of Big Data using Apache Spark (April 4, 2020). Available at SSRN: https://ssrn.com/abstract=3568360

Ankur Saxena (Contact Author)

Amity University ( email )

Amity Institute of Biotechnology
Amity University, Sector 125
Noida, Uttar Pradesh 2013003
India

Monika Chand

affiliation not provided to SSRN

Chetna Shakya

Amity University ( email )

ASET- IT Department, Sec-125
Amity University, Sector 125
Noida, UT Uttar Pradesh 2013003
India

Gagandeep Singh Gagandeep Singh Saggu

affiliation not provided to SSRN

Deepesh Saha

IBS Hyderabad (A Constituent of the ICFAI Foundation for Higher Education, a Deemed University) ( email )

Dontanapalli
Shankerpalli Road, Hyderabad 501203,
Telangana
India

Inish Krishna Shreshtha

Amity University ( email )

ASET- IT Department, Sec-125
Amity University, Sector 125
Noida, UT Uttar Pradesh 2013003
India

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
33
Abstract Views
164
PlumX Metrics