Review on improving performance of Web Crawler and Search System Architecture

5 Pages Posted: 30 Jan 2019 Last revised: 22 Feb 2019

See all articles by Dinesh Rai

Dinesh Rai

Ansal University

Naresh Kumar

Maharaja Surajmal Institute of Technology

Jyoti Mor

Ansal University - School of Engineering and Technology

Date Written: 2018

Abstract

The W3 is a popular medium through which different types of users are disseminating information. The size of web is increasing exponentially today. Therefore, efficient searching of required content in minimal possible time becomes a matter of concern; with the increase in number of users per day. The current Web Crawler used for information retrieval have challenges associated with them. As these crawlers while accessing Web Pages consume network bandwidth, CPU Utilization and, memory utilization and other resources. So to improve the performance of Web Crawlers with reduced usage of resources is the need of the hour. Such Crawlers, having high Precision and Recall and less consumption of available resources are required to be developed.

Suggested Citation

Rai, Dinesh and Kumar, Naresh and Mor, Jyoti, Review on improving performance of Web Crawler and Search System Architecture (2018). International Journal of Advanced Studies of Scientific Research, Vol. 3, No. 10, 2018, Available at SSRN: https://ssrn.com/abstract=3318418

Dinesh Rai

Ansal University

Golf Course Road
Sector 55
Haryana, Gurgaon 122011
India

Naresh Kumar

Maharaja Surajmal Institute of Technology ( email )

C-4, Lal Sain Mandir Marg, Janak Puri
New Delhi, Delhi 110058
India

Jyoti Mor (Contact Author)

Ansal University - School of Engineering and Technology ( email )

Sector 55, Golf Course Road
Gurugram, 122003
India

Do you want regular updates from SSRN on Twitter?

Paper statistics

Downloads
73
Abstract Views
320
rank
428,632
PlumX Metrics