Video Summarization Using Feature Vector Clustering

9 Pages Posted: 2 Dec 2020

See all articles by Yash Dhamecha

Yash Dhamecha

College of Engineering Pune (COEP)

Swanand Gadekara

College of Engineering Pune (COEP)

Sai Deshmukh

College Of Engineering Pune

Yashodhara Haribhakta

College of Engineering Pune (COEP)

Date Written: November 21, 2020

Abstract

With ever-growing utilization of online and offline videos and increasing video content, Video Summarization serves as the best aid for video browsing. It involves domain explicit semantic comprehension of a video and understanding of user expectations. Generally, video summarization systems include extracting video features, analyzing the visual variations and selecting video frames. Over the years, various methodologies have been developed for the same. Different supervised and unsupervised algorithms have been established and these models have been trained on various factors or various rewards. The challenges these methods face stand as a motivation for the approach this paper discusses. Like in many cases, summary frames may be repeated if some scene or concept appears more than once. This paper presents a novel approach based on clustering of video frames based on their feature vectors. The clustering takes into consideration the semantic factor of video frames. Each concept cluster gives a representative frame which then forms the summary set, here concept cluster refers to the independent entity present in a video which can be easily distinguished by another concept or entity. This entity can be a scene of a mountain or different persons. It also aims to increase system performance by removing the redundancy. The system is developed using a CNN for feature extraction and a clustering algorithm that takes into consideration the similarity factor between these vectors. The model is evaluated on the measures Precision and Recall and tested on the VSUMM dataset. The results outperform some of the established methodologies and serve the summarization purpose.

Keywords: Video Summarization, Clustering, Feature Vectors, Semantic factor

Suggested Citation

Dhamecha, Yash and Gadekara, Swanand and Deshmukh, Sai and Haribhakta, Yashodhara, Video Summarization Using Feature Vector Clustering (November 21, 2020). Proceedings of the 2nd International Conference on IoT, Social, Mobile, Analytics & Cloud in Computational Vision & Bio-Engineering (ISMAC-CVB 2020), Available at SSRN: https://ssrn.com/abstract=3734732 or http://dx.doi.org/10.2139/ssrn.3734732

Yash Dhamecha (Contact Author)

College of Engineering Pune (COEP) ( email )

shivajinagr Pune
Pune, MA 411 005
India

Swanand Gadekara

College of Engineering Pune (COEP) ( email )

shivajinagr Pune
Pune, MA 411 005
India

Sai Deshmukh

College Of Engineering Pune ( email )

shivajinagr Pune
Pune, MA 411 005
India

Yashodhara Haribhakta

College of Engineering Pune (COEP) ( email )

shivajinagr Pune
Pune, MA 411 005
India

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
36
Abstract Views
251
PlumX Metrics