Interactive Dance Lessons through Human Body Pose Estimation and Skeletal Topographies Matching

6 Pages Posted: 28 Mar 2019

See all articles by Suman Deb

Suman Deb

National Institute of Technology (NIT), Agartala - CSE Department

Alpana Sharan

National Institute of Technology (NIT), Agartala - CSE Department

Shivangi Chaturvedi

National Institute of Technology (NIT), Agartala - CSE Department

Ankit Arun

National Institute of Technology Agartala, Students

Aayush Gupta

National Institute of Technology (NIT), Agartala - CSE Department

Date Written: 2018

Abstract

During elementary period of learning, children are enthusiastic and spontaneous. This is very intuitive and natural human behaviour. But, the growth of affordable mobile devices have given us the possibility to experience diverse learning without physical movement. It is a considerable threat towards their physical and mental development. In this work, we tried to explore the possibilities of natural human-movement interaction with machine through ExerLearning experience, that is, gamified learning through exercise. We device a learning game for teaching simple dance moves to children which encourages them to perform a pose to match the given dance move. The findings of this work are very encouraging for stimulating students to perform exercise while learning, which effectively shortens the learning time with increased enthusiasm toward the content. Though ExerLearning approaches have been in practice with special devices, our stress on work was cost effective skeletal movement design, independent of body markers and special devices. We attempt to replace conventional skeleton tracking, provided by devices such as Microsoft Kinect, with a single camera, leveraging the power of Deep Learning to perform the same task. The anecdotal description and quantitative data reveals the effect of the enhanced learning outcome on the participants. The design recommendations base on the experimental data can pave a new paradigm of interactive and cost effective ExerLearning.

Suggested Citation

Deb, Suman and Sharan, Alpana and Chaturvedi, Shivangi and Arun, Ankit and Gupta, Aayush, Interactive Dance Lessons through Human Body Pose Estimation and Skeletal Topographies Matching (2018). International Journal of Computational Intelligence & IoT, Vol. 2, No. 4, 2018, Available at SSRN: https://ssrn.com/abstract=3361142

Suman Deb

National Institute of Technology (NIT), Agartala - CSE Department

India

Alpana Sharan (Contact Author)

National Institute of Technology (NIT), Agartala - CSE Department ( email )

India

Shivangi Chaturvedi

National Institute of Technology (NIT), Agartala - CSE Department ( email )

India

Ankit Arun

National Institute of Technology Agartala, Students ( email )

Agartala
India

HOME PAGE: http://arnitkun.github.io

Aayush Gupta

National Institute of Technology (NIT), Agartala - CSE Department ( email )

India

Here is the Coronavirus
related research on SSRN

Paper statistics

Downloads
291
Abstract Views
1,117
rank
117,242
PlumX Metrics