Loading [a11y]/accessibility-menu.js
Predicting Presentation Skill of a Speaker Using Automatic Speaker and Audience Measurement | IEEE Journals & Magazine | IEEE Xplore

Predicting Presentation Skill of a Speaker Using Automatic Speaker and Audience Measurement


Abstract:

Effective presentation skills are an important ability for students and professionals to possess. Automatic analysis of presentation skills can help provide feedback to a...Show More

Abstract:

Effective presentation skills are an important ability for students and professionals to possess. Automatic analysis of presentation skills can help provide feedback to a speaker, and a complete analysis is possible only with both speaker and audience measurement. In this article, we propose a methodology to predict presentation skills on a small dataset using a model learned on a larger and reasonably closer dataset, which we call the source dataset. A classroom-type multimodal dataset with videos of both the speaker and the audience was collected. A rich set of audio, visual, and textual cues were extracted that relate to the presentation skill of a speaker. The presentation skills and audience engagement are inferred using models learned on the source dataset, which is close to our data. The analysis shows that adaptation of the source model to the target domain data is required for better performance. Also, automatic prediction of audience engagement is done to analyze the relationship between audience engagement and the presentation skill of the speaker. The analysis shows that a weak correlation exists between the automatic audience engagement prediction and the audience rating given for the presentation skill of the speaker.
Published in: IEEE Transactions on Learning Technologies ( Volume: 15, Issue: 3, 01 June 2022)
Page(s): 350 - 363
Date of Publication: 03 May 2022

ISSN Information:

Funding Agency:

Author image of Chinchu Thomas
Multimodal Perception Lab, International Institute of Information Technology Bangalore, Bangalore, India
Chinchu Thomas received the B.Tech. degree in electronics and communication and the M.Tech. degree in signal processing from the Cochin University of Science and Technology, Kochi, India, in 2013 and 2015, respectively. She is currently working toward the Ph.D. degree in signal processing with the International Institute of Information Technology, Bangalore (IIIT-B), Bangalore, India.
Her research interests include multimo...Show More
Chinchu Thomas received the B.Tech. degree in electronics and communication and the M.Tech. degree in signal processing from the Cochin University of Science and Technology, Kochi, India, in 2013 and 2015, respectively. She is currently working toward the Ph.D. degree in signal processing with the International Institute of Information Technology, Bangalore (IIIT-B), Bangalore, India.
Her research interests include multimo...View more
Author image of Dinesh Babu Jayagopi
Multimodal Perception Lab, International Institute of Information Technology Bangalore, Bangalore, India
Dinesh Babu Jayagopi received the B.Tech. degree in electronics from the Madras Institute of Technology, Chennai, India, in 2001, the M.Tech. degree in system science and signal processing from the Indian Institute of Science, Bangalore, India, in 2003, and the Ph.D. degree in electrical and electronics engineering from Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, in 2011.
He is currently an Asso...Show More
Dinesh Babu Jayagopi received the B.Tech. degree in electronics from the Madras Institute of Technology, Chennai, India, in 2001, the M.Tech. degree in system science and signal processing from the Indian Institute of Science, Bangalore, India, in 2003, and the Ph.D. degree in electrical and electronics engineering from Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, in 2011.
He is currently an Asso...View more

Author image of Chinchu Thomas
Multimodal Perception Lab, International Institute of Information Technology Bangalore, Bangalore, India
Chinchu Thomas received the B.Tech. degree in electronics and communication and the M.Tech. degree in signal processing from the Cochin University of Science and Technology, Kochi, India, in 2013 and 2015, respectively. She is currently working toward the Ph.D. degree in signal processing with the International Institute of Information Technology, Bangalore (IIIT-B), Bangalore, India.
Her research interests include multimodal signal processing, machine learning, and social computing.
Chinchu Thomas received the B.Tech. degree in electronics and communication and the M.Tech. degree in signal processing from the Cochin University of Science and Technology, Kochi, India, in 2013 and 2015, respectively. She is currently working toward the Ph.D. degree in signal processing with the International Institute of Information Technology, Bangalore (IIIT-B), Bangalore, India.
Her research interests include multimodal signal processing, machine learning, and social computing.View more
Author image of Dinesh Babu Jayagopi
Multimodal Perception Lab, International Institute of Information Technology Bangalore, Bangalore, India
Dinesh Babu Jayagopi received the B.Tech. degree in electronics from the Madras Institute of Technology, Chennai, India, in 2001, the M.Tech. degree in system science and signal processing from the Indian Institute of Science, Bangalore, India, in 2003, and the Ph.D. degree in electrical and electronics engineering from Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, in 2011.
He is currently an Associate Professor with the Department of Data Science with the IIIT Bangalore, Bangalore, India, where he heads the Multimodal Perception Lab. His research interests include audio-visual signal processing, machine learning, and social computing.
Dinesh Babu Jayagopi received the B.Tech. degree in electronics from the Madras Institute of Technology, Chennai, India, in 2001, the M.Tech. degree in system science and signal processing from the Indian Institute of Science, Bangalore, India, in 2003, and the Ph.D. degree in electrical and electronics engineering from Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, in 2011.
He is currently an Associate Professor with the Department of Data Science with the IIIT Bangalore, Bangalore, India, where he heads the Multimodal Perception Lab. His research interests include audio-visual signal processing, machine learning, and social computing.View more
Contact IEEE to Subscribe

References

References is not available for this document.