Abstract:
Autism spectrum disorder (ASD) is a developmental disorder that impairs the development of social and communication skills. There is evidence that children with ASD prefe...Show MoreMetadata
Abstract:
Autism spectrum disorder (ASD) is a developmental disorder that impairs the development of social and communication skills. There is evidence that children with ASD prefer images of self over others[1] . These studies may explain the effectiveness of video self-modeling (VSM), an evidence-based ASD intervention in which one learns by watching oneself on video performing a target behavior. VSM content is difficult to create as target behaviors are sporadic. In this paper, we propose the MEBook system which uses a Kinect sensor to inject self-images into a gesture-based social narrative to teach children with ASD proper greeting behaviors. MEBook consists of two components. The first component is a social narrative. A social narrative is an animated story about the main character meeting and greeting different cartoon characters in a particular setting. Self-modeling is achieved by first replacing the main characters face with an image of the learner, and then animating the learner's body and voice to match the narration. The second component is a positive reinforcement practice session in which the subject is prompted to greet different cartoon characters. Through depth-based body posture tracking, proper greeting behaviors are recognized and immediately reinforced with praise and visual confetti. Novel computational multimedia tools are proposed to turn video recordings of successful attempts into VSM content, thereby alleviating the tedious production process. A multiple-baseline single subject pilot study has been conducted and the preliminary results show that MEBook is potentially effective in teaching greeting behaviors to children with ASD.
Published in: IEEE Transactions on Learning Technologies ( Volume: 11, Issue: 4, 01 Oct.-Dec. 2018)
Funding Agency:
Department of Electrical and Computer Engineering, University of Kentucky, Lexington, KY
Nkiruka Uzuegbunam is a 5th year PhD candidate in the Department of Electrical and Computer Engineering, University of Kentucky, Lexington, Kentucky. Her research is in the development of algorithms and systems at the intersection of computer vision, multimedia, and healthcare. She is a member of the IEEE.
Nkiruka Uzuegbunam is a 5th year PhD candidate in the Department of Electrical and Computer Engineering, University of Kentucky, Lexington, Kentucky. Her research is in the development of algorithms and systems at the intersection of computer vision, multimedia, and healthcare. She is a member of the IEEE.View more
Educational, School, and Counseling Psychology Department, University of Kentucky, Lexington, KY
Wing Hang Wong is a graduate student in school psychology at the, University of Kentucky, Lexington, Kentucky. She is interested in the application of technology on treatments for individuals with autism spectrum disorder and their families.
Wing Hang Wong is a graduate student in school psychology at the, University of Kentucky, Lexington, Kentucky. She is interested in the application of technology on treatments for individuals with autism spectrum disorder and their families.View more
Department of Electrical and Computer Engineering, University of Kentucky, Lexington, KY
Sen-Ching Samson Cheung (M'91-SM'07) received the PhD degree from the University of California, Berkeley, California, in 2002. He is a professor of the Department of Electrical and Computer Engineering, University of Kentucky (UKY), Lexington, Kentucky. Before joining UKY in 2004, he was a computer scientist with the Scientific Data Mining Group, Lawrence Livermore National Laboratory. His work spans a num...Show More
Sen-Ching Samson Cheung (M'91-SM'07) received the PhD degree from the University of California, Berkeley, California, in 2002. He is a professor of the Department of Electrical and Computer Engineering, University of Kentucky (UKY), Lexington, Kentucky. Before joining UKY in 2004, he was a computer scientist with the Scientific Data Mining Group, Lawrence Livermore National Laboratory. His work spans a num...View more
Educational, School, and Counseling Psychology Department, University of Kentucky, Lexington, KY
Lisa Ruble received the BS degree in biology from Indiana University, Bloomington, Indiana, in 1985, the MS degree in rehabilitation psychology from Purdue University, Indianapolis, Indiana, in 1992, and the PhD degree in educational psychology from Indiana University, in 1998. She completed her clinical psychology internship with the University of Minnesota Medical School, in 1997. In 1998, she helped est...Show More
Lisa Ruble received the BS degree in biology from Indiana University, Bloomington, Indiana, in 1985, the MS degree in rehabilitation psychology from Purdue University, Indianapolis, Indiana, in 1992, and the PhD degree in educational psychology from Indiana University, in 1998. She completed her clinical psychology internship with the University of Minnesota Medical School, in 1997. In 1998, she helped est...View more
Contents Department of Electrical and Computer Engineering, University of Kentucky, Lexington, KY
Nkiruka Uzuegbunam is a 5th year PhD candidate in the Department of Electrical and Computer Engineering, University of Kentucky, Lexington, Kentucky. Her research is in the development of algorithms and systems at the intersection of computer vision, multimedia, and healthcare. She is a member of the IEEE.
Nkiruka Uzuegbunam is a 5th year PhD candidate in the Department of Electrical and Computer Engineering, University of Kentucky, Lexington, Kentucky. Her research is in the development of algorithms and systems at the intersection of computer vision, multimedia, and healthcare. She is a member of the IEEE.View more
Educational, School, and Counseling Psychology Department, University of Kentucky, Lexington, KY
Wing Hang Wong is a graduate student in school psychology at the, University of Kentucky, Lexington, Kentucky. She is interested in the application of technology on treatments for individuals with autism spectrum disorder and their families.
Wing Hang Wong is a graduate student in school psychology at the, University of Kentucky, Lexington, Kentucky. She is interested in the application of technology on treatments for individuals with autism spectrum disorder and their families.View more
Department of Electrical and Computer Engineering, University of Kentucky, Lexington, KY
Sen-Ching Samson Cheung (M'91-SM'07) received the PhD degree from the University of California, Berkeley, California, in 2002. He is a professor of the Department of Electrical and Computer Engineering, University of Kentucky (UKY), Lexington, Kentucky. Before joining UKY in 2004, he was a computer scientist with the Scientific Data Mining Group, Lawrence Livermore National Laboratory. His work spans a number of different areas in multimedia, including video copy detection, data mining, video surveillance, privacy protection, encrypted domain signal processing, and computational multimedia for therapy. He is/was an associate editor of the IEEE Transactions of Multimedia, the IEEE Transactions on Information Forensics and Security, the Signal Processing: Image Communications, the EURASIP Journal on Information Security, and the ASA Journal on Statistical Analysis and Data Mining. He is a senior member of the IEEE and the ACM.
Sen-Ching Samson Cheung (M'91-SM'07) received the PhD degree from the University of California, Berkeley, California, in 2002. He is a professor of the Department of Electrical and Computer Engineering, University of Kentucky (UKY), Lexington, Kentucky. Before joining UKY in 2004, he was a computer scientist with the Scientific Data Mining Group, Lawrence Livermore National Laboratory. His work spans a number of different areas in multimedia, including video copy detection, data mining, video surveillance, privacy protection, encrypted domain signal processing, and computational multimedia for therapy. He is/was an associate editor of the IEEE Transactions of Multimedia, the IEEE Transactions on Information Forensics and Security, the Signal Processing: Image Communications, the EURASIP Journal on Information Security, and the ASA Journal on Statistical Analysis and Data Mining. He is a senior member of the IEEE and the ACM.View more
Educational, School, and Counseling Psychology Department, University of Kentucky, Lexington, KY
Lisa Ruble received the BS degree in biology from Indiana University, Bloomington, Indiana, in 1985, the MS degree in rehabilitation psychology from Purdue University, Indianapolis, Indiana, in 1992, and the PhD degree in educational psychology from Indiana University, in 1998. She completed her clinical psychology internship with the University of Minnesota Medical School, in 1997. In 1998, she helped establish TRIAD, Vanderbilt University. In 2002, she established the STAR Program with the University of Louisville. She received the New Investigator Award from the National Institute of Mental Health in 2005. Since 2007, she has been a faculty member with the Department of Educational, School and Counseling Psychology, University of Kentucky. In 2017, she was recognized as a University of Kentucky Research Professor. Her research focuses on implementation science and randomized controlled trials of the Collaborative Model for Promoting Competence and Success (COMPASS), an intervention designed to enhance quality of life outcomes of individuals with autism spectrum disorder.
Lisa Ruble received the BS degree in biology from Indiana University, Bloomington, Indiana, in 1985, the MS degree in rehabilitation psychology from Purdue University, Indianapolis, Indiana, in 1992, and the PhD degree in educational psychology from Indiana University, in 1998. She completed her clinical psychology internship with the University of Minnesota Medical School, in 1997. In 1998, she helped establish TRIAD, Vanderbilt University. In 2002, she established the STAR Program with the University of Louisville. She received the New Investigator Award from the National Institute of Mental Health in 2005. Since 2007, she has been a faculty member with the Department of Educational, School and Counseling Psychology, University of Kentucky. In 2017, she was recognized as a University of Kentucky Research Professor. Her research focuses on implementation science and randomized controlled trials of the Collaborative Model for Promoting Competence and Success (COMPASS), an intervention designed to enhance quality of life outcomes of individuals with autism spectrum disorder.View more
