Abstract:
Autism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by core deficits in social interaction and communication. Collaborative puzzle games are int...Show MoreMetadata
Abstract:
Autism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by core deficits in social interaction and communication. Collaborative puzzle games are interactive activities that can be played to foster the collaboration and verbal-communication skills of children with ASD. In this article, we have designed an intelligent agent that can play collaborative puzzle games with children and verbally communicate with them as if it is another human player. Furthermore, this intelligent agent is also able to automatically measure children's task-performance and verbal-communication behaviors throughout the game play. Two preliminary studies were conducted with children with ASD to evaluate the feasibility and performance of the intelligent agent. Results of Study I demonstrated the intelligent agent's ability to play games and communicate with children within the game-playing domain. Results of Study II indicated its potential to measure the communication and collaboration skills of human users.
Published in: IEEE Transactions on Learning Technologies ( Volume: 14, Issue: 3, 01 June 2021)
Funding Agency:
Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, USA
Robotics and Autonomous Systems Laboratory, Vanderbilt University, Nashville, TN, USA
Lian Zhang received the M.S. degree from the School of Automation Science and Electrical Engineering, Beihang University, Beijing, China, in 2012, and the Ph.D. degree in electrical engineering from, Vanderbilt University, Nashville, TN, USA, in 2018.
She is currently working as a Software Engineer with Facebook, CA, USA. Her research interests include affective computing, virtual reality, machine learning, and human–compu...Show More
Lian Zhang received the M.S. degree from the School of Automation Science and Electrical Engineering, Beihang University, Beijing, China, in 2012, and the Ph.D. degree in electrical engineering from, Vanderbilt University, Nashville, TN, USA, in 2018.
She is currently working as a Software Engineer with Facebook, CA, USA. Her research interests include affective computing, virtual reality, machine learning, and human–compu...View more
Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, USA
Robotics and Autonomous Systems Laboratory, Vanderbilt University, Nashville, TN, USA
Ashwaq Zaini Amat received the B.Eng. degree in electrical and biomedical engineering from Vanderbilt University, Nashville, TN, USA, in 2009, and the M.S. degree in embedded systems engineering from the University of Leeds, Leeds, U.K., in 2014. She is currently working toward the Ph.D. degree in electrical engineering with the Department of Electrical Engineering and Computer Science, Vanderbilt University.
From 2009 to ...Show More
Ashwaq Zaini Amat received the B.Eng. degree in electrical and biomedical engineering from Vanderbilt University, Nashville, TN, USA, in 2009, and the M.S. degree in embedded systems engineering from the University of Leeds, Leeds, U.K., in 2014. She is currently working toward the Ph.D. degree in electrical engineering with the Department of Electrical Engineering and Computer Science, Vanderbilt University.
From 2009 to ...View more
Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, USA
Robotics and Autonomous Systems Laboratory, Vanderbilt University, Nashville, TN, USA
Huan Zhao received the Ph.D. degrees in electrical engineering from Vanderbilt University, Nashville, TN, USA, in 2020, both in electrical engineering.
Her research interests include the design and development of systems for special needs using the technologies of virtual reality, machine learning, artificial intelligence, human–machine interaction, and robotics.
Huan Zhao received the Ph.D. degrees in electrical engineering from Vanderbilt University, Nashville, TN, USA, in 2020, both in electrical engineering.
Her research interests include the design and development of systems for special needs using the technologies of virtual reality, machine learning, artificial intelligence, human–machine interaction, and robotics.View more
Vanderbilt Kennedy Center, Treatment and Research Institute for Autism Spectrum Disorders, Nashville, TN, USA
Amy R. Swanson is currently with the Vanderbilt Kennedy Center's Treatment and Research Institute for Autism Spectrum Disorders (TRIAD), Nashville, TN, USA, where she has worked for 15 years. Here research interests include technology-based intervention and training mechanisms to serve both pediatric health care providers and families of young children with autism spectrum disorder.
Amy R. Swanson is currently with the Vanderbilt Kennedy Center's Treatment and Research Institute for Autism Spectrum Disorders (TRIAD), Nashville, TN, USA, where she has worked for 15 years. Here research interests include technology-based intervention and training mechanisms to serve both pediatric health care providers and families of young children with autism spectrum disorder.View more
Department of Pediatrics, Vanderbilt University Medical Center, Treatment and Research Institute for Autism Spectrum Disorders, Nashville, TN, USA
Amy S. Weitlauf received the Ph.D. degree in clinical psychology from Vanderbilt University, Nashville, TN, USA, in 2011.
She was as Intern at the University of North Carolina at Chapel Hill, Chapel Hill, NC, USA, and a Postdoctoral Fellow at the Vanderbilt Kennedy Center Treatment and Research Institute for Autism Spectrum Disorders (TRIAD). Nashville. She is currently an Assistant Professor of Pediatrics with Vanderbilt ...Show More
Amy S. Weitlauf received the Ph.D. degree in clinical psychology from Vanderbilt University, Nashville, TN, USA, in 2011.
She was as Intern at the University of North Carolina at Chapel Hill, Chapel Hill, NC, USA, and a Postdoctoral Fellow at the Vanderbilt Kennedy Center Treatment and Research Institute for Autism Spectrum Disorders (TRIAD). Nashville. She is currently an Assistant Professor of Pediatrics with Vanderbilt ...View more
Department of Pediatrics, Vanderbilt University Medical Center, Treatment and Research Institute for Autism Spectrum Disorders, Nashville, TN, USA
Zachary E. Warren received the Ph.D. degree in clinical psychology from the University of Miami, Miami, FL, USA, in 2005.
He was an Intern at Children's Hospital Boston/Harvard Medical School, Boston, MA, USA, and a Postdoctoral Fellow at the Medical University of South Carolina, Charleston, SC, USA. He is currently a Professor of Pediatrics, Special Education, and Psychiatry and Behavioral Sciences, and the Executive Dire...Show More
Zachary E. Warren received the Ph.D. degree in clinical psychology from the University of Miami, Miami, FL, USA, in 2005.
He was an Intern at Children's Hospital Boston/Harvard Medical School, Boston, MA, USA, and a Postdoctoral Fellow at the Medical University of South Carolina, Charleston, SC, USA. He is currently a Professor of Pediatrics, Special Education, and Psychiatry and Behavioral Sciences, and the Executive Dire...View more
Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, USA
Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, USA
Robotics and Autonomous Systems Laboratory, Vanderbilt University, Nashville, TN, USA
Nilanjan Sarkar (Senior Member, IEEE) received the Ph.D. degree in mechanical engineering and applied mechanics from the University of Pennsylvania, Philadelphia, PA, USA, in 1993.
He was a Postdoctoral Fellow at Queen's University, Kingston, ON, Canada, and an Assistant Professor of Mechanical Engineering at the University of Hawaii, HI, USA. In 2000, he joined Vanderbilt University, Nashville, TN, USA, where he is curren...Show More
Nilanjan Sarkar (Senior Member, IEEE) received the Ph.D. degree in mechanical engineering and applied mechanics from the University of Pennsylvania, Philadelphia, PA, USA, in 1993.
He was a Postdoctoral Fellow at Queen's University, Kingston, ON, Canada, and an Assistant Professor of Mechanical Engineering at the University of Hawaii, HI, USA. In 2000, he joined Vanderbilt University, Nashville, TN, USA, where he is curren...View more
Contents Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, USA
Robotics and Autonomous Systems Laboratory, Vanderbilt University, Nashville, TN, USA
Lian Zhang received the M.S. degree from the School of Automation Science and Electrical Engineering, Beihang University, Beijing, China, in 2012, and the Ph.D. degree in electrical engineering from, Vanderbilt University, Nashville, TN, USA, in 2018.
She is currently working as a Software Engineer with Facebook, CA, USA. Her research interests include affective computing, virtual reality, machine learning, and human–computer interaction.
Lian Zhang received the M.S. degree from the School of Automation Science and Electrical Engineering, Beihang University, Beijing, China, in 2012, and the Ph.D. degree in electrical engineering from, Vanderbilt University, Nashville, TN, USA, in 2018.
She is currently working as a Software Engineer with Facebook, CA, USA. Her research interests include affective computing, virtual reality, machine learning, and human–computer interaction.View more
Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, USA
Robotics and Autonomous Systems Laboratory, Vanderbilt University, Nashville, TN, USA
Ashwaq Zaini Amat received the B.Eng. degree in electrical and biomedical engineering from Vanderbilt University, Nashville, TN, USA, in 2009, and the M.S. degree in embedded systems engineering from the University of Leeds, Leeds, U.K., in 2014. She is currently working toward the Ph.D. degree in electrical engineering with the Department of Electrical Engineering and Computer Science, Vanderbilt University.
From 2009 to 2013, she was working as an IT consultant. Her research interests include human-computer interaction, robotics, embedded systems and cyber physical systems.
Ashwaq Zaini Amat received the B.Eng. degree in electrical and biomedical engineering from Vanderbilt University, Nashville, TN, USA, in 2009, and the M.S. degree in embedded systems engineering from the University of Leeds, Leeds, U.K., in 2014. She is currently working toward the Ph.D. degree in electrical engineering with the Department of Electrical Engineering and Computer Science, Vanderbilt University.
From 2009 to 2013, she was working as an IT consultant. Her research interests include human-computer interaction, robotics, embedded systems and cyber physical systems.View more
Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, USA
Robotics and Autonomous Systems Laboratory, Vanderbilt University, Nashville, TN, USA
Huan Zhao received the Ph.D. degrees in electrical engineering from Vanderbilt University, Nashville, TN, USA, in 2020, both in electrical engineering.
Her research interests include the design and development of systems for special needs using the technologies of virtual reality, machine learning, artificial intelligence, human–machine interaction, and robotics.
Huan Zhao received the Ph.D. degrees in electrical engineering from Vanderbilt University, Nashville, TN, USA, in 2020, both in electrical engineering.
Her research interests include the design and development of systems for special needs using the technologies of virtual reality, machine learning, artificial intelligence, human–machine interaction, and robotics.View more
Vanderbilt Kennedy Center, Treatment and Research Institute for Autism Spectrum Disorders, Nashville, TN, USA
Amy R. Swanson is currently with the Vanderbilt Kennedy Center's Treatment and Research Institute for Autism Spectrum Disorders (TRIAD), Nashville, TN, USA, where she has worked for 15 years. Here research interests include technology-based intervention and training mechanisms to serve both pediatric health care providers and families of young children with autism spectrum disorder.
Amy R. Swanson is currently with the Vanderbilt Kennedy Center's Treatment and Research Institute for Autism Spectrum Disorders (TRIAD), Nashville, TN, USA, where she has worked for 15 years. Here research interests include technology-based intervention and training mechanisms to serve both pediatric health care providers and families of young children with autism spectrum disorder.View more
Department of Pediatrics, Vanderbilt University Medical Center, Treatment and Research Institute for Autism Spectrum Disorders, Nashville, TN, USA
Amy S. Weitlauf received the Ph.D. degree in clinical psychology from Vanderbilt University, Nashville, TN, USA, in 2011.
She was as Intern at the University of North Carolina at Chapel Hill, Chapel Hill, NC, USA, and a Postdoctoral Fellow at the Vanderbilt Kennedy Center Treatment and Research Institute for Autism Spectrum Disorders (TRIAD). Nashville. She is currently an Assistant Professor of Pediatrics with Vanderbilt University Medical Center, Nashville, and the Associate Director of TRIAD Research.
Amy S. Weitlauf received the Ph.D. degree in clinical psychology from Vanderbilt University, Nashville, TN, USA, in 2011.
She was as Intern at the University of North Carolina at Chapel Hill, Chapel Hill, NC, USA, and a Postdoctoral Fellow at the Vanderbilt Kennedy Center Treatment and Research Institute for Autism Spectrum Disorders (TRIAD). Nashville. She is currently an Assistant Professor of Pediatrics with Vanderbilt University Medical Center, Nashville, and the Associate Director of TRIAD Research.View more
Department of Pediatrics, Vanderbilt University Medical Center, Treatment and Research Institute for Autism Spectrum Disorders, Nashville, TN, USA
Zachary E. Warren received the Ph.D. degree in clinical psychology from the University of Miami, Miami, FL, USA, in 2005.
He was an Intern at Children's Hospital Boston/Harvard Medical School, Boston, MA, USA, and a Postdoctoral Fellow at the Medical University of South Carolina, Charleston, SC, USA. He is currently a Professor of Pediatrics, Special Education, and Psychiatry and Behavioral Sciences, and the Executive Director of the Vanderbilt Kennedy Center Treatment and Research Institute for Autism Spectrum (TRIAD)Disorders with Vanderbilt University, Nashville, TN, USA, where he is also the Deputy Director of the Frist Center for Autism and Innovation. His research interests include developing novel tools for early identification of Autism Spectrum Disorder (ASD) and developing technologies to accelerate service for those with ASD.
Zachary E. Warren received the Ph.D. degree in clinical psychology from the University of Miami, Miami, FL, USA, in 2005.
He was an Intern at Children's Hospital Boston/Harvard Medical School, Boston, MA, USA, and a Postdoctoral Fellow at the Medical University of South Carolina, Charleston, SC, USA. He is currently a Professor of Pediatrics, Special Education, and Psychiatry and Behavioral Sciences, and the Executive Director of the Vanderbilt Kennedy Center Treatment and Research Institute for Autism Spectrum (TRIAD)Disorders with Vanderbilt University, Nashville, TN, USA, where he is also the Deputy Director of the Frist Center for Autism and Innovation. His research interests include developing novel tools for early identification of Autism Spectrum Disorder (ASD) and developing technologies to accelerate service for those with ASD.View more
Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, USA
Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, USA
Robotics and Autonomous Systems Laboratory, Vanderbilt University, Nashville, TN, USA
Nilanjan Sarkar (Senior Member, IEEE) received the Ph.D. degree in mechanical engineering and applied mechanics from the University of Pennsylvania, Philadelphia, PA, USA, in 1993.
He was a Postdoctoral Fellow at Queen's University, Kingston, ON, Canada, and an Assistant Professor of Mechanical Engineering at the University of Hawaii, HI, USA. In 2000, he joined Vanderbilt University, Nashville, TN, USA, where he is currently the Department Chair and Professor of Mechanical Engineering, Professor of Electrical Engineering and Computer Science, and the Deputy Director for Technical Innovation for the Frist Center for Autism and Innovation. His current research interests include human–robot interaction, affective computing, dynamics, and control.
Nilanjan Sarkar (Senior Member, IEEE) received the Ph.D. degree in mechanical engineering and applied mechanics from the University of Pennsylvania, Philadelphia, PA, USA, in 1993.
He was a Postdoctoral Fellow at Queen's University, Kingston, ON, Canada, and an Assistant Professor of Mechanical Engineering at the University of Hawaii, HI, USA. In 2000, he joined Vanderbilt University, Nashville, TN, USA, where he is currently the Department Chair and Professor of Mechanical Engineering, Professor of Electrical Engineering and Computer Science, and the Deputy Director for Technical Innovation for the Frist Center for Autism and Innovation. His current research interests include human–robot interaction, affective computing, dynamics, and control.View more
