Loading [a11y]/accessibility-menu.js
A Control Systems Concept Inventory Test Design and Assessment | IEEE Journals & Magazine | IEEE Xplore

A Control Systems Concept Inventory Test Design and Assessment


Abstract:

Any meaningful initiative to improve the teaching and learning in introductory control systems courses needs a clear test of student conceptual understanding to determine...Show More

Abstract:

Any meaningful initiative to improve the teaching and learning in introductory control systems courses needs a clear test of student conceptual understanding to determine the effectiveness of proposed methods and activities. The authors propose a control systems concept inventory. Development of the inventory was collaborative and iterative. The diagnostic test was administered to students before (pre) and after (post) student learning activities. Test responses were analyzed to provide instructors with feedback on their teaching. Using classical test theory and item response theory, aggregated results were analyzed to assess internal consistency and measurement error, respectively. Students demonstrated an improvement from pre- to post-test scores, showing gains of 23%-34% in understanding of new concepts learned. The internal consistency of the test has ranged from 0.61 to 0.68. It can be shown that the precision of the test is highest in the score range of 33%-66%, which is where most post-test scores occurred.
Published in: IEEE Transactions on Education ( Volume: 55, Issue: 2, May 2012)
Page(s): 203 - 212
Date of Publication: 14 July 2011

ISSN Information:

Department of Systems Design Engineering, University of Waterloo, Waterloo, ONT, Canada
Michele Bristow (S'08) received the B.A.Sc. degree in systems design engineering and M.A.Sc. degree in mechanical engineering from the University of Waterloo, Waterloo, ON, Canada, in 2006 and 2008, respectively, and is currently pursuing the Ph.D. degree in systems design engineering at the University of Waterloo.
Mrs. Bristow is an Engineer-in-Training (EIT) registered with Professional Engineers Ontario, Canada. In 2007...Show More
Michele Bristow (S'08) received the B.A.Sc. degree in systems design engineering and M.A.Sc. degree in mechanical engineering from the University of Waterloo, Waterloo, ON, Canada, in 2006 and 2008, respectively, and is currently pursuing the Ph.D. degree in systems design engineering at the University of Waterloo.
Mrs. Bristow is an Engineer-in-Training (EIT) registered with Professional Engineers Ontario, Canada. In 2007...View more
Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ONT, Canada
Kaan Erkorkmaz received the B.Sc. degree from Istanbul Technical University, Istanbul, Turkey, in 1995, and the M.A.Sc. and Ph.D. degrees from the University of British Columbia, Vancouver, BC, Canada, in 1999 and 2004, respectively, all in mechanical engineering.
He joined the Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON, Canada, as an Assistant Professor in 2004 and was prom...Show More
Kaan Erkorkmaz received the B.Sc. degree from Istanbul Technical University, Istanbul, Turkey, in 1995, and the M.A.Sc. and Ph.D. degrees from the University of British Columbia, Vancouver, BC, Canada, in 1999 and 2004, respectively, all in mechanical engineering.
He joined the Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON, Canada, as an Assistant Professor in 2004 and was prom...View more
Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ONT, Canada
Jan Paul Huissoon received the B.A. B.A.I. and Ph.D. degrees from Trinity College Dublin, Dublin, Ireland in 1979 and 1983, respectively.
He is currently a Professor and Deputy Chair of Mechanical and Mechatronics Engineering with the University of Waterloo, Waterloo, ON, Canada. His research interests include robotic welding, autonomous robotics, mechatronic design, modeling, and control.
Prof. Huissoon is a member of the ...Show More
Jan Paul Huissoon received the B.A. B.A.I. and Ph.D. degrees from Trinity College Dublin, Dublin, Ireland in 1979 and 1983, respectively.
He is currently a Professor and Deputy Chair of Mechanical and Mechatronics Engineering with the University of Waterloo, Waterloo, ON, Canada. His research interests include robotic welding, autonomous robotics, mechatronic design, modeling, and control.
Prof. Huissoon is a member of the ...View more
Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ONT, Canada
Soo Jeon (M'09) received the B.S. and M.S. degrees in mechanical and aerospace engineering from the Seoul National University, Seoul, Korea, and the Ph.D. degree in mechanical engineering from the University of California, Berkeley, in 1998, 2001, and 2007, respectively.
He was a Mechanical Engineer with Applied Materials, Inc., Santa Clara, CA, and is currently Assistant Professor with the Department of Mechanical and Mec...Show More
Soo Jeon (M'09) received the B.S. and M.S. degrees in mechanical and aerospace engineering from the Seoul National University, Seoul, Korea, and the Ph.D. degree in mechanical engineering from the University of California, Berkeley, in 1998, 2001, and 2007, respectively.
He was a Mechanical Engineer with Applied Materials, Inc., Santa Clara, CA, and is currently Assistant Professor with the Department of Mechanical and Mec...View more
Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ONT, Canada
William S. Owen (M'03) received his B.A.Sc. degree in engineering physics (mechanical option) and M.A.Sc. degree in mechanical engineering from the University of British Columbia, Vancouver, BC, Canada, in 1990 and 2001, respectively, and the Ph.D. degree in mechanical engineering from the University of Toronto, Toronto, ON, Canada, in 2005.
From 1992 to 1999, he was employed in the consulting industry, designing and build...Show More
William S. Owen (M'03) received his B.A.Sc. degree in engineering physics (mechanical option) and M.A.Sc. degree in mechanical engineering from the University of British Columbia, Vancouver, BC, Canada, in 1990 and 2001, respectively, and the Ph.D. degree in mechanical engineering from the University of Toronto, Toronto, ON, Canada, in 2005.
From 1992 to 1999, he was employed in the consulting industry, designing and build...View more
Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ONT, Canada
Steven L. Waslander (S'06–M'08) received the B.S. in mathematics and engineering from Queen's University, Kingston, ON, Canada, in 1998, and the M.S. and Ph.D. degrees in aeronautics and astronautics from Stanford University, Stanford, CA, in 2002 and 2007, respectively.
From 1998 to 2001, he worked as a Control Systems Analyst with Pratt & Whitney Canada, Mississauga, ON, Canada, and was a Postdoctoral Scholar with Stanfo...Show More
Steven L. Waslander (S'06–M'08) received the B.S. in mathematics and engineering from Queen's University, Kingston, ON, Canada, in 1998, and the M.S. and Ph.D. degrees in aeronautics and astronautics from Stanford University, Stanford, CA, in 2002 and 2007, respectively.
From 1998 to 2001, he worked as a Control Systems Analyst with Pratt & Whitney Canada, Mississauga, ON, Canada, and was a Postdoctoral Scholar with Stanfo...View more
Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ONT, Canada
Gordon D. Stubley received the B.A.Sc. degree from the University of Waterloo, Waterloo, ON, Canada, in 1977, the M.S. degree from Stanford University, Stanford, CA, in 1978, and the Ph.D. degree from the University of Waterloo in 1981, all in mechanical engineering.
He joined the faculty of the Mechanical and Mechatronics Engineering Department, University of Waterloo, as a tenure-track Assistant Professor in 1982. His re...Show More
Gordon D. Stubley received the B.A.Sc. degree from the University of Waterloo, Waterloo, ON, Canada, in 1977, the M.S. degree from Stanford University, Stanford, CA, in 1978, and the Ph.D. degree from the University of Waterloo in 1981, all in mechanical engineering.
He joined the faculty of the Mechanical and Mechatronics Engineering Department, University of Waterloo, as a tenure-track Assistant Professor in 1982. His re...View more

Department of Systems Design Engineering, University of Waterloo, Waterloo, ONT, Canada
Michele Bristow (S'08) received the B.A.Sc. degree in systems design engineering and M.A.Sc. degree in mechanical engineering from the University of Waterloo, Waterloo, ON, Canada, in 2006 and 2008, respectively, and is currently pursuing the Ph.D. degree in systems design engineering at the University of Waterloo.
Mrs. Bristow is an Engineer-in-Training (EIT) registered with Professional Engineers Ontario, Canada. In 2007, she received a Teaching Assistant Award from the Department of Mechanical and Mechatronics Engineering, University of Waterloo, and was voted as “Our Best TA” by the Mechatronics 2008 class.
Michele Bristow (S'08) received the B.A.Sc. degree in systems design engineering and M.A.Sc. degree in mechanical engineering from the University of Waterloo, Waterloo, ON, Canada, in 2006 and 2008, respectively, and is currently pursuing the Ph.D. degree in systems design engineering at the University of Waterloo.
Mrs. Bristow is an Engineer-in-Training (EIT) registered with Professional Engineers Ontario, Canada. In 2007, she received a Teaching Assistant Award from the Department of Mechanical and Mechatronics Engineering, University of Waterloo, and was voted as “Our Best TA” by the Mechatronics 2008 class.View more
Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ONT, Canada
Kaan Erkorkmaz received the B.Sc. degree from Istanbul Technical University, Istanbul, Turkey, in 1995, and the M.A.Sc. and Ph.D. degrees from the University of British Columbia, Vancouver, BC, Canada, in 1999 and 2004, respectively, all in mechanical engineering.
He joined the Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON, Canada, as an Assistant Professor in 2004 and was promoted to Associate Professor in 2009. He conducts research in the areas of manufacturing, controls, optimal trajectory generation, and precision engineering.
Prof. Erkorkmaz is an Associate Member of CIRP and a member of ASME, ASPE, and SME. He is also a Professional Engineer registered in the Province of Ontario, Canada. He is holder of SME's Outstanding Young Manufacturing Engineer Award in 2007, the Province of Ontario's Early Researcher Award in 2008, and the InnoLecture Visiting Professorship at the University of Stuttgart in 2011, funded by the Carl-Zeiss Foundation and Donor's Association for German Science, for his innovations in developing and teaching controls lectures at undergraduate and graduate levels.
Kaan Erkorkmaz received the B.Sc. degree from Istanbul Technical University, Istanbul, Turkey, in 1995, and the M.A.Sc. and Ph.D. degrees from the University of British Columbia, Vancouver, BC, Canada, in 1999 and 2004, respectively, all in mechanical engineering.
He joined the Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON, Canada, as an Assistant Professor in 2004 and was promoted to Associate Professor in 2009. He conducts research in the areas of manufacturing, controls, optimal trajectory generation, and precision engineering.
Prof. Erkorkmaz is an Associate Member of CIRP and a member of ASME, ASPE, and SME. He is also a Professional Engineer registered in the Province of Ontario, Canada. He is holder of SME's Outstanding Young Manufacturing Engineer Award in 2007, the Province of Ontario's Early Researcher Award in 2008, and the InnoLecture Visiting Professorship at the University of Stuttgart in 2011, funded by the Carl-Zeiss Foundation and Donor's Association for German Science, for his innovations in developing and teaching controls lectures at undergraduate and graduate levels.View more
Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ONT, Canada
Jan Paul Huissoon received the B.A. B.A.I. and Ph.D. degrees from Trinity College Dublin, Dublin, Ireland in 1979 and 1983, respectively.
He is currently a Professor and Deputy Chair of Mechanical and Mechatronics Engineering with the University of Waterloo, Waterloo, ON, Canada. His research interests include robotic welding, autonomous robotics, mechatronic design, modeling, and control.
Prof. Huissoon is a member of the Institute of Engineers of Ireland and the American Welding Society and is a Registered Professional Engineer in Ontario, Canada.
Jan Paul Huissoon received the B.A. B.A.I. and Ph.D. degrees from Trinity College Dublin, Dublin, Ireland in 1979 and 1983, respectively.
He is currently a Professor and Deputy Chair of Mechanical and Mechatronics Engineering with the University of Waterloo, Waterloo, ON, Canada. His research interests include robotic welding, autonomous robotics, mechatronic design, modeling, and control.
Prof. Huissoon is a member of the Institute of Engineers of Ireland and the American Welding Society and is a Registered Professional Engineer in Ontario, Canada.View more
Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ONT, Canada
Soo Jeon (M'09) received the B.S. and M.S. degrees in mechanical and aerospace engineering from the Seoul National University, Seoul, Korea, and the Ph.D. degree in mechanical engineering from the University of California, Berkeley, in 1998, 2001, and 2007, respectively.
He was a Mechanical Engineer with Applied Materials, Inc., Santa Clara, CA, and is currently Assistant Professor with the Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON, Canada. His research interest is the integrated sensing and motion control.
Dr. Jeon is a member of the American Society of Mechanical Engineers (ASME) and a Professional Engineer of Ontario, Canada. He received the Rudolf Kalman Best Paper Award from the Dynamic Systems and Control Division (DSC) of ASME in 2010.
Soo Jeon (M'09) received the B.S. and M.S. degrees in mechanical and aerospace engineering from the Seoul National University, Seoul, Korea, and the Ph.D. degree in mechanical engineering from the University of California, Berkeley, in 1998, 2001, and 2007, respectively.
He was a Mechanical Engineer with Applied Materials, Inc., Santa Clara, CA, and is currently Assistant Professor with the Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON, Canada. His research interest is the integrated sensing and motion control.
Dr. Jeon is a member of the American Society of Mechanical Engineers (ASME) and a Professional Engineer of Ontario, Canada. He received the Rudolf Kalman Best Paper Award from the Dynamic Systems and Control Division (DSC) of ASME in 2010.View more
Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ONT, Canada
William S. Owen (M'03) received his B.A.Sc. degree in engineering physics (mechanical option) and M.A.Sc. degree in mechanical engineering from the University of British Columbia, Vancouver, BC, Canada, in 1990 and 2001, respectively, and the Ph.D. degree in mechanical engineering from the University of Toronto, Toronto, ON, Canada, in 2005.
From 1992 to 1999, he was employed in the consulting industry, designing and building industrial process plants. He is currently Associate Director of First-Year Engineering and an Adjunct Professor with the Mechanical and Mechatronics Engineering Department, University of Waterloo, Waterloo, ON, Canada. His research interests include industrial robotics, multiple robotic manipulators, mobile robotics, motion planning, and pedagogy.
Dr. Owen is a Registered Professional Engineer in the provinces of British Columbia and Ontario, Canada.
William S. Owen (M'03) received his B.A.Sc. degree in engineering physics (mechanical option) and M.A.Sc. degree in mechanical engineering from the University of British Columbia, Vancouver, BC, Canada, in 1990 and 2001, respectively, and the Ph.D. degree in mechanical engineering from the University of Toronto, Toronto, ON, Canada, in 2005.
From 1992 to 1999, he was employed in the consulting industry, designing and building industrial process plants. He is currently Associate Director of First-Year Engineering and an Adjunct Professor with the Mechanical and Mechatronics Engineering Department, University of Waterloo, Waterloo, ON, Canada. His research interests include industrial robotics, multiple robotic manipulators, mobile robotics, motion planning, and pedagogy.
Dr. Owen is a Registered Professional Engineer in the provinces of British Columbia and Ontario, Canada.View more
Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ONT, Canada
Steven L. Waslander (S'06–M'08) received the B.S. in mathematics and engineering from Queen's University, Kingston, ON, Canada, in 1998, and the M.S. and Ph.D. degrees in aeronautics and astronautics from Stanford University, Stanford, CA, in 2002 and 2007, respectively.
From 1998 to 2001, he worked as a Control Systems Analyst with Pratt & Whitney Canada, Mississauga, ON, Canada, and was a Postdoctoral Scholar with Stanford University from 2007 to 2008. He joined the faculty of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON, Canada, in July 2008. His research interests include advanced perception, planning and coordination algorithms for autonomous mobile robotics, unmanned aerial, ground and surface vehicles, and nonlinear estimation and control techniques.
Dr. Waslander is a member of the American Institute for Aeronautics and Astronautics and the Canadian Aeronautics and Space Institute and is a Professional Engineer in Ontario, Canada.
Steven L. Waslander (S'06–M'08) received the B.S. in mathematics and engineering from Queen's University, Kingston, ON, Canada, in 1998, and the M.S. and Ph.D. degrees in aeronautics and astronautics from Stanford University, Stanford, CA, in 2002 and 2007, respectively.
From 1998 to 2001, he worked as a Control Systems Analyst with Pratt & Whitney Canada, Mississauga, ON, Canada, and was a Postdoctoral Scholar with Stanford University from 2007 to 2008. He joined the faculty of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON, Canada, in July 2008. His research interests include advanced perception, planning and coordination algorithms for autonomous mobile robotics, unmanned aerial, ground and surface vehicles, and nonlinear estimation and control techniques.
Dr. Waslander is a member of the American Institute for Aeronautics and Astronautics and the Canadian Aeronautics and Space Institute and is a Professional Engineer in Ontario, Canada.View more
Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ONT, Canada
Gordon D. Stubley received the B.A.Sc. degree from the University of Waterloo, Waterloo, ON, Canada, in 1977, the M.S. degree from Stanford University, Stanford, CA, in 1978, and the Ph.D. degree from the University of Waterloo in 1981, all in mechanical engineering.
He joined the faculty of the Mechanical and Mechatronics Engineering Department, University of Waterloo, as a tenure-track Assistant Professor in 1982. His research interests include computational fluid dynamics, fluids engineering design, and engineering education.
Prof. Stubley, P.Eng., is registered with Professional Engineers Ontario (PEO) and is a Member the Canadian Engineering Education Association (CEEA). He received the University of Waterloo's Sanford Fleming Award for Teaching Excellence and the Distinguished Teacher Award in 1999 and 2009, respectively, the Ontario Ministry of Training, Colleges and Universities Leadership in Faculty Teaching Award in 2006, and the Ontario Confederation of University Faculty Associations Teaching Awards in 2009.
Gordon D. Stubley received the B.A.Sc. degree from the University of Waterloo, Waterloo, ON, Canada, in 1977, the M.S. degree from Stanford University, Stanford, CA, in 1978, and the Ph.D. degree from the University of Waterloo in 1981, all in mechanical engineering.
He joined the faculty of the Mechanical and Mechatronics Engineering Department, University of Waterloo, as a tenure-track Assistant Professor in 1982. His research interests include computational fluid dynamics, fluids engineering design, and engineering education.
Prof. Stubley, P.Eng., is registered with Professional Engineers Ontario (PEO) and is a Member the Canadian Engineering Education Association (CEEA). He received the University of Waterloo's Sanford Fleming Award for Teaching Excellence and the Distinguished Teacher Award in 1999 and 2009, respectively, the Ontario Ministry of Training, Colleges and Universities Leadership in Faculty Teaching Award in 2006, and the Ontario Confederation of University Faculty Associations Teaching Awards in 2009.View more
Contact IEEE to Subscribe

References

References is not available for this document.