ERIC Number: ED573674
Record Type: Non-Journal
Publication Date: 2016-Sep
Pages: 62
Abstractor: ERIC
ISBN: N/A
ISSN: N/A
EISSN: N/A
Analysis of IDEA Student Ratings of Instruction System 2015 Pilot Data. IDEA Technical Report No. 19
Li, Dan; Benton, Stephen L.; Brown, Ron; Sullivan, Patricia; Ryalls, Kenneth R.
IDEA Center, Inc.
This report describes statistical analyses performed on data collected in the Spring of 2015 from the pilot study of proposed revised and new items in the IDEA Student Ratings of Instruction (SRI) system. Described are the methods employed, results obtained, and decisions made in selecting items for the updated instruments. The procedures occurred across a one-year period, beginning in the Spring of 2015 and ending with the development of IDEA Diagnostic Feedback (DF) 2016 and Learning Essentials (LE) 2016 in the Fall of 2015. The need for the current revision stemmed from many changes that have occurred in higher education including: (1) the increase in the number of courses offered online; (2) widespread agreement about global student learning outcomes not emphasized in 1999, notably civic engagement, ethical reasoning, diverse perspectives, and quantitative literacy; (3) teaching methods that provide meaningful feedback and help students to interpret subject matter from diverse perspectives, encourage self-reflection, and engage students in service; (4) student characteristics such as background preparation and self-efficacy that are known to influence learning; and (5) the prevalence of mobile devices, which makes in-class capture more manageable but also makes a shorter instrument more desirable. Appended to the report are: (1) Item by Item Comparisons of the Original and Proposed Updates of Learning Objectives; (2) Item by Item Comparisons of the Original and Proposed Updates of Teaching Methods; (3) IDEA Alignment with NSSE Engagement Indicators; and (4) Bayesian Model Averaging on 13 Learning Objectives in Medium Classes (15-34).
Descriptors: Statistical Analysis, Rating Scales, Student Evaluation of Teacher Performance, Course Evaluation, Test Items, Pilot Projects, Review (Reexamination), Teaching Methods, Behavioral Objectives, Student Characteristics, Predictor Variables, Data Analysis, Comparative Analysis, Correlation, Relevance (Education), Factor Structure, Course Content, Difficulty Level
IDEA Center, Inc. 301 South Fourth Street Suite 200, Manhattan, KS 66502. Tel: 800-255-2757; Tel: 785-320-2400; e-mail: info@IDEAedu.org; Web site: http://ideaedu.org
Publication Type: Reports - Research; Numerical/Quantitative Data
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: IDEA Center
Grant or Contract Numbers: N/A