Reform efforts in statistics education emphasize the need for students to develop statistical thinking. Critical to this goal is a solid understanding of design in the process of collecting data, evaluating evidence, and drawing conclusions. We collected survey responses from over 700 college students at the start of an introductory statistics…

Background: Traditional survey efforts to gather outcome data at scale have significant limitations, including cost, time, and respondent burden. This pilot study explored new and innovative large-scale methods of collecting and validating data from publicly available sources. Taking advantage of emerging data science techniques, we leverage…

This article presents the findings of a systematic qualitative analysis of research in the ethics of digital trace data use in learning and education. From the resulting analysis of 77 peer-reviewed studies, we (1) map the characteristics of research by study type, academic community, institutional setting, and national context; (2) identify the…

The present article introduces the Fuzzy Delphi method results obtained in the study on determining e-Portfolio elements in learning process for art and design context. This method bases on qualified experts that assure the validity of the collected information. In particular, the confirmation of elements is based on experts' opinion and…

The teaching performance assessment (TPA) seeks to measure the knowledge, skills, and competencies of teachers during the credential phase of their training. The TPA was introduced in California in 2004 with programs piloting it and then became mandatory for candidates enrolling in preliminary programs in 2008. Although California has multiple…

Intelligence gathering, or data collection, is a preliminary and critical stage of decision making. Two key approaches to intelligence gathering are "discovery" and "idea imposition." The discovery approach allows us to learn about possibilities by gathering intelligence in order to identify and weigh options. The idea imposition approach limits…

Teacher preparation programs (TPPs) are where prospective teachers gain a foundation of knowledge about pedagogy and subject matter, as well as early exposure to practical classroom experience. Although competence in teaching, as in all professions, is shaped significantly by on-the-job experiences and continuous learning, the programs that…

Educational improvement through data-based decision-making using high-quality data is a longstanding goal of policymakers and practitioners, and ensuring the quality of the evidence available to inform such decisions is a key part of the No Child Left Behind Act of 2001. The evidence-based education that such initiatives promote involves the…

This paper is an extension of the author's earlier work on developing management information services and creating a culture of assessment in libraries. The author will focus observations on the use of data in decision-making in libraries, specifically on the role of leadership in making evidence-based decision a reality, and will review new…

Describes three basic approaches to needs assessment--problem identification, problem analysis, and problem verification--and assesses them in terms of their potential utility to users in business and educational settings as measured by their estimated time requirement, accuracy, and cost. Needs assessment data collection resources and techniques…

The current high-stakes accountability environment has created strong incentives for educators to systematically collect and use data to inform instructional decisions. This article examines the strategies employed by three urban school districts to promote data use for instructional improvement and their effect on administrator, principal, and…

Student ratings of instruction are widely used as a basis for personnel decisions and faculty development recommendations. This digest discusses concerns about the validity of student ratings and presents a case for their use in teacher evaluation. There are several strong arguments for using student ratings to evaluate teachers. Students are in a…

This chapter presents a number of problems related to designing local-level summative evaluation studies and suggests solutions to these problems. Three general areas are covered. First, many of the motivational, organizational, and attitudinal constraints likely to face the local-level evaluator are discussed. Second, various threats to the…

As with any new theory, it is necessary to validate the basic construct of vocational maturity. Once this is done, instruments to measure vocational maturity, or decision making, can be evaluated. With this as an objective, this paper discusses some of the problems associated with measuring vocational maturity, such as identifying variables,…

The California Healthy Kids Survey (CHKS) is a comprehensive youth health risk and resilience data collection service sponsored by the California Department of Education (CDE). This part of the guidebook will assist practitioners in understanding, interpreting, and deriving the maximum benefit from the CHKS results. It provides a basic road map…