This article presents the findings of a systematic qualitative analysis of research in the ethics of digital trace data use in learning and education. From the resulting analysis of 77 peer-reviewed studies, we (1) map the characteristics of research by study type, academic community, institutional setting, and national context; (2) identify the…

Institutional researchers are often tasked with assessing why college-wide initiatives succeed or fail. This can be a difficult task: researchers need to discriminate between multiple feasible explanations, work with limited data, and produce compelling narratives. Process tracing is a qualitative methodology that enables researchers to make valid…

The use of rubrics for grading and feedback in higher education has increased in response to requirements for consistency and transparency across a diverse range of assessment tasks. There is a growing evidence base demonstrating the reliability of rubrics across different markers and instances. The number of studies describing the impact of…

Institutional report cards are increasingly being used by higher educational institutions to present academic outcomes to external audiences of prospective students and parents, as well as program and institutional evaluators. While some prospective students are served by national transparency measures most users mine information from the…

The purpose of this document is to serve as a reference guide for States involved in the P-20 effort to map data elements to the Common Education Data Standards (CEDS). It describes how one State used Align to assist in development of its P-20 system and describes in detail how this project could be replicated. The CEDS provide a shared vocabulary…

This pan Canadian participatory action research project involved faculty and managers in twelve Canadian colleges and institutes, nine employers, and 1300 students and workers in examining exemplary practice in essential skills as a way of catalyzing system change. Multiple sources of data were used in the three year project and key findings…

The purpose of this study is to look closely at how aspects of instructional leadership, and organizational learning affect the quality of madrasah in improving the quality of graduate the state madrasah aliyah. The experiment was conducted using a quantitative approach with descriptive and inferential methods, in inferential methods used…

Because it is often impractical or impossible to obtain school transcripts or records on subjects, many researchers rely on college students to accurately self-report their academic record as part of their data collection procedures. The purpose of this study is to investigate the validity and reliability of student self-reported academic…

This discussion constructs a survey data quality strategy for institutional researchers in higher education in light of total survey error theory. It starts with describing the characteristics of institutional research and identifying the gaps in literature regarding survey data quality issues in institutional research and then introduces the…

This researcher examined the relationship of bureaucratic structure to school climate by means of an exploratory factor analysis of a measure of bureaucracy developed by Hoy and Sweetland (2000) and the four dimensional measure of climate developed by Hoy, Smith, and Sweetland (2002). Since there had been no other empirical studies whose authors…

This paper intends to construct a survey data quality strategy for institutional researchers in higher education in light of total survey error theory. It starts with describing the characteristics of institutional research and identifying the gaps in literature regarding survey data quality issues in institutional research. Then it is followed by…

The results of a content analysis of the mail survey methodologies used in three studies of diverse higher education topics are reported. Each study used Dillman's Total Design Method procedures and obtained a high rate of return. (MLW)

Suggests Web-based logs contain useful empirical data with which World Wide Web designers and design theorists can assess usability and effectiveness of design choices. Enumerates identification of types of Web server logs, client logs, types and uses of log data, and issues associated with the validity of these data. Presents an approach to…

This report finds problems in the ability of the five major federal credit agencies to reasonably estimate subsidy costs related to the $216.6 billion in direct loans and $712.4 billion in loan guarantees issued by the federal government. The five agencies are the Small Business Administration (SBA) and the departments of Education, Housing and…

The process for completing four national questionnaires was analyzed following site visits and detailed documentation at each of six representative medical schools. A number of problems with the process were found that inhibited the provision of reliable data. Corrective action for institutions and sponsoring agencies are suggested. (Editor/LBH)