ERIC Number: EJ1334932
Record Type: Journal
Publication Date: 2022
Pages: 20
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1364-5579
EISSN: N/A
What's the Measure? An Empirical Investigation of Self-Ratings on Response Scales
Hilbert, Sven; Pargent, Florian; Kraus, Elisabeth; Naumann, Felix; Eichhorn, Kathryn; Ungar, Patrizia; Bühner, Markus
International Journal of Social Research Methodology, v25 n1 p59-78 2022
Two studies were conducted to investigate how self-ratings on questionnaire items reflect the underlying real-scores. Participants gave numerical information about personal attributes (the real-scores), such as age, height, and weight, and subsequently rated themselves regarding these attributes. In Study 1, they rated themselves on a five-point Likert-type scale from three different perspectives, a personal, a general, and an outsiders', inducing three different frames of reference. By regressing these ratings on the real-scores, it was shown that information about means of and differences between the real-scores were not readily reflected by the response scales. The outsiders' perspective resulted in the most adequate representation of the real-score differences, indicated by the intervals between the categories estimated by the ordinal regression models. In Study 2, neutral item wording with a five-point Likert-type scale and a four-point Likert-type scale was used to rule out the effect of positive wording. This increased the adequacy of the representations just slightly. The findings indicate that, even on average, the investigated rating scales and items reflect the numeric real-scores only limitedly and that self-ratings depend on the item phrasing instead of simply representing a coarse measure of the real-scores. All data and analysis scripts are available at https://osf.io/4pcdb/.
Descriptors: Measurement Techniques, Measures (Individuals), Individual Characteristics, Foreign Countries, Validity, Phrase Structure, Gender Differences
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Germany
Grant or Contract Numbers: N/A
Data File: URL: https://osf.io/4pcdb/