NDLI: Self-Judgments of Accuracy as Indicators of Performance Evaluation Quality: Should We Believe Them?

Content Provider	Springer Nature Link
Author	Roch, Sylvia G. McNall, Laurel A. Caputo, Pat M.
Copyright Year	2010
Abstract	This paper explores how well raters’ self-judgments of their rating and behavioral accuracy reflect reality. We also explore the role of motivation in determining the quality of raters’ self-judgments and their rating and behavioral accuracy.In this study, 327 participants watched two videotaped lecturers and provided ratings and behavioral identifications, along with self-judgments of the accuracy of these ratings and behavioral identifications and self-reported motivation. Three types of monetary incentives were also offered.Raters’ self-judgments were related to how well they identified behaviors (i.e., behavioral accuracy) and the type of rating accuracy arguably most closely associated with behaviors (i.e., differential accuracy (DA)). Although more motivated raters believed that they provided both more accurate ratings and behavioral identifications, this was only the case for behavioral identifications. Financial incentives based on the quality of self-judgments only influenced whether self-judgments related to rating accuracy (DA).If organizations are interested in improving the quality of behavioral feedback or assessment practices relying on ratings, it may be useful to ask raters/interviewers to what extent they believe that they correctly identified behaviors or gave accurate ratings, especially if the raters/interviewers are motivated to be accurate.This is one of the first studies to show that raters’ self-judgments can be useful indicators of whether they accurately recognized behavior and some kinds of accuracy. Furthermore, this is the first study to show that more motivated raters provide both more accurate self-judgments of behavioral accuracy and more accurate behavioral identifications.
Starting Page	41
Ending Page	55
Page Count	15
File Format	PDF
ISSN	08893268
Journal	Journal of Business and Psychology
Volume Number	26
Issue Number	1
e-ISSN	1573353X
Language	English
Publisher	Springer US
Publisher Date	2010-03-15
Publisher Place	Boston
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Performance evaluations Rating accuracy Behavioral accuracy Rater motivation Interview ratings Social Sciences Business/Management Science Personality and Social Psychology Community and Environmental Psychology
Content Type	Text
Resource Type	Article
Subject	Business and International Management Applied Psychology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Factors Influencing Employee Intentions to Provide Honest Upward Feedback Ratings

Rater Personality and Performance Dimension Weighting in Making Overall Performance Judgments

Reconsidering the Equivalence of Multisource Performance Ratings: Evidence for the Importance and Meaning of Rater Factors

The Performance Appraisal Milieu: A Multilevel Analysis of Context Effects in Performance Ratings

Behavioral Expression of Job Interview Anxiety

Accuracy of the Situational Interview in Rating Multiple Job Candidates

A Dispositional Approach to Applicant Reactions: Examining Core Self-Evaluations, Behavioral Intentions, and Fairness Perceptions

Contrast and Rater-Perspective Effects on Judgments of Sexual Harassment Severity: What He Thinks She Thinks, and Vice Versa

BENCHMARKS AFFECT PERCEPTIONS OF PRIOR DISABILITY IN A STRUCTURED INTERVIEW

Self-Judgments of Accuracy as Indicators of Performance Evaluation Quality: Should We Believe Them?

Similar Documents

Factors Influencing Employee Intentions to Provide Honest Upward Feedback Ratings

Rater Personality and Performance Dimension Weighting in Making Overall Performance Judgments

Reconsidering the Equivalence of Multisource Performance Ratings: Evidence for the Importance and Meaning of Rater Factors

The Performance Appraisal Milieu: A Multilevel Analysis of Context Effects in Performance Ratings

Behavioral Expression of Job Interview Anxiety

Accuracy of the Situational Interview in Rating Multiple Job Candidates

A Dispositional Approach to Applicant Reactions: Examining Core Self-Evaluations, Behavioral Intentions, and Fairness Perceptions

Contrast and Rater-Perspective Effects on Judgments of Sexual Harassment Severity: What He Thinks She Thinks, and Vice Versa

BENCHMARKS AFFECT PERCEPTIONS OF PRIOR DISABILITY IN A STRUCTURED INTERVIEW

Self-Judgments of Accuracy as Indicators of Performance Evaluation Quality: Should We Believe Them?