Skip To Main Content University of Washington Department of Rehabilitation Medicine
  Department of Rehabilitation Medicine 
  maximizing potential across the lifespan

Title:

Reliability of a 360-degree evaluation to assess resident competence

Author(s):

Massagli TL, Carline JD

Year:

2007

Publication Info:

American Journal of Physical Medicine and Rehabilitation, 86(10):845-852

Abstract:

OBJECTIVE: To determine the feasibility and psychometric qualities of a 360-degree evaluation of physical medicine and rehabilitation (PM&R) residents' competence.
DESIGN: Nurses, allied health staff, and medical students completed a 12-item questionnaire after each PM&R resident rotation from January 2002 to December 2004. The items were derived from five of the six competencies defined by the Accreditation Council for Graduate Medical Education (ACGME).
RESULTS: Nine hundred thirty evaluations of 56 residents were completed. The alpha reliability coefficient for the instrument was 0.89. Ratings did not vary significantly by resident gender. Senior residents had higher ratings than junior residents. A reliability of >0.8 could be achieved by ratings from just five nurses or allied health staff, compared with 23 ratings from medical students. Factor analysis revealed all items clustered on one factor, accounting for 84% of the variance. In a subgroup of residents with low scores, raters were able to differentiate among skills.
CONCLUSION: Resident assessment tools should be valid, reliable, and feasible. This Web-based 360-degree evaluation tool is a feasible way to obtain reliable ratings from rehabilitation staff about resident behaviors. The assignment of higher ratings for senior residents than junior residents is evidence for the general validity of this 360-degree evaluation tool in the assessment of resident performance. Different rater groups may need distinct instruments based on the exposure of rater groups to various resident activities and behaviors.

Link to Article:

http://www.ncbi.nlm.nih.gov/pubmed/17885319

Featured Research Articles

Traumatic Brain Injury

View the latest research articles on Traumatic Brain Injury written by faculty from the Department of Rehabilitation Medicine.

Volunteer to Participate in our Research Studies

The Department of Rehabilitation Medicine is looking for volunteers to participate in research studies on Multiple Sclerosis & Pain Management, and Traumatic Brain Injury.

Level A conformance icon, 
          W3C-WAI Web Content Accessibility Guidelines 1.0
Copyright © 2000-2017 University of Washington