|
Interview
Ratings
Faculty rate
students' level of goal attainment based on loosely structured
interviews using standardized questions framed to measure each
of six goals.
Agreement
Among Faculty Ratings
Faculty ratings
are systematically examined to determine that each faculty team
provided consistent ratings on the students interviewed. Agreement
between raters was relatively high with 78% of the sets of ratings
differing by only 0-1 point.
Student
Self-Ratings
Students rate
their own level of attainment on the same six goals in a written
survey prior to the interview.
Rating
Scale
Both faculty
ratings and student self-ratings are based on the following scale:
1=Little
or no attainment; 2=Below average attainment; 3=Average attainment;
4=Above average attainment; and, 5=Outstanding attainment
A comments
section was provided on the faculty rating form.
Difference
Scores
The discrepancies
between faculty ratings and the student self-ratings on each goal
is presented. The mean difference scores indicate that students
tend to overestimate their level of attainment, but by less than
half a point.
|
