Assessment of Work Performance

Muskuloskeletal, Psychological, and Other Internal Physical Disorders: (Sandqvist et al., 2009; n=364, mean age= 45 (7.4); Swedish sample)

• SEM for entire group (n=364)=7.4/19.08=0.388

Work-related problems: (Fan et al., 2013; n=365; mean age =44.8)

• SEM (n=365) = 2/19.1=0.105

Muskuloskeletal, Psychological, and Other Internal Physical Disorders: (Sandqvist et al., 2009)

• MDC for entire group (n=364)=13.443

Work-related problems: (Fan et al., 2013)

• Excellent: Cronbach’s alpha was .83

Predictive Validity:

Muskuloskeletal, Psychological, and Other Internal Physical Disorders: (Sandqvist et al., 2009)

• Adequate to excellent predictive validity of the AWP (R²=.52 of the total variance and a predictive value of Q²=.30)

Muskuloskeletal, Psychological, and Other Internal Physical Disorders: (Sandqvist et al., 2009)

• Excellent degree of correlation between the items and the component due to all 14 items on the AWP having positive loadings.

• Adequate construct validity due to items in the three domains (musculoskeletal, psychological, and other) being relatively well clustered but still separated from each other.

Muskuloskeletal, Psychological, and Other Internal Physical Disorders: (Sandqvist, et al., 2008; n= 67; mean age= 44.7; Swedish sample)

• Content validity was evaluated by 67 users with various expertise in the assessment who answered a detailed questionnaire. The majority of respondents (63.2%) thought that the AWP covered all possible aspects of observable working skills at least “to a great extent”, leading Sandqvist et al. (2008) to conclude adequate content validity.

Patients in pain rehabilitation, neurologic rehabilitation, and psychiatric care: (Karlsson et al., 2018; n = 15; mean age = 49.2; mean experience in assessing work ability = 8 years; Swedish sample)

• Content validity was evaluated by 15 assessors in Sweden who had all administered the AWP before. Though some improvements were suggested, they concluded that all 14 skills and 3 work tasks were covered, giving the instrument adequate content validity

• Social validity:Assessors stated that the work tasks were appropriate and acceptable to clients, indicating adequate social validity. Still, the limited sample size is not generalizable to all users and populations.

Work-related problems: (Fan et al., 2013)

• Person-response validity: In the initial sample, 94.6% of clients fit the model’s expectations, which is slightly lower than the 95% or more that was necessary to demonstrate person-response validity. Once the 5.4% of misfit clients were removed by using infit and outfit criteria, the reduced sample showed adequate person-response validity of only 3.1% misfit.

• Test unidimensionality: Unidimensionality was supported if identified constructs accounted for at least 60% of total variance. Since 70.4% of total variance was explained by the AWP items, adequate unidimensionality is supported.

Muskuloskeletal, Psychological, and Other Internal Physical Disorders: (Sandqvist et al., 2006; n= 21; mean age= not reported; Swedish sample)

• Preliminary testing of face validity and utility of the AWP was determined by a group of 21 assessors in Sweden with varying amounts of expertise in the AWP. The testing supported further development and testing of this assessment and reported adequate face validity.

Work-related problems: (Fan et al., 2013)

• Excellent floor effects for all subdomains

• Adequate ceiling effects with the highest effect found in the communication and interaction skills subdomain at 13.7%