Are inspectors
[FULL TEXT READ AT SOURCE for the passages below, at the PubMed Central deposit PMC5207299, published version under CC BY. Author order verified at api.openalex.org: Alan Boyd first and corresponding, Alliance Manchester Business School, University of Manchester; Addicott, Robertson and Ross then at The King's Fund; Kieran Walshe last, Manchester. Peer-reviewed, open access] Boyd, A., Addicott, R., Robertson, R., Ross, S., & Walshe, K. (2016). 'Are inspectors' assessments reliable? Ratings of NHS acute hospital trust services in England.' Journal of Health Services Research & Policy, 22(1), 28-36. doi:10.1177/1355819616669736. THE MOST IMPORTANT ADDITION OF THE CLOSING PASS, BECAUSE IT IS THE DESIGN THE ARTICLE ACTUALLY WANTS: many equally qualified professionals, the identical case, one scale, inside one system. The design, in their words: they 'investigated the inter-rater reliability of assessments made by inspectors inspecting acute hospitals in England during the piloting of a new regulatory model implemented by the Care Quality Commission (CQC) in 2013 and 2014', and 'In an online survey, we asked individual inspectors to assign a domain and a rating to each of 10 vignettes of service provision information extracted from CQC inspection reports', on a four-point scale across five domains, safety, effectiveness, caring, responsiveness and leadership. They then simulated ratings for teams of inspectors, and separately observed inspections and interviewed staff at inspected hospitals. Sample, verbatim: 'Two hundred and eighty-six individuals (response rate 65%) allocated domains and ratings to all 10 vignettes.' THE FIGURES, measured with Krippendorff's alpha, which the authors chose because it 'takes account of the PA that would be expected by chance': agreement among individuals 'varied substantially, from almost perfect agreement on vignette V3 (Ka = 0.94) to
[FULL TEXT READ AT SOURCE for the passages below, at the PubMed Central deposit PMC5207299, published version under CC BY. Author order verified at api.openalex.org: Alan Boyd first and corresponding, Alliance Manchester Business School, University of Manchester; Addicott, Robertson and Ross then at The King's Fund; Kieran Walshe last, Manchester. Peer-reviewed, open access] Boyd, A., Addicott, R., Robertson, R., Ross, S., & Walshe, K. (2016). 'Are inspectors' assessments reliable? Ratings of NHS acute hospital trust services in England.' Journal of Health Services Research & Policy, 22(1), 28-36. doi:10.1177/1355819616669736. THE MOST IMPORTANT ADDITION OF THE CLOSING PASS, BECAUSE IT IS THE DESIGN THE ARTICLE ACTUALLY WANTS: many equally qualified professionals, the identical case, one scale, inside one system. The design, in their words: they 'investigated the inter-rater reliability of assessments made by inspectors inspecting acute hospitals in England during the piloting of a new regulatory model implemented by the Care Quality Commission (CQC) in 2013 and 2014', and 'In an online survey, we asked individual inspectors to assign a domain and a rating to each of 10 vignettes of service provision information extracted from CQC inspection reports', on a four-point scale across five domains, safety, effectiveness, caring, responsiveness and leadership. They then simulated ratings for teams of inspectors, and separately observed inspections and interviewed staff at inspected hospitals. Sample, verbatim: 'Two hundred and eighty-six individuals (response rate 65%) allocated domains and ratings to all 10 vignettes.' THE FIGURES, measured with Krippendorff's alpha, which the authors chose because it 'takes account of the PA that would be expected by chance': agreement among individuals 'varied substantially, from almost perfect agreement on vignette V3 (Ka = 0.94) to
Written from the fULL TEXT READ AT SOURCE for the passages below, at the PubMed Central deposit PMC5207299, published version under CC BY. Author order verified at api.openalex.org: Alan Boyd first and corresponding, Alliance Manchester Business School, University of Manchester; Addicott, Robertson and Ross then at The King's Fund; Kieran Walshe last, Manchester. Peer-reviewed, open access.
What our sources record
Recorded when this source was checked, figures included, with page references and quotation marks removed.
assessments reliable? Ratings of NHS acute hospital trust services in England.' Journal of Health Services Research & Policy, 22(1), 28-36. doi:10.1177/1355819616669736