• Kushagra Verma, Prakash Sitoula, Peter Gabos, Kerry Loveland, James Sanders, Satyendra Verma, and Suken A Shah.
• *Department of Orthopaedic Surgery, Nemours/A.I. duPont Hospital for Children, Wilmington, DE †Department of Orthopaedic Surgery, Thomas Jefferson University, Philadelphia, PA ‡Department of Orthopaedic Surgery, University of Rochester Medical Center, Rochester, NY; and §Project Research Consulting.
• Spine. 2014 Dec 15;39(26):E1592-8.

Study DesignRetrospective radiographical review by 5 independent observers.ObjectiveTo validate the intra- and interobserver reliability of the simplified skeletal maturity scoring (SSMS) system in a large cohort for each stage and for the overall cohort.Summary Of Background DataThe SSMS has been used to successfully predict curve progression in idiopathic scoliosis.MethodsA total of 275 patients with scoliosis (8-16 yr) with 1 hand radiograph were included from 2005 to 2011. Five participants independently scored images on 2 separate occasions using the SSMS (stage, 1-8). Observers (listed in order of increasing SSMS experience) included orthopedic surgery resident, clinical fellow (CF), research fellow, and senior faculty. Intraobserver agreement between the 2 sets of scores was estimated using the Pearson and Spearman rank correlation coefficients. Interobserver agreement was estimated with the unweighted Fleiss κ coefficient for the overall cohort and for junior (orthopedic surgery resident, CF, research fellow) versus senior faculty.ResultsIntrarater reliability for orthopedic surgery resident, CF, research fellow, senior faculty was 0.956, 0.967, 0.986, 0.991, and 0.998, respectively (Spearman). Intrarater agreement improved with greater familiarity using the SSMS. The inter-rater reliability for junior faculty (κ = 0.65), senior faculty (κ = 0.652), and the overall group (κ = 0.66) indicated agreement between all observers but no improved inter-rater agreement with experience. However, 98% of disagreements occurred only within 1 stage. Stages 2, 3, and 4 accounted for most of the variability; stage 3 was the most commonly scored stage, corresponding to peak growth velocity.ConclusionThe SSMS has excellent intraobserver agreement with substantial interobserver agreement. Intraobserver--but not interobserver agreement--improves with familiarity using the SSMS. Expectancy bias may contribute to a higher likelihood of assigning an SSMS 3. Discrepancies when classifying stages 2 to 4 may be resolved by improved descriptions of epiphyseal capping in stages 2 and 3.Level Of Evidence2.

16 keywords...

hide…