• Elise H Lawson, Rachel Louie, David S Zingmond, Greg D Sacks, Robert H Brook, Bruce Lee Hall, and Clifford Y Ko.
• *Department of Surgery, David Geffen School of Medicine, University of California, Los Angeles, CA †Division of Research and Optimal Patient Care, American College of Surgeons, Chicago, IL ‡VA Greater Los Angeles Healthcare System, Los Angeles, CA §Department of Medicine, David Geffen School of Medicine, University of California, Los Angeles, CA ¶RAND Corporation, Santa Monica, CA ||UCLA Jonathan and Karin Fielding School of Public Health, Los Angeles, CA **Department of Surgery, School of Medicine, Washington University in St Louis, and Barnes Jewish Hospital, St Louis, MO ††Center for Health Policy and the Olin Business School at Washington University in St Louis, St Louis, MO ‡‡Department of Surgery, John Cochran Veterans Affairs Medical Center, St Louis, MO §§BJC Healthcare, St Louis, MO.
• Ann. Surg. 2016 Jan 1;263(1):50-7.

ObjectiveTo examine the validity of hybrid quality measures that use both clinical registry and administrative claims data, capitalizing on the strengths of each data source.BackgroundPrevious studies demonstrate substantial disagreement between clinical registry and administrative claims data on the occurrence of postoperative complications. Clinical data have greater validity than claims data for quality measurement but can be burdensome for hospitals to collect.MethodsAmerican College of Surgeons National Surgical Quality Improvement Program records were linked to Medicare inpatient claims (2005-2008). National Quality Forum-endorsed risk-adjusted measures of 30-day postoperative complications or death assessed hospital quality for patients undergoing colectomy, lower extremity bypass, or all surgical procedures. Measures use hierarchical multivariable logistic regression to identify statistical outliers. Measures were applied using clinical data, claims data, or a hybrid of both data sources. Kappa statistics assessed agreement on determinations of hospital quality.ResultsA total of 111,984 patients participated from 206 hospitals. Agreement on hospital quality between clinical and claims data was poor. Hybrid models using claims data to risk-adjust complications identified by clinical data had moderate agreement with all clinical data models, whereas hybrid models using clinical data to risk-adjust complications identified by claims data had routinely poor agreement with all clinical data models.ConclusionsAssessments of hospital quality differ substantially when using clinical registry versus administrative claims data. A hybrid approach using claims data for risk adjustment and clinical data for complications may be a valid alternative with lower data collection burden. For quality measures focused on postoperative complications to be meaningful, such policies should require, at a minimum, collection of clinical outcomes data.

12 keywords...

hide…