- Research article
- Open Access
Perioperative patient safety indicators and hospital surgical volumes
BMC Research Notesvolume 7, Article number: 117 (2014)
Since the late 1990s, patient safety has been an important policy issue in developed countries. To evaluate the effectiveness of the activities of patient safety, it is necessary to quantitatively assess the incidence of adverse events by types of failure mode using tangible data. The purpose of this study is to calculate patient safety indicators (PSIs) using the Japanese Diagnosis Procedure Combination/per-diem payment system (DPC/PDPS) reimbursement data and to elucidate the relationship between perioperative PSIs and hospital surgical volume.
DPC/PDPS data of the Medi-Target project managed by the All Japan Hospital Association were used. An observational study was conducted where PSIs were calculated using an algorithm proposed by the US Agency for Healthcare Research and Quality. We analyzed data of 1,383,872 patients from 188 hospitals who were discharged from January 2008 to December 2010.
Among 20 provider level PSIs, four PSIs (three perioperative PSIs and decubitus ulcer) and mortality rates of postoperative patients were related to surgical volume. Low-volume hospitals (less than 33rd percentiles surgical volume per month) had higher mortality rates (5.7%, 95% confidence interval (CI), 3.9% to 7.4%) than mid- (2.9%, 95% CI, 2.6% to 3.3%) or high-volume hospitals (2.7%, 95% CI, 2.5% to 2.9%). Low-volume hospitals had more deaths among surgical inpatients with serious treatable complications (38.5%, 95% CI, 33.7% to 43.2%) than high-volume hospitals (21.4%, 95% CI, 19.0% to 23.9%). Also Low-volume hospitals had lower proportion of difficult surgeries (54.9%, 95% CI, 50.1% to 59.8%) compared with high-volume hospitals (63.4%, 95% CI, 62.3% to 64.6%). In low-volume hospitals, limited experience may have led to insufficient care for postoperative complications.
We demonstrated that PSIs can be calculated using DPC/PDPS data and perioperative PSIs were related to hospital surgical volume. Further investigations focusing on identifying risk factors for poor PSIs and effective support to these hospitals are needed.
Since the late 1990s, patient safety has been an important policy issue in developed countries. To evaluate the effectiveness of the activities of patient safety, it is necessary to quantitatively assess the incidence of adverse events by types of failure mode using tangible data. However, the conventional retrospective clinical record reviews are now difficult to conduct because of the amount of effort required and the stringent regulations regarding the protection of personal information . To develop alternative method to measure the incidence of adverse events is an important issue, although claim data or hospital administrative data have been used for this purpose [2, 3].
The US Agency for Healthcare Research and Quality (AHRQ) started developing clinical indicators in the early 1990s, known as AHRQ quality indicators (QIs) . AHRQ QIs are categorized on the basis of the domain in healthcare that they reflect. Among them, patient safety indicators (PSIs) are a set of QIs that provide information regarding potentially preventable in-hospital complications and adverse events following surgeries, procedures, and childbirth. PSIs comprise seven regional level indicators and 20 provider level (hospital level) indicators.
Each PSI has a denominator and numerator that are defined using ICD-9-CM and DRG codes. Both ICD-9-CM and DRG codes are widely used for not only hospital reimbursement and monitoring of health services but also objectively measure patient safety concerns in a hospital on the basis of information collected daily from discharged patients. PSIs focus on potentially preventable complications, and they use information of diagnoses made after surgeries or procedures . PSIs have been validated using data obtained from Veterans Affairs hospitals [6–8] and are currently being used to reimburse hospitals. The US Center for Medicare and Medicaid Services adopted PSIs in value-based purchasing programs to measure hospital performance . AHRQ has developed and released a user’s guide and software for calculating PSIs.
In Japan, the Diagnosis Procedure Combination/per-diem payment system (DPC/PDPS) was introduced in 2003 to reimburse university hospitals and is now a standard reimbursement system for acute care hospitals. DPC/PDPS reimbursement data include electronic information regarding diagnoses and details of daily medical procedures, surgeries, and prescribed medicines as well as patient demographics. DPC/PDPS data use ICD-10 codes for diagnoses and K-codes (Japanese original codes) for surgeries. DPC/PDPS data can be used to improve healthcare transparency and quality. For example, the All Japan Hospital Association (AJHA), one of the largest nation-wide hospital associations comprising 2,300 hospitals, handles the administration of the Medi-Target project, a benchmark project using clinical indicators based on DPC/PDPS data. Participation in Medi-Target project was optional, and there were 27 participating hospitals in 2008, 174 hospitals in 2009, and 182 hospitals in 2010.
The purpose of the present study was to calculate PSIs using DPC/PDPS data and to investigate the incidence of adverse events by type. The relationship among hospital surgical volume, difficulty of surgeries, and perioperative PSIs were also investigated.
DPC/PDPS data of the Medi-Target project from January 2008 to December 2010 were used for analysis. PSI technical specifications versions 4.2 released by AHRQ were used for calculating PSIs.
Technical specifications designate both inclusion and exclusion criteria for the numerators and denominators of each PSI with patient demographics such as age, length of hospital stay, primary and secondary diagnoses, surgeries, and procedures defined by ICD-9-CM codes. In this study, ICD-9-CM codes were converted to ICD-10 codes and ICD-9-CM procedure codes were converted to K-codes using a translation table released by the Medical Information System Development Center of Japan. Thereafter, we constructed a database storing information regarding patient demographics, primary and secondary diagnoses, comorbidities at admission, postadmission complications, surgeries, and procedures.
To investigate the relationship between hospital surgical volume and PSIs, we divided the hospitals into three groups on the basis of volume, i.e., high-volume, mid-volume, and low-volume, using the 66th and 33rd percentiles of the distribution of surgeries per month. Surgical difficulty and patient severity were also considered. The Association of Social Insurance Committees of the Surgical Societies of Japan classified surgeries into five classes on the basis of difficulty, i.e., A–E with E being the most difficult. Classes D and E were defined as surgeries that should be performed by surgeons with more than 15 years of experience and special skills in the area.
We assessed patient severity using the Charlson Comorbidity Index  on the basis of comorbidities at admission. The Charlson Comorbidity Index originally used ICD-9-CM codes and has been translated to ICD-10 codes using an algorithm proposed by Quan et al. .
Analysis of variance (ANOVA) was used for statistical analysis among high-, mid- and low-volume hospitals. Multiple liner regression analysis with the forced entry method was used to determine the relationship between surgical volume and PSIs adjusting for patient age, severity, and proportion of difficult surgeries. We considered surgical difficulty as one of the characteristics of surgery and that variable was put into multiple linear regression analysis. SPSS version 20 was used for statistical analysis and a p value <0.05 was considered statistically significant.
This study used only anonymised data, and did not use human or animals. In Japan, for this kind of study no institutional review is requested .
In the present analysis, we used data of 1,383,872 patients treated at 188 hospitals. The mean age of the patients was 61.5 years and the average length of hospital stay was 16.2 days. Basic hospital characteristics are shown in Table 1. There were 587,506 operative patients, and they were used for further analyses. We accounted for the correlation of data within hospitals. We have observed a correlation between number of surgical operations per month and number of patients discharged per month. The correlation coefficient of this relationship was over 0.9 and that was statistically significant (p < 0.01). Low-volume hospitals treated more elderly and female patients, and also reported longer hospital stays and higher mortality rates than mid- or high-volume hospitals. High-volume hospitals performed more difficult surgeries than low-volume hospitals. The mortality rate of postoperative patients was also related to surgical volume: low-volume hospitals, 5.7%; mid-volume hospitals, 2.9%; and high-volume hospitals, 2.7% (p < 0.01 by ANOVA).
The relationship between hospital surgical volume and PSIs is shown in Table 2. High-volume hospitals had higher scores for PSI#9 (postoperative hemorrhage or hematoma) and PSI#13 (postoperative sepsis). Low-volume hospitals had higher scores for PSI#3 (pressure ulcer) and PSI#4 (death among surgical inpatients with serious treatable complications). Low-volume hospitals incurred more deaths among surgical inpatients with serious treatable complications compared with high-volume hospitals, although the proportion of difficult surgeries (classes E and D) was less than that of high-volume hospitals.
Multiple linear regression analysis was performed to determine the relationship between surgical volume and three PSIs (PSI#4, #9, and #13), adjusting for patient age, severity, and proportion of difficult surgeries (Table 3). A significant relationship was observed between surgical volume and the three PSIs. Each additional surgical patient per month is associated with 0.2 fewer cases of Death among surgical inpatients with serious treatable complications /1,000 hospitalizations but 0.2 more cases of postoperative hemorrhage or hematoma and 0.3 more cases of postoperative sepsis/1,000 hospitalizations.
The results of our study suggest that surgical volume was related to PSI#4, #9, and #13. In low-volume hospitals, experience to perform difficult surgeries was limited and they may have experienced difficulty in dealing with postoperative complications, thereby resulting in higher mortality rates. In high-volume hospitals, the proportion of difficult surgeries and surgical patients were high and their ability to detect complications, such as postoperative hemorrhage/hematoma or sepsis, may have been high, leading to the higher prevalence of postoperative complications. However, the experience of the hospital staff and greater resources to deal with complications may explain the relatively low mortality rates.
In the US, analysis of Nationwide Inpatient Sample Discharge Database suggested that high-volume hospitals had lower mortality rates among surgical inpatients with serious treatable complications who underwent coronary artery bypass grafting and Roux-en-Y gastric bypass surgeries .
PSIs are also used in other countries. For example, in the UK, PSIs are calculated using the AHRQ algorithm . The Health Care Quality Indicators project conducted by the Organization for Economic Co-operation and Development developed an international benchmark system that included 12 PSIs among 59 candidate indicators . In the present study, we demonstrated that PSIs can be calculated from DPC/PDPS data, which are easy to obtain and may be useful for international PSI comparisons.
Most previous Japanese studies regarding perioperative and operative patient safety focused on specific surgical procedures, such as cardiovascular and gastric cancer surgeries, using operative patient registration system . DPC/PDPS is a standard reimbursement system for inpatients in acute care hospitals in Japan and contains electronic data regarding diagnoses, details of daily medical procedures, surgeries, and prescribed medications in addition to patient demographics.
This study is not free from limitations. First is the process of translation and difference of coding habits among countries. Some of the ICD-9-CM codes were difficult to translate to the DPC/PDPS codes. In Japan, some codes such as a foreign body left during procedure are seldom used. They might affect calculations, and we should be prudent in comparing results from different countries. We believe that there is a need to consider the next study to clarify the characteristics related to the translation of the technical specification, including conversion from ICD-9-CM to ICD-10 and the effect of study results. DPC/PDPS system has basically designed for reimbursement and incident reporting system has been managed separate from reimbursement system. There is possibility that information about the disease which developed after admission which do not affect the reimbursement would not be input to DPC/PDPC database. This cording habit might lead underestimate of PSIs. Second is representativeness of the dataset used in our study. In 2012, 1,496 acute care hospitals are reimbursed using DPC/PDPS all over Japan, the dataset of this study reflects about 10-15% of the DPC/PDPS hospitals, and they are not selected randomly. Participation in Medi-Target project is optional, and participating hospitals might pay more attention to quality and safety issues than non-participating hospitals. PSIs calculated in the study might not be applied to the other hospitals.
In the future, DPC/PDPS will be extended to reimburse outpatients. Although we used a dataset of hospitals participating in the Medi-Target project, PSIs of all acute care hospitals in Japan can be calculated without any special preparation using the method developed in this study. This is the first study to use large data, and further studies focusing on organizational safety issues using DPC/PDPS data are needed.
In the present study, we demonstrated that DPC/PDPS data can be used to calculate PSIs. Perioperative PSIs were related to hospital surgical volume. The mortality rate of patients with operations was also related to surgical volume, and low-volume hospitals had higher mortality rates than mid- or high-volume hospitals. Low-volume hospitals had more deaths among surgical inpatients with serious treatable complications compared with high-volume hospitals, although the proportion of difficult surgeries (classes E and D) was less than that of high-volume hospitals. In low-volume hospitals, limited experience may have led to insufficient care of postoperative complications. Thus, effective support should be investigated focusing on these hospitals.
All Japan Hospital Association
Agency for Healthcare Research and Quality
Analysis of variance
Diagnosis procedure combination/per-diem payment system
Patient safety indicators
O’Keefe CM, Connolly CJ: Privacy and the use of health data for research. Med J Aust. 2010, 193: 537-541.
Iezzoni LI, Foley SM, Heeren T, Daley J, Duncan CC, Fisher ES, Hughes J: A method for screening the quality of hospital care using administrative data: preliminary validation results. QRB Qual Rev Bull. 1992, 18: 361-371.
Miller MR, Elixhauser A, Zhan C, Meyer GS: Patient safety indicators: using administrative data to identify potential patient safety concerns. Health Serv Res. 2001, 36: 110-132.
Farquhar M: AHRQ quality indicators. Patient safety and quality: an evidence-based handbook for nurses. Edited by: Hughes RG. 2008, Rockville: Agency for Healthcare Research and Quality, 41-67.
McDonald KM, Romano PS, Geppert J, Davies SM, Duncan BW, Shojania KG, Hansen A: Measures of patient safety based on hospital administrative data - the patient safety indicators. 2002, Agency for Healthcare Research and Quality: Rockville
Borzecki AM, Cevasco M, Chen Q, Shin M, Itani KM, Rosen AK: How valid is the AHRQ patient safety indicator “postoperative physiologic and metabolic derangement”?. J Am Coll Surg. 2011, 212: 968-976. 10.1016/j.jamcollsurg.2011.01.001. e961-962
Cevasco M, Borzecki AM, O’Brien WJ, Chen Q, Shin MH, Itani KM, Rosen AK: Validity of the AHRQ patient safety indicator “central venous catheter-related bloodstream infections”. J Am Coll Surg. 2011, 212: 984-990. 10.1016/j.jamcollsurg.2011.02.005.
Chen Q, Rosen AK, Cevasco M, Shin M, Itani KM, Borzecki AM: Detecting patient safety indicators: how valid is “foreign body left during procedure” in the Veterans Health Administration?. J Am Coll Surg. 2011, 212: 977-983. 10.1016/j.jamcollsurg.2011.02.003.
Rivard PE, Elwy AR, Loveland S, Zhao S, Tsilimingras D, Elixhauser A, Romano PS, Rosen AK: Advances in patient safety: from research to implementation. 2005, Agency for Healthcare Research and Quality: Rockville
Charlson ME, Pompei P, Ales KL, MacKenzie CR: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987, 40: 373-383. 10.1016/0021-9681(87)90171-8.
Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, Saunders LD, Beck CA, Feasby TE, Ghali WA: Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005, 43: 1130-1139. 10.1097/01.mlr.0000182534.19832.83.
Ethical guidelines for epidemiological research. [http://www.lifescience.mext.go.jp/files/pdf/n796_01.pdf]
Hernandez-Boussard T, Downey JR, McDonald K, Morton JM: Relationship between patient safety and hospital surgical volume. Health Serv Res. 2012, 47: 756-769. 10.1111/j.1475-6773.2011.01310.x.
Raleigh VS, Cooper J, Bremner SA, Scobie S: Patient safety indicators for England from hospital administrative data: case–control analysis and comparison with US data. BMJ. 2008, 337: a1702-10.1136/bmj.a1702.
Drösler SE, Klazinga NS, Romano PS, Tancredi DJ, Gogorcena Aoiz MA, Hewitt MC, Scobie S, Soop M, Wen E, Quan H, Ghali WA, Mattke S, Kelley E: Application of patient safety indicators internationally: a pilot study among seven countries. Int J Qual Health Care. 2009, 21: 272-278. 10.1093/intqhc/mzp018.
Kazui T, Osada H, Fujita H, Committee for Scientific Affairs: An attempt to analyze the relation between hospital surgical volume and clinical outcome. Gen Thorac Cardiovasc Surg. 2007, 55: 483-492.
This study was supported, in part, by the Health and Labour Sciences Research Grant (Grant No. H23-Iryo-Ippan-004) of the Japan Ministry of Health, Labour, and Welfare.
The authors declare that they have no competing interests.
TK participated in the design of the study, performed the data collection and the analysis, and drafted the manuscript. KM participated in the design of the study and performed the analysis. SF, AY, SI and HN performed the data collection and the analysis. TH conceived of the study, and participated in its design and helped to draft the manuscript. All authors read and approved the final manuscript.