Table 3

Changes in percentages of visits with potential alternate orders

ConditionControl periodIntervention periodFollow-up period
n* %n*Δ in % (95% CI)‡pn*Δ in % (95% CI)‡p
Low back pain666913.252951.9 (0.5 to 3.3)0.00742281.5 (−0.5 to 3.6)0.14
Headaches16619.510744.2 (−1.0 to 9.3)0.117913.4 (−1.7 to 8.6)0.19
Acute sinusitis20900.71224−0.2 (−0.8 to 0.4)0.44864−0.5 (−1.3 to 0.2)0.14
Any of the three conditions§10 42010.175931.7 (0.3 to 3.1)0.0158831.4 (−0.4 to 3.1)0.12
  • *n=number of visits with an International Classification of Diseases, Ninth Revision (ICD-9) code for each respective condition during each study period. The lists of ICD-9 codes were previously developed by Premera Blue Cross and the Washington State Choosing Wisely Task Force to measure rates of potentially low-value services in visits for which each respective Choosing Wisely recommendation could apply. All lists of ICD-9 codes are shown in online  supplementary appendix table 1.

  • †The raw percentage of visits with a potential alternate order of questionable value: sinus X-ray, sinus CT or ear, nose and throat referrals for acute sinusitis; opiate prescriptions, or orthopaedics, neurosurgery, spine clinic, neurology or pain clinic referrals for low back pain; or opiate or butalbital prescriptions, or neurology or pain clinic referrals for headaches.

  • ‡Mean absolute differences between the control period and the intervention or follow-up period, respectively, in the percentages of visits with potential alternate orders of questionable value (defined above) as estimated from linear mixed models with random effects for providers nested in practices, adjusted for patient characteristics, time and comorbidities. SEs are robust SEs clustered at the clinic level.

  • §Composite measure in which the denominator is all visits for one of the three conditions, and the numerator is a potential alternate order of questionable value for that respective condition.