Medical care epidemiology and unwarranted variation: the Israeli case
Israel Journal of Health Policy Research volume 6, Article number: 9 (2017)
In an article in this Journal, Mendlovic and colleagues report on regional variation in medical care across Israeli regions. This study joins a growing literature demonstrating generally high variation in the provision of health care services within developed countries. This commentary summarizes the status of medical care epidemiology and its studies of unwarranted variation in health care, and provides a conceptual framework to guide future studies. Recommendations are offered for advancing studies in Israel that could guide policy development and clinical improvement.
If we want to improve health care, systematic population-based measurement of health care delivery is essential . While the importance of ascertaining population health status is well recognized, medical care as a focus of measurement is less developed. Barriers include poor data availability and the reluctance to publicly report findings, resulting in a failure to identify many opportunities for policy development and clinical improvement. While there are a few countries in which medical care epidemiology is robust, the implementation of this essential partner to disease epidemiology remains uneven . Researchers outside the U.S., U.K., and Canada have been relatively slow in initiating analysis of medical care and its variation until a decade ago, when academic and governmental interest began to grow. One example of greater national interest is Israel’s participation in the medical practice variation project of the Organisation for Economic Co-operation and Development (OECD)  which led to Mendlovic and colleagues’ recent paper in IJHPR . This article reports an important study for the Israeli health care system and makes a notable contribution to the international effort to better understand health care and target improvement.
The landscape of Israeli hospital utilization shows striking similarities, and some differences, to the other 12 countries participating in the OECD project . With two exceptions, regional variation of medical hospitalizations and procedures was markedly high, a phenomenon observed for most types of medical and surgical care wherever measured . Low variation in utilization was found for surgery after hip fracture in Israel as has also been observed in other developed countries. This can be attribiuted to professional certainty in diagnosis and the need for treatment. Almost all hip fractures are diagnosed and have surgery. Therefore, hip fracture with surgery rates correlate closely with disease incidence. In general, differences in populations, including health status, are less important contributors to variation than is professional uncertainty and physician practice styles. More unusual was Israel’s low variation in hysterectomies, but Israel also has the lowest rate of hysterectomies of the 13 reporting OECD countries. To place Israel’s rate of 122 hysterectomies per 100,000 in perspective, Spain had the next highest rate at 172, and Canada’s rate was 394, the highest of the 13 participating countries.
Development of medical care epidemiology
Description is the start of any epidemiologic analysis, and quickly leads to questions of causation. What factors lead to high medical practice variation? Can we say that some types of medical practice variation are “good” and other types “bad?” If we determine the causes, are there remedies that might improve health care and health? At this early stage, there are no specific answers to these questions for Israel. Inferential analysis of the causes and health consequences of variation proceeds much more slowly than description. But there is a sizable body of inferential research from other countries that may have relevance to Israel .
The primary motivation to study patterns of health care utilization is to gain insight into the performance of health care providers and systems. Suboptimal health care performance has consequences for population health, but variation in health care is only partially explained by area population differences. The technical term for the variation that is not explained by patient needs or preferences is “unwarranted variation” and reflects differences in health care quality and efficiency. Originally, analyses examining unwarranted variation were termed “small area analysis,”  in reference to analysis across empirically defined health care service areas (i.e. geographic health care markets). With improvements in data quality, recent efforts have been directed toward the measurement across providers, such as hospitals. Regardless of the units that define the population or patient denominators, the study of health care variation faces similar challenges in methods and interpretation.
While the first study of medical practice variation was published in England in 1938,  John Wennberg’s 1973 paper in Science reporting differences in health care resources and utilization across the relatively homogenous State of Vermont marked the beginning of rapid growth in small area analysis studies in the U.S. . Given today’s recognition of the uneven shortcomings in health care, it may be difficult to appreciate that in the 1970s these findings were initially ignored, later attacked,  before being replicated [10–12] and then widely embraced by clinicians, health system administrators and policy makers in the U.S. Canada, and the U.K. A notable testament to the seminal character of Wennberg’s paper is its citation by over 1200 other academic papers . Subsequent studies by Dr. Wennberg and his Dartmouth colleagues further advanced the methods to interpret regional patterns of care from the beginning to the end of life [14, 15]. Cohort studies were developed to address inherent weaknesses in cross-sectional designs, and ecologic analyses were supplanted by multi-level models with the patient as the unit of analysis [16–18]. With funding from the Robert Wood Johnson Foundation in 1992, Wennberg and colleagues introduced the Dartmouth Atlas of Health Care series (see www.dartmouthatlas.org) as a dissemination tool directed towards non-academic audiences, such as health care administrators, health policy makers, and congressional staffers. At the same time, research into health care variation grew in the U.K. and Canada, and more recently, with strong support from national and provincial health ministries . In the past 40 years, these and other studies of unwarranted variation have influenced the practice of medicine, the organization of delivery systems, the financing of medical care, and national health care policy.
Types of variation
The most widely used framework for interpreting medical practice variation parses unwarranted variation into three categories—effective, preference sensitive, and supply sensitive care.
Variation in effective care
Variation in effective care reflects differences in technical quality, where medical care interventions have high benefit and low risk. Usually, the “right” rate is close to 100% for the target population. Obvious examples are childhood immunizations, the use of beta blockers and aspirin in myocardial infarctions, and monitoring HgA1C in diabetics. Low utilization rates indicate unwarranted variation in the provision of effective medical practice. Reducing variation in effective care is the most common focus of clinical quality improvement efforts in Israel  and internationally. Technical assistance in improving effective care is available from the Institute for Health Care Improvement or the International Society for Quality in Healthcare [20, 21].
Variation in preference-based care
Preference-based care refers to utilization variation for decisions where there are more than one diagnostic and therapeutic option, each with its own profile of benefits and harm. The original analyses that led to this concept were studies of the treatment of benign prostatic hypertrophy in adult men . In the early 1980s, the high regional variation in the use of transurethral prostatectomies in the U.S. was driven by local differences in theories of benefit and harm held by urologists. Patients usually followed their physician recommendations, which differed across urologists. The risk/benefit profile of TURP compared to watchful waiting was based on a poor evidence base, but in the late 1980s effectiveness studies showed that TURPs offered the benefit of easier and less frequent urination but with the tradeoff of much higher rates of incontinence and sexual dysfunction than previously appreciated by the medical community. Most importantly, average patience preferences favored less TURPs than were observed in utilization rates. These average preferences hid the diversity of values (i.e. utilities) assigned by patients and physicians to the known outcomes. While the “best” choice was the decision that would maximize the utility for each patient, most decisions rested on the average utility assigned by the urologist. Examples of preference sensitive care include treatment options associated with early stage prostate and breast cancer, lower back pain, and arthroplasty. Variation in treatment utilization rates for these conditions reflects the local practice style of physicians, which originates from training and then is molded by clinical experience.
Unfortunately, physicians are poor at diagnosing patient preferences . Improving decision quality through shared decision-making requires new methods of conveying information to patients, such as decision aids,  accompanied by encouraging patient identification of preferences and participation in the decision process. Often, but not always, the introduction of decision aids reduces utilization rates of procedures or aggressive care. Unlike effective sensitive care, there is no single “right rate.” The right rate for a population reflects the average decisions of informed and engaged patients and families. It is expected that the care choices may differ across families, and in turn, across regions.
Variation in supply sensitive care
Supply sensitive care refers to medical services for which utilization rates are responsive to the local availability of health care capacity, such as beds and physicians . These services have also been termed discretionary. While in some instances a low supply of resources may constrain effective care, this category is concerned with the range of capacity that is viewed as adequate.
The backdrop to supply sensitive care is that the regional variation in capacity in many countries does not reflect differences in population need. Despite some efforts to direct physicians, hospital beds, and catheterization labs to places where health status is lower, historical patterns of hospital building and physician location patterns tend to favor more affluent and attractive communities [26, 27].
In the U.S., medical admissions for chronic illness are considered supply sensitive care [28, 29]. Medical discharge rates in the elderly vary 200–300% across hospital services areas and are strongly influenced by area bed supply . How can this occur? Congestive heart failure (CHF) hospitalizations are a useful example. A clinician caring for a patient in the office or ER with signs of worsening CHF has the option of initiating more aggressive treatment with outpatient monitoringor hospitalization, and will decide after considering physiologic parameters, past medical history, and available family and patient preferences. Clinical opinions regarding the “right choice” for a specific patient can differ frequently, even for physicians familiar with clinical guidelines. Invisible to the clinician is the local supply of beds and its subtle influence on the threshold of admission. As bed supply varies, so does discharge rates for CHF along with most other medical causes of admission. There is no evidence that U.S. patients are harmed in regions with lower bed supply and medical hospitalization rates, suggesting that there are unrealized efficiency gains in reducing unnecessary acute care [16, 17].
Further examples of supply sensitive care include the number of hospital or ICU days for medical care, emergency room visits, rates of consultations, physician revisit rates, and imaging procedures. The decisions related to these medical care events elude the concepts of efficacy and effectiveness. Unlike effective care, population rate differences are very weakly associated with outcomes [16, 17].
Israeli medical practice variation in context
Caution is needed in applying these ideas to Israel’s patterns of care. The old adage comes to mind: if you’ve seen one health care system, you’ve seen one health care system. At the same time, the experiences from the U.S. and from other OECD countries may identify future directions for Israeli health policy research. Several recommendations follow:
Measuring health across regions and providers requires consistent efforts at improving measurement, and encouraging inquiry by researchers and policy analysts. Just as disease epidemiology continually monitors and investigates health and disease, medical care epidemiology requires a national commitment to using the findings of population-based evidence to improve care. Israeli patients would benefit from an expansion of health care measures that are tabulated annually. Also, allowing researchers access to the data would bring new insights into the delivery of medical care.
Studies should incorporate more recent methods for controlling for population differences to better reveal the proportion of variation that is unwarranted . The best method is highly dependent on the specific research question, the population of interest, and the quality of available data. Applying improved methods of population adjustment would increase the inferential value of the results.
Given the heterogeneity of both population and health care delivery in Israel, further insight may be gained by studies that use smaller areas or hospitals as the units of analysis. Ideally, the scale of measurement is dictated by the extent of regionalization of care, ranging from primary care  to tertiary care . Hospital specific cohorts for conditions such as acute myocardial infarctions or end of life cancer care can provide high specificity and insight into the responsible health care systems [32, 33].
Finally, without identifying the causes of unwarranted variation, improvement efforts operate in the dark. As descriptions of the Israeli health care utilization develop, a national investment in research examining the causes and consequences of variation is likely to have high returns for patients.
The strains in health care are increasingly evident. The public expects continual gains in medical science, in the development of prevention measures and illness treatment, and in their equitable dissemination through an ever more comprehensive health system. Care known to have high benefits to patients is often incompletely implemented. Low value care disguised as innovative treatments frequently takes root, often at great expense and potential harm. In some instances, patients remain in the dark about available treatment options, as clinicians make well-meaning recommendations that align poorly with patient preferences. Worldwide, rising costs challenge the ability of the health care system to meet these expectations as health care takes an increasing proportion of national wealth, competing against needs in education, housing, and other strategic investments. Israel has successfully constrained spending as a proportion of GDP, but the growth of private spending is high . As public expectations continue to rise in an era of limits in public and private spending, measuring health system performance and its variation across providers can guide the search for better value in health care.
Wennberg J. Tracking medicine: a researcher’s quest to understand health care. New York: New York Oxford University Press; 2010.
Corallo AN, Croxford R, Goodman DC, Bryan EL, Srivastava D, Stukel TA. A systematic review of medical practice variation in OECD countries. Health Policy. 2014;114(1):5–14.
Organisation for Economic Cooperation and Development. Geographic variations in health care : what do we know and what can be done to improve health systems perforance? Paris: OECD; 2014.
Mendlovic J, Gordon ES, Haklai Z, Meron J, Afek A. Geographic variation in selected hospital procedures and services in the Israeli health care system. Isr J Health Policy Res. 2017;6:4.
Wennberg International Collaborative. http://www.wennbergcollaborative.org/. Accessed 30 Jan 2017.
Shaheen P, Clark J, Williams D. Small area analysis: a review and analysis of the north American literature. J Health Polit Policy Law. 1987;12(4):741–809.
Glover JA. The incidence of tonsillectomy in school children. Proc R Soc Med. 1938;31:95–112.
Wennberg J, Gittelsohn A. Small area variations in health care delivery. Science. 1973;182(117):1102–8.
Moore FD. Small area variations in health care delivery, a critique. J Maine Med Assoc. 1977;68:49–57.
Wennberg JE, Gittelsohn A. Health care delivery in Maine I: patterns of use of common surgical procedures. J Maine Med Assoc. 1975;66(5):123–30.
Wennberg JE, Gittelsohn A, Shapiro N. Health care delivery in Maine III: evaluating the level of hospital performance. J Maine Med Assoc. 1975;66(11):298–306.
Wennberg JE, Gittelsohn A, Soule D. Health care delivery in Maine II: conditions explaining hospital admission. J Maine Med Assoc. 1975;66(10):255–61.
Thomson Reuters. Web of Science. 2017. www.webofknowledge.com. Accessed 28 Jan 2017.
Goodman DC. Unwarranted variation in pediatric medical care. Pediatr Clin North Am. 2009;56(4):745–55.
Goodman D, Fisher E, Chang C, et al. Quality of end-of-life cancer care for medicare beneficiaries. Regional and hospital specific analyses. Hanove: Dartmoiuth College; 2010.
Fisher ES, Wennberg DE, Stukel TA, Gottlieb DJ, Lucas FL, Pinder EL. The implications of regional variations in medicare spending. Part 2: health outcomes and satisfaction with care. Ann Intern Med. 2003;138(4):288–98.
Fisher ES, Wennberg DE, Stukel TA, Gottlieb DJ, Lucas FL, Pinder EL. The implications of regional variations in medicare spending. Part 1: the content, quality, and accessibility of care. Ann Intern Med. 2003;138(4):273–87.
Goodman DC, Fisher ES, Little GA, Stukel TA, Chang CH, Schoendorf KS. The relation between the availability of neonatal intensive care and neonatal mortality. N Engl J Med. 2002;346(20):1538–44.
Jaffe DH, Shmueli A, Ben-Yehuda A, et al. Community healthcare in Israel: quality indicators 2007–2009. Isr J Health Policy Res. 2012;1(1):3.
Institute for Healthcare Improvement. http://www.ihi.org/. Accessed 30 Jan 2017.
The International Society for Quality in Health Care. http://www.isqua.org/. Accessed 30 Jan 2017.
Wennberg J, Mulley Jr A, Hanley D, et al. An assessment of prostatectomy for benign urinary tract obstruction. Geographic variations and the evaluation of medical care outcomes. JAMA. 1988;259(20):3027–30.
Mulley AG, Trimble C, Elwyn G. Stop the silent misdiagnosis: patients’ preferences matter. BMJ. 2012;345:e6572.
Barry M, Levin C, Maccuaig M, Mulley A, Sepucha K. Shared decision making: vision to reality. Health Expect. 2011;14 Suppl 1:1–5.
The Dartmouth Atlas of Health Care. Supply-Sensitive Care. Hanover, NH: Dartmouth College;2007. http://www.dartmouthatlas.org/downloads/reports/supply_sensitive.pdf. Accessed 30 Jan 2017.
Goodman D, Fisher E, Bronner K. Hospital and Physician Capacity Update—A Brief Report from the Dartmouth Atlas of Heatlh Care. Hanover, NH: The Dartmouth Institute for Health Policy and Clinical Practice;2009 http://www.dartmouthatlas.org/downloads/reports/Capacity_Report_2009.pdf. Accessed 30 Jan 2017.
Goodman DC, Fisher ES, Little GA, Stukel TA, Chang CH. Are neonatal intensive care resources located according to need? regional variation in neonatologists, beds, and low birth weight newborns. Pediatrics. 2001;108(2):426–31.
Roemer MI. Bed supply and hospital utilization: a natural experiment. Hospitals. 1961;35:36–42.
Wennberg JE, Freeman JL, Culp WJ. Are Hospital Services rationed in New Haven or Over-Utilised in Boston? Lancet. 1987;1(8543):1185–8.
Goodman DC, Mick SS, Bott D, et al. Primary care service areas: a new tool for the evaluation of primary care services. Health Serv Res. 2003;38(1 Pt 1):287–309.
Goodman DC, Fisher ES, Little GA, Stukel TA, Chang CH. The uneven landscape of newborn intensive care services: variation in the neonatology workforce. Eff Clin Pract. 2001;4(4):143–9.
Brown JR, Chang CH, Zhou W, Mackenzie TA, Malenka DJ, Goodman DC. Health system characteristics and rates of readmission after acute myocardial infarction in the United States. J Am Heart Assoc. 2014;3(3):e000714.
Morden NE, Chang CH, Jacobson JO, et al. End-of-life care for Medicare beneficiaries with cancer is highly intensive overall and varies widely. Health Aff (Millwood). 2012;31(4):786–96.
Rosen B, Merkur S, Waitzberg R. European Observatory on Health Systems and Policies, World Health Organization. Israel: Health System Review; 2015.
DCG drafted the paper. AAG provided research and critically reviewed and edited the manuscript. All authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.
David Goodman is professor of pediatrics and health policy at the Geisel School of Medicine at Dartmouth, and is the co-principal investigator of The Dartmouth Atlas of Health Care. He is also the co-founder of the Wennberg International Collaborative with his colleague Prof. Gwyn Bevan of the London School of Economics.
Andrew Goodman is a healthcare consultant at Goodman Health Services with a focus on value-based payment methodologies, physician engagement, and payer-provider alignment.
The authors have no competing interests or funding sources relevant to the commentary.
Mendlovic J, Gordon ES, Haklai Z, Meron J and Afek A: Geographic variation in selected hospital procedures and services in the Israeli health care system. Isr J of Health Policy Res 2017, 6:4. https://ijhpr.biomedcentral.com/articles/10.1186/s13584-016-0127-y.
About this article
Cite this article
Goodman, D.C., Goodman, A.A. Medical care epidemiology and unwarranted variation: the Israeli case. Isr J Health Policy Res 6, 9 (2017). https://doi.org/10.1186/s13584-017-0135-6