Skip to content

Advertisement

  • Commentary
  • Open Access

Improving research and policy interactions requires a better understanding of what works in different contexts

Israel Journal of Health Policy Research20187:60

https://doi.org/10.1186/s13584-018-0256-6

  • Received: 10 September 2018
  • Accepted: 12 September 2018
  • Published:

The original article was published in Israel Journal of Health Policy Research 2018 7:35

Abstract

There is keen interest in many jurisdictions in finding ways to improve the way that research evidence informs policy. One possible mechanism for this is to embed academics within government agencies either as advisers or full staff members. Our commentary argues that, in addition to considering the role of academics in government as proposed by Glied and colleagues, we need to understand better how research and policy interactions function across policy sectors. We believe more comparative research is needed to understand if and why academics from certain disciplines are more likely to be recruited to work in some policy sectors rather than others. We caution against treating government as monolithic by advocating the same model for collaborative interaction between academics and government. Lastly, we contend that contextualized research is needed to illuminate important drivers of research and policy interactions before we can recommend what is likely to be more and less effective in different policy sectors.

Keywords

  • Evidence-informed policy
  • Evidence-based policy
  • Academic and policy maker collaborations
  • Research and policy interactions

Background

The ‘evidence revolution’ and the call for more interaction between academics and government policy-makers

The ‘evidence revolution’ to make better use of research in policy has taken root in many countries and policy contexts around the world. In many cases, it has become the publicly expressed expectation, not the exception. For example, in the United Kingdom, this expectation was enshrined nearly two decades ago in government White Papers such as Modernising Government and Professional Policymaking for the Twenty First Century [1, 2]. Such expectations align with the aspirations of ‘modern’ governments such as transparency, accountability and a less ideologically driven approach to improving public service provision [35]. An evidence-based policy (EBP) discourse also serves to legitimize policy-making through, at a minimum, the appearance of objectivity afforded by a government’s commitment to the use of scientific knowledge [5, 6]. Yet, it is well known that direct use of research evidence in policy is difficult to assess, research evidence as a form a knowledge must compete with many other ways of knowing and research evidence is one among many contributors to policy [7]. Recognition that a pure form of EBP is unlikely to be achievable (or even necessarily desirable) has resulted in a shift of position among most advocates of the better use of evidence towards the more modest ambition of ‘evidence-informed’ policy-making (EIP) [810].

The relationship between research evidence and policy has been extensively studied in the literature on knowledge mobilization, translation and exchange activities [1116]. Such work has moved from the more normative to the more empirical to understand how different models of interaction between academics and policymakers aid in improving the role of research for policy, offering more collaborative and interactive solutions such as co-production and knowledge brokering [17]. A common theme across this literature is the idea that improving the relationship between academics and policymakers or practitioners will lead to both production of more relevant research and greater opportunities for research evidence to be used in decision-making. Such collaborative interactions may take place with academics situated outside government, working on government-commissioned research activities, or inside government where academics may hold formal positions as advisors or, for varying periods of time, become civil servants.

Glied, Wittenberg and Israeli offer their perspective on the role of research evidence and academics in government in their article Research in Government and Academia [18]. Situating their perspective in the larger shifts of governments’ policy practices, their collective experience from the United States, England and Israel of working in both academia and policy-making provides insight into the role of academics in government as one mechanism to foster more evidence-informed policy. As they traverse the interaction between health policy research and government, Glied and colleagues offer informed perspectives on barriers and drivers for research use in government, how government agendas shape their desires for, and consequently the production of, specific types of research-based knowledge, and mechanisms for considering how to improve the interaction between research and policy by situating academics in formal governmental roles [18].

As they set out how academics in government can serve a multiplicity of different roles, one of the most intriguing and perhaps provocative points is their reflection on the need to reconsider the role of academics in government from carriers or conduits of scientific knowledge and skills to that of active shaper of knowledge and evidence-informed practices for policy. Glied and colleagues contend that academics are able to use their training and expertise within government to bring research evidence to the fore of policy decisions building on their unique understanding of research and, over time, their appreciation of policy-making environments and processes. They raise the question of what the appropriate role of academics in the research and policy relationship is, leaning toward academics in government serving to inform and improve policy-making by facilitating a closer engagement and accessible dissemination of relevant concepts to decision makers and injecting research evidence into more aspects of policy-making. In so doing they raise the question of whether academics should apply their conceptual ‘filters’ and shape research-based knowledge so that it is more usable in situ. Their point is less about changing the role of the academic from dispassionate producer of evidence to positioned advocate and more about appreciating the unique skillsets academics could utilize to assist governments by seeking out, making sense of, and perhaps using research evidence in ways more conducive to policy environments. In so doing, academics in government could, through a variety of activities, bring knowledge from research and related expertise closer to the site of policy decisions so that it may have a greater chance of informing policy [19].

While this way of considering the role of academics in government is useful, Glied and colleagues’ arguments on the interaction between research and policy could be strengthened with further considerations. First, are there characteristics of academics inclined to enter into health policy roles in government that are distinctive compared to other social policy sectors (e.g., nature or type of disciplinary training) and do any differences have an influence on the way in which they contribute to policy-making? Next, much of the work to date on research and policy interactions provides solutions that assume government is monolithic, offering up models of collaboration intended to fit all contexts. Is EIP differentially operationalized across government departments and policy sectors (i.e. to what extent are Glied et al.’s experiences specific to health policy-making)? Finally, in what ways would a contextualized learning of relationships between research evidence generation, research use and its impact on practice inform their analyses?

Different academic disciplines in government

As evidenced from Glied and colleagues’ experience [18], and those of two of the current authors (Mays and Robinson) who have served in various governmental roles, academics working in health policy in government often, but not always, appear to come from a small range of disciplines (e.g., typically economics and health sciences). In our experience, it is less often the case that academics from the other social sciences such as sociologists, anthropologists, or political scientists, assume government roles as described by Glied and colleagues [18], and even less likely for those from the humanities (e.g. history). While the lack of other social scientists in government is not necessarily problematic, it may speak to a broader level of how certain types of research are more readily accepted within policymaking environments and may be partly a reflection of the nature of work called for to inform health policy issues. It may be representative of the status of certain kinds of particularly quantitative, positivist pursuit of knowledge and assumptions about certain disciplines’ truth claims as qualitative research may, unfairly, be considered less objective that quantitative pursuits [6, 20]. It may also be because academics from certain disciplines find direct counter-parts in the civil service with whom they can work. A large proportion of the analysts within central government in England, for instance, are economists and, accordingly, in our experience, find it relatively easier to work with academic economists than others.

There may be a number of reasons why government would want academics to serve in formal roles, many of which have been previously pointed out by others and echoed by Glied and colleagues [9, 10, 21]. Academics in government may be positioned to deploy their expertise and skills in manners more conducive for research-based knowledge to inform policy processes than if advising from outside of government, but we know little about how academics in government shape policy practices. We know even less about similarities or differences between health policy as compared to, for example, education or environmental policy. A critical questioning of why certain disciplines and forms of knowledge are more readily accepted across areas in government, and reasons for differences, may shed light on these relationships.

Academic-policy-maker interactions in different policy sectors

While research and policy interactions have been extensively studied in health policy, there is a growing literature on research and policy interactions across policy sectors [9, 17, 22, 23]. Too often in research and policy studies government is treated as monolithic, assuming what happens in one policy sector is broadly applicable to others. Relatively few studies examine, for instance, academic and civil servant collaborations as a unit of analysis to understand how these relationships are enacted and negotiated in practice [14, 19, 24, 25], with a few notable exceptions [26, 27]. We see fewer studies attempting to dissect why similarities and differences in research and policy, and that of academic and civil servant collaborations, exist across policy sectors (e.g., health, education). Empirical work that draws on more diverse theoretical approaches including, but not limited to, the use of policy theory, such as the various strands of institutionalism, and organizational sociology, is needed on the interaction between research and policy to better understand how governments interact with, for example, academics, and what works in context. An excellent example can be seen in Ferlie et al.’s narrative synthesis of the diversity of approaches to knowledge mobilization in the healthcare management literature. The authors highlight an epistemological turn in the evolution in the healthcare knowledge mobilization literature from 2000 signaling a challenge to hierarchical models of evidence based on medical authority in favor of qualitative and narrative forms and a shift from linear conceptualizations of knowledge transfer to relational and organic (trust based) models. A further helpful source – this time based more firmly on the interactions between policy makers and academics is Cairney and Oliver’s work related to the need for better incorporation of policy theories and innovative approaches to both improving and understanding research and policy interactions [18, 19]. These authors highlight the importance of persuasion, emotion, and beliefs as tools for academic researchers to make their work more accessible to policy makers.

Problematizing the relationship between research evidence generation, use and impact on practice

Frequently, proponents of improving the relationship between research and policy, including many knowledge mobilization, translation and exchange proponents, have approached the interaction from a narrowly conceived ‘use’ perspective [28]. However, viewing the function of research for policy purely through such instrumental terms (i.e., direct use in policy) has begun to give way to a discourse that recognizes that research has other functions such as substantiating policy agendas or shaping policy through the broader ideas derived from research findings [28, 29]. This represents an important shift in conceiving the interaction between research and policy and opens opportunities to investigate this relationship from new perspectives. If research evidence is only one policy puzzle piece, how should that modify our understanding of why government would adopt an EIP discourse and consequentially enact EIP practices such as having academics serve in formal governmental roles?

A deeper understanding of the social function of research and its relationship with policy requires moving beyond the paradigmatic dominance in the knowledge mobilization, translation and exchange literature of an instrumental theory of knowledge use and its concomitant recommendations for collaborative working relationships premised on improving relationships to increase use such as co-production and knowledge brokering. This is not to discredit or minimize the importance of such models for developing closer working relationships between research and policy. Rather, it is to recognize that the pursuit of generalizable models of collaboration may have come at the price of advancing contextualized knowledge of other functions of research in and for policy. Too few studies have attempted to develop alternative frameworks of research and policy interactions that appreciate that research evidence serves multiple functions for policy in addition to direct use of findings in policy [30]. Consequently, we know more about what works in terms of collaborative models to improve the use of research in policy as opposed to the wider drivers of EIP practices – where, when, why and how organizations such as governmental departments adopt, enact and seek to employ EIP practices [19].

Conclusion

Research and policy interactions are an area deserving of more comparative empirical analysis if we are to ensure research evidence and academics have a seat at the policy-making table. Having academics serve in government is one mechanism for operationalizing evidence-informed policy practices, but we need to know more about where and for what purposes these relationships flourish (or decline). Developing more nuanced appreciations of research and policy interactions involving different disciplines, across different policy sectors is needed before we can suggest which models of interaction might fit different settings best. This also entails understanding what draws academics to work in government, what, if any, characteristics of academics drawn to health policy are unique compared to academics working in other areas of government, and how academics in government influence actual policy practices. To do so, we also need research and policy studies that include understanding the wider reasons why governments pursue EIP.

Abbreviations

EBP: 

Evidence-based policy

EIP: 

Evidence-informed policy

Declarations

Authors’ contributions

All authors contributed equally in developing the commentary. All authors read and approved the final manuscript.

Authors’ information

JR is a Doctor of Public Health candidate at the London School of Hygiene & Tropical Medicine and former Health Services Research & Policy Advisor to the Director of Health Services Research and Development at the U.S. Department of Veteran’s Affairs.

NM is Professor of Health Policy and Director of the Policy Innovation Research Unit funded by England’s Department of Health and Social Care.

AF is Assistant Professor and core member of the Policy Innovation Research Unit.

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Authors’ Affiliations

(1)
Department of Health Services Research & Policy, London School of Hygiene and Tropical Medicine, 15-17 Tavistock Place, London, WC1H 9SH, UK

References

  1. Cabinet Office. Modernizing government. London: Cabinet Office; 1999.Google Scholar
  2. Cabinet Office. Professional policymaking for the twenty first century. London: Cabinet Office; 1999.Google Scholar
  3. Head B. Three lenses of evidence-based policy. Aust J Public Adm. 2008;67(1):1–11.View ArticleGoogle Scholar
  4. Head B. Reconsidering evidence-based policy: key issues and challenges. Polic Soc. 2010;29(2):77–94.View ArticleGoogle Scholar
  5. Haskins R. Evidence-based policy: the movement, the goals, the issues, the promises. Ann Am Soc Poli Soc Sci. 2018;678(1):8–37.View ArticleGoogle Scholar
  6. Jasanoff S. The practices of objectivity in regulatory science. In: Camic C, Gross N, Lamont M, editors. Social knowledge in the making. Chicago: The University of Chicago Press; 2011. p. 307–38.Google Scholar
  7. Oliver K, Lorenc T, Innvaer S. New directions in evidence-based policy research: a critical analysis of the literature. Health Res Policy Syst. 2014;12(34):1–11.Google Scholar
  8. Black N. Evidence based policy: proceed with care. Br Med J. 2001;6(2):237–53.Google Scholar
  9. Cairney P. The politics of evidence-based policy-making. London: Palgrave Macmillan; 2016.View ArticleGoogle Scholar
  10. Parkhurst J. The politics of evidence: from evidence-based policy to the good governance of evidence. London and New York: Routledge; 2017.Google Scholar
  11. Contandriopoulos D, Lemire M, Tremblay E, Denis JL. Knowledge exchange processes in organizations and policy arenas: a narrative systematic review of the literature. Milbank Q. 2010;88(4):444–83.View ArticleGoogle Scholar
  12. Innvaer S, Vist G, Trommald M, Oxman A. Health policy-makers’ perceptions of their use of evidence: a systematic review. J. Health Serv. Res. Policy. 2002;7(4):239–44.View ArticleGoogle Scholar
  13. Lomas J. Using ‘linkage and exchange’ to move research into policy at a Canadian foundation. Health Affairs. 2000;19(3):236–40.View ArticleGoogle Scholar
  14. Mitton C, Adair C, McKenzie E, Patten SB, Wayne PB. Knowledge transfer and exchange: review and synthesis of the literature. Milbank Q. 2007;86(4):729–68.View ArticleGoogle Scholar
  15. Oliver K, Innvaer S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv. Res. 2014;14(1):2.View ArticleGoogle Scholar
  16. Orton L, Lloyd-Williams F, Taylor-Robinson D, O’Flaherty M, Capewell S. The use of research evidence in public health decision making processes: a systematic review. PLoS One. 2011;6(7):e21704.View ArticleGoogle Scholar
  17. Cvitanovic C, Hobday A, van Keykhoff L, Wilson S, Dobbs K, Marshall NA. Improving knowledge exchange among scientists and decision-makers to facilitate the adaptive governance of marine resources: a review of knowledge and research needs. Ocean Coast. Manag. 2015;112:25–35.View ArticleGoogle Scholar
  18. Glied S, Wittenberg R, Israeli A. Research in government and academia. Isr. J. Health Policy Res. 2018;7(X).Google Scholar
  19. Cairney P, Oliver K. Evidence-based policymaking is not like evidence-based medicine, so how far should you go to bridge the divide between evidence and policy? Health Res Policy Syst. 2017;15:35.View ArticleGoogle Scholar
  20. Ferlie E, Crilly T, Jashapara A, Peckham A. Knowledge mobilisation in healthcare: a critical review of health sector and generic management literature. Soc. Sci. Med. 2012;74:1297–304.View ArticleGoogle Scholar
  21. Hawkins B, Parkhurst J. The ‘good governance’ of evidence in health policy. Evid Policy. 2016;12(4):575–92.View ArticleGoogle Scholar
  22. Cooper A. Knowledge mobilisation in education across Canada: a cross-case analysis of 44 research brokering organisations. Evid Policy. 2014;10:29–59.View ArticleGoogle Scholar
  23. Nilsson A, Swartling A, Eckerber K. Knowledge for local climate change adaptation in Sweden: challenges of multilevel governance. Local Environ. 2012;17(6–7):751–67.View ArticleGoogle Scholar
  24. Haynes A, Gillespies J, Derrick G, Hall W, Redmen S, et al. Galvanizers, guides, champions, and shields: the way that policymakers use public health researchers. Milbank Q. 2011;89(4):564–98.View ArticleGoogle Scholar
  25. Lomas J, Brown A. Research and advice giving: a functional view of evidence-informed policy advice in a Canadian ministry of health. Milbank Q. 2009;87(4):903–26.View ArticleGoogle Scholar
  26. Bekker M, van Egmond S, Wehrens R, Putters K, Bal R. Linking research and policy in Dutch healthcare: infrastructure, innovations and impacts. Evid Policy. 2010;692:237–53.View ArticleGoogle Scholar
  27. van Egmond S, Bekker M, Bal R, van der Grinten T. Connecting evidence and policy: bringing researchers and policy makers together for effective evidence-based health policy in the Netherlands: a case study. Evid Policy. 2011;7(1):25–39.View ArticleGoogle Scholar
  28. Boswell C. The political uses of expert knowledge: immagration policy and social research. New York: Cambridge University Press; 2009.View ArticleGoogle Scholar
  29. Smith K. Beyond evidence-based policy in public health: ideas, interests and identities. Los Angeles, London, New Dehli, Singapore, and Washington, DC: SAGE Publications; 2013.View ArticleGoogle Scholar
  30. Boswell C, Smith K. Rethinking policy ‘impact’: four models of research- policy relations. Palgrave Commun. 2017;3:44. https://doi.org/10.1057/s41599-017-0042-z.View ArticleGoogle Scholar

Copyright

© The Author(s). 2018

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate. Please note that comments may be removed without notice if they are flagged by another user or do not comply with our community guidelines.

Advertisement