6 item(s) found.

Post-Normal MAGIC: Editorial

18 September 2020

Post-Normal MAGIC: Editorial

MAGIC

September 2020 marks the end of the MAGIC project. This last issue of The Nexus Times is devoted to the overarching question: “What is the contribution of MAGIC to Post-Normal Science?" In this issue, project members reflect on the project’s research and engagement activities, its strengths and challenges, as well as its contributions and accomplishments, particularly related to post-normal science (PNS). Policy narratives, “wu wei”, mixed science-policy teams, transdisciplinarity, and uncomfortable knowledge are among the topics that are elaborated and reflected on in this issue.

In the first article, Sandra shares her experiences of managing a Horizon 2020 project and reflects on the tensions that arise when applying a post-normal science approach while at the same time aiming to adhere to the requirements of a European Commission Grant Agreement. How to best bring together the necessary openness that comes with PNS with ideals of rigid project-plans, (quantitatively visible) impact and easily applicable solutions?

In our second article, Angela and Thomas use the case of a workshop on the water-energy-food-ecosystem nexus co-organized by MAGIC and the EC’s Joint Research Centre to discuss what it means to work with extended peer communities in the European Commission. Is there a politics of extension?

In their contribution, Kirsty, Kerry and Keith focus on engagements with actors from the EC policy DGs and identify a number of key paradoxes that arise when working in “mixed science-policy teams”. They raise important questions regarding the most relevant groups to engage and how to make a selection, the problems to focus on, and the kinds of relationships to aim for.

In their reflection on the MAGIC project, Mario and Silvio discuss how conceptual aspects of MAGIC have complemented an understanding of post-normal science. They address three types of narratives in EU policy-making - justification, normative and explanation narratives - and point to the importance of quality control of these narratives through extended peer communities. In this sense their contribution is a call for democratizing evidence.

Finally, Roger weaves together the different parts and endeavours of MAGIC and provides some insights into what it meant to live with this project for four years. Starting from a short history of post-normal science, he asks for the particular contribution of this project to the philosophy of PNS. Adding to this, Roger draws on Eastern philosophy to develop one possible avenue for the future journey of PNS.

 

 

Managing a Post-Normal Science Project within Horizon 2020: Dream, Nightmare or Both?

Managing a Post-Normal Science Project within Horizon 2020: Dream, Nightmare or Both?

Sandra Bukkens (project manager)

In this article, I briefly elaborate on what made MAGIC management a ‘unique’ experience.  

Probably one of the main characteristics of a post-normal science project is that there is not, and cannot be, a pre-determined plan. In post-normal science, the course of action is flexible and shaped by the stakeholder engagement. Policies and innovations of interest, relevant stakeholders, and engagement opportunities are unpredictable and fluid.  While the philosophy of post-normal science research closely adheres to the recommendation of the Commission for Responsible Research and Innovation, notably its emphasis on public engagement, it is incompatible with the Commission’s vision of a Grant Agreement, which resembles more of a five-year Soviet plan. This has been particularly problematic in MAGIC, where the public engagement was set to take place in the pre-analytic phase. How to co-create the research plan without having to continuously resort to amendments? Fortunately, there (still) is a human face behind the EC participant portal, which helped to resolve some of these problems!

The impacts strived for by the project—awareness, changes in mindset, attitude, and connectivity of policymakers—do not easily let themselves capture by numerical indicators, patents or other tangible outcomes. Especially not if this change is to take place within the Commission itself. Impacts strived for by MAGIC are largely imperceptible on the surface, but nonetheless of great significance. A quote from a retired EC policy officer, writing to the project coordinator (MG) after reading the MAGIC publication on policy legends [1], may illustrate this: “Now I understand a lot better how already then there must have been this “ancien régime syndrome” by which uncomfortable facts are silently and almost unconsciously filtered out to “avoid the unavoidable“ (called “unknown knowns” by MG)”. Note that there is only one key performance indicator (KPI) in Horizon 2020 for Responsible Research & Innovation, i.e. “institutional change”, but this KPI is normally assumed to measure changes everywhere else than within the EC directorates themselves. The inclusion of filters/criteria such as “policy related results” and “raise awareness and possibly influence policy” in the recently created Horizon2020 Results Platform is a promising step forward. Reflexive evaluation by stakeholders could be another solution.

Transdisciplinarity has been quite another test. MAGIC has shown that transdisciplinary research is easier said than done and the ambition of the consortium to jointly develop a novel transdisciplinary approach was a bold one. Indeed, it quickly became evident in the early stages of the project that many of the consortium partners did not quite fully realize what they had signed up for. Transdisciplinary research requires collaboration (which translates in time, patience and trust), an open mindset, and willingness to question business as usual and embark on something new and possibly risky. This involves making compromises and willingness to face uncertainty. In this sense, the project/consortium itself has served as a small-scale experiment for what it pretended to achieve at EC level. MAGIC has shown that genuine change takes time, but that eventually it can be done!

A post-normal science project does not offer optimal solutions nor best courses of action for policymaking. MAGIC’s quantitative story-telling works by exposing untenable assumptions in prevailing (‘politically correct’) narratives, thereby paving the way for the recognition of the relevance of alternative narratives for other social actors. Therefore, results produced by MAGIC, almost by definition, create uncomfortable knowledge for the establishment. This not only is at odds with the expectation from a H2020 project, but also creates a considerable challenge for project communication. MAGIC has seen significant discussion within the consortium regarding the handling of social media and project dissemination at times akin to censorship (”we cannot say that!”). With several beneficiaries in the MAGIC consortium also being involved in other research projects, which evidently demanded more politically correct messages, MAGIC’s communication with the outside has been under continuous scrutiny, not only from the outside, but also from within, notably in the early phases of the project when consortium members had yet to learn to trust each other and assimilate the spirit of post-normal science.

Looking back, now that the project is drawing to an end, I might be inclined to say that MAGIC has been a rewarding adventure, but I rather wait till we have concluded the final reporting …

 

References:

[1] Giampietro M & Funtowicz SO (2020), 'From elite folk science to the policy legend of the circular economy', Environmental Science & Policy: 109, 64–72. https://doi.org/10.1016/j.envsci.2020.04.012.

 

 

Post-Normal Science and the European Commission’s Joint Research Centre

Post-Normal Science and the European Commission’s Joint Research Centre

Ângela Guimarães Pereira & Thomas Völker

Engagements with different actors on various levels of governance and policymaking were a central element of Quantitative Story Telling (QST) approach developed and applied in MAGIC. This approach builds on ideas developed by Jerry Ravetz and Silvio Funtowicz as a part of their writing on post-normal science (PNS). In particular, our work made use of their concept of an ‘extended peer communities’ (Funtowicz and Ravetz, 1993), i.e. “consisting not merely of persons with some form or other of institutional accreditation, but rather of all those with a desire to participate in the resolution of the issue.” (Ravetz, 1999: 651)

While these engagements were for the most part carefully designed and orchestrated, sometimes chances for interacting with the world of policy emerge as a coincidence. We want to use an event of the latter sort to reflect on the relation between PNS and the European Commission (EC).

Midway through the project, the Joint Research Centre (JRC) started contributing to a so-called Flagship-project on the Water-Energy-Food-Ecosystem (WEFE) nexus, which brought together different units at the JRC. Since it was common knowledge at that time that both of us were part of the MAGIC project and thus also working on nexus governance, we were approached to “do something together”. Our JRC colleagues thus were able to report collaboration with different nexus initiatives while we could tick the box of science-policy-engagements.

The workshop we came up with aimed at bringing together JRC researchers, policy officers from policy DGs and scholars working on the WEF concept with a selection of MAGIC consortium partners to discuss nexus narratives together with challenges to nexus governance and approaches for addressing these challenges. The main aim of the workshop was discussing key narratives that were distilled from a document analysis of policy papers and interviews with EC policymakers. The idea was that these could inspire future model requirements.

Reading this description, you might have stumbled across the notion “narrative”, which we casually dropped a couple of times already. What do we mean by that and how does it fit with this workshop?

Conceptually speaking, narrative means a (mostly retrospective) sequential ordering of events from a narrator’s perspective, thus constituting particular temporal and spatial structures and establishing a set of actors/subject positions with particular rationales, often together with a causal relationship between a problem and a solution. Narratives are a fundamental part of how we as individuals and organised social collectives engage with the world. When we walk through a wood, we might see a habitat for certain species, the “lungs” of our world, a recreational space in a world characterised by increasing urbanisation, or – more recently – an area increasingly threatened by climate change and wildfires. It is practically impossible to cognitively and interactionally make sense of ‘the wood’ without embedding it in a story. It is in that sense that Jerome Bruner talks about human beings as “storied animals” (Bruner, 1991). Consequently, stories or narratives not only refer to a cognitive capacity of single isolated actors, but additionally they can be regarded as a “sociocultural artefact” (Herman, 2003). Narratives do something, they way in which we narratively grasp the world in which we live in does have consequence for how we live in it. They express broader imaginations about the world, who and what has agency in it and what is valued. They are closely related to institutional, cultural, moral and material formations of society (Bremer et al., 2017). In policy-making, narratives tacitly define possible horizons for action and distinguish actors from non-actors and issues from non-issues (Hajer, 2006). They naturalise the “normal”, the “taken for granted”. Thus, when working with narratives it is eminently important to talk about not only what is actually there but to also stay attentive to that which is absent. This was done in MAGIC by asking for the relation of dominant to counter narratives or to explore the functions of certain types of narratives (see Mario Giampietro and Silvio Funtowicz in this issue).

Working with narratives in MAGIC has been a way to collaborate more closely with policy DGs to explore how policy narratives relate to scientific representations, while also aiming to extend the peer community of policymakers. Additionally, talking and reflecting about policy narratives is a way to tackle the more informal side of institutions and practices of governance (Hajer, 2006). They become a method to “challenge unthinking consensus” as our colleague Keith Matthews likes to put it.

In this contribution to the Nexus Time we don’t want to reflect on the outcomes of this particular workshop in terms of the main take-aways, nor do we want to engage in the practice of selling success stories that are among the most valuable commodities within the JRC/EC institutional ecology. What we want to do is to use this workshop to reflect on peer-group extension as a practice with the Joint Research Centre to see what “doing post-normal science” entails and means in this particular context. The term “extended peer community” is usually used descriptively, e.g. “the case of AIDS” (Funtowicz and Ravetz, 1993: 753) or normatively to call for the involvement of heterogeneous actors in policy- and decision-making processes.

If PNS is indeed characterised by extended peer communities and extended facts (Funtowicz and Ravetz, 1993) this in turn makes it necessary to reflect on the problem of extension (Collins and Evans, 2002; Dickel and Franzen, 2016) and on questions about the legitimacy of certain ways of knowing and claims to expertise. We argue that is important to consider extension as a practice involving competing claims about the legitimacy of certain sets of expertise, methods and even disciplines in a given organisational-cultural process for any given problem. Extension then becomes a messy practice involving actors with different stakes and aims.

So, why was this workshop made possible? What happened during and after the event, and (maybe more importantly) what did not happen?

In the more recent past, the JRC was led by a management that made a lot of effort to break down existing “silos”, attempting to walk the talk of interdisciplinary research and paying attention to questions of complexity; there was a new attention e.g. to social sciences and humanities and some organisational push towards collaborative work through transversal and flagship projects. Furthermore, there was a de facto restructuring of services. In practice, however, this hasn’t always translated into epistemic dialogue but rather resulted in amalgamations of different standpoints, with the consequence that the historically stabilised - usually inoffensive - standpoints are channelled to policy. In the case of this workshop, a senior manager was open to the opportunity to conduct this encounter. Not surprisingly, he has anticipated the kinds of resistance that we faced later on but was nonetheless quite enthusiastic about it.

After the workshop, a report was produced, which mapped and described the different nexus-challenges (and controversies about them) for each of the narratives that we discussed with participants. The challenges were subsequently translated into questions that could potentially be addressed by the existing or adapted models. However, it is on what follows that we can further our reflection on what “extension” means in practice.

First, we think that there was institutional momentum to conduct this activity. Not only did the JRC strategy at that time require cross-unit “collaborative work”, but also the management actors involved saw an opportunity to safely explore the interdisciplinary pursuit: safely here means that there were no real (political) commitments of follow-up and no “witch-hunting” on the horizon. To put it bluntly, the outcomes could be outright ignored, and the reputations would not be touched.

Secondly, on the same vein, to start with many of the researchers involved had genuine interest in the conceptual discussions that the narratives helped to prompt. The discussions were often uncomfortable, as there was open criticism of taken for granted concepts (e.g. water scarcity) or regarding the reductionism of adopted concepts in nexus related policy (e.g. ecosystems services). However, there was no real mandate for the researchers to follow-up on those discussions and to change anything in existing practices or to be committed to this “extension” for longer period of time; this has found in very pragmatic justifications (e.g. lack of personnel, no policy request, urgency to deliver narratives) no practical implementation of the discussions, as far as modelling was concerned.

Thirdly, we want to direct attention of an ongoing politics of expertise that was part of this experiment in extension: To start with, the authors of this paper are not formally trained on the models that were discussed in the workshop. Hence, to some extent our legitimacy was granted whilst we prepared and run the workshop, after which the workshop outcomes were deemed “philosophical”, which may mean that they were considered unpractical.  Furthermore, it must be noted that the dissenting and competing expertise present at the workshop was from outside the JRC, which gave the JRC actors some leeway in how and if to make use of these inputs; in the end of the day,  the material form of the workshop became therefore a shelved report for which there is no clear accountability.

So, what can MAGIC learn from this experiment of extension as means to channel uncomfortable knowledge into a science-for-policy-milieu like the JRC? And what are potential broader implications for engagements with the policy-realm?

When we look at extension as a practice of social, epistemic, organisational and moral re-ordering, we see that in order for this workshop to take place, there needed to be momentum in the sense of coinciding interests of various actors on different institutional levels, agreement on the necessary people to involve and on the acceptable degree of disruptiveness. Also, and this is probably the most important element, the workshop depended on powerful actors that functioned as gatekeepers or “champions” of extension. What we described as an event emerging by “coincidence” in the beginning of this essay, is the outcome of what can be described as a complex politics of extension. This also became visible in the ongoing struggle for legitimacy of different ways of knowing and kinds of expertise (uncomfortable knowledge as “philosophical”).

Next to such politics of extension, one needs to stay attentive to the temporalities involved. As we laid out, there was no mandate, accountability, or long-term commitment, so it was safe to conduct this workshop.

Overall, one may ask whether there was any extension. We have two possible answers for this question: either the extension did not exist, to the extent that the workshop was merely performative, useful to tick some boxes, or the question is outright inappropriate, as the workshop did not actually invite an “extended” but an “inconvenient” peer community that brought in uncomfortable knowledge. Hence, it is important to note that the honest discussion has not led to change, and in the spirit of PNS, one is left to wonder if science-policy institutions would ever be able to work with extended peer communities. We could argue that the extension in this case was the work on and with narratives, which - shelved or not - was a warning that the “taken for granted” narratives might not always be what they seem.

In conclusion, it is important to remember that it took the Commission almost 20 years to pass from a seminal White Paper on participatory governance (2001) to advance the extension talk into a political priority and commitment. The process of making it visible took perseverance, subversive work, and some degree of serendipity. The uncomfortable knowledge generated by MAGIC seems to be still overwhelming in an institutional sense. The process of making it visible might take either a catastrophe or hopefully courageous politics to avoid the former, precisely by institutionalising practices of extension.

 

References:

Bremer, S. et al. (2017) ‘Narrative as a method for eliciting tacit knowledge of climate variability in Bangladesh’, Weather, Climate, and Society. American Meteorological Society, 9(4), pp. 669–686.

Bruner, J. (1991) ‘The narrative construction of reality’, Critical Inquiry, 18(1), pp. 1–21.

Collins, H. M. and Evans, R. (2002) ‘The Third Wave of Science Studies’, Social Studies of Science, 32(2), pp. 235–296. Available at: http://sss.sagepub.com/content/32/2/235.abstract.

Dickel, S. and Franzen, M. (2016) ‘The “Problem of Extension” revisited: new modes of digital participation in science’, Journal of Science Communication, 15(1), p. A06_en.

Funtowicz, S. and Ravetz, J. (1993) ‘Science for the Post-Normal Age’, Futures, 25(7), pp. 739–757.

Hajer, M. A. (2006) ‘The living institutions of the EU: Analysing governance as performance’, Perspectives on European politics and society, 7(1), pp. 41–55.

Herman, D. (2003) Stories as a Tool for Thinking. In D. Herman (Ed.), CSLI lecture notes. Narrative theory and the cognitive sciences (p. 163–192). Center for the Study of Language and Information.

Ravetz, J. R. (1999) ‘What is Post-Normal Science’, Futures, 31, pp. 647–653.

Image credit: Schuman Berlaymont

 

 

Post-Normal Policy Interactions: Paradoxes for Science-Policy teams

Post-Normal Policy Interactions: Paradoxes for Science-Policy teams

Kirsty Blackstock, Kerry Waylen & Keith Matthews

The premise of Post-Normal Science (PNS) is to focus on how knowledge is (co)-produced and used by different actors in different contexts. One activity within MAGIC has explored use of the Quantitative Story Telling (QST) methodology within European policy domains, working with actors from EU policy institutions in ‘mixed science-policy teams’.  During the QST cycle exploring the progress of the EU towards Sustainable Development Goal 2 (Zero Hunger), we engaged with actors in 13 European policy organisations. Most of these individuals worked within the Directorate Generals (DGs) of the European Commission.  Although we were warned that transdisciplinary working in such settings would be difficult, we persisted and made some useful contacts who helped deepen our understanding of how the SDGs and sustainable agriculture are understood and operationalised within different DGs. However, reflecting on our experiences of trying to complete the full QST cycle (outlined in Figure 1 below) has led us to identify several paradoxes regarding working in mixed teams. We present a selection of these paradoxes below.

 

Figure 1: Steps in Quantitative Story Telling Cycle

 

Engage many versus engage few

We received advice to engage with more actors or other groups beyond the EU institutions, to raise their awareness amongst the many other stakeholders of the agri-food system. This advice emphasised the distributed nature of the responsibility to achieve change for sustainability. Yet at the same time, we were encouraged to engage with targeted stakeholders in a more in-depth way to build interpersonal trust and confidence.  Whilst both responses are understandable, it was impossible to engage with every possible relevant group and also build in-depth relationships with strategic individuals.

Focus on specific problems or highlight systemic issues

Some stakeholders expressed desires for more specific and targeted advice that would help inform current policy questions and processes. These stakeholders suggest that awareness of current policy context is important. We had contextualised the quantified metrics in light of current policy objectives, but some expected more specific policy recommendations. In parallel, other stakeholders commented that the value of new approaches such as MAGIC is to highlight aspects of the system that are not currently well-considered by policy-making. PNS also encourages us to avoid reducing systemic problems to single aspects. However, a detailed evaluation of specific policy instruments is more constructive and salient to individual bureaucrats than a systemic diagnosis of (un)sustainability.

Provoke reactions versus build relationships

Most advice on science-policy interactions advises building interpersonal relationships. This was mirrored by the instinctive approach of some MAGIC team members when attempting to make contacts or when reacting to questions from participants, i.e. giving emollient responses to questions and making enquiries about participants’ own work. However, the QST cycle is premised on questioning the robustness of current framings that shape policy responses to sustainability challenges, with the normative goal of questioning the status quo. Such a critical stance can make building relationships more difficult.

These tensions suggest QST is not easily implemented to satisfy all expectations and interpretations. Our work’s contribution to PNS is to illustrate the tensions and challenges inherent when working with actors working on processes and in institutions that do not (yet) reflect the post-normal ethos. One potential solution is to find a policy entrepreneur to champion a post-normal approach within the existing institutional arrangements. Such interactions require significant scientist investments of time and energy to locate and engage such champions, and the use of science to support transformation from the inside, potentially at short notice. Putting PNS into practice may first depend on adapting to prevailing norms and expectations – as well as responding to policy cycles and opportunities – before science-policy relationships are sufficient to allow its more provocative and challenging ways of working.

Image credit: DG Regio Communication Unit

The MAGIC-Post-Normal Science Nexus

The MAGIC-Post-Normal Science Nexus

Mario Giampietro & Silvio Funtowicz

Insights of PNS in MAGIC

Innovative conceptual aspects of MAGIC have complemented an understanding of Post-Normal Science (PNS) grounded on complexity [1–3] that proved useful to achieve practical results during the four years of the MAGIC research journey.

The impossibility of decoupling passion from reason in sustainability analysis

MAGIC has developed a set of narratives found in policy discussions offering a new interpretation of the PNS insights: (1) justification narratives (about concerns to be addressed, resulting from the political management of feelings and emotions); (2) normative narratives (about actions to be taken, based on power relations and knowledge claims); and (3) explanation narratives (about scientific evidence for the selection of the first two narratives) [4].

The three types of narratives, as will be illustrated below, are not independent, interacting in an impredicative loop.

Quality control, in sustainability science, requires an extended peer community

Fig. 1 shows why rigor is not a robust quality criterion in governance-related research for the scientific analysis generating the evidence.  Before arriving to a specific framing of the problem at hand (in the center of Fig. 1), priorities about relevant concerns must be addressed to select narratives to be used as justification narratives. 

 

Figure 1: The sources of concern for the quality of knowledge inputs for governance

 

At the same time, information from existing knowledge claims is used to provide relevant insights about “the best” framing of the relevant problem.  Therefore, the interaction of these two different inputs, and their impredicative relation, implies that in sustainability science, “optimal solutions” based only on a scientific evidence are a mirage. 

Thus, Fig. 1 is a conceptual interpretation of the PNS insight about the need to integrate the scientific and value inputs in the problem-solving practice, which was confirmed by research in MAGIC when assessing the quality of EU policies in different policy domains and innovations.  The consistency among justification, normative and explanation narratives, in the MAGIC case studies clearly indicated the need for extended peer communities [5, 6].  An additional result has been the identification of five sources of concern about quality in the steps needed to use and produce scientific evidence for policy.  These five are represented in the horizontal strip in the middle of Fig. 1.

Sustainability is about learning how to deal with the tragedy of change (update the identity of the society while remaining functional) something requiring managing passion and feelings

The definition of the identity of a society can be related to two sets of constraints: (1) the expression of social practices must match what is expected by the rules, institutions and validated knowledge claims endorsed by society (to be verified at the level of the society), and (2) the affective interactions, when expressing societal practices, must be compatible with the fears, hopes, feelings and emotions of individual.  This implies that, as suggested by Luhmann [7], we could assume the existence of a psychic structure of the society in which, the aggregated effect of personal emotions, when scaled-up to the level of the whole society, affect and are affected by the expression of social practices. This process of definition of the identity of social systems, is at the core of issues addressed by PNS.

Main messages of MAGIC

In relation to the quality of the narratives used for deliberating sustainability:

* MAGIC has illustrated that the main institutional narratives used to address the sustainability crises are based on legends, a strategy that is unlike to provide sound policies to face the challenges [8].

The claims that with the green deal, moving to a circular bio-economy, in the next 30 years, the EU will be able to substitute fossil fuel with biofuels, decarbonize the electricity sector, make its agriculture competitive, environmentally friendly, and capable of guaranteeing food security no longer depending on imports, show a remarkable lack of scientific and political understanding of these issues. Implausible narratives are impossible to implement, risking of delegitimating the institutions proposing them. It is becoming ostensibly clear that the current pattern of economic growth is incapable to solve growing concerns about inequity, environmental protection, dangerous dependence on disappearing resources and on the exploitation of less powerful social-ecological systems. To avoid the risk of a collapse in the credibility of the EU system, it is the right time to move from the present class of “yes we can” narratives to the class of narratives “Houston we have a problem”. A growing proportion of EU citizens can feel the seriousness of the sustainability crises, opting, however, not to acknowledge its deep implications, including the loss of their urban privileged lifestyles. But for how long can this situation last? For how long can we keep abusing natural processes and disrupting social-ecological systems?

* MAGIC has illustrated that it is possible (and urgent) to abandon the illusion of simplistic economic narratives to explain the sustainability predicament [9].

The existing reliance on received economic narratives led to a simple problem structuring – i.e. decisions can be taken using only scientific evidence. However, it is obvious that the assumptions that we will always have prices – i.e. that we will never experience absolute scarcity - entails the impossibility of unsustainability.  Obviously, narratives that cannot see the possibility of experiencing absolute scarcity cannot be useful to study the sustainability predicament. It is time to move to alternative methods of analysis and alternative methods of decision making based on the acknowledgment of complexity and the need of reflexivity. Sustainability research must avoid the silo-governance attractor by integrating in a coherent way different inputs of relevant information referring to different levels and dimensions of analysis. This is essential in order to be able to reflect the existence of a variety of legitimate but non-equivalent concerns found in society. This cannot be done by relying on “Frankenstein models” (e.g. Integrated Assessment Models) in which a basic framework of analysis developed within economic narratives is fed with simplistic “ad hoc” models studying “water”, “energy”, “food”, “emissions” linked to a variety of non-equivalent descriptive domains impossible to integrate.  In the era of big data, we still use quantitative analysis based on differential equations: an inferential system that requires the adoption of a scale and a dimension at the time.

* The COVID-19 has clearly shown the possibility that large-scale perturbations can impose sudden radical changes in society, and the futility of searching for a Laplacian demon that will restore prediction and control. We do not have (or we do not recognize) the quality evidence required for a fair and robust deliberation about radical re-adjustments of social practices.

History tells us that the legitimacy (and stability) of the institutions of a society depends on their ability of reducing the stress (associated with the fears and hopes experienced daily) of its population. We are now living in a “full” and over-connected world in which it is becoming more and more likely to experience large scale perturbations coming either from nature, political turmoil, or financial collapses. A discussion over the possibility of quick adjustments of society to forced change should start from a share understanding of actual societal practices and their relation to feelings. The COVID-19 has shown that we can change our social practices overnight, something that cannot be done by technological silver-bullets. So rather than working on more and more complicated technological fixes (that would require decades to become operational) we should explore the remarkable capability of adaptation of human societies.

Why are we using resources? To do what? How are resources used? Which resources are more essential? How are they affecting the quality of social practices? These are some of the questions needed to explore and deliberate over a transition to alternative lifestyles institutions, and ways of developing and deploying technology.

This is the information that MAGIC has generated, and that is systematically ignored by convention. Unfortunately, rather than understanding the deep challenges in order to be prepared for changes, we bet that technocratic promises, based on shallow innovations and new business models, will be capable of preserving the existing institutions and life styles forever.

In relation to epistemological reflections:

* MAGIC has illustrated the complexity of the Nexus. We have to accept that error and failure are inevitable parts of the policy-making ecosystem; it is urgent to develop a culture of experimentation and resilience in a context in which the mainstream narrative has always been one of efficiency and control.

* MAGIC has shown that there is untapped useful knowledge beyond accredited expertise and institutional boundaries. Some of these types of knowledge are not utilized because of bureaucratic and disciplinary constraints, and other types of relevant knowledge becomes invisible because it can perturb a perceive fragile status-quo. It is urgent to develop democratic processes for the seamless deployment of uncomfortable knowledge.

* MAGIC has shown that many institutional goals reflect a nostalgic view of the past, including the privileged role of expert evidence as an input to policy-making. What constitutes quality evidence is not sculpted in stone but modulated by power, tradition, culture and other contextual and contingent considerations. It is urgent to democratize evidence, developing or enhancing robustness by inclusion, diversity, and plurality.

 

References

[1] Funtowicz, S. O., & Ravetz, J. R. 1993. Science for the post-normal age. Futures, 25(7), 739–755. https://doi.org/10.1016/0016-3287(93)90022-L

[2] Funtowicz, S. O. and Ravetz, J. R., 1994 Emergent Complex Systems Futures 26(6): 568-582

[3] Funtowicz, S. O. and Ravetz, J. R., 1997.The Poetry of Thermodynamics, Energy, Entropy, Exergy and quality Futures 29(9):791-810.

[4] Giampietro, M., 2018. Perception and representation of the resource nexus at the interface between society and the natural environment. Sustain. 10, 1–17. https://doi.org/10.3390/su10072545

[5] Renner, A., Giampietro, M., 2020. Socio-technical discourses of European electricity decarbonization: Contesting narrative credibility and legitimacy with quantitative story-telling. Energy Res. Soc. Sci. 59, 101279. https://doi.org/10.1016/j.erss.2019.101279

[6] Cadillo-Benalcazar, J.J., Bukkens, S.G.F., Ripa, M., Giampietro, M., 2020a. Why does the European Union produce biofuels? Examining consistency and plausibility in prevailing narratives with quantitative storytelling. Energy Res. Soc. Sci. under revi.

[7] Luhmann, N. 1995 Social Systems Stanford University Press

[8] Giampietro, M., Funtowicz, S.O., 2020. From elite folk science to the policy legend of the circular economy. Environ. Sci. Policy 109, 64–72. https://doi.org/10.1016/j.envsci.2020.04.012

[9] Giampietro, M., 2019. On the Circular Bioeconomy and Decoupling: Implications for Sustainable Growth. Ecol. Econ. 162, 143–156. https://doi.org/10.1016/j.ecolecon.2019.05.001

MAGIC: a Journey with Uncomfortable Knowledge and Values

MAGIC: a Journey with Uncomfortable Knowledge and Values

Roger Strand

30 September 2020 is our last day as researchers in the Horizon 2020-funded Research and Innovation action “MAGIC: Moving towards Adaptive Governance in Complexity: Informing Nexus Security”. For me personally, MAGIC has been an enormously enriching experience. As the project in its formal sense is coming to an end, I will try to put into words some lessons from it.

In this last issue of the Nexus Times, we ask: “What is the contribution of MAGIC to Post-Normal Science?" Part of the answer follows from the sheer size and institutional positioning of the project. With a budget of 7 million euros and with formal connections with European Commission departments and agencies, MAGIC was able to go massively into ongoing policy issues and analyse them from the post-normal science perspective. In our studies, we have combined number crunching integrated environmental assessments, theoretically grounded social science and real-life engagement with policy-makers at what I believe is a hitherto unprecedented depth and scope in the post-normal community. I have also argued elsewhere that MAGIC developed into a truly inter- and in some respects transdisciplinary journey in which researchers coming from different fields and different epistemological postures learned, developed and changed on the way (Strand 2019).

Working inside of and living with this huge project has given opportunities to further develop the philosophy of post-normal science. What follows, are some early reflections.

Post-Normal Science

What is post-normal science (PNS)? In order to answer the question, it is useful to distinguish between the diagnosis and the proposed therapy, to borrow from medical jargon (Strand 2018). In the very first statement of the diagnosis, five years before the term “post-normal science” was invented, Funtowicz and Ravetz (1985) explained how there is a class of decision problems where stakes and/or systems uncertainties are very high. Indeed, uncertainties are not only high but irreducible because technical and scientific attempts to reduce them end up being contested, and instead of consensus on knowledge and action there is only more controversy. Reducing uncertainty in a decision problem by means of scientific and technical expertise implies reducing the scope. One has to define a problem that is tractable for science or engineering, meaning that the borders of the system have to be defined, the model of causal networks considered has to be closed (Wynne 1992), the time frame has to be limited, and ultimately cut-offs have to be made with respect to what are the legitimate stakes and who are the affected parties by the decision. Scientific choices accordingly have consequences for what is seen as legitimate stakes. Conversely, choices on who are the legitimate stakeholders and what are their stakes, have bearings on the definition of the scientific and technical problems to be pursued.

While PNS literature tends to say “high stakes or high uncertainties”, this may lead readers to believe that stakes and uncertainties are two separate and independent criteria. They are not, and this was made crystal clear already in the original treatment of the subject (Funtowicz & Ravetz 1985). Stakes and uncertainties are deeply entangled, and more generally, so are knowledge and values. The latter entanglement is perhaps the only significant insight that grew out of the many theoretical debates in philosophy of science in the 20th century and that led to the culmination and decline of logical positivism and logical empiricism.

When are stakes and uncertainties high? They are high when the controversy does not go away. In principle, anyone with the required skill and effort can find uncertainty and complexity. Already the ancient rabbis knew that he who destroys a single soul destroys a whole world, and in addition, there are innumerous connections between that single soul and its surroundings. The “therapy” proposed by Funtowicz and Ravetz in 1985 to governmental actors in charge of public decision-making processes was to accept the state of affairs in cases of seemingly never-ending controversies instead of trying to enforce consensus by imposing scientific and technical reduction of uncertainty. The post-normal answer to the decision problem was to admit that it was a hybrid political and technical one, in which both facts and values have to be deliberated upon – a “total-environmental assessment” in their words:

“This evolution, towards rationality and dialogue, may indeed take years to accomplish: in its early stages a “total-environmental assessment” may really seem to be a clash between incommensurable world-view. But such debates tend to stimulate the production of knowledge, of relevant facts and of value commitments, which eventually enable such problems to be resolved by political debate rather than by civil war.” (Funtowicz & Ravetz 1985, p. 844)

We might add: rather than by civil war or by unilateral violence or other forms of hegemonic power to silence others.

Since the 1990s, a PNS community of scholars and practitioners emerged and the focus on practical implementation and progress increased. Techniques developed for characterising and managing uncertainty, as well as participatory approaches to producing and appraising knowledge claims (“extending the peer community”). Along the way, the original argumentative link between the diagnostic and therapeutic part of PNS has in my opinion been somewhat lost or deflated. Funtowicz and Ravetz did not sell or offer techniques in order to make decision-making easier or more efficient; PNS was not proposed as a “quick fix”. It was a matter of accepting that the usual strategies in the modern state and in modern bureaucracies (of relegating knowledge questions to science) sometimes do not work; of accepting that sometimes there can be no quick fix. In particular, controversies tend not to go away by using the quick fix of imposing narrow notions of rationality which exclude every type of reason that does not pretend to be value-neutral. “Le cœur a ses raisons, que la raison ne connaît point,” Pascal (1670) said. Besides of that, there is no deduction from the diagnosis to the one “right” therapy. Indeed, Funtowicz and Ravetz always welcomed new approaches to PNS and never policed against them as long as they shared the fundamental value commitment to deliberation and conviviality rather than violence (Ravetz & Funtowicz 1999).

Uncomfortable knowledge

Since 1985, never-ending public controversies about almost any kind of decision in our sociotechnical systems have become ubiquitous. The concept of post-normal science is widely cited and used, and so are more or less similar concepts such as “wicked problems”, “Mode 2”, “socially robust” and many others. The creation of the internet and the information society made it easier for billions of people to retrieve, produce and disseminate facts, values and worldviews. In this sense, the world has become post-normal and possibly also post-modern in the sense that the monopoly on Grand Narratives is weaker.

Nexus issues, which arise at the interface between different sectors and areas of governance, each with their specific scientific, technical and legal expertise, are almost by definition post-normal in the sense of high stakes and system uncertainties. All the issues that MAGIC analysed and engaged with, were definitely post-normal, and the MAGIC research approach was tailored to deal with that by studying the relationship between value commitments (in the form of preanalytical policy narratives) and facts (in the form knowledge claims about decision options and consequences).

At the same time, the knowledge production inside MAGIC, in particular that related to MuSIASEM, the multiscale, multi-level type of integrated environmental assessment developed by the project coordinator Mario Giampietro and his colleagues, comes with its own value commitment. It is committed to respect the value of sustainability of the biosphere. Accordingly, perhaps the singularly most important concept in MAGIC was that of biophysical feasibility: of whether a given course of action allows or undermines the regeneration of the biophysical funds upon which it depends. For instance, agriculture is not feasible in the long run if performed in such a way that the soil is eroded or destroyed. Again and again, MAGIC case studies indicated the biophysical unfeasibility of policies that are very real and very much alive and endorsed by the EU and its member states. Current energy policies, agricultural policies and policies for the circular economy were found to be unfeasible.

MAGIC was of course not the first research effort to make this discovery. Colleagues within and outside of the MAGIC consortium have been making similar claims for years if not decades, in particular within the field of ecological economics. The special circumstance of MAGIC was, however, that we had an institutional anchoring to engage with policy-makers in the European Commission and its agencies to discuss the results with them. Recalling the 1985 Funtowicz and Ravetz classic, we were placed – or rather placed ourselves – within a total-environmental assessment in which we sometimes even played two roles simultaneously, as dissidents that created and upheld a controversy around the policies, and as creators and custodians of that deliberative space in which the controversy played out.

Unsurprisingly, our contributions were not always so welcome. This observation is reflected upon elsewhere in the Nexus Times and in our project deliverables (from WP5 and WP6) and it was even endorsed as an empirical finding by our project reviewers. In order to make sense of that finding, we found Steve Rayner’s (2012) concepts of “uncomfortable knowledge” and “socially constructed ignorance” to be particularly useful. Any actor (be it an institution or an individual) has to simplify complexity in order to be able to act at all. One cannot wait for complete understanding of everything from every point of view. This is even more so for bureaucracies, which have a value commitment to legal certainty and predictability and work by applying an institutional logic (in terms of rules, regulations and practices). That institutional logic, in Rayner’s analysis, is in need of legitimization, which it gets from a (largely implicit) model of the world with which it interacts. This model has to be a simplified view of reality that justifies action in the absence of full information about the parts of reality that lie outside of the scope of the model. Otherwise the institution cannot act. In this sense, the institutional logic is justified by socially constructed ignorance outside of its subject domain. A simple word for this is “silo”. Now, the problem occurs when the institution is presented with knowledge that undermines the credibility of that simplified view of reality and accordingly, the legitimacy of the institutional logic and its practices. Such knowledge is what Rayner called uncomfortable.

In the course of its four years, MAGIC produced nothing but uncomfortable knowledge from the perspective of European policies. Almost all our findings could be taken to undermine the credibility of the more or less implicit assumptions of the nexus policies we investigated. In part, this discrepancy (or whatever we should call it) probably reflects back on us as scientists/scholars and our own academic identities, value commitments and idiosyncrasies. More fundamentally, however, we believe the discrepancy to be part of a collective, civilisational discrepancy that produces dangerous forms of socially constructed ignorance in our institutions, and a dangerous form of cognitive dissonance in individuals. Kjetil Rommetveit described this as a tension between two meta-narratives of our time (Rommetveit et al. 2013). The first narrative is “GEOS”, the narrative that builds on the systems sciences (ecology, climate science, ecological economics and others) to say that things are not going well, there are limits to growth and that sustainability calls for radical changes in society and the economy. The second narrative is “BIOS”, the narrative building on neo-classical economics and the optimism surrounding biotechnology and ICT that says that things are going very well, and that we should continue with business-as-usual, innovation and growth within some form of capitalism.

In Kovacic et al. (2019) we discussed how both BIOS and GEOS concerns are present in the policies and the bureaucracies (though quite unevenly distributed across directorates and agencies). However, BIOS is the more powerful narrative, deeply embedded in the European institutions, which means that GEOS concerns (sustainability, biodiversity, climate change etc) often are dealt with in policy-making by devising a BIOS solution attempt (emission trading, circular economy, technological innovation etc). Most MAGIC results, however, indicated that these translations from GEOS concerns to BIOS solutions fail to be biophysically viable.

For many policy-makers, MAGIC findings were accordingly not useful because they could not be translated into action within the existing institutional logic. Worse, the findings delegitimized existing policy and action.

Uncomfortable values

Rayner’s vision for how to escape the lock-in of uncomfortable knowledge and socially constructed ignorance is simply institutional change. If there is valid knowledge around that discredits the model of reality upon which an institution is built, the model should be revised, and the institutional logic and practice should change. Rayner warned about sources of inertia that impede necessary change.

In the case of the tension between BIOS and GEOS, the roots of the inertia seem to run deep and far beyond the organisational culture of the governmental organisations. The European Green Deal appears to acutely express this depth. While it describes the unsustainability of our societies and the severity of the various environmental crises more clearly than perhaps any such high-level policy did before, it proceeds directly into promises of continued growth and increased wealth for everybody, “ensuring that no one is left behind” (EC 2019). Europe is to become a society “where there are no net emissions of greenhouse gases in 2050 and where economic growth is decoupled from resource use” (EC 2019).

Now, one does not need a big research project to know that these statements, indeed the fundamental assumption on which the entire narrative of the European Green Deal is built, simply are contrary to existing knowledge. Decoupling has not taken place and there are decades of research that strongly indicate that it cannot take place to any significant degree (Parrique et al. 2019). When a one-trillion euro policy is built around a knowledge claim that would not survive introductory exams in sustainability science, this cannot be accounted for by rigid institutional structure. Rather, it stands out as an expression of affect, of combined hope, fear and despair. It emanates the emotional necessity of material wealth and prosperity. Economic decline is too painful to endure. If reality tells the Europeans that their level of prosperity and affluence has to decrease in order that society become sustainable, then reality must cede.

A similar analysis was made with respect to the Sustainable Development Goals, seeing them as expressions of fantasy in the psychoanalytic sense (Fletcher & Rammelt 2017).

The MAGIC project has also been a venue to discuss such ideas. Mario Giampietro has moved his multi-level, multi-scale style of thought also into the relationship between societies, communities and individual human psyche. In his perspective, the conspicuous lack of feasibility of dominant narratives on food, energy and the environment can be interpreted as a form of collective delirium of affluent urban elites (Giampietro 2018), as a wilful loss of cognitive function in order to escape the cognitive dissonance between BIOS and GEOS, and the unbearable pain of fear for becoming poor.

To recall Pascal, also the policy-makers’ hearts have reasons that reason does not know. Parallel to Rayner’s analysis, one could postulate that reality offers too much complexity also in the affective dimension, and that actors both at the collective and individual level have to shield themselves from being overwhelmed and paralysed by conflicting values and desires. In this case, the dissonance arises from the fact/value-complex that the citizens of the urban elite (1) want and need to consume at unsustainable levels now and for the rest of their lives but they also (2) want that future generations enjoy the same affluence, and (3) you cannot have both in reality. Of these three elements one can only choose two; or perhaps one and two halves, sacrificing a bit of cognitive function and a bit of the concern for future generations. In this sense it appears to be a hybrid of socially constructed ignorance and socially constructed intemperance. This could also explain the occasional outbursts of affect when MAGIC researchers have engaged with policy-makers. It may not have been just a case of uncomfortable knowledge; it may also have been a matter of uncomfortable values that discredited the intemperance as we stated the concern of (real) sustainability with such clarity. At least my personal experience fits with this explanation: The angrier the response, the more knowledgeable was the responder. And the anger was perhaps mixed with self-anger.

The Ego, wuwei and the TAO

What some might think is a dry topic – nexus issues in European policy-making – was accordingly also a journey into the deep existential issues of citizens of the 21st century, of hopes and desires, of fear and denial, of conviviality and co-existence with the biosphere on which we depend for long-term survival.

The final and unfinished part of that journey, which at least to me was helpful for my understanding of post-normal science, is the one that asked about our own role in society, as post-normal thinkers in a big research project of this type. What we already largely knew at the onset of the project, was that we as researchers do not speak Truth to Power but that we too have a view from somewhere, from our own epistemic and value commitments. This is an insight that calls for reflexivity and modesty (Strand & Cañellas-Boltà 2006). As researchers-citizens-activists we care for some issues, which means that there are other issues that we do not care equally much for; care is not morally innocent (Puig de la Bellacasa 2011).

In our efforts to engage with nexus policy-making, we tried to combine the care for sustainability (understood in terms of biophysical feasibility and societal viability) with a posture of care for the individuals and institutions with which we engaged. While it is far too early to know what we may have achieved, I would not be too surprised if it turns out that little traceable impact in the direction of institutional change can be attributed to our efforts.

The question is, however, if one should aim for impact, or if this is another of these metaphors that reduce complexity in unfortunate ways. “Impact” connotes a mechanical relationship between interlocutors, in this case us researchers and them, the policy-makers, as if we run into them at high speed and the collision sets them in motion.

Towards the end of the project, some of us – as witnessed on Zora Kovacic’ blog[1] and in the final chapter of Kovacic et al. (2019) – consulted the history of philosophy to reflect around these issues, and found gems in ancient Taoist writings, notably Laozi’s Tao Te Ching and Zhuangzi’s writings. In Zhuangzi’s stories “In the World of Men”, there is indeed a profound discussion about how to give advice to the ruler who is not impressed by the advisor. As always in Taoism, the answer lies in wuwei – “non-action”, which does not mean passivity but to abstain from trying to enforce change, from pushing and trying to control. This motif is already present in Laozi,’ Tao Te Ching:

Trying to control the world?

I see you won’t succeed.

The world is a spiritual vessel

And cannot be controlled.

Those who control, fail.

Those who grasp, lose.

-and has been utilized in the writings of Mario Giampietro and Kozo Mayumi as a way to explain how to govern in complexity (see e.g. Giampietro et al. 2012). If we think of the biosphere as the TAO, we realize that we, through our very partial understanding of it, will fail if we try to control it. Rather, wuwei means to act in accordance with the workings of the biosphere, and do as little as we can to oppose it. If we try to force it, we risk destroying subtle workings that we do not understand.

Zhuangzi took the analysis further by also recognising that humans and human individuals, including the ruler, are also TAO. We do not fully understand their minds and we should not try to push them; wuwei would mean to act in accordance with their workings.

Interpretations of this relatively vague insight abound. It can be seen as a pedagogical point – that nudging is better than screaming, perhaps, still within a logic of “impact” and manipulation, quite alien to the ethos of post-normal science of deliberation and conviviality. Or it can be seen as an ethical point, akin to yogic thought where one would say that one should try to meet one’s fellow human being at a higher chakra. To confront the urban elite for being ignorant, selfish and deluded would perhaps be to meet them at the lowest of chakras, kicking them in the belly or below. If so, it would not be surprising that the response is defensive or hostile. A posture of care would at least have to rise to the heart chakra to empathise.

Zhuangzi, however, makes a much taller order, all the way up to what the yogis would call the highest chakra, and asks for a posture of “fasting the mind”, that is, emptying and bracketing one’s ego and one’s own sense of urgency and desire to push and achieve. Our own actions should not be caused by the prospect of “impact”. Rather, they should be grounded in our own TAO, in who we are, who we choose to be and what we choose to care for.

In modern language, the line of argument from post-normal science via reflexivity seems to flow towards virtue ethics (to which the ethics of care belongs). A similar argument was developed by Funtowicz and Strand (2011), going towards the philosophy of Hannah Arendt rather than Zhuangzi. I see this rediscovery as a MAGIC contribution to post-normal science that emphasizes even more strongly that PNS is not and should not be a set of techniques and promises of quick fix, and that the currently ubiquitous sense of urgency is part of our troubles. I call it a rediscovery because in its spirit, these trains of thought seem to return to the very first articulation of total-environmental assessment (Funtowicz & Ravetz 1985): that in some instances, there is no simple solution and the attempt to enforce it will simply make things worse. The challenge we are confronted with is to accept that the world is what it is and maintain a spirit of respectful engagement and conviviality, while staying true to our desire to change the things for the better and strive for sustainability. In less prosaic terms, what is called for is a reconciliation of our minds, hearts and bodies. While certainly not offering any quick fix, MAGIC developed knowledge, tools and approaches to pursue that path, the first steps to try to integrate the wuwei of governing within the complexity within the biosphere and within society and its complex institutions and individuals, without losing ourselves on the way.

 

References

EC (2019). The European Green Deal. COM/2019/640 https://eur-lex.europa.eu/legal-content/EN/TXT/?qid=1576150542719&uri=COM%3A2019%3A640%3AFIN

Fletcher R. & C. Rammelt (2017)  Decoupling: A Key Fantasy of the Post-2015 Sustainable Development Agenda, Globalizations, 14:3, 450-467, https://doi.org/10.1080/14747731.2016.1263077

Funtowicz, S. & J. Ravetz (1985) Three types of risk assessment: a methodological analysis, in: C. Whipple & V. T. Covello (eds): Risk Analysis in the Private Sector (pp. 217-231), New York and London: Plenum Press.

Funtowicz, S., & Strand, R. (2011). Change and commitment: Beyond risk and responsibility. Journal of Risk Research, 14(8), 995–1003. https://doi.org/10.1080/13669877.2011.571784

Giampietro, M. (2018). Anticipation in Agriculture. In: R. Poli (Ed.): Handbook of Anticipation, Springer: Cham, Switzerland, https://doi.org/10.1007/978-3-319-31737-3_23-1

Giampietro, M., Mayumi, K., & Sorman, A. H. (2012). The metabolic pattern of societies: Where economists fall short. London and New York: Routledge.

Kovacic, Z., R. Strand & T. Völker (2019) The Circular Economy in Europe: Critical Perspectives on Policies and Imaginaries. Routledge. https://www.routledge.com/The-Circular-Economy-in-Europe-Critical-Perspectives-on-Policies-and-Imaginaries/Kovacic-Strand-Volker/p/book/9780367183585

Lao-Tzu. (~6th century BC/1993). Tao Te Ching. Hackett Publishing Company.

Parrique, T., J. Barth, F. Briens & J. Spangenberg (2019). Decoupling Debunked: Evidence and Arguments against Green Growth as a Sole Strategy for Sustainability. European Environment Bureau.

Pascal, B. (1670) Pensées. http://www.penseesdepascal.fr/

Puig de la Bellacasa, M. (2011). Matters of care in technoscience: Assembling neglected things. Social Studies of Science, 41(1), 85–106. https://doi.org/10.1177/0306312710380301

Ravetz, J. & S. Funtowicz (1999) Post-Normal Science-an insight now maturing. Futures 31: 641-646.

Rayner, S. (2012). Uncomfortable knowledge: the social construction of ignorance in science and environmental policy discourses. Economy and Society, 41:107–125. https://doi.org/10.1080/03085147.2011.637335

Rommetveit, K., Strand, R., Fjelland, R., Funtowicz, S., & Saltelli, A. (2013). What can history teach us about the prospects of a European Research Area ? https://doi.org/10.2788/1057

Strand, R. (2017). Post-Normal Science. In C. Spash (Ed.): Routledge Handbook of Ecological Economics. London: Routledge, https://doi.org/10.4324/9781315679747 , pp 288-298.

Strand, R. (2019) Striving for Reflexive Science. Fteval – Journal for Research and Technology Policy Evaluation 48: 56-61. http://doi.org/10.22163/fteval.2019.368

Strand, R. & Cañellas-Boltà, S. (2006). “Reflexivity and Modesty in the Application of Complexity Theory” in A. Guimarães Pereira, S. Vaz & S. Tognetti (eds): Interfaces between Science and Society (pp 100-117). Sheffield, UK: Greenleaf Publishing.

Wynne, B. (1992) Uncertainty and environmental learning: reconceiving science and policy in the preventive paradigm. Global Environmental Change 2:111-127.

Zhuangzi, Z. (~4th century BC/2003). Basic writings. New York: Columbia University Press.

Image credit: Michael Hofmann