I would like to propose another way to describe the epistemological relationships between computational and experimental neuroscience. In acoustics, there is a methodology known as “analysis-synthesis” of sounds (Risset & Wessel, 1982) to understand what makes the quality (or “timbre”) of a sound (see in particular Gaver (1993), “How do we hear in the world?”). A first step is to examine the sound by various methods, for example acoustic analysis (look at the spectrum, the temporal envelope, etc), and try to extract the salient features. A second step consists in synthesizing sounds that display these features. One then listen to these sounds to evaluate whether they successfully reproduce the quality of the original sounds. This evaluation step can be made objective with psychoacoustic experiments. The results of the synthesis step then inform the analysis, which can then focus on those aspects that were not correctly captured, and the procedure goes through a new iteration. The analysis can also be guided by physical analysis, i.e., by theory. For example, the perceived size of a sounding object should be related to the resonant frequencies, whose wavelengths correspond to the dimensions of the object. The type of material (wood, metal) should be related to the decay rate of the temporal envelope. By these principles, it is possible to synthesize convincing sounds of impacts on a wood plate, for example.

There is a direct analogy with the relationship between computational and experimental neuroscience. Experimental neuroscience aims at identifying various aspects of the nervous system that seem significant: this is the analysis step. The object of experiments is a fully functional organism, or a piece of it. The empirical findings are considered significant in relationship with the theory of the moment (perhaps in analogy with physical analysis in acoustics), and with the chosen method of analysis (type of measurement and experimental protocol). By themselves, they only indicate what might contribute to the function of the organism, and more importantly how it contributes to it. For example, if the attack of a piano sound is removed, it doesn’t sound like a piano anymore, so the attack is important to the quality of the piano sound. In the same way, lesion studies inform us of what parts of the brain are critical for a given function, but this doesn’t tell us how exactly those parts contribute to the function. Computational neuroscience, then, can be viewed as the synthesis step. Starting from nothing (i.e., not a fully functional organism), one tries to build a drastically simplified system, informed by the analysis step. But the goal is not to reproduce all the pieces of empirical data that were used to inform the system. The goal is to reproduce the function of the organism. In analogy with sound: the goal is not to reproduce detailed aspects of the spectrum, but rather that the synthesized signal sounds good. If the function is not correctly reproduced, then maybe the features identified by the analysis step were not the most relevant ones. In this way the synthesis step informs the analysis step.

This analogy highlights a few important epistemological specificities of computational neuroscience. Most importantly, computational neuroscience is primarily about explaining the function, and only secondarily the empirical data. Empirical experiments on the auditory system of the barn owl aim at explaining how the barn owl catches a mouse in the dark. Computational studies also aim at explaining how the barn owl catches a mouse in the dark, not at reproducing the results of the empirical experiments. Another way to put it: the data to be explained by the theory are not only what is explicitly stated in the Results section, but also the other empirical piece of evidence that is implicitly stated in the Methods or the Introduction section, that is, that before the experiment, the barn owl was a fully functional living organism able to catch a prey in the dark. Secondly, computational neuroscience, as a synthetic approach, aims at a simple, conceptually meaningful, description of the system. Realism is in the function (how the signal sounds), not in the amount of decoration aimed at mimicking pieces of empirical data.

This discussion also brings support to the criticism of epistemic reductionism. Imagine we can measure all the components of the brain, and put them together in a realistic simulation of the brain (which already implies some form of methodological reductionism). This would correspond to fully analyzing the spectrum of a sound, recording it in complete details, and then playing it back. What is learned about what makes the quality of the sound? A second point is methodological: suppose we collect all necessary data about the brain, but from different individual brains, and perhaps a bunch of related species like mice. Would the result sound like a piano, or would it sound like a cacophony of different pianos and a violin?

Almost all work in philosophy of science concerns the question of how a scientific theory is validated, by confronting it with empirical evidence. The converse, how a theory is formulated in the first place, is considered as a mysterious process that concerns the field of psychology. As a result of this focus, one might be led to think that the essence of scientific activity is the confrontation of theories with empirical facts. This point stands out in the structure of biology articles, which generally consist of a short introduction, where the hypothesis is formulated, the methods, where the experiments are described, the results, where the outcome of the experiments is described, and the discussion, where the hypothesis is evaluated in regard of the experimental results. The making of theory generally makes a negligible part of the articles.

Let us consider the problem from a logical point of view. At a given point of time, there is only a finite set of empirical elements that can be taken into account to formulate a theory. A theory, on the other hand, consists of universal statements that apply to an infinite number of predictions. Because the empirical basis to formulate a theory is finite, there are always an infinite number of possible theories that can be formulated. Therefore, from a purely logical point of view, it appears that the making of a theory is an arbitrary process. Imagine for example the following situation. One is presented with the first two observations of an infinite sequence of numbers: 2, 4 and 6. One theory could be: this is the sequence of even numbers, and the empirical prediction is that the next number is 8. Another theory would be: this is the beginning of a Fibonacci sequence, and so the next number should be 10. But it might also be that the next number is 7 or any other number. So no theory is a logical consequence of observations.

If what is meant by “scientific” is a process that is purely based on empirical evidence, then we must recognize that the making of a theory is a process that is not entirely scientific. This process is constrained by the empirical basis, and possibly by Popper’s falsifiability criterion (that the theory could be falsified by future experiments), but it leaves a considerable amount of possibilities. Whether a theory is “good” or “bad” can be partly judged by its consistence with the empirical evidence at the time when it is made, but mostly the empirical evaluation of a theory is posterior to its formulation. Thus, at the time when a theory is formulated, it may be considered interesting, i.e., worth investigating, rather than plausible. Therefore the choice of formulating one theory rather than another is determined by non-empirical criteria such as: the elegance and simplicity of the theory; its generality (whether it only accounts for current empirical evidence or also makes many new predictions); its similarity with other fruitful theories in other fields; its consonance with convincing philosophical point of views; the fact that it may generalize over preexisting theories; the fact that it suggests new experiments that were not thought of before; the fact that it suggests connections between previously distinct theories.

Thus, theoretical activity reaches far beyond what is usually implicitly considered as scientific, i.e., the relationship with empirical evidence. Yet there is no science without theories.

A striking fact about the making of science is that in any field of research, there are considerable disagreements between scientists. This is an interesting observation, because it contradicts the naive view of science as a progressive accumulation of knowledge. Indeed, if science worked in this way, then any disagreement should concern empirical data only (e.g. whether the measurements are correct). On the contrary, disagreements often concern the interpretation of data rather than the data themselves. The interpretative framework is provided by a scientific theory, and there are often several of them in any field of research. Another type of disagreement concerns the judgment of how convincingly some specific piece of data demonstrates a particular claim.

There are two possibilities: either a large proportion of scientists are bad scientists, who do not correctly apply sound scientific methodology, or the adhesion to a theory and the judgment of particular claims are not entirely based on scientific principles. The difficulty with the first claim, of course, is that there is no systematic and objective criterion to judge what “good science” is and what “bad science” is. In fact, the very nature of this question is epistemological: how is knowledge acquired and how do we distinguish between different scientific theories? Thus, part of the disagreement between scientists is not scientific but epistemological. Epistemological questions are in fact at the core of scientific activity, and failure to recognize this point leads to the belief that there is a single way to do science, and therefore to dogmatism.

So why do scientists favor one theory rather than the other, given the same body of empirical data? Since the choice is not purely empirical, it must rely on other factors that are not entirely scientific. I would argue that a major determinant of the adhesion to a particular theory, at least in neuroscience, is the consonance with philosophical conceptions that the scientist holds. These conceptions may not be recognized as such, because many scientists have limited knowledge or interest in philosophy. One such conception would be, for example, that the objects of perception exist independently of the organism and that the function of a perceptual system is to represent them. Such a conception provides a framework in which empirical data are collected and interpreted, and therefore it is not generally part of the theoretical claims that are questioned by data. It is a point of view rather than a scientific statement, but it guides our scientific enquiry. Once we realize that we are in fact guided by philosophical conceptions, we can then start questioning these conceptions. For example, why would the organism need to represent the external world if the world is already there to be seen? Shouldn’t a perceptual system rather provide ways to act in the world rather than represent it? Who reads the “representation” of the world? Given that the world can only be accessed through the senses, how can this representation be interpreted in terms of the external world?

Many scientists deny that philosophy is relevant for their work, because they consider that only science can answer scientific questions. However, given that the adhesion of a scientist to a particular scientific theory (and therefore also the making of a scientific theory) is in fact guided by philosophical preconceptions, rejecting philosophy only has the result that the scientist may be guided by naive philosophical conceptions.

Finally, another determinant of the adhesion to a particular scientific theory is psychological and linked to the personal history of the scientist. The theory of cognitive dissonance, perhaps the most influential theory in psychology, claims that human psychology is determined by the drive to minimize the dissonance between different cognitive elements. For example, when a piece of evidence is presented that contradicts the beliefs of the scientist, this produces cognitive dissonance and a drive to reduce it. There are different ways to reduce it. One is that the scientist changes her mind and adopts another theory that is consistent with the new piece of data. Another one is that the piece of data is rejected or interpreted in a way that is consonant with the beliefs of the scientist, possibly by adding an ad hoc hypothesis. Another one is to add consonant elements, e.g. by providing new pieces of evidence that support the beliefs of the scientist. Another one is to seek consonant information and to avoid dissonant information (e.g. only read those papers that are most likely to support the beliefs of the scientist). The theory of cognitive dissonance predicts that the first way rarely occurs. Indeed, as the scientist develops his carrier within a given scientific theory, she develops more and more ways to discard dissonant pieces of information, seeks information that is consonant with the theory and by taking all these decisions, many of them public, increases the dissonance between her behavior and contradictory elements. An important and counter-intuitive prediction of the theory of cognitive dissonance is that contradictory evidence generally reinforces the beliefs of the scientist that is deeply committed to a particular theory.

In summary, a large part of scientific activity, including the making of and the adhesion to a scientific theory, relies on epistemological, philosophical and psychological elements.

Computational neuroscience is a field that seeks a mechanistic understanding of cognition. It has the ambition to explain how cognition arises from the interaction of neurons, to the point that if the rules that govern the brain are understood in sufficient detail, it should be in principle possible to simulate them on a computer. Therefore, the field of computational neuroscience is intrinsically reductionist: it is assumed that the whole (how the brain works) can be reduced to final elements that compose it.

To be more precise, this view refers to ontological reductionism. A non ontologically reductionist view would be for example vitalism, the idea that life is due to the existence of a vital force, without which any given set of molecules would not live. A similar view is that the mind comes from a non-material soul, which is not scientifically accessible, or at least not describable in terms of the interaction of material elements. One could also imagine that the mind arises from matter, but that there is no final intelligible element – e.g. neurons are as complex as the whole mind, and smaller elements are not more intelligible.
In modern science in general and in neuroscience in particular, ontological reductionism is fairly consensual. Computational neuroscience relies on this assumption. This is why criticisms of reductionism are sometimes wrongly perceived as if they were criticisms of the entire scientific enterprise. This perception is wrong because criticisms of reductionism are generally not about ontological reductionism but about other forms of reductionism, which are more questionable and controversial.

Methodological reductionism is the idea that the right way, or the only way, to understand the whole is to understand the elements that compose it. It is then assumed that the understanding of the whole (e.g. function) derives from this atomistic knowledge. For example, one would consider that the problem of memory is best addressed by understanding the mechanics of synaptic plasticity – e.g. how the activity of neurons changes the synapses between them. In genetics, one may consider that memory is best addressed by understanding which genes are responsible for memory, and how they control the production of proteins involved in the process. This is an assumption that is less consensual, in computational neuroscience or in science in general, including in physics. Historically, it is certainly not true that scientific enquiry in physics started from understanding microscopic laws before macroscopic laws. Classical mechanics came before quantum mechanics. In addition, macroscopic principles (such as thermodynamics and energy in general) and symmetry principles are also widely used in physics in place of microscopic laws (for example, to understand why soap makes spherical bubbles). However, this is a relatively weak criticism, as it can be conceived that macroscopic principles are derived from microscopic laws, even if this does not reflect the history of physics.

In life sciences, there are specific reasons to criticize methodological reductionism. The most common criticism in computational neuroscience is that, while function derives from the interaction of neurons, it can also be said that the way neurons interact together is indirectly determined by function, since living organisms are adapted to their environment through evolution. Therefore, unlike objects of physics, living beings are characterized by a circular rather than causal relationship between microscopic and macroscopic laws. This view underlies “principle-based” or “top-down” approaches in computational neuroscience. Note that this is a criticism of methodological reductionism, but not of ontological reductionism.

There is also a deeper criticism of methodological reductionism, following the theme of circularity. It stems from the view that the organization of life is circular. It has been developed by Humberto Maturana and Francisco Varela under the name “autopoiesis”, and by Robert Rosen under the name “M-R systems” (M for metabolism and R for repair). What defines an entity as living, before the fact that it may be able to reproduce itself, is the fact that it is able to live. It is such an obvious truth about life that it is easy to forget, but to maintain its existence as an energy-consuming organism is not trivial at all. Therefore, a living entity is viewed as a set of physical processes in interaction with the environment that are organized in such a way that they maintain their own existence. It follows that, while a part of a rock is a smaller rock, a part of a living being is generally not a living being. Each component of the living entity exists in relationship with the organization that defines the entity as living. For this reason, the organism cannot be fully understood by examining each element of its structure in isolation. This is so because the relationship between structure and organization is not causal but circular, while methodological reductionism assumes a causal relationship between the elements of structure and higher-order constructs (“function”). This criticism is deep, because it does not only claim that the whole cannot be understood by only looking at the parts, but also that the parts themselves cannot be fully understood without understanding the whole. That is, to understand what a neuron does, one must understand in what way it contributes to the organization of the brain (or more generally of the living entity).

Finally, there is another type of criticism of reductionism that has been formulated against attempts to simulate the brain. The criticism is that, even if we did manage to successfully simulate the entire brain, this would not imply that we would understand it. In other words, to reproduce is not to understand. Indeed we can clone an animal, and this fact alone does not give us a deep understanding of the biology of that animal. It could be opposed that the cloned animal is never exactly the same animal, but certainly the same could be said about the simulated brain. But tenants of the view that simulating a brain would necessarily imply understanding the brain may rather mean that such a simulation requires a detailed knowledge of the entire structure of the brain (ionic channels in neurons, connections between neurons, etc) and that by having this detailed knowledge about everything that is in the brain, we would necessarily understand the brain. This form of reductionism is called epistemic reductionism. It is somehow the reciprocal of ontological reductionism. According to ontological reductionism, if you claim to have a full mechanistic understanding of the brain, then you should be able to simulate it (providing adequate resources). Epistemic reductionism claims that this is not only a necessary condition but also a sufficient condition: if you are able to simulate the brain, then you fully understand it. This is a much stronger form of reductionism.

Criticisms of reductionism can be summarized by their answers to the question: “Can we (in principle, one day) simulate the brain?”. Critics of ontological reductionism would answer negatively, arguing that there is something critical (e.g., the soul) that cannot be simulated. Critics of epistemic reductionism would answer: yes, but this would not necessarily help us understanding the brain. Critics of methodological reductionism would answer: yes, and it would probably require a global understanding of the brain, but it could only be achieved by examining the organism as a system with an organization rather than as a set of independent elements in interaction.