Document Detail

Cooperation and the evolution of intelligence.
Jump to Full Text
MedLine Citation:
PMID:  22496188     Owner:  NLM     Status:  MEDLINE    
The high levels of intelligence seen in humans, other primates, certain cetaceans and birds remain a major puzzle for evolutionary biologists, anthropologists and psychologists. It has long been held that social interactions provide the selection pressures necessary for the evolution of advanced cognitive abilities (the 'social intelligence hypothesis'), and in recent years decision-making in the context of cooperative social interactions has been conjectured to be of particular importance. Here we use an artificial neural network model to show that selection for efficient decision-making in cooperative dilemmas can give rise to selection pressures for greater cognitive abilities, and that intelligent strategies can themselves select for greater intelligence, leading to a Machiavellian arms race. Our results provide mechanistic support for the social intelligence hypothesis, highlight the potential importance of cooperative behaviour in the evolution of intelligence and may help us to explain the distribution of cooperation with intelligence across taxa.
Luke McNally; Sam P Brown; Andrew L Jackson
Related Documents :
22329058 - We really are all multiculturalists now.
22761748 - Socio-geography of human mobility: a study using longitudinal mobile phone data.
22708028 - Neighborhood intimacy as perceived by women living in urban areas and its association w...
10455618 - The behavioural status index: therapeutic assessment of risk, insight, communication an...
16714148 - Epilepsy, intellectual disability, and living environment: a critical review.
19580598 - The ironic detachment of edward gibbon.
Publication Detail:
Type:  Journal Article; Research Support, Non-U.S. Gov't     Date:  2012-04-11
Journal Detail:
Title:  Proceedings. Biological sciences / The Royal Society     Volume:  279     ISSN:  1471-2954     ISO Abbreviation:  Proc. Biol. Sci.     Publication Date:  2012 Aug 
Date Detail:
Created Date:  2012-06-27     Completed Date:  2012-11-30     Revised Date:  2014-02-24    
Medline Journal Info:
Nlm Unique ID:  101245157     Medline TA:  Proc Biol Sci     Country:  England    
Other Details:
Languages:  eng     Pagination:  3027-34     Citation Subset:  IM    
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Biological Evolution*
Brain / physiology
Cooperative Behavior*
Decision Making
Neural Networks (Computer)
Grant Support
095831//Wellcome Trust; //Wellcome Trust

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine

Full Text
Journal Information
Journal ID (nlm-ta): Proc Biol Sci
Journal ID (iso-abbrev): Proc. Biol. Sci
Journal ID (publisher-id): RSPB
Journal ID (hwp): royprsb
ISSN: 0962-8452
ISSN: 1471-2954
Publisher: The Royal Society
Article Information
Download PDF
This journal is © 2012 The Royal Society
Received Day: 27 Month: 1 Year: 2012
Accepted Day: 16 Month: 3 Year: 2012
Print publication date: Day: 7 Month: 8 Year: 2012
Electronic publication date: Day: 11 Month: 4 Year: 2012
pmc-release publication date: Day: 11 Month: 4 Year: 2012
Volume: 279 Issue: 1740
First Page: 3027 Last Page: 3034
ID: 3385471
PubMed Id: 22496188
DOI: 10.1098/rspb.2012.0206
Publisher Id: rspb20120206

Cooperation and the evolution of intelligence Alternate Title:Cooperation and intelligence
Luke McNally12*
Sam P. Brown3
Andrew L. Jackson12
1Department of Zoology, School of Natural Sciences, Trinity College Dublin, Dublin 2, Republic of Ireland
2Centre for Biodiversity Research, Trinity College Dublin, Dublin 2, Republic of Ireland
3Centre for Immunity, Infection and Evolution, School of Biological Sciences, University of Edinburgh, Edinburgh EH9 3JT, UK
*Author for correspondence (

1.  Introduction

Natural selection never favours excess; if a lower-cost solution is present, it is selected for. Intelligence is a hugely costly trait. The human brain is responsible for 25 per cent of total glucose use, 20 per cent of oxygen use and 15 per cent of our total cardiac output, although making up only 2 per cent of our total body weight [1]. Explaining the evolution of such a costly trait has been a long-standing goal in evolutionary biology, leading to a rich array of explanatory hypotheses, ranging from evasion of predators to intelligence acting as an adaptation for the evolution of culture [24]. Among the proposed explanations, arguably the most influential has been the ‘social intelligence hypothesis’, which posits that it is the varied demands of social interactions that have led to advanced intelligence [412].

In recent years, the cognitive demands of reciprocity, one of the mechanisms posited as important in the maintenance of cooperation in humans and other intelligent taxa, have been suggested to be a causal factor in the evolution of advanced intelligence and human language. This has been particularly apparent in the evolutionary game theory literature, where conjecture regarding this relationship is frequent [1316]. Indeed, there is a rich history of work relating intelligence and reciprocity in the game theory literature, though most of this work has focused on the cognitive abilities required for the evolution of cooperation, rather than the possible role that the negotiation of these interactions has in the evolution of intelligence [1724]. As well as the cognitive abilities required for the coordination of partners during cooperative acts, both direct (decisions based on what you do to me) and indirect (decisions based on what you do to others) reciprocity have additional demands in terms of the ability to remember previous interactions and to integrate across these interactions to make decisions in cooperative dilemmas [2531]. These cognitive demands, combined with the occurrence of cooperative behaviour between unrelated individuals in intelligent taxa, suggest that selection for these mechanisms of cooperation could, at least in part, be responsible for advanced cognitive abilities [26].

The many subfields within the social intelligence hypothesis have shown a rich elaboration of verbal arguments, and data from comparative studies support many of their predictions [3234]. However, verbal reasoning and comparative analysis alone are not sufficient to assess the relative merit of competing hypotheses [35]; mechanistic models are needed to assess the plausibility of these different explanations for advanced cognition.

Here, we use an artificial neural network model to focus on the potential for direct reciprocity, a behaviour that is widespread in humans, to select for advanced cognitive abilities. Rather than manufacturing some form of functional relationship between intelligence and fitness, we allow this relationship to emerge based on the demands of decision-making in two social dilemmas, and analyse the consequences for the evolution of intelligence.

2.  Material and methods
(a)  The social dilemmas

In order to consider the dynamics of cooperative social interactions, we use the framework of two classic social dilemmas: the iterated prisoner's dilemma (IPD) and the iterated snowdrift game (ISD). In both games, two players must choose between cooperation and defection during repeated rounds. In the event of mutual cooperation or mutual defection, both players receive payoffs R or P, respectively, while a defector exploiting a cooperator gets T and the cooperator gets S. In the prisoner's dilemma, the benefit of an individual's cooperative behaviour goes to their opponent, while they pay all of the costs (e.g. food sharing, reciprocal coalitionary behaviour). This results in a payoff order of T > R > P > S. Here, the worst possible outcome for an individual is to cooperate while their opponent defects, while the best outcome is to defect while the opponent cooperates. In the snowdrift game, the benefits of cooperative behaviours are shared between opponents, and the costs are shared if both individuals cooperate (e.g. cooperative hunting, coalitionary behaviour with shared benefits). This results in a payoff order of T > R > S > P. Again, the best outcome for an individual is to defect while their opponent cooperates, though the worst possible outcome for an individual is for neither them nor their opponent to cooperate. In both games, the overall payoff (sum of both individual's payoffs) is greatest for mutual cooperation and lowest for mutual defection.

All of this means that the equilibrium frequency of cooperation for a single interaction (single-interaction Nash equilibrium) will be zero in the prisoner's dilemma but will be non-zero for a single-interaction snowdrift game [36]. These single-interaction Nash equilibria provide a useful benchmark against which to assess the effects of contingent behaviours (i.e. those that depend on the behaviour of others) in repeated interactions.

(b)  The neural network model

Any attempt to define a metric of intelligence will always be a contentious matter. However, comparative studies across taxa have usually focused on two main classes of brain properties as proxies of intelligence: metrics based on relative or absolute size of the brain or certain brain regions, and metrics based on more specific properties such as numbers of cortical neurons [37]. It is with this tradition in mind that we develop our artificial neural network model, with evolving network structure, using the number of neurons, i, as our proxy for intelligence. Each individual can display varying levels of intelligence, from simply being characterized by a binary response of always cooperate or always defect to large neural networks that possess complex neuronal structure, allowing for computations to inform decisions based on payoffs and the integration of longer-term memory into their current decision-making processes.

Each individual in our simulated populations possesses a neural network that determines their behaviour in social dilemmas (illustrated in figure 1). The networks each have two input nodes (which receive the payoffs of the individual and their opponent in the previous round as inputs) and one output node (giving the probability that they cooperate during their next interaction). The hidden layer of each individual's network has an evolving structure, possessing different numbers of cognitive and context nodes [38] (figure 1). Cognitive nodes allow for computation based on the values of network inputs and context nodes, which in turn allow for the build-up of memory based on previous states of their associated cognitive nodes.

Computation in the network is implemented via synchronous updating of nodes. The value of each input node is passed to each of the network's cognitive nodes, multiplied by the weight linking the two nodes. Each cognitive node is also passed the current value of their associated context node (if they possess one) multiplied by the weight linking the two nodes. The cognitive nodes sum across all of the weighted values that they receive and pass this value through a sigmoidal squashing function, resulting in a value between 0 and 1, analogous to a probability of activation. All context nodes are then passed the value of their associated cognitive nodes. This allows the context nodes to build up memory of previous interactions without having to store the actual sequence of events that have occurred. The internal states of these context nodes could be considered analogous to emotional states. Finally, the values at all cognitive nodes are then passed to the output node (multiplied by their weights), summed and again passed through a sigmoidal squashing function. This output gives the probability that the individual will cooperate in the current round. As the sigmoidal function asymptotes to 0 at –∞ and 1 at ∞, there will always be inherent noise in the network's probabilistic decision. This property of the function also means that it is easy to minimize noise in the network's behaviour if that behaviour shows a lack of contingency (as the node can always be near one of the asymptotes), while contingent behaviour will show greater noise (as switching is more difficult to achieve near the asymptotes). This formulation has intuitive appeal over simply adding extraneous noise to individual decisions, as in nature we would expect individuals to make few mistakes when their behaviour is non-contingent, while more complex decisions would be expected to be more error-prone. As the network cannot make decisions without an input, each individual has an additional trait encoding whether they cooperate or defect in the first round.

We allowed networks to evolve according to natural selection using a genetic algorithm where fitness is the mean payoff per round from the iterated games minus a penalty for the individual's intelligence, i. When individuals reproduce, mutations allow for the gain and loss of nodes from the hidden layer of their network with a fixed probability. Context nodes could only be gained if there was already a cognitive node present without an associated context node. The loss of a cognitive node with an associated node resulted also in the loss of the associated context node.

The addition of extra cognitive nodes gives networks the potential to perform complex computation based on payoffs by increasing the dimensions of internal representation of the network. The addition of context nodes gives the potential for the integration of longer-term memory of previous interactions in these computations. If an individual possessed no hidden layer nodes in its network, its behaviour in all rounds was decided by its first round move (i.e. they either always cooperated or always defected). The weights of each node in the network (arrowed lines in figure 1) and the threshold of each node (see the electronic supplementary material) were encoded as continuous genetic traits, again subject to mutation during reproduction. This means that, while the number of nodes in the network constrains the possible behavioural repertoire, it is the way that the constituent parts of the network interact that actually decides the individual's behaviour. In this way, our metric of intelligence assesses the potential for complex behaviour that the individual possesses, rather than the appropriateness or ‘wisdom’ of their behaviour, similarly to the measures of intelligence used in comparative studies.

(c)  Model implementation

In order to elucidate when selection favoured intelligence, we ran 10 replicates of our model for both the IPD and ISD, with each replicate lasting 50 000 generations. The payoff values used for all simulations were R = 6, P = 2, T = 7 and S = 1 for the IPD, and R = 5, P = 1, T = 8 and S = 2 for the ISD. The genetic algorithm was implemented as follows (see the electronic supplementary material for further details):

  • — an initial population of random networks was generated;
  • — each individual played every other individual in the population (50 individuals) in an IPD or ISD;
  • — each individual network's fitness was calculated as their mean payoff per round minus a fitness penalty for their level of intelligence, i;
  • — individuals were selected to reproduce asexually with probability proportional to their fitness;
  • — newly produced offspring underwent mutation of their network weights, node thresholds and network structure with constant probabilities;
  • — the previous generation died; and
  • — the algorithm returned to step 2 until 50 000 generations was reached.

During simulations we recorded the frequency of cooperation in the population, the intelligence of individuals (i) and assessments of the behaviour of individuals against a pre-determined test set of moves (see the electronic supplementary material). We then analysed the gradients of selection for intelligence across these simulations by taking selection for intelligence as the covariance between fitness and intelligence in any given generation [39]. As 50 million individual neural networks were simulated in our study, and individuals were not constrained to base their behaviour only on the previous move, our simulations generated a great diversity of strategies. In order to gain a coarse-grained overview of the strategic composition of the population, we clustered individuals based on their proximity to four canonical strategy types: always-defect-like, always-cooperate-like, tit-for-tat-like (do what your opponent did to you) and Pavlov-like (if your payoff is over a threshold, repeat your previous move). Assignment to each of these strategy types was based on which of these four strategies each individual network clustered closest to based on its behaviour against the test set. While this clustering is only a coarse-grained view, it allows assessment of the effects of shifts towards contingent cooperative strategies on selection for intelligence. Additionally, contingent human cooperation has previously clustered as either tit-for-tat-like or Pavlov-like [40], though longer-term memory is often included [41]. For full details of our data analysis, we direct readers to the electronic supplementary material.

3.  Results

Our model shows the spontaneous evolutionary emergence of behaviours similar to strategies known to perform well in the IPD and ISD, such as tit-for-tat and Pavlov, as well as simple always-cooperate or always-defect strategies (figure 2) [42]. Although our networks’ behaviours are similar to these strategies, they often show integration over many previous rounds to decide on their next moves. For example, manual interrogation of networks revealed that, of the tit-for-tat type strategies that emerge, many are tit-for-2(or more)-tats, and many of the Pavlov-like strategies also show a threshold mechanism, switching to constant defection against opponents that show behaviour close to an always-defect strategy. Behaviour was observed that appeared to be close to many other strategies—for example, grim variants (cooperate until the opponent defects, then defect forever), though often requiring more than one defection to trigger permanent defection; false cooperator (cooperate first then switch to defection), though often giving another cooperative move after many defections; and many other variants of tit-for-tat such as 2-tits-for-1-tat and 2-tits-for-2-tats. It is worth noting that strategies of these types that use longer-term memory are observed in behavioural experiments of repeated games with noise [41]. These responsive strategies require greater cognitive abilities in order to carry out computations based on payoffs, memorize past rounds and integrate across them to make decisions, in comparison with the lower requirements of simply always cooperating or defecting. We hasten to add, however, that the strategies emerging only resemble these strategies; the strategies vary in a continuous manner and often incorporate memory over more rounds. Our goal here is not to describe the strategies that can emerge in repeated games, as there is already extensive literature on this topic (see table 2.1 in [43]), but rather to elucidate the potential effects of their evolution on selection for cognitive capacities.

In order to elucidate the causal factors leading to the evolution of more complex strategies, we analyse the gradient of selection for intelligence in response to population features such as the prevalence of cooperative acts. We find that the selection for intelligence is maximized as the level of cooperation in the population moves above the single-interaction Nash equilibria towards more cooperative regimes (figure 3). In the IPD, this maximum occurs during increases in cooperation from the single-interaction Nash equilibrium, whereas in the ISD selection for intelligence is maximized at levels of cooperation just above the single-interaction Nash equilibrium. This discrepancy between the games is explained by the different natures of their single-interaction Nash equilibria. In the IPD, this equilibrium is zero, meaning that declining cooperation near this equilibrium is caused by increases in the frequency of individuals that always defect, requiring only little cognitive ability. In the ISD, the equilibrium is non-zero (0.23 in our simulations), meaning that decreases in cooperation back towards the equilibrium can be caused by ‘meaner’ contingent strategies (e.g. 2-tits-for-1-tat and false-cooperator variants), as well as individuals that always defect. As a result, transitions back to the single-interaction Nash equilibrium in the ISD can in principle select for intelligence, while this is very unlikely in the IPD.

We also find that increasing intelligence decreases the mean frequency of cooperative acts in the IPD (Spearman's rank correlation test; ρ = −0.2333, p < 0.001; figure 4a), while slightly increasing cooperation in the ISD (Spearmans' rank correlation test; ρ = 0.0089, p < 0.0001, figure 4b). Increasing intelligence increases the variance in the frequency of cooperative acts in the population in both the IPD (Breusch–Pagan test; intercept = 0.0294, slope = 0.0582, p < 0.0001; figure 4a) and the ISD (Breusch–Pagan test; intercept = 0.0309, slope = 0.0384, p < 0.001; figure 4b), showing that intelligence can facilitate greater extremes of cooperation. These results can be explained by assortment of individuals' cooperative acts [44]; the contingent strategies facilitated by increased intelligence allow an individual to increase the probability that they assort their cooperative acts with other cooperative acts. This leads to a synergistic process, where this increase in cooperation due to increased intelligence creates further opportunities for intelligent individuals to engage in mutual cooperation. However, as levels of cooperation increase further this feedback can break down, as there may be enough cooperation occurring for unconditional cooperators to increase in the population, allowing in turn for the invasion of unconditional defectors or ‘meaner’ intelligent strategies (e.g. grim variants, false-cooperator variants, etc.). This results in intelligence-facilitating cycles in the levels of cooperation seen in the population (figure 2), which increases both the variance in, and the maximum level of, cooperation.

In addition to dependency on the prevalence of, and change in, cooperative actions (figure 3), we find that intelligence can be subject to a Machiavellian runaway process [11,12]. In the ISD, as the frequency of contingent (intelligent) strategies increases, so too does selection for intelligence in the population (tit-for-tat-like strategies: Spearman's ρ = 0.2025, p < 0.0001; Pavlov-like strategies: ρ = 0.2352, p < 0.0001; see figure 5; electronic supplementary material, table S1 and figure S1). In the IPD, increasing frequencies of tit-for-tat and Pavlov reduces selection for intelligence at low levels of cooperation (frequency of cooperation <0.5; tit-for-tat: ρ = −0.0945, p < 0.0001; Pavlov: ρ = −0.0529, p < 0.0001), but does increase selection for intelligence when cooperation is more frequent (frequency of cooperation ≥ 0.5; tit-for-tat: ρ = 0.5491, p < 0.0001; Pavlov: ρ = 0.3187, p < 0.0001). The reason for this distinction between the IPD and the ISD is that there must already be some cooperation occurring for cooperative contingent strategies to be favoured via their ability to assort cooperative acts. In the ISD, the partially cooperative single-interaction equilibrium provides sufficient baseline cooperation for tit-for-tat and Pavlov to be favoured, whereas in the IPD the single-interaction equilibrium of zero cooperation means that unless contingent strategies (or random drift) have already increased cooperation, tit-for-tat-like and Pavlov-like strategies cannot be favoured, and hence cannot lead to an arms race. Note that it is still the case that intelligence is selected for in the IPD when cooperative acts are rare yet increasing (figure 3a). However, the cooperative acts that drive selection for intelligence in this case are generated by less cooperative contingent strategies, which cluster with always-defect as their closest pure strategy (ρ = 0.1095, p < 0.0001; see electronic supplementary material, table S1 and figure S1). This means that there is a succession in the arms race in the IPD, with ‘mean’ contingent strategies initially increasing selection for intelligence at low cooperation, and ‘kind’ contingent strategies increasing selection for intelligence as cooperation increases.

It is not any particular single strategy that drives these arms races; rather, as the complexity of the strategies in the population increases, there is selection for other complex strategies to outwit them. Unlike previous analyses where fixed strategies or strategies with constrained memory were used, our open-ended system allows for near infinite strategic variations to outwit opponents. In this way, selection for intelligence occurs owing to a constantly shifting strategic environment, where the ‘best response’ to the population of strategies can be shifting from generation to generation. Increases in memory allow for the potential of the recognition of opponents’ strategies, allowing for the alteration of one's own strategy in response (e.g. Pavlov-like strategies that can recognize individuals that always defect). In turn this can allow for attempts to deceive opponents regarding one's own strategy (e.g. false cooperators).

4.  Discussion

It is important here to note the closed nature of our model system; individuals can only choose within one social task (whether to cooperate or defect against another individual based on their behaviour in previous interactions with them). However, our results may apply in principle to other social scenarios where individuals use strategies to decide who to cooperate with or when to cooperate, such as indirect reciprocity [17,18], policing/punishment [45,46] and partner choice [4749]. Along with kin selection, these are the major mechanisms thought to lead to transitions to cooperative groups. As the intelligence of an individual increases, it is likely that more of these behavioural repertoires will become available to them, with increased intelligence acting as a pre-adaptation. For example, increased intelligence owing to selection for direct reciprocity could facilitate the evolution of indirect reciprocity or partner choice, highlighting the contingent nature of social evolution in multiple strategic dimensions [50]. The facilitation of new social behaviours due to emergent intelligence could allow for a perpetuated Machiavellian arms race leading to ever-greater levels of intelligence. Additionally, in our simulations populations evolved to play only a single game (either the IPD or ISD). The simultaneous play of multiple games could greatly increase strategic complexity, with the possibility of the integration of information from previous interactions in games with different payoff structures into the decision-making process.

It has previously been suggested that the pinnacles of cooperative behaviour in nature show a bimodal distribution with intelligence, with the most cooperative species displaying either limited cognition (e.g. microbes, social hymenoptera) or exceptional intelligence (e.g. humans and other primates, certain cetaceans and birds) [26]. It is clear in the former case that cooperation has evolved primarily owing to combinations of kin selection and ecological factors [51]. However, in the latter case, kin selection is not the only mechanism leading to cooperation, and may not even be the most important. A recent study has in fact suggested that relatedness was too low in human hunter–gatherer groups for kin selection to drive the evolution of human cooperation [52]. In highly intelligent species, contingent behaviours (reciprocity, partner choice, etc.) appear to have been important in the evolution of cooperation [26]. Our results may help us to explain this pattern by showing that the selection for appropriate behavioural assortment of cooperative acts can lead to selection for greater cognitive abilities and Machiavellian arms races, and that intelligence facilitates greater extremes of cooperation. Additionally, although kin selection is still of importance in highly intelligent taxa, high relatedness may hinder the evolution of intelligence by driving unconditional cooperation to fixation in the population, without any need of contingent behaviours.

A trait as complex as advanced intelligence is likely to have evolved owing to a combination of several factors rather than a single factor [4]. Along with the social intelligence hypothesis, many other theories attempting to explain the evolution of advanced intelligence have been suggested, among them that intelligence is an adaptation for tool use [53,54], that intelligence is an adaptation for social learning and the accumulation of culture [5557], and that intelligence is the result of sexual selection [58]. All of these theories are supported by evidence from at least some of the most intelligent animals. However, the difficulty lies in disentangling the traits that are causal factors in the evolution of intelligence from those that are by-products of advanced intelligence. The combination of game theoretic frameworks and artificial neural network models presented here may provide a framework for the evaluation of the mechanistic strengths of these different hypotheses. While previous models have sought to relate cooperation and intelligence, the focus has most frequently been on the cognitive requirements of cooperation, rather than on the selection for intelligence. Many of these models have lacked an explicit brain structure [1722], and among those studies that have used artificial neural networks, we know of no examples where the network structure was allowed to freely evolve or implications of selection for decision-making strategies for the evolution of intelligence were directly addressed [23,24]. While artificial neural networks are not real brains, relying on abstraction of the activity of millions of real neurons down to a manageable number of artificial neurons, they can provide insight into the dynamics of cognitive evolution and allow for the flexible evolution of behaviour [59]. Our results show that, in a freely evolving system, selection for efficient decision-making in social interactions can give rise to selection pressures for advanced cognition, supporting the view that the transition to the cooperative groups seen in the most intelligent taxa may be the key to their intellect.


We thank G. D. Ruxton, C. J. Tanner, I. Donohue, N. M. Marples, K. Irvine, R. Bshary and two anonymous reviewers for helpful comments on a previous version of this manuscript. We also thank F. J. Weissing, S. Gavrillets, J. A. R. Marshall and R. Kümmerli for helpful discussions. L.M. was supported by a scholarship from the Irish Research Council for Science, Engineering and Technology. S.P.B. was supported by the Wellcome Trust.

1. Clarke D. D.,Sokoloff L.. Year: 1999Circulation and energy metabolism. In Basic neurochemistry: molecular, cellular and medical aspects (eds Siegel G. J.,Agranoff B. W.,Albers R. W.,Fisher S. K.,Uhler M. D.), pp. 637–670Philadelphia, PA: Lippincott-Raven
2. Deaner R. O.,Nunn C. L.,van Schaik C. P.. Year: 2000Comparative tests of primate cognition: different scaling methods produce different results. Brain Behav. Evol.55, 44–5210.1159/000006641 (doi:10.1159/000006641)10773625
3. Barton R. A.. Year: 2006Primate brain evolution: integrating comparative, neurophysiological, and ethological data. Evol. Anthropol.15, 224–23610.1002/evan.20105 (doi:10.1002/evan.20105)
4. Reader S. M.,Hager Y.,Laland K. N.. Year: 2011The evolution of primate general and cultural intelligence. Phil. Trans. R. Soc. B366, 1017–102710.1098/rstb.2010.0342 (doi:10.1098/rstb.2010.0342)21357224
5. Humphrey N. K.. Year: 1976The social function of intellect. In Growing points in ethology (eds Bateson P. P. G.,Hinde R. A.), pp. 303–317Cambridge, UK: Cambridge University Press
6. Jerison H. J.. Year: 1973Evolution of the brain and intelligence. New York, NY: Academic Press
7. Byrne R. W.,Whiten A.. Year: 1988Machiavellian intelligence: social expertise and the evolution of intellect in monkeys, apes and humans. Oxford, UK: Clarendon Press
8. Whiten A.,Byrne R. W.. Year: 1997Machiavellian intelligence II: evaluations and extensions. Cambridge, UK: Cambridge University Press
9. Dunbar R. I. M.. Year: 1998The social brain hypothesis. Evol. Anthropol.6, 178–19010.1002/(SICI)1520-6505(1998)6:5<178::AID-EVAN5>3.0.CO;2-8 (doi:10.1002/(SICI)1520-6505(1998)6:5<178::AID-EVAN5>3.0.CO;2-8)
10. Kaplan H.,Hill K.,Lancaster J.,Hurtado A. M.. Year: 2000A theory of human life history evolution: diet, intelligence, and longevity. Evol. Anthropol.9, 156–18510.1002/1520-6505(2000)9:4<156::AID-EVAN5>3.0.CO;2-7 (doi:10.1002/1520-6505(2000)9:4<156::AID-EVAN5>3.0.CO;2-7)
11. Adolphs R.. Year: 2003Cognitive neuroscience of human social behaviour. Nat. Rev. Neurosci.4, 165–17810.1038/nrn1056 (doi:10.1038/nrn1056)12612630
12. Emery N. J.,Clayton N. S.,Frith C. D.. Year: 2007Introduction. Social intelligence: from brain to culture. Phil. Trans. R. Soc. B362, 485–48810.1098/rstb.2006.2022 (doi:10.1098/rstb.2006.2022)
13. Nowak M. A.,Sigmund K.. Year: 1998Evolution of indirect reciprocity by image scoring. Nature393, 573–57710.1038/31225 (doi:10.1038/31225)9634232
14. Nowak M. A.,Sigmund K.. Year: 2005Evolution of indirect reciprocity. Nature437, 1291–129810.1038/nature04131 (doi:10.1038/nature04131)16251955
15. Nowak M. A.. Year: 2006Five rules for the evolution of cooperation. Science314, 1560–156310.1126/science.1133755 (doi:10.1126/science.1133755)17158317
16. Nowak M. A.. Year: 2008Generosity: a winner's advice. Nature456, 47910.1038/456579a (doi:10.1038/456579a)
17. Rubinstein A.. Year: 1986Finite automata play the repeated prisoner's dilemma. J. Econ. Theory39, 83–9610.1016/0022-0531(86)90021-9 (doi:10.1016/0022-0531(86)90021-9)
18. Abreu D.,Rubinstein A.. Year: 1988The structure of Nash equilibrium in repeated games with finite automata. Econometrica56, 1259–128110.2307/1913097 (doi:10.2307/1913097)
19. Gilboa I.,Samet D.. Year: 1989Bounded versus unbounded rationality: the tyranny of the weak. Games Econ. Behav.1, 213–22110.1016/0899-8256(89)90009-2 (doi:10.1016/0899-8256(89)90009-2)
20. Fogel D. B.. Year: 1993Evolving behaviours in the iterated prisoner's dilemma. Evol. Comput.1, 77–9710.1162/evco.1993.1.1.77 (doi:10.1162/evco.1993.1.1.77)
21. Ho T.-H.. Year: 1996Finite automata play repeated prisoner's dilemma with information processing costs. J. Econ. Dyn. Control20, 173–20710.1016/0165-1889(94)00848-1 (doi:10.1016/0165-1889(94)00848-1)
22. Miller J. H.. Year: 1996The coevolution of automata in the repeated prisoner's dilemma. J. Econ. Behav. Organ.29, 87–11210.1016/0167-2681(95)00052-6 (doi:10.1016/0167-2681(95)00052-6)
23. Harald P. G.,Fogel D. B.. Year: 1996Evolving continuous behaviour in the iterated prisoner's dilemma. Biosystems37, 135–14510.1016/0303-2647(95)01550-7 (doi:10.1016/0303-2647(95)01550-7)8924632
24. Chellapilla K.,Fogel D. B.. Year: 1999Evolution, neural networks, games and intelligence. Proc. IEEE87, 1471–149610.1109/5.784222 (doi:10.1109/5.784222)
25. Stevens J. R.,Cushman F. A.,Hauser M. D.. Year: 2005Evolving the psychological mechanisms for cooperation. Annu. Rev. Ecol. Evol. Syst.36, 499–51810.1146/annurev.ecolsys.36.113004.083814 (doi:10.1146/annurev.ecolsys.36.113004.083814)
26. Brosnan S. F.,Salwiczek L.,Bshary R.. Year: 2010The interplay of cognition and cooperation, Phil.Trans. R. Soc. B365, 2699–271010.1098/rstb.2010.0154 (doi:10.1098/rstb.2010.0154)
27. Brosnan S. F.,de Waal F. B. M.. Year: 2002A proximate perspective on reciprocal altruism. Hum. Nat.13, 129–15210.1007/s12110-002-1017-2 (doi:10.1007/s12110-002-1017-2)
28. Stevens J. R.,Hauser M. D.. Year: 2004Why be nice? Psychological constraints on the evolution of cooperation. Trends Cogn. Sci.8, 60–6510.1016/j.tics.2003.12.003 (doi:10.1016/j.tics.2003.12.003)15588809
29. Barrett L.,Henzi P.. Year: 2005The social nature of primate cognition. Proc. R. Soc. B22, 1865–187510.1098/rspb.2005.3200 (doi:10.1098/rspb.2005.3200)
30. Hauser M.,McAuliffe K.,Blake P. R.. Year: 2009Evolving the ingredients for reciprocity and spite. Phil. Trans. R. Soc. B364, 3255–326610.1098/rstb.2009.0116 (doi:10.1098/rstb.2009.0116)19805432
31. Melis A. P.,Semmann D.. Year: 2010How is human cooperation different?Phil. Trans. R. Soc. B365, 2663–267410.1098/rstb.2010.0157 (doi:10.1098/rstb.2010.0157)20679110
32. Pawlowskil B.,Lowen C. B.,Dunbar R. I. M.. Year: 1998Neocortex size, social skills and mating success in primates. Behaviour135, 357–36810.1163/156853998793066285 (doi:10.1163/156853998793066285)
33. Dunbar R. I. M.. Year: 2003The social brain: mind, language, and society in evolutionary perspective. Ann. Rev. Anthropol.32, 163–18110.1146/annurev.anthro.32.061002.093158 (doi:10.1146/annurev.anthro.32.061002.093158)
34. Byrne R. W.,Corp N.. Year: 2004Neocortex size predicts deception rate in primates. Proc. R. Soc. Lond. B271, 1693–169910.1098/rspb.2004.2780 (doi:10.1098/rspb.2004.2780)
35. Gavrilets S.,Vose A.. Year: 2006The dynamics of Machiavellian intelligence. Proc. Natl Acad. Sci. USA103, 16 823–16 82810.1073/pnas.0601428103 (doi:10.1073/pnas.0601428103)
36. Hauert C.,Doebeli M.. Year: 2004Spatial structure often inhibits the evolution of cooperation in the snowdrift game. Nature428, 643–64610.1038/nature02360 (doi:10.1038/nature02360)15074318
37. Roth G.,Dicke U.. Year: 2005Evolution of the brain and intelligence. Trends Cogn. Sci.9, 250–25710.1016/j.tics.2005.03.005 (doi:10.1016/j.tics.2005.03.005)15866152
38. Elman J. L.. Year: 1991Distributed representations, simple recurrent networks, and grammatical structure. Mach. Learn.7, 195–225
39. Price G.. Year: 1970Selection and covariance. Nature227, 520–52110.1038/227520a0 (doi:10.1038/227520a0)5428476
40. Kümmerli R.,Colliard C.,Fiechter N.,Petitpierre B.,Russier F.,Keller L.. Year: 2007Human cooperation in social dilemmas: comparing the snowdrift game with the prisoner's dilemma. Proc. R. Soc. B274, 2965–297010.1098/rspb.2007.0793 (doi:10.1098/rspb.2007.0793)
41. Fudenberg D.,Rand D. G.,Dreber A.. In press. Slow to anger and fast to forgive: cooperation in an uncertain world. Am. Econ. Rev. (doi:10.2139/ssrn.1616396)
42. Nowak M. A.,Sigmund K.. Year: 1993A strategy of win-stay, lose-shift that outperforms tit-for-tat in the prisoner's dilemma game. Nature364, 56–5810.1038/364056a0 (doi:10.1038/364056a0)8316296
43. Dugatkin L. A.. Year: 1997Cooperation among animals: an evolutionary perspective. Oxford, UK: Oxford University Press
44. Fletcher J. A.,Doebeli M.. Year: 2009A simple and general explanation for the evolution of altruism. Proc. R. Soc. B276, 13–1910.1098/rspb.2008.0829 (doi:10.1098/rspb.2008.0829)
45. Boyd R.,Gintis H.,Bowles S.,Richerson P. J.. Year: 2003The evolution of altruistic punishment. Proc. Natl Acad. Sci. USA100, 3531–353510.1073/pnas.0630443100 (doi:10.1073/pnas.0630443100)12631700
46. Hauert C.,Traulsen A.,Brandt H.,Nowak M. A.,Sigmund K.. Year: 2007Via freedom to coercion: the emergence of costly punishment. Science316, 1905–190710.1126/science.1141588 (doi:10.1126/science.1141588)17600218
47. Roberts G.. Year: 1998Competitive altruism: from reciprocity to the handicap principle. Proc. R. Soc. Lond. B265, 427–43110.1098/rspb.1998.0312 (doi:10.1098/rspb.1998.0312)
48. Sherratt T. N.,Roberts G.. Year: 1998The evolution of generosity and choosiness in cooperative exchanges. J. Theor. Biol.193, 167–17710.1006/jtbi.1998.0703 (doi:10.1006/jtbi.1998.0703)9689952
49. McNamara J. M.,Barta Z.,Fromhage L.,Houston A. I.. Year: 2008The coevolution of choosiness and cooperation. Nature451, 189–19210.1038/nature06455 (doi:10.1038/nature06455)18185587
50. Brown S. P.,Taylor P. D.. Year: 2010Joint evolution of multiple social traits: a kin selection analysis. Proc. R. Soc. B277, 415–42210.1098/rspb.2009.1480 (doi:10.1098/rspb.2009.1480)
51. West S. A.,Griffin A. S.,Gardner A.. Year: 2007Evolutionary explanations for cooperation. Curr. Biol.17, R661–R67210.1016/j.cub.2007.06.004 (doi:10.1016/j.cub.2007.06.004)17714660
52. Hill K. R.,et al. Year: 2011Co-residence patterns in hunter–gatherer societies show unique human social structure. Science331, 1286–128910.1126/science.1199071 (doi:10.1126/science.1199071)21393537
53. Oakley K. P.. Year: 1949Man the tool maker. London, UK: Trustees of the British Museum
54. Wynn T.. Year: 1988Tools and the evolution of human intelligence. In Machiavellian intelligence: social expertise and the evolution of intellect in monkeys, apes and humans (eds Byrne R. W.,Whiten A.), pp. 271–294Oxford, UK: Clarendon Press
55. Whiten A.,van Schaik C. P.. Year: 2007The evolution of animal ‘cultures’ and social intelligence. Phil. Trans. R. Soc. B362, 603–62010.1098/rstb.2006.1998 (doi:10.1098/rstb.2006.1998)17255007
56. Moll H.,Tomasello M.. Year: 2007Cooperation and human cognition: the Vygotskian intelligence hypothesis. Phil. Trans. R. Soc. B362, 639–64810.1098/rstb.2006.2000 (doi:10.1098/rstb.2006.2000)17296598
57. van Schaik C. P.,Burkart J. M.. Year: 2011Social learning and evolution: the cultural intelligence hypothesis. Phil. Trans. R. Soc. B366, 1008–101610.1098/rstb.2010.0304 (doi:10.1098/rstb.2010.0304)21357223
58. Miller G. F.. Year: 2000The mating mind: how sexual choice shaped the evolution of human nature. London, UK: Heinemann
59. Enquist M.,Ghirlanda S.. Year: 2005Neural networks and animal behaviour. Princeton, NJ: Princeton University Press


[Figure ID: RSPB20120206F1]
Figure 1. 

The artificial neural network model. (a) A schematic to aid in the understanding of our network structures is shown. Input nodes, which receive the payoffs of both players in the previous round, are labelled A. Cognitive nodes, which can receive input from both input and context nodes, are labelled B. Context nodes, which store the previous state of their cognitive node and return this state (times a weight) as input in the next round, are labelled C. The output node that receives inputs from the cognitive nodes and gives the individual's decision to cooperate or defect is labelled D. The most complex artificial neural network allowed in our simulations is shown in (b), possessing 10 cognitive nodes and 10 context nodes. A sample of a possible sequence of mutations to network structure is shown in (c). Individuals gain and lose cognitive and context nodes by random mutation. If a cognitive node with a connection to a context node is lost by mutation, the context node is also lost.

[Figure ID: RSPB20120206F2]
Figure 2. 

The emergence of intelligent strategies. Shown are the dynamics during 10 000 generation subsets of our simulations for the (a,c) prisoner's dilemma and the (b,d) snowdrift game. (a,b) Sample cycles in the frequency of cooperative acts in the population. (b,d) Frequencies of different strategy types (black, always-defect-like; white, always-cooperate-like; dark grey, tit-for-tat-like; light grey, Pavlov-like) as determined by clustering individuals with their nearest pure strategy (see §2 and electronic supplementary material for details). Transitions to cooperation are characterized by high numbers of contingent strategies, followed by the invasion of the always-cooperate strategy.

[Figure ID: RSPB20120206F3]
Figure 3. 

Selection for intelligence and transitions to cooperation. Shown is the level of selection for intelligence, taken as the covariance between fitness and intelligence, against the frequency of cooperation in the current generation and the change in the frequency of cooperation since the last generation. Darker shades indicate greater selection for intelligence. White areas indicate impossible value combinations. Selection for intelligence is maximized during transitions away from single-interaction equilibria, which are no cooperation for the IPD (a), and a frequency of cooperation of 0.23 for the ISD (b). Values displayed were smoothed using a Gaussian kernel.

[Figure ID: RSPB20120206F4]
Figure 4. 

Intelligence and the distribution of cooperation. Shown are the relationships between the frequency of cooperative acts in the population and the mean level of intelligence in the population (a) for the prisoner's dilemma and (b) for the snowdrift game. Mean values are shown by the open circles and lines, and the ranges of the data are shown by the error bars. Greater intelligence decreases the mean level of cooperation in the IPD, while slightly increasing the mean level of cooperation in the ISD. The maximum and variance in the frequency of cooperative acts increases with intelligence, showing that the evolution of intelligent, contingent strategies leads to greater extremes in the frequency of cooperation.

[Figure ID: RSPB20120206F5]
Figure 5. 

Strategic composition and selection for intelligence. The barplots show the Spearman rank correlation (ρ) between the frequency of each of our four strategy types and selection for intelligence for (a) all levels of cooperation, (b) low cooperation (frequency of cooperative acts less than 0.5) and (c) high cooperation (frequency of cooperative acts greater than or equal to 0.5). Tit-for-tat-like and Pavlov-like strategies always increase selection for intelligence in the ISD, but only when cooperation is high in the IPD. For further details, see electronic supplementary material, figure S1 and table S1.

Article Categories:
  • 1001
  • 203
  • 70
  • 42
Article Categories:
  • Research Articles

Keywords: reciprocity, Machiavellian intelligence, cognition, social brain, prisoner's dilemma, snowdrift game.

Previous Document:  The role of moulting in parasite defence.
Next Document:  Plant-soil feedbacks provide an additional explanation for diversity-productivity relationships.