Learning to coordinate in complex networks

Sven van Segbroeck, Steven de Jong, Ann Nowé, Francisco C. Santos, Tom Lenaerts

Research output: Contribution to journalArticlepeer-review

26 Citations (Scopus)

Abstract

Designing an adaptive multi-agent system often requires the specification of interaction patterns between the different agents. To date, it remains unclear to what extent such interaction patterns influence the dynamics of the learning mechanisms inherent to each agent in the system. Here, we address this fundamental problem, both analytically and via computer simulations, examining networks of agents that engage in stag-hunt games with their neighbors and thereby learn to coordinate their actions. We show that the specific network topology does not affect the game strategy the agents learn on average. Yet, network features such as heterogeneity and clustering effectively determine how this average game behavior arises and how it manifests itself. Network heterogeneity induces variation in learning speed, whereas network clustering results in the emergence of clusters of agents with similar strategies. Such clusters also form when the network structure is not predefined, but shaped by the agents themselves. In that case, the strategy of an agent may become correlated with that of its neighbors on the one hand, and with its degree on the other hand. Here, we show that the presence of such correlations drastically changes the overall learning behavior of the agents. As such, our work provides a clear-cut picture of the learning dynamics associated with networks of agents trying to optimally coordinate their actions.

Original languageEnglish
Pages (from-to)416-427
Number of pages12
JournalAdaptive Behavior
Volume18
Issue number5
DOIs
Publication statusPublished - Oct 2010

Keywords

  • Complex networks
  • evolutionary game theory
  • learning automata

Fingerprint

Dive into the research topics of 'Learning to coordinate in complex networks'. Together they form a unique fingerprint.

Cite this