Draft:Dynamic message passing

Dynamic message passing (DMP) is a family of message-passing algorithms for computing marginal probabilities of various dynamical processes on networks. The need for such equations comes from the fact that standard message passing methods such as belief propagation (BP) are computationally inefficient when directly applied to dynamic problems. Though DMP equations can be directly derived from BP, they take advantage of the structure imposed on the problem by a specific type of dynamics. This allows for direct computation of the BP solution, without the need of iterating the equations. Good example are DMP equations for unidirectional compartmental models dynamics on trees, which were strictly derived from BP.[1] Sometimes the name is used to refer to message passing like equations, which are applied to dynamic problems on networks, but are not directly connected to BP.[2] In such cases the equations may not be exact on trees, but can still be useful in other settings.

Motivation

Being able to compute marginal probabilities is specifically useful for prediction tasks. One particular example is the task of estimating the expected global spread for spreading models on networks. If we denote the number of infected individuals in the population at time by , then we can write

where is the infected state, is the number of infected individuals at time and is the state of node at time . ... In the case of simple unidirectional dynamics the complexity of the problem can be further simplified... ...

Equations for specific models

Most popular use-case for DMP equations are epidemic models on networks. These are typically network versions of classical compartmental models, like for example Susceptible-Infected-Recovered model. Below are some examples of DMP equations for such models.

Susceptible-Infected model

...In this simple model of epidemic spreading...

Susceptible-Infected-Recovered model

...adding the extra state...

Independent Cascade model

...special case of the above described SIR model...popular in computer science...

Derivation from belief propagation

DMP equations can be directly derived from belief propagation equations, but it requires a modification of the original spreading graph. Straightforward... ...

...

...

...

...

Independent Cascade model case

As an example...

...

...

Limitations

DMP inherits the properties of belief propagation and as such is exact on trees, unless other approximations were used. It is also asymptotically exact for sparse and tree-like graphs, but breaks down when many short loops are present. Low, even linear, complexity in time is achieved for models with unidirectional dynamics, where a single trajectory can be parametrised by only a few parameters, regardless of the time horizon. ...Trees, Unidirectional dynamics...

Applications

DMP is an approximate inference technique, but its main strength comes from the fact that, unlike standard BP, it does not require iteration and with certain realistic assumptions about the dynamics, can be as computationally efficient as a single Monte Carlo run [needs citation]. These advantages, together with marginalisation over time, make DMP a perfect sub-rutine for more complex tasks, such as learning [needs citation] or optimisation [needs citation]. One good example is...(learning with partial observation <-- can deal with unobserved nodes due to marginalisation over nodes and is computationally efficient)... ...Inference, Learning, Optimisation...

References

  1. ^ Lokhov, Andrey; Mézard, Marc; Zdeborová, Lenka (2015). "Dynamic message-passing equations for models with unidirectional dynamics". Physical Review E. APS: 012811.
  2. ^ Shrestha, Munik; Scarpino, Samuel; Moore, Cristopher (2015). "Message-passing approach for recurrent-state epidemic models on networks". Physical Review E. APS: 022821.

Content Disclaimer

Informasi ini disarikan dari Wikipedia dan disajikan kembali untuk tujuan edukasi. Konten tersedia di bawah lisensi CC BY-SA 3.0. Kami tidak bertanggung jawab atas ketidakakuratan data yang bersumber dari kontribusi publik tersebut.

  1. The information displayed on this website is sourced in part or in whole from Wikipedia and has been adapted for the purpose of restating it. We strive to provide accurate and relevant information, however:
  2. There is no guarantee of absolute accuracy. Wikipedia is an open, collaborative project that can be edited by anyone, so information is subject to change.
  3. It is not intended to constitute professional advice. The content displayed is for informational and educational purposes only. For important decisions (e.g., medical, legal, or financial), please consult a professional.
  4. Content copyright. Wikipedia is licensed under the Creative Commons Attribution-ShareAlike License (CC BY-SA). This means that content may be reused with appropriate attribution and shared under a similar license.
  5. Responsible use. Any risk arising from the use of information from this website is entirely the responsibility of the user.