Ushiki's theorem

The system size expansion, also known as van Kampen's expansion or the Ω-expansion, is a technique pioneered by van Kampen used in the analysis of stochastic processes. Specifically, it allows one to find an approximation to the solution of a master equation with nonlinear transition rates. This approximation is often formulated in the linear noise approximation, in which the master equation is represented by a Fokker–Planck equation with linear coefficients determined by the transition rates and stochiometry of the system.

Less formally, it is normally straightforward to write down a mathematical description of a system where processes happen randomly (for example, radioactive atoms randomly decay in a physical system, or genes are randomly expressed in a biological system). However, these mathematical descriptions are often complicated and difficult to solve for interesting properties of the system (for example, the mean and variance of the number of atoms or genes as a function of time). The system size expansion allows us to approximate a complicated mathematical description by a simpler one that is guaranteed to provide (approximate) results for these properties.

Preliminaries

Systems that admit a treatment with the system size expansion may be described by a probability distribution $P(X,t)$, giving the probability of observing the system in state $X$ at time $t$. $X$ may be, for example, a vector with elements corresponding to the number of molecules of different chemical species in a system. In a system of size $\mathrm{\Omega }$ (intuitively interpreted as the volume), we will adopt the following nomenclature: $\mathbf{X}$ is a vector of macroscopic copy numbers, $\mathbf{x}=\mathbf{X}/\mathrm{\Omega }$ is a vector of concentrations, and $\mathit{\varphi }$ is a vector of deterministic concentrations, as they would appear according to the rate equation in an infinite system. $\mathbf{x}$ and $\mathbf{X}$ are thus quantities subject to stochastic effects.

A master equation describes the time evolution of this probability. Henceforth, a system of chemical reactions will be discussed to provide a concrete example, although the nomenclature of "species" and "reactions" is generalisable. A system involving $N$ species and $R$ reactions can be described with the master equation:

$\frac{dP(\mathbf{X},t)}{dt}=\mathrm{\Omega }\sum _{j=1}^R(\prod _{i=1}^N{\mathbb{𝔼}}^{-S_{ij}}-1)f_j(\mathbf{x},\mathrm{\Omega })P(\mathbf{X},t).$

Here, $\mathrm{\Omega }$ is the system size, $\mathbb{𝔼}$ is an operator which will be addressed later, $S_{ij}$ is the stochiometric matrix for the system (in which element $S_{ij}$ gives the stoichiometric coefficient for species $i$ in reaction $j$), and $f_j$ is the rate of reaction $j$ given a state $\mathbf{x}$ and system size $\mathrm{\Omega }$.

${\mathbb{𝔼}}^{-S_{ij}}$ is a step operator, removing $S_{ij}$ from the $i$th element of its argument. For example, ${\mathbb{𝔼}}^{-S_{23}}f(x_1,x_2,x_3)=f(x_1,x_2-S_{23},x_3)$. This formalism will be useful later.

The above equation can be interpreted as follows. The initial sum on the RHS is over all reactions. For each reaction $j$, the brackets immediately following the sum give two terms. The term with the simple coefficient −1 gives the probability flux away from a given state $\mathbf{X}$ due to reaction $j$ changing the state. The term preceded by the product of step operators gives the probability flux due to reaction $j$ changing a different state ${\mathbf{X}}^{\prime }$ into state $\mathbf{X}$. The product of step operators constructs this state ${\mathbf{X}}^{\prime }$.

Example

For example, consider the (linear) chemical system involving two chemical species $X_1$ and $X_2$ and the reaction $X_1\to X_2$. In this system, $N=2$ (species), $R=1$ (reactions). A state of the system is a vector $\mathbf{X}=\{n_1,n_2\}$, where $n_1,n_2$ are the number of molecules of $X_1$ and $X_2$ respectively. Let $f_1(\mathbf{x},\mathrm{\Omega })=\frac{n_1}{\mathrm{\Omega }}=x_1$, so that the rate of reaction 1 (the only reaction) depends on the concentration of $X_1$. The stochiometry matrix is $(-1,1{)}^T$.

Then the master equation reads:

$\begin{array}{rl}\frac{dP(\mathbf{X},t)}{dt}& =\mathrm{\Omega }({\mathbb{𝔼}}^{-S_{11}}{\mathbb{𝔼}}^{-S_{21}}-1)f_1\left(\frac{\mathbf{X}}{\mathrm{\Omega }}\right)P(\mathbf{X},t)\\ & =\mathrm{\Omega }(f_1\left(\frac{\mathbf{X}+\mathrm{\Delta }\mathbf{X}}{\mathrm{\Omega }}\right)P(\mathbf{X}+\mathrm{\Delta }\mathbf{X},t)-f_1\left(\frac{\mathbf{X}}{\mathrm{\Omega }}\right)P(\mathbf{X},t)),\end{array}$

where $\mathrm{\Delta }\mathbf{X}=\{1,-1\}$ is the shift caused by the action of the product of step operators, required to change state $\mathbf{X}$ to a precursor state ${\mathbf{X}}^{\prime }$.

Linear Noise Approximation

If the master equation possesses nonlinear transition rates, it may be impossible to solve it analytically. The system size expansion utilises the ansatz that the variance of the steady-state probability distribution of constituent numbers in a population scales like the system size. This ansatz is used to expand the master equation in terms of a small parameter given by the inverse system size.

Specifically, let us write the $X_i$, the copy number of component $i$, as a sum of its "deterministic" value (a scaled-up concentration) and a random variable $\xi$, scaled by ${\mathrm{\Omega }}^{1/2}$:

$X_i=\mathrm{\Omega }{\varphi }_i+{\mathrm{\Omega }}^{1/2}{\xi }_i.$

The probability distribution of $\mathbf{X}$ can then be rewritten in the vector of random variables $\xi$:

$P(\mathbf{X},t)=P(\mathrm{\Omega }\mathit{\varphi }+{\mathrm{\Omega }}^{1/2}\mathit{\xi })=\mathrm{\Pi }(\mathit{\xi },t).$

Let us consider how to write reaction rates $f$ and the step operator $\mathbb{𝔼}$ in terms of this new random variable. Taylor expansion of the transition rates gives:

$f_j(\mathbf{x})=f_j(\mathit{\varphi }+{\mathrm{\Omega }}^{-1/2}\mathit{\xi })=f_j(\mathit{\varphi })+{\mathrm{\Omega }}^{-1/2}\sum _{i=1}^N\frac{\partial f{\text{'}}_j(\mathit{\varphi })}{\partial {\varphi }_i}{\xi }_i+O({\mathrm{\Omega }}^{-1}).$

The step operator has the effect $\mathbb{𝔼}f(n)\to f(n+1)$ and hence $\mathbb{𝔼}f(\xi )\to f(\xi +{\mathrm{\Omega }}^{-1/2})$:

$\prod _{i=1}^N{\mathbb{𝔼}}^{-S_{ij}}\simeq 1-{\mathrm{\Omega }}^{-1/2}\sum _i{S}_{ij}\frac{\partial }{\partial {\xi }_i}+\frac{{\mathrm{\Omega }}^{-1}}{2}\sum _i\sum _k{S}_{ij}{S}_{kj}\frac{{\partial }^2}{\partial {\xi }_i\partial {\xi }_k}+O({\mathrm{\Omega }}^{-3/2}).$

We are now in a position to recast the master equation.

$\begin{array}{rl}& \frac{\partial \mathrm{\Pi }(\mathit{\xi },t)}{\partial t}-{\mathrm{\Omega }}^{1/2}\sum _{i=1}^N\frac{\partial {\varphi }_i}{\partial t}\frac{\partial \mathrm{\Pi }(\mathit{\xi },t)}{\partial {\xi }_i}\\ & =\mathrm{\Omega }\sum _{j=1}^R(-{\mathrm{\Omega }}^{-1/2}\sum _i{S}_{ij}\frac{\partial }{\partial {\xi }_i}+\frac{{\mathrm{\Omega }}^{-1}}{2}\sum _i\sum _k{S}_{ij}{S}_{kj}\frac{{\partial }^2}{\partial {\xi }_i\partial {\xi }_k}+O({\mathrm{\Omega }}^{-3/2}))\\ & \times (f_j(\mathit{\varphi })+{\mathrm{\Omega }}^{-1/2}\sum _i\frac{\partial f{\text{'}}_j(\mathit{\varphi })}{\partial {\varphi }_i}{\xi }_i+O({\mathrm{\Omega }}^{-1}))\mathrm{\Pi }(\mathit{\xi },t).\end{array}$

This rather frightening expression makes a bit more sense when we gather terms in different powers of $\mathrm{\Omega }$. First, terms of order ${\mathrm{\Omega }}^{1/2}$ give

$\sum _{i=1}^N\frac{\partial {\varphi }_i}{\partial t}\frac{\partial \mathrm{\Pi }(\mathit{\xi },t)}{\partial {\xi }_i}=\sum _{i=1}^N\sum _{j=1}^R{S}_{ij}f{\text{'}}_j(\mathit{\varphi })\frac{\partial \mathrm{\Pi }(\mathit{\xi },t)}{\partial {\xi }_j}.$

These terms cancel, due to the macroscopic reaction equation

$\frac{\partial {\varphi }_i}{\partial t}=\sum _{j=1}^R{S}_{ij}f{\text{'}}_j(\mathit{\varphi }).$

The terms of order ${\mathrm{\Omega }}^0$ are more interesting:

$\frac{\partial \mathrm{\Pi }(\mathit{\xi },t)}{\partial t}=\sum _j(\sum _{ik}-S_{ij}\frac{\partial f{\text{'}}_j}{\partial {\varphi }_k}\frac{\partial ({\xi }_k\mathrm{\Pi }(\mathit{\xi },t))}{\partial {\xi }_i}+\frac{1}{2}f{\text{'}}_j\sum _{ik}{S}_{ij}{S}_{kj}\frac{{\partial }^2\mathrm{\Pi }(\mathit{\xi },t)}{\partial {\xi }_i\partial {\xi }_k}),$

which can be written as

$\frac{\partial \mathrm{\Pi }(\mathit{\xi },t)}{\partial t}=\sum _{ik}{A}_{ik}\frac{\partial ({\xi }_k\mathrm{\Pi })}{\partial {\xi }_i}+\frac{1}{2}\sum _{ik}[{\mathbf{B}\mathbf{B}}^T{]}_{ik}\frac{{\partial }^2\mathrm{\Pi }}{\partial {\xi }_i\partial {\xi }_k},$

where

$A_{ik}=\sum _{j=1}^R{S}_{ij}\frac{\partial f{\text{'}}_j}{\partial {\varphi }_k}=\frac{\partial ({\mathbf{S}}_i\cdot \mathbf{f})}{\partial {\varphi }_k},$

and

$[{\mathbf{B}\mathbf{B}}^T{]}_{ik}=\sum _{j=1}^R{S}_{ij}{S}_{kj}f{\text{'}}_j(\mathit{\varphi })=[\mathbf{S}\text{diag}(f(\mathit{\varphi })){\mathbf{S}}^T{]}_{ik}.$

The time evolution of $\mathrm{\Pi }$ is then governed by the linear Fokker–Planck equation with coefficient matrices $\mathbf{A}$ and ${\mathbf{B}\mathbf{B}}^T$ (in the large-$\mathrm{\Omega }$ limit, terms of $O({\mathrm{\Omega }}^{-1/2})$ may be neglected, termed the linear noise approximation). With knowledge of the reaction rates $\mathbf{f}$ and stochiometry $S$, the moments of $\mathrm{\Pi }$ can then be calculated.

Applications to modeling stochastic reaction kinetics inside cells and higher order corrections

The linear noise approximation has become a popular technique for estimating the size of intrinsic noise in terms of coefficients of variation and Fano factors for molecular species in intracellular pathways. The second moment obtained from the linear noise approximation (on which the noise measures are based) are exact only if the pathway is composed of first-order reactions. However bimolecular reactions such as enzyme-substrate, protein-protein and protein-DNA interactions are ubiquitous elements of all known pathways; for such cases, the linear noise approximation can give estimates which are accurate in the limit of large reaction volumes. Since this limit is taken at constant concentrations, it follows that the linear noise approximation gives accurate results in the limit of large molecule numbers and becomes less reliable for pathways characterized by many species with low copy numbers of molecules.

A number of studies have elucidated cases of the insufficiency of the linear noise approximation in biological contexts by comparison of its predictions with those of stochastic simulations. This has led to the investigation of higher order terms of the system size expansion that go beyond the linear approximation. These terms have been used to obtain more accurate moment estimates for the mean concentrations and for the variances of the concentration fluctuations in intracellular pathways. In particular, the leading order corrections to the linear noise approximation yield corrections of the conventional rate equations. Terms of higher order have also been used to obtain corrections to the variances and covariances estimates of the linear noise approximation. The linear noise approximation and corrections to it can be computed using the open source software intrinsic Noise Analyzer. The corrections have been shown to be particularly considerable for allosteric and non-allosteric enzyme-mediated reactions in intracellular compartments.

References

43 year old Petroleum Engineer Harry from Deep River, usually spends time with hobbies and interests like renting movies, property developers in singapore new condominium and vehicle racing. Constantly enjoys going to destinations like Camino Real de Tierra Adentro.