|
|
| Line 1: |
Line 1: |
| The '''Kirkwood superposition approximation''' was introduced in 1935 by [[John Gamble Kirkwood|John G. Kirkwood]] as a means of representing a [[discrete probability distribution]].<ref>Kirkwood, J. G. ''Statistical Mechanics of Fluid Mixtures''. [[J. Chem. Phys.]] 3, 300, (1935)</ref> The Kirkwood approximation for a discrete [[probability density function]] <math>P(x_{1},x_{2},\ldots ,x_{n})</math> is given by
| | Hello friend. Let me introduce myself. I am Luther Aubrey. Delaware is the only location I've been residing in. The favorite pastime for him and his kids is to play badminton but he is struggling to find time for it. She is currently a cashier but quickly she'll be on her own.<br><br>my website - [http://Plus-Iq.com/profile-1669/info/ http://Plus-Iq.com/profile-1669/info/] |
| | |
| :<math>
| |
| P^{\prime }(x_1,x_2,\ldots ,x_n)=\frac{\frac{\frac{\prod_{\mathcal{T}
| |
| _{n-1}\subseteq \mathcal{V}}p(\mathcal{T}_{n-1})}{\prod_{\mathcal{T}
| |
| _{n-2}\subseteq \mathcal{V}}p(\mathcal{T}_{n-2})}}{\vdots }}{\prod_{\mathcal{
| |
| T}_1\subseteq \mathcal{V}}p(\mathcal{T}_1)}
| |
| </math>
| |
| | |
| where
| |
| | |
| : <math>\prod_{\mathcal{T}_i\subseteq \mathcal{V}}p(\mathcal{T}_i)</math> | |
| | |
| is the product of probabilities over all subsets of variables of size ''i'' in variable set <math>\scriptstyle\mathcal{V}</math>. This kind of formula has been considered by Watanabe (1960) and, according to Watanabe, also by Robert Fano. For the three-variable case, it reduces to simply
| |
| | |
| :<math> | |
| P^\prime(x_1,x_2,x_3)=\frac{p(x_1,x_2)p(x_2,x_3)p(x_1,x_3)}{p(x_1)p(x_{2})p(x_3)}
| |
| </math>
| |
|
| |
| The Kirkwood approximation does not generally produce a valid probability distribution (the normalization condition is violated). Watanabe claims that for this reason informational expressions of this type are not meaningful, and indeed there has been very little written about the properties of this measure. The Kirkwood approximation is the probabilistic counterpart of the [[interaction information]].
| |
| | |
| [[Judea Pearl]] (1988 §3.2.4) indicates that an expression of this type can be exact in the case of a ''decomposable'' model, that is, a probability distribution that admits a [[graph (mathematics)|graph]] structure whose [[clique (graph theory)|cliques]] form a [[tree (graph theory)|tree]]. In such cases, the numerator contains the product of the intra-clique joint distributions and the denominator contains the product of the clique intersection distributions.
| |
| | |
| == References ==
| |
| {{reflist}}
| |
| | |
| * Jakulin, A. & Bratko, I. (2004), Quantifying and visualizing attribute interactions: An approach based on entropy, ''Journal of Machine Learning Research'', (submitted) pp. 38–43.
| |
| | |
| * Matsuda, H. (2000), Physical nature of higher-order mutual information: Intrinsic correlations and frustration, ''Physical Review E'' '''62''', 3096–3102.
| |
| | |
| * Pearl, J. (1988), ''Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference'', Morgan Kaufmann, San Mateo, CA.
| |
| | |
| * Watanabe, S. (1960), Information theoretical analysis of multivariate correlation, ''IBM Journal of Research and Development'' '''4''', 66–82.
| |
| | |
| [[Category:Probability theory]]
| |
| [[Category:Discrete distributions]]
| |
| [[Category:Statistical approximations]]
| |
Hello friend. Let me introduce myself. I am Luther Aubrey. Delaware is the only location I've been residing in. The favorite pastime for him and his kids is to play badminton but he is struggling to find time for it. She is currently a cashier but quickly she'll be on her own.
my website - http://Plus-Iq.com/profile-1669/info/