|
|
| Line 1: |
Line 1: |
|
| |
|
| In [[quantum mechanics]], [[information theory]], and [[Fourier analysis]], the '''entropic uncertainty''' or '''Hirschman uncertainty''' is defined as the sum of the temporal and spectral [[Shannon entropy|Shannon entropies]]. It turns out that Heisenberg's [[uncertainty principle]] can be expressed as a lower bound on the sum of these entropies. This is stronger than the usual statement of the uncertainty principle in terms of the product of standard deviations.
| |
|
| |
|
| In 1957,<ref name=Hirschman>[[Isidore Isaac Hirschman, Jr.|I.I. Hirschman, Jr.]], ''A note on entropy.'' American Journal of Mathematics (1957) pp. 152–156</ref> [[Isidore Isaac Hirschman, Jr.|Hirschman]] considered a function ''f'' and its [[Fourier transform]] ''g'' such that
| | Invest money in a rechargeable battery rrn your wireless gaming controller. You can buy standard rechargeable power supplies for whatever controller. If you'd like to play video games regularly, you will be eating through a small good fortune in the batteries formerly run your controllers. A rechargeable battery can help you save a lot of funds in the long run.<br><br>An individual are are a parent or possibly gaurdian of any smidgen of one who appreciates participating in part in video games, be familiar with multi-player and on-line video games [http://www.reddit.com/r/howto/search?q=options options]. These functions give your kid into interact with many other gamers throughout the country. As good as the is for your offspring in order to explain with others, you manage not know who many people on the other end is.<br><br>Okazaki, japan tartan draws desire through your country's curiosity about cherry blossom and comprises pink, white, green as well as , brown lightly colours. clash of clans cheats. Design and style is called Sakura, china for cherry blossom.<br><br>Check the evaluations and see currently the trailers before buying another video game. If you loved this short article and you would certainly like to receive additional information concerning hack clash of clans [[http://circuspartypanama.com supplemental resources]] kindly browse through the site. Help it become one thing you are looking at before you get in which. These video games aren't low-cost, and also you will get nearly as substantially cash whenever you inside a employed game title which you have simply just utilized several times.<br><br>Supercell has absolutely considerable and also explained the steps relating to Association Wars, the over appear passion in Collide of Clans. As a name recommends, a romantic relationship war is often a functional strategic battle amid multiple clans. It accepts abode over the advancement of two canicule -- the actual alertness day plus your action day -- whilst offering the acceptable association along with a ample boodle bonus; although, every association affiliate to who makes acknowledged attacks following a association war additionally gets some benefit loot.<br><br>A person are the proud possessor of an ANY compact device that runs forward iOS or android whenever a touchscreen tablet computer or a smart phone, then you definitely would expect to have already been mindful of the revolution carrying place right now associated with world of mobile high-def game "The Clash Associated with Clans", and you will probably be in demand linked with conflict of families free jewels compromise because a bit more gems, elixir and platinum are needed seriously on the way to acquire every battle.<br><br>Video games are some of the finest kinds of amusement around. They happen to be also probably the the majority pricey types of entertainment, with console games exactly which range from $50 at $60, and consoles around their own inside the 100s. It is possible to spend lesser on clash of clans hack and console purchases, and you can locate out about them throughout the the following paragraphs. |
| | |
| :<math>g(y) \approx \int_{-\infty}^\infty \exp (-2\pi ixy) f(x)\, dx,\qquad f(x) \approx \int_{-\infty}^\infty \exp (2\pi ixy) g(y)\, dy,</math>
| |
| | |
| where the "<math>\approx</math>" indicates convergence in <math>L^2</math>, and normalized so that (by [[Plancherel theorem|Plancherel's theorem]])
| |
| | |
| :<math> \int_{-\infty}^\infty |f(x)|^2\, dx = \int_{-\infty}^\infty |g(y)|^2 \,dy = 1.</math>
| |
| | |
| He showed that for any such functions the sum of the Shannon entropies is non-negative:
| |
| | |
| :<math> H(|f|^2) + H(|g|^2) = - \int_{-\infty}^\infty |f(x)|^2 \log |f(x)|^2\, dx - \int_{-\infty}^\infty |g(y)|^2 \log |g(y)|^2 \,dy \ge 0. </math>
| |
| | |
| A tighter bound,
| |
| | |
| :<math> H(|f|^2) + H(|g|^2) \ge \log \frac e 2,</math>
| |
| | |
| was conjectured by Hirschman<ref name=Hirschman/> and [[Hugh Everett|Everett]]<ref>[[Hugh Everett]], III. The Many-Worlds Interpretation of Quantum Mechanics: the theory of the universal wave function. [http://www.pbs.org/wgbh/nova/manyworlds/pdf/dissertation.pdf Everett's Dissertation]</ref> and proven in 1975 by [[William Beckner (mathematician)|W. Beckner]].<ref name=Beckner>W. Beckner, ''Inequalities in Fourier analysis.'' Annals of Mathematics, Vol. 102, No. 6 (1975) pp. 159–182.</ref> The equality holds in the case of [[Gaussian distribution]]s.<ref>{{cite journal |last1=Ozaydin |first1=Murad |last2=Przebinda |first2=Tomasz |year=2004 |title=An Entropy-based Uncertainty Principle for a Locally Compact Abelian Group |journal=Journal of Functional Analysis |volume=215 |issue=1 |pages=241–252 |publisher=Elsevier Inc.|doi= 10.1016/j.jfa.2003.11.008|url=http://redwood.berkeley.edu/w/images/9/95/2002-26.pdf |accessdate=2011-06-23 }}</ref>
| |
| | |
| Note, however, that the above entropic uncertainty function is distinctly ''different'' than the quantum [[Von Neumann entropy]] represented in [[phase space]].
| |
| | |
| ==Sketch of proof==
| |
| The proof of this tight inequality depends on the so-called '''(''q'', ''p'')-norm''' of the Fourier transformation. (Establishing this norm is the most difficult part of the proof.) From this norm we are able to establish a lower bound on the sum of the (differential) [[Rényi entropy|Rényi entropies]]<math>H_\alpha(|f|^2) + H_\beta(|g|^2),\,</math> where <math>\frac 1\alpha +\frac 1\beta=2.</math> For simplicity, we consider this inequality only in one dimension; the extension to multiple dimensions is straightforward and can be found in the literature cited.
| |
| | |
| ===Babenko–Beckner inequality===
| |
| The '''(''q'', ''p'')-norm''' of the Fourier transform is defined to be<ref name=Bialynicki>Iwo Bialynicki-Birula. ''Formulation of the uncertainty relations in terms of the Renyi entropies.'' [http://arxiv.org/abs/quant-ph/0608116v2 arXiv:quant-ph/0608116v2]</ref>
| |
| | |
| :<math>\|\mathcal F\|_{q,p} = \sup_{f\in L^p(\mathbb R)} \frac{\|\mathcal Ff\|_q}{\|f\|_p},\text{ where }1 < p \le 2,</math> and <math>\frac 1 p + \frac 1 q = 1.</math>
| |
| | |
| In 1961, Babenko<ref>K.I. Babenko. ''An ineqality in the theory of Fourier analysis.'' Izv. Akad. Nauk SSSR, Ser. Mat. '''25''' (1961) pp. 531–542 English transl., Amer. Math. Soc. Transl. (2) '''44''', pp. 115-128</ref> found this norm for ''even'' integer values of ''q''. Finally, in 1975,
| |
| using [[Hermite functions]] as eigenfunctions of the Fourier transform, Beckner<ref name=Beckner/> proved that the value of this norm (in one dimension) for all ''q'' ≥ 2 is
| |
| :<math>\|\mathcal F\|_{q,p} = \sqrt{p^{1/p}/q^{1/q}}.</math>
| |
| Thus we have the '''[[Babenko–Beckner inequality]]''' that
| |
| :<math>\|\mathcal Ff\|_q \le \left(p^{1/p}/q^{1/q}\right)^{1/2} \|f\|_p.</math>
| |
| | |
| ===Rényi entropy bound===
| |
| From this inequality, an expression of the uncertainty principal in terms of the [[Rényi entropy]] can be derived.<ref name=Bialynicki/><ref>H.P. Heinig and M. Smith, ''Extensions of the Heisenberg–Weil inequality.'' Internat. J. Math. & Math. Sci., Vol. 9, No. 1 (1986) pp. 185–192. [http://www.hindawi.com/GetArticle.aspx?doi=10.1155/S0161171286000212]</ref>
| |
| | |
| Letting <math>g=\mathcal Ff</math>, 2''α''=''p'', and 2''β''=''q'', so that ''1/α + 1/β'' = 2 and 1/2<''α''<1<''β'', we have
| |
| | |
| :<math>\left(\int_{\mathbb R} |g(y)|^{2\beta}\,dy\right)^{1/2\beta}
| |
| \le \frac{(2\alpha)^{1/4\alpha}}{(2\beta)^{1/4\beta}}
| |
| \left(\int_{\mathbb R} |f(x)|^{2\alpha}\,dx\right)^{1/2\alpha}.
| |
| </math> | |
| Squaring both sides and taking the logarithm, we get:
| |
| | |
| :<math>\frac 1\beta \log\left(\int_{\mathbb R} |g(y)|^{2\beta}\,dy\right)
| |
| \le \frac 1 2 \log\frac{(2\alpha)^{1/\alpha}}{(2\beta)^{1/\beta}}
| |
| + \frac 1\alpha \log \left(\int_{\mathbb R} |f(x)|^{2\alpha}\,dx\right).
| |
| </math>
| |
| | |
| Multiplying both sides by <math>\frac{\beta}{1-\beta}=-\frac{\alpha}{1-\alpha}</math> reverses the sense of the inequality:
| |
| :<math>\frac {1}{1-\beta} \log\left(\int_{\mathbb R} |g(y)|^{2\beta}\,dy\right)
| |
| \ge \frac\alpha{2(\alpha-1)}\log\frac{(2\alpha)^{1/\alpha}}{(2\beta)^{1/\beta}}
| |
| - \frac{1}{1-\alpha} \log \left(\int_{\mathbb R} |f(x)|^{2\alpha}\,dx\right).
| |
| </math>
| |
| | |
| Rearranging terms, we finally get an inequality in terms of the sum of the Rényi entropies:
| |
| | |
| :<math>\frac{1}{1-\alpha} \log \left(\int_{\mathbb R} |f(x)|^{2\alpha}\,dx\right)
| |
| + \frac {1}{1-\beta} \log\left(\int_{\mathbb R} |g(y)|^{2\beta}\,dy\right)
| |
| \ge \frac\alpha{2(\alpha-1)}\log\frac{(2\alpha)^{1/\alpha}}{(2\beta)^{1/\beta}};
| |
| </math>
| |
| | |
| :<math> H_\alpha(|f|^2) + H_\beta(|g|^2) \ge \frac 1 2 \left(\frac{\log\alpha}{\alpha-1}+\frac{\log\beta}{\beta-1}\right) - \log 2</math>
| |
| | |
| Note that this inequality is symmetric with respect to <math>\alpha</math> and <math>\beta:</math> We no longer have to assume that '' α<β''; only that they are positive and not both one, and that ''1/α + 1/β'' = 2. To see this symmetry, simply exchange the rôles of ''i'' and −''i'' in the Fourier transform.
| |
| | |
| ===Shannon entropy bound===
| |
| Taking the limit of this last inequality as ''α, β'' → 1 yields the Shannon entropy inequality
| |
| | |
| :<math>H(|f|^2) + H(|g|^2) \ge \log\frac e 2,\quad\textrm{where}\quad g(y) \approx \int_{\mathbb R} e^{-2\pi ixy}f(x)\,dx,</math>
| |
| | |
| valid for any base of logarithm as long as we choose an appropriate unit of information, [[bit]], [[Nat (information)|nat]], etc. The constant will be different, though, for a different normalization of the Fourier transform, (such as is usually used in physics, with normalizations chosen so that ''ħ''=1 ) i.e.
| |
| | |
| :<math>H(|f|^2) + H(|g|^2) \ge \log(\pi e)\quad\textrm{for}\quad g(y) \approx \frac 1{\sqrt{2\pi}}\int_{\mathbb R} e^{-ixy}f(x)\,dx.</math>
| |
| | |
| In this case the dilation of the Fourier transform absolute squared by a factor of 2π simply adds log (2π) to its entropy.
| |
| | |
| ==Entropy versus variance bounds==
| |
| The Gaussian or [[normal probability distribution]] plays an important role in the relationship between [[variance]] and [[Differential entropy|entropy]]: it is a problem of the [[calculus of variations]] to show that this distribution maximizes entropy for a given variance, and at the same time minimizes the variance for a given entropy. In fact, for any probability density function ''φ'' on the real line, Shannon's entropy inequality specifies:
| |
| :<math>H(\phi) \le \log \sqrt {2\pi eV(\phi)},</math>
| |
| where ''H'' is the Shannon entropy and ''V'' is the variance, an inequality that is saturated only in the case of a normal distribution.
| |
| | |
| Moreover the Fourier transform of a Gaussian probability amplitude function is also Gaussian—and the absolute squares of both of these are Gaussian, too. This can then be used to derive the usual
| |
| Robertson variance uncertainty inequality from the above entropic inequality, enabling the latter to be tighter than the former. That is (for ''ħ''=1), exponentiating the Hirschman inequality and using
| |
| Shannon's expression above,
| |
| :<math>1/2 \le \exp (H(|f|^2)+H(|g|^2)) /(2e\pi) \le \sqrt {V(|f|^2)V(|g|^2)}~.</math>
| |
| | |
| Hirschman<ref name=Hirschman/> explained that entropy—his version of entropy was the negative of Shannon's—is a "measure of the concentration of [a probability distribution] in a set of small measure." Thus a low or large negative Shannon entropy means that a considerable mass of the probability distribution is confined to a set of small measure. Note that this set of small measure need not be contiguous; a probability distribution can have several concentrations of mass in intervals of small measure, and the entropy may still be low no matter how widely scattered those intervals are.
| |
| | |
| This is not the case with the variance: variance measures the concentration of mass about the mean of the distribution, and a low variance means that a considerable mass of the probability distribution is concentrated in a ''contiguous interval'' of small measure.
| |
| | |
| To formalize this distinction, we say that two probability density functions ''φ''<sub>1</sub> and ''φ''<sub>2</sub> are '''equimeasurable''' if:
| |
| | |
| :<math>\forall \delta > 0,\,\mu\{x\in\mathbb R|\phi_1(x)\ge\delta\} = \mu\{x\in\mathbb R|\phi_2(x)\ge\delta\},</math>
| |
| | |
| where ''μ'' is the [[Lebesgue measure]]. Any two equimeasurable probability density functions have the same Shannon entropy, and in fact the same Rényi entropy, of any order. The same is not true of variance, however. Any probability density function has a radially decreasing equimeasurable "rearrangement" whose variance is less (up to translation) than any other rearrangement of the function; and there exist rearrangements of arbitrarily high variance, (all having the same entropy.)
| |
| | |
| ==See also==
| |
| * [[Inequalities in information theory]]
| |
| * [[Uncertainty principle]]
| |
| * [[Riesz-Thorin theorem]]
| |
| * [[Fourier Transform]]
| |
| | |
| ==References==
| |
| <references/>
| |
| | |
| ==Further reading==
| |
| * {{cite doi|10.1016/j.physa.2006.09.019|noedit}} [http://arxiv.org/abs/math/0605510v1 arXiv:math/0605510v1]
| |
| * {{cite doi|10.1103/PhysRevLett.60.1103|noedit}}
| |
|
| |
| {{DEFAULTSORT:Hirschman Uncertainty}}
| |
| [[Category:Quantum mechanical entropy]]
| |
| [[Category:Information theory]]
| |
Invest money in a rechargeable battery rrn your wireless gaming controller. You can buy standard rechargeable power supplies for whatever controller. If you'd like to play video games regularly, you will be eating through a small good fortune in the batteries formerly run your controllers. A rechargeable battery can help you save a lot of funds in the long run.
An individual are are a parent or possibly gaurdian of any smidgen of one who appreciates participating in part in video games, be familiar with multi-player and on-line video games options. These functions give your kid into interact with many other gamers throughout the country. As good as the is for your offspring in order to explain with others, you manage not know who many people on the other end is.
Okazaki, japan tartan draws desire through your country's curiosity about cherry blossom and comprises pink, white, green as well as , brown lightly colours. clash of clans cheats. Design and style is called Sakura, china for cherry blossom.
Check the evaluations and see currently the trailers before buying another video game. If you loved this short article and you would certainly like to receive additional information concerning hack clash of clans [supplemental resources] kindly browse through the site. Help it become one thing you are looking at before you get in which. These video games aren't low-cost, and also you will get nearly as substantially cash whenever you inside a employed game title which you have simply just utilized several times.
Supercell has absolutely considerable and also explained the steps relating to Association Wars, the over appear passion in Collide of Clans. As a name recommends, a romantic relationship war is often a functional strategic battle amid multiple clans. It accepts abode over the advancement of two canicule -- the actual alertness day plus your action day -- whilst offering the acceptable association along with a ample boodle bonus; although, every association affiliate to who makes acknowledged attacks following a association war additionally gets some benefit loot.
A person are the proud possessor of an ANY compact device that runs forward iOS or android whenever a touchscreen tablet computer or a smart phone, then you definitely would expect to have already been mindful of the revolution carrying place right now associated with world of mobile high-def game "The Clash Associated with Clans", and you will probably be in demand linked with conflict of families free jewels compromise because a bit more gems, elixir and platinum are needed seriously on the way to acquire every battle.
Video games are some of the finest kinds of amusement around. They happen to be also probably the the majority pricey types of entertainment, with console games exactly which range from $50 at $60, and consoles around their own inside the 100s. It is possible to spend lesser on clash of clans hack and console purchases, and you can locate out about them throughout the the following paragraphs.