Chebyshev distance: Difference between revisions
en>Double sharp mNo edit summary |
Add the vinculum in square root |
||
Line 1: | Line 1: | ||
'''Possibility theory''' is a mathematical theory for dealing with certain types of [[uncertainty]] and is an alternative to [[probability theory]]. Professor [[Lotfi Zadeh]] first introduced possibility theory in 1978 as an extension of his theory of [[fuzzy sets]] and [[fuzzy logic]]. [[Didier Dubois (mathematician)|Didier Dubois]] and Henri Prade further contributed to its development. Earlier in the 50s, economist [[G. L. S. Shackle]] proposed the [[min/max algebra]] to describe degrees of potential surprise. | |||
==Formalization of possibility== | |||
For simplicity, assume that the [[universe of discourse]] Ω is a finite set, and assume that all subsets are [[measurable]]. A distribution of possibility is a function <math>\operatorname{pos}</math> from <math>2^\Omega</math> to [0, 1] such that: | |||
:Axiom 1: <math>\operatorname{pos}(\varnothing) = 0</math> | |||
:Axiom 2: <math>\operatorname{pos}(\Omega) = 1</math> | |||
:Axiom 3: <math>\operatorname{pos}(U \cup V) = \max \left( \operatorname{pos}(U), \operatorname{pos}(V) \right)</math> for any disjoint subsets <math>U</math> and <math>V</math>. | |||
It follows that, like probability, the possibility measure on finite set is determined by its behavior on singletons: | |||
:<math>\operatorname{pos}(U) = \max_{\omega \in U} \operatorname{pos}(\{\omega\})</math> | |||
provided ''U'' is finite or countably infinite. | |||
Axiom 1 can be interpreted as the assumption that Ω is an exhaustive description of future states of the world, because it means that no belief weight is given to elements outside Ω. | |||
Axiom 2 could be interpreted as the assumption that the evidence from which <math>\operatorname{pos}</math> was constructed is free of any contradiction. Technically, it implies that there is at least one element in Ω with possibility 1. | |||
Axiom 3 corresponds to the additivity axiom in probabilities. However there is an important practical difference. Possibility theory is computationally more convenient because Axioms 1–3 imply that: | |||
:<math>\operatorname{pos}(U \cup V) = \max \left( \operatorname{pos}(U), \operatorname{pos}(V) \right)</math> for ''any'' subsets <math>U</math> and <math>V</math>. | |||
Because one can know the possibility of the union from the possibility of each component, it can be said that possibility is [[Principle of compositionality|''compositional'']] with respect to the union operator. Note however that it is not compositional with respect to the intersection operator. Generally: | |||
:<math>\operatorname{pos}(U \cap V) \leq \min \left( \operatorname{pos}(U), \operatorname{pos}(V) \right)</math> | |||
When Ω is not finite, Axiom 3 can be replaced by: | |||
:For all index sets <math>I</math>, if the subsets <math>U_{i,\, i \in I}</math> are pairwise disjoint, <math>\operatorname{pos}\left(\cup_{i \in I} U_i\right) = \sup_{i \in I}\operatorname{pos}(U_i).</math> | |||
==Necessity== | |||
Whereas [[probability theory]] uses a single number, the probability, to describe how likely an event is to occur, possibility theory uses two concepts, the ''possibility'' and the ''necessity ''of the event. For any set <math>U</math>, the necessity measure is defined by | |||
:<math>\operatorname{nec}(U) = 1 - \operatorname{pos}(\overline U)</math> | |||
In the above formula, <math>\overline U</math> denotes the complement of <math>U</math>, that is the elements of <math>\Omega</math> that do not belong to <math>U</math>. It is straightforward to show that: | |||
:<math>\operatorname{nec}(U) \leq \operatorname{pos}(U)</math> for any <math>U</math> | |||
and that: | |||
:<math>\operatorname{nec}(U \cap V) = \min ( \operatorname{nec}(U), \operatorname{nec}(V))</math> | |||
Note that contrary to probability theory, possibility is not self-dual. That is, for any event <math>U</math>, we only have the inequality: | |||
:<math>\operatorname{pos}(U) + \operatorname{pos}(\overline U) \geq 1</math> | |||
However, the following duality rule holds: | |||
:For any event <math>U</math>, either <math>\operatorname{pos}(U) = 1</math>, or <math>\operatorname{nec}(U) = 0</math> | |||
Accordingly, beliefs about an event can be represented by a number and a bit. | |||
==Interpretation== | |||
There are four cases that can be interpreted as follows: | |||
<math>\operatorname{nec}(U) = 1</math> means that <math>U</math> is necessary. <math>U</math> is certainly true. It implies that <math>\operatorname{pos}(U) = 1</math>. | |||
<math>\operatorname{pos}(U) = 0</math> means that <math>U</math> is impossible. <math>U</math> is certainly false. It implies that <math>\operatorname{nec}(U) = 0</math>. | |||
<math>\operatorname{pos}(U) = 1</math> means that <math>U</math> is possible. I would not be surprised at all if <math>U</math> occurs. It leaves <math>\operatorname{nec}(U)</math> unconstrained. | |||
<math>\operatorname{nec}(U) = 0</math> means that <math>U</math> is unnecessary. I would not be surprised at all if <math>U</math> does not occur. It leaves <math>\operatorname{pos}(U)</math> unconstrained. | |||
The intersection of the last two cases is <math>\operatorname{nec}(U) = 0</math> and <math>\operatorname{pos}(U) = 1</math> meaning that I believe nothing at all about <math>U</math>. Because it allows for indeterminacy like this, possibility theory relates to the graduation of a many-valued logic, such as [[intuitionistic logic]], rather than the classical two-valued logic. | |||
Note that unlike possibility, fuzzy logic is compositional with respect to both the union and the intersection operator. The relationship with fuzzy theory can be explained with the following classical example. | |||
* Fuzzy logic: When a bottle is half full, it can be said that the level of truth of the proposition "The bottle is full" is 0.5. The word "full" is seen as a fuzzy predicate describing the amount of liquid in the bottle. | |||
* Possibility theory: There is one bottle, either completely full or totally empty. The proposition "the possibility level that the bottle is full is 0.5" describes a degree of belief. One way to interpret 0.5 in that proposition is to define its meaning as: I am ready to bet that it's empty as long as the odds are even (1:1) or better, and I would not bet at any rate that it's full. | |||
==Possibility theory as an imprecise probability theory== | |||
There is an extensive formal correspondence between probability and possibility theories, where the addition operator corresponds to the maximum operator. | |||
A possibility measure can be seen as a consonant [[plausibility measure]] in [[Dempster–Shafer theory]] of evidence. The operators of possibility theory can be seen as a hyper-cautious version of the operators of the [[transferable belief model]], a modern development of the theory of evidence. | |||
Possibility can be seen as an [[upper and lower probabilities|upper probability]]: any possibility distribution defines a unique set of admissible probability distributions by | |||
::<math>\left\{\, p: \forall S\ p(S)\leq \operatorname{pos}(S)\,\right\}.</math> | |||
This allows one to study possibility theory using the tools of [[imprecise probability|imprecise probabilities]]. | |||
==Necessity logic== | |||
We call ''generalized possibility'' every function satisfying Axiom 1 and Axiom 3. We call ''generalized necessity'' the dual of a generalized possibility. The generalized necessities are related with a very simple and interesting fuzzy logic we call ''necessity logic''. In the deduction apparatus of necessity logic the logical axioms are the usual classical [[tautology (logic)|tautologies]]. Also, there is only a fuzzy inference rule extending the usual Modus Ponens. Such a rule says that if α and α → β are proved at degree λ and μ, respectively, then we can assert β at degree min{λ,μ}. It is easy to see that the theories of such a logic are the generalized necessities and that the completely consistent theories coincide with the necessities (see for example Gerla 2001). | |||
==See also== | |||
*[[Logical possibility]] | |||
*[[Probabilistic logic]] | |||
*[[Fuzzy measure theory]] | |||
*[[Upper and lower probabilities]] | |||
*[[Transferable belief model]] | |||
{{inline|date=February 2012}} | |||
==References== | |||
*Dubois, Didier and Prade, Henri, "Possibility Theory, Probability Theory and Multiple-valued Logics: A Clarification", ''Annals of Mathematics and Artificial Intelligence'' 32:35–66, 2001. | |||
*Gerla Giangiacomo, Fuzzy logic: Mathematical Tools for Approximate Reasoning, Kluwer Academic Publishers, Dordrecht 2001. | |||
*[[Lotfi Zadeh|Zadeh, Lotfi]], "Fuzzy Sets as the Basis for a Theory of Possibility", ''Fuzzy Sets and Systems'' 1:3–28, 1978. (Reprinted in ''Fuzzy Sets and Systems'' 100 (Supplement): 9–34, 1999.) | |||
[[Category:Probability theory]] | |||
[[Category:Fuzzy logic]] | |||
[[Category:Possibility]] |
Revision as of 15:49, 23 December 2013
Possibility theory is a mathematical theory for dealing with certain types of uncertainty and is an alternative to probability theory. Professor Lotfi Zadeh first introduced possibility theory in 1978 as an extension of his theory of fuzzy sets and fuzzy logic. Didier Dubois and Henri Prade further contributed to its development. Earlier in the 50s, economist G. L. S. Shackle proposed the min/max algebra to describe degrees of potential surprise.
Formalization of possibility
For simplicity, assume that the universe of discourse Ω is a finite set, and assume that all subsets are measurable. A distribution of possibility is a function from to [0, 1] such that:
It follows that, like probability, the possibility measure on finite set is determined by its behavior on singletons:
provided U is finite or countably infinite.
Axiom 1 can be interpreted as the assumption that Ω is an exhaustive description of future states of the world, because it means that no belief weight is given to elements outside Ω.
Axiom 2 could be interpreted as the assumption that the evidence from which was constructed is free of any contradiction. Technically, it implies that there is at least one element in Ω with possibility 1.
Axiom 3 corresponds to the additivity axiom in probabilities. However there is an important practical difference. Possibility theory is computationally more convenient because Axioms 1–3 imply that:
Because one can know the possibility of the union from the possibility of each component, it can be said that possibility is compositional with respect to the union operator. Note however that it is not compositional with respect to the intersection operator. Generally:
When Ω is not finite, Axiom 3 can be replaced by:
Necessity
Whereas probability theory uses a single number, the probability, to describe how likely an event is to occur, possibility theory uses two concepts, the possibility and the necessity of the event. For any set , the necessity measure is defined by
In the above formula, denotes the complement of , that is the elements of that do not belong to . It is straightforward to show that:
and that:
Note that contrary to probability theory, possibility is not self-dual. That is, for any event , we only have the inequality:
However, the following duality rule holds:
Accordingly, beliefs about an event can be represented by a number and a bit.
Interpretation
There are four cases that can be interpreted as follows:
means that is necessary. is certainly true. It implies that .
means that is impossible. is certainly false. It implies that .
means that is possible. I would not be surprised at all if occurs. It leaves unconstrained.
means that is unnecessary. I would not be surprised at all if does not occur. It leaves unconstrained.
The intersection of the last two cases is and meaning that I believe nothing at all about . Because it allows for indeterminacy like this, possibility theory relates to the graduation of a many-valued logic, such as intuitionistic logic, rather than the classical two-valued logic.
Note that unlike possibility, fuzzy logic is compositional with respect to both the union and the intersection operator. The relationship with fuzzy theory can be explained with the following classical example.
- Fuzzy logic: When a bottle is half full, it can be said that the level of truth of the proposition "The bottle is full" is 0.5. The word "full" is seen as a fuzzy predicate describing the amount of liquid in the bottle.
- Possibility theory: There is one bottle, either completely full or totally empty. The proposition "the possibility level that the bottle is full is 0.5" describes a degree of belief. One way to interpret 0.5 in that proposition is to define its meaning as: I am ready to bet that it's empty as long as the odds are even (1:1) or better, and I would not bet at any rate that it's full.
Possibility theory as an imprecise probability theory
There is an extensive formal correspondence between probability and possibility theories, where the addition operator corresponds to the maximum operator.
A possibility measure can be seen as a consonant plausibility measure in Dempster–Shafer theory of evidence. The operators of possibility theory can be seen as a hyper-cautious version of the operators of the transferable belief model, a modern development of the theory of evidence.
Possibility can be seen as an upper probability: any possibility distribution defines a unique set of admissible probability distributions by
This allows one to study possibility theory using the tools of imprecise probabilities.
Necessity logic
We call generalized possibility every function satisfying Axiom 1 and Axiom 3. We call generalized necessity the dual of a generalized possibility. The generalized necessities are related with a very simple and interesting fuzzy logic we call necessity logic. In the deduction apparatus of necessity logic the logical axioms are the usual classical tautologies. Also, there is only a fuzzy inference rule extending the usual Modus Ponens. Such a rule says that if α and α → β are proved at degree λ and μ, respectively, then we can assert β at degree min{λ,μ}. It is easy to see that the theories of such a logic are the generalized necessities and that the completely consistent theories coincide with the necessities (see for example Gerla 2001).
See also
- Logical possibility
- Probabilistic logic
- Fuzzy measure theory
- Upper and lower probabilities
- Transferable belief model
References
- Dubois, Didier and Prade, Henri, "Possibility Theory, Probability Theory and Multiple-valued Logics: A Clarification", Annals of Mathematics and Artificial Intelligence 32:35–66, 2001.
- Gerla Giangiacomo, Fuzzy logic: Mathematical Tools for Approximate Reasoning, Kluwer Academic Publishers, Dordrecht 2001.
- Zadeh, Lotfi, "Fuzzy Sets as the Basis for a Theory of Possibility", Fuzzy Sets and Systems 1:3–28, 1978. (Reprinted in Fuzzy Sets and Systems 100 (Supplement): 9–34, 1999.)