Hereditary property: Difference between revisions
en>Helpful Pixie Bot m ISBNs (Build KC) |
en>Anrnusna m →Monotone property: journal name, replaced: The Annals of Applied Probability → Annals of Applied Probability using AWB |
||
Line 1: | Line 1: | ||
In the [[mathematics|mathematical]] [[Areas of mathematics|discipline]] of [[linear algebra]], '''eigendecomposition''' or sometimes '''[[spectral decomposition]]''' is the [[factorization]] of a [[matrix (math)|matrix]] into a [[canonical form]], whereby the matrix is represented in terms of its [[eigenvalues]] and [[eigenvectors]]. Only [[diagonalizable matrix|diagonalizable matrices]] can be factorized in this way. | |||
==Fundamental theory of matrix eigenvectors and eigenvalues== | |||
{{main|Eigenvalue, eigenvector and eigenspace}} | |||
A (non-zero) vector '''v''' of dimension ''N'' is an '''eigenvector''' of a square (''N''×''N'') matrix '''A''' [[if and only if]] it satisfies the linear equation | |||
:<math> \mathbf{A} \mathbf{v} = \lambda \mathbf{v} </math> | |||
where ''λ'' is a scalar, termed the '''eigenvalue''' corresponding to '''v'''. That is, the eigenvectors are the vectors which the linear transformation '''A''' merely elongates or shrinks, and the amount that they elongate/shrink by is the eigenvalue. The above equation is called the '''eigenvalue equation''' or the '''eigenvalue problem'''. | |||
== | This yields an equation for the eigenvalues | ||
:<math> p\left(\lambda\right) := \det\left(\mathbf{A} - \lambda \mathbf{I}\right)= 0. \!\ </math> | |||
We call ''p''('''λ''') the '''[[characteristic polynomial]]''', and the equation, called the '''characteristic equation''', is an ''N''th order polynomial equation in the unknown ''λ''. This equation will have ''N''<sub>λ</sub> distinct solutions, where 1 ≤ ''N''<sub>λ</sub> ≤ ''N'' . The set of solutions, ''i.e.'' the eigenvalues, is sometimes called the '''spectrum''' of '''A'''. | |||
We can [[Factorization|factor]] ''p'' as | |||
:<math>p\left(\lambda\right)= (\lambda-\lambda_1)^{n_1}(\lambda-\lambda_2)^{n_2}\cdots(\lambda-\lambda_k)^{n_k} = 0. \!\ </math> | |||
The integer ''n''<sub>''i''</sub> is termed the '''algebraic multiplicity''' of eigenvalue λ<sub>''i''</sub>. The algebraic multiplicities sum to ''N'': | |||
== | :<math>\sum\limits_{i=1}^{N_{\lambda}}{n_i} =N.</math> | ||
For each eigenvalue, λ<sub>''i''</sub>, we have a specific eigenvalue equation | |||
:<math> \left(\mathbf{A} - \lambda_i \mathbf{I}\right)\mathbf{v} = 0. \!\ </math> | |||
There will be 1 ≤ ''m''<sub>''i''</sub> ≤ ''n''<sub>''i''</sub> [[linearly independent]] solutions to each eigenvalue equation. The ''m''<sub>''i''</sub> solutions are the eigenvectors associated with the eigenvalue λ<sub>''i''</sub>. The integer ''m''<sub>''i''</sub> is termed the '''geometric multiplicity''' of λ<sub>''i''</sub>. It is important to keep in mind that the algebraic multiplicity ''n''<sub>''i''</sub> and geometric multiplicity ''m''<sub>''i''</sub> may or may not be equal, but we always have ''m''<sub>''i''</sub> ≤ ''n''<sub>''i''</sub>. The simplest case is of course when ''m''<sub>''i''</sub> = ''n''<sub>''i''</sub> = 1. The total number of linearly independent eigenvectors, ''N''<sub>'''v'''</sub>, can be calculated by summing the geometric multiplicities | |||
:<math>\sum\limits_{i=1}^{N_{\lambda}}{m_i} =N_{\mathbf{v}}.</math> | |||
The eigenvectors can be indexed by eigenvalues, ''i.e.'' using a double index, with '''v'''<sub>''i'',''j''</sub> being the ''j''<sup>th</sup> eigenvector for the ''i''<sup>th</sup> eigenvalue. The eigenvectors can also be indexed using the simpler notation of a single index '''v'''<sub>''k''</sub>, with ''k'' = 1, 2, ..., ''N''<sub>'''v'''</sub>. | |||
== | ==Eigendecomposition of a matrix== | ||
Let '''A''' be a square (''N''×''N'') matrix with ''N'' [[linearly independent]] eigenvectors, <math>q_i \,\, (i = 1, \dots, N).</math> Then '''A''' can be [[matrix decomposition|factorized]] as | |||
:<math>\mathbf{A}=\mathbf{Q}\mathbf{\Lambda}\mathbf{Q}^{-1} </math> | |||
where '''Q''' is the square (''N''×''N'') matrix whose ''i''<sup>th</sup> column is the eigenvector <math>q_i</math> of '''A''' and '''Λ''' is the [[diagonal matrix]] whose diagonal elements are the corresponding eigenvalues, ''i.e.'', <math>\Lambda_{ii}=\lambda_i</math>. Note that only [[diagonalizable matrix|diagonalizable matrices]] can be factorized in this way. For example, the [[defective matrix]] <math>\begin{pmatrix} | |||
1 & 1 \\ | |||
0 & 1 \\ | |||
\end{pmatrix}</math> cannot be diagonalized. | |||
== | The eigenvectors <math>q_i \,\, (i = 1, \dots, N)</math> are usually normalized, but they need not be. A non-normalized set of eigenvectors, <math>v_i \,\, (i = 1, \dots, N),</math> can also be used as the columns of '''Q'''. That can be understood by noting that the magnitude of the eigenvectors in '''Q''' gets canceled in the decomposition by the presence of '''Q'''<sup>−1</sup>. | ||
===Example=== | |||
== | Taking a 2 × 2 real matrix <math>\mathbf{A} = \begin{bmatrix} 1 & 0 \\ 1 & 3 \\ \end{bmatrix}</math> as an example to be decomposed into a diagonal matrix through multiplication of a non-singular matrix <math>\mathbf{B} = \begin{bmatrix} | ||
a & b \\ | |||
c & d \\ | |||
\end{bmatrix}, [a, b, c, d] \in \mathbb{R} </math>. | |||
Then | |||
: <math>\begin{bmatrix} | |||
a & b \\ c & d \\ \end{bmatrix}^{-1} \begin{bmatrix} 1 & 0 \\ 1 & 3 \\ \end{bmatrix} \begin{bmatrix} a & b \\ c & d \\ \end{bmatrix} = \begin{bmatrix} x & 0 \\ 0 & y \\ \end{bmatrix}</math>, for some real diagonal matrix <math>\begin{bmatrix} x & 0 \\ 0 & y \\ \end{bmatrix}</math>. | |||
Shifting <math>\mathbf{B}</math> to the right hand side: | |||
: <math>\begin{bmatrix} 1 & 0 \\ 1 & 3 \\ \end{bmatrix} \begin{bmatrix} a & b \\ c & d \\ \end{bmatrix} = \begin{bmatrix} a & b \\ c & d \\ \end{bmatrix} \begin{bmatrix} x & 0 \\ 0 & y \\ \end{bmatrix}</math> | |||
The above equation can be decomposed into 2 simultaneous equations: | |||
: <math> \begin{cases} \begin{bmatrix} 1 & 0\\ 1 & 3 \end{bmatrix} \begin{bmatrix} a \\ c \end{bmatrix} = \begin{bmatrix} ax \\ cx \end{bmatrix} \\ \begin{bmatrix} 1 & 0\\ 1 & 3 \end{bmatrix} \begin{bmatrix} b \\ d \end{bmatrix} = \begin{bmatrix} by \\ dy \end{bmatrix} \end{cases} </math> | |||
Factoring out the [[eigenvalues]] <math>x</math> and <math>y</math>: | |||
: <math> \begin{cases} \begin{bmatrix} 1 & 0\\ 1 & 3 \end{bmatrix} \begin{bmatrix} a \\ c \end{bmatrix} = x\begin{bmatrix} a \\ c \end{bmatrix} \\ \begin{bmatrix} 1 & 0\\ 1 & 3 \end{bmatrix} \begin{bmatrix} b \\ d \end{bmatrix} = y\begin{bmatrix} b \\ d \end{bmatrix} \end{cases} </math> | |||
== | Letting <math>\overrightarrow{a} = \begin{bmatrix} a \\ c \end{bmatrix}, \overrightarrow{b} = \begin{bmatrix} b \\ d \end{bmatrix}</math>, this gives us two vector equations: | ||
: <math> \begin{cases} A \overrightarrow{a} = x \overrightarrow{a} \\ A \overrightarrow{b} = y \overrightarrow{b} \end{cases}</math> | |||
And can be represented by a single vector equation involving 2 solutions as eigenvalues: | |||
: <math>\mathbf{A} \mathbf{u} = \lambda \mathbf{u}</math> | |||
where <math> \lambda</math> represents the two eigenvalues <math>x</math> and <math>y</math>, <math> \mathbf{u}</math> represents the vectors <math>\overrightarrow{a}</math> and <math>\overrightarrow{b}</math>. | |||
Shifting <math>\lambda \mathbf{u}</math> to the left hand side and factorizing <math> \mathbf{u}</math> out | |||
: <math> (\mathbf{A}-\lambda \mathbf{I}) \mathbf{u} = 0 </math> | |||
Since <math>\mathbf{B}</math> is non-singular, it is essential that <math>\mathbf{u}</math> is non-zero. Therefore, | |||
: <math> (\mathbf{A}-\lambda \mathbf{I}) = \mathbf{0} </math> | |||
Considering the [[determinant]] of <math>(\mathbf{A}-\lambda \mathbf{I})</math>, | |||
: <math> \begin{bmatrix} 1- \lambda & 0\\ 1 & 3- \lambda \end{bmatrix} =0 </math> | |||
Thus | |||
: <math>(1- \lambda)(3- \lambda)=0</math> | |||
Giving us the solutions of the eigenvalues for the matrix <math>\mathbf{A}</math> as <math> \lambda=1 </math> or <math> \lambda=3 </math>, and the resulting diagonal matrix from the eigendecomposition of <math>\mathbf{A}</math> is thus <math>\begin{bmatrix} 1 & 0 \\ 0 & 3 \end{bmatrix}</math>. | |||
Putting the solutions back into the above simultaneous equations | |||
<math> \begin{cases} \begin{bmatrix} 1 & 0 \\ 1 & 3 \end{bmatrix} \begin{bmatrix} a \\ c \end{bmatrix} = 1\begin{bmatrix} a \\ c \end{bmatrix} \\ \begin{bmatrix} 1 & 0\\ 1 & 3 \end{bmatrix} \begin{bmatrix} b \\ d \end{bmatrix} = 3\begin{bmatrix} b \\ d \end{bmatrix} \end{cases} </math> | |||
Solving the equations, we have <math>a= -2c, a\in \mathbb{R}</math> and <math>b=0, d\in \mathbb{R}</math> | |||
Thus the matrix <math>\mathbf{B}</math> required for the eigendecomposition of <math>\mathbf{A}</math> is <math>\begin{bmatrix} -2c & 0 \\ c & d \end{bmatrix}, [c, d]\in \mathbb{R} </math>. i.e. : | |||
: <math>\begin{bmatrix} | |||
-2c & 0 \\ c & d \\ \end{bmatrix}^{-1} \begin{bmatrix} 1 & 0 \\ 1 & 3 \\ \end{bmatrix} \begin{bmatrix} -2c & 0 \\ c & d \\ \end{bmatrix} = \begin{bmatrix} 1 & 0 \\ 0 & 3 \\ \end{bmatrix}, [c, d]\in \mathbb{R}</math> | |||
===Matrix inverse via eigendecomposition=== | |||
{{main|Inverse matrix}} | |||
If matrix '''A''' can be eigendecomposed and if none of its eigenvalues are zero, then '''A''' is [[nonsingular]] and its inverse is given by | |||
:<math>\mathbf{A}^{-1}=\mathbf{Q}\mathbf{\Lambda}^{-1}\mathbf{Q}^{-1} </math> | |||
Furthermore, because '''Λ''' is a [[diagonal matrix]], its inverse is easy to calculate: | |||
:<math>\left[\Lambda^{-1}\right]_{ii}=\frac{1}{\lambda_i}</math> | |||
====Practical implications<ref name=inverse>{{cite journal|last1=Hayde|first1= A. F. |last2=Twede|first2=D. R. |title=Observations on relationship between eigenvalues, instrument noise and detection performance|bibcode=2002SPIE.4816..355H|volume=4816|year=2002|pages=355|journal=Imaging Spectrometry VIII. Edited by Shen|doi=10.1117/12.453777|series=Imaging Spectrometry VIII|editor1-last=Shen|editor1-first=Sylvia S}}</ref>==== | |||
When eigendecomposition is used on a matrix of measured, real [[data]], the [[inverse function|inverse]] may be less valid when all eigenvalues are used unmodified in the form above. This is because as eigenvalues become relatively small, their contribution to the inversion is large. Those near zero or at the "noise" of the measurement system will have undue influence and could hamper solutions (detection) using the inverse. | |||
Two mitigations have been proposed: 1) truncating small/zero eigenvalues, 2) extending the lowest reliable eigenvalue to those below it. | |||
The first mitigation method is similar to a sparse sample of the original matrix, removing components that are not considered valuable. However, if the solution or detection process is near the noise level, truncating may remove components that influence the desired solution. | |||
The second mitigation extends the eigenvalue so that lower values have much less influence over inversion, but do still contribute, such that solutions near the noise will still be found. | |||
The reliable eigenvalue can be found by assuming that eigenvalues of extremely similar and low value are a good representation of measurement noise (which is assumed low for most systems). | |||
If the eigenvalues are rank-sorted by value, then the reliable eigenvalue can be found by minimization of the [[Laplace operator|Laplacian]] of the sorted eigenvalues:<ref name=inverse2>{{cite journal| last1=Twede|first1= D. R. |last2=Hayden|first2= A. F. |title=Refinement and generalization of the extension method of covariance matrix inversion by regularization|bibcode=2004SPIE.5159..299T| volume=5159| year=2004| pages=299| journal=Imaging Spectrometry IX. Edited by Shen| doi=10.1117/12.506993| series=Imaging Spectrometry IX| editor1-last=Shen| editor1-first=Sylvia S| editor2-last=Lewis| editor2-first=Paul E}}</ref> | |||
:<math>\min|\nabla^2 \lambda_s | </math> | |||
where the eigenvalues are subscripted with an 's' to denote being sorted. The position of the minimization is the lowest reliable eigenvalue. In measurement systems, the square root of this reliable eigenvalue is the average noise over the components of the system. | |||
==Functional calculus== | |||
The eigendecomposition allows for much easier computation of power series of matrices. If ''f''(''x'') is given by | |||
:<math>f(x)=a_0+a_1 x+a_2 x^2+\cdots</math> | |||
then we know that | |||
:<math>f\left(\mathbf{A}\right)=\mathbf{Q}f\left(\mathbf{\Lambda}\right)\mathbf{Q}^{-1}</math> | |||
Because '''Λ''' is a [[diagonal matrix]], functions of '''Λ''' are very easy to calculate: | |||
:<math>\left[f\left(\mathbf{\Lambda}\right)\right]_{ii}=f\left(\lambda_i\right)</math> | |||
The off-diagonal elements of ''f''('''Λ''') are zero; that is, ''f''('''Λ''') is also a diagonal matrix. Therefore, calculating ''f''('''A''') reduces to just calculating the function on each of the eigenvalues . | |||
A similar technique works more generally with the [[holomorphic functional calculus]], using | |||
:<math>\mathbf{A}^{-1}=\mathbf{Q}\mathbf{\Lambda}^{-1}\mathbf{Q}^{-1}</math> | |||
from [[#Matrix inverse via eigendecomposition|above]]. Once again, we find that | |||
:<math>\left[f\left(\mathbf{\Lambda}\right)\right]_{ii}=f\left(\lambda_i\right)</math> | |||
===Examples=== | |||
:<math>\mathbf{A}^{2}=(\mathbf{Q}\mathbf{\Lambda}\mathbf{Q}^{-1})(\mathbf{Q}\mathbf{\Lambda}\mathbf{Q}^{-1}) = \mathbf{Q}\mathbf{\Lambda}(\mathbf{Q}^{-1}\mathbf{Q})\mathbf{\Lambda}\mathbf{Q}^{-1}=\mathbf{Q}\mathbf{\Lambda}^{2}\mathbf{Q}^{-1}</math> | |||
:<math>\mathbf{A}^{n}=\mathbf{Q}\mathbf{\Lambda}^{n}\mathbf{Q}^{-1}</math> | |||
==Decomposition for special matrices== | |||
{{Expand section|date=June 2008}} | |||
===Normal matrices=== | |||
A complex [[normal matrix]] (<math>A^* A = A A^*</math>) has an orthogonal eigenvector basis, so a normal matrix can be decomposed as | |||
:<math>\mathbf{A}=\mathbf{U}\mathbf{\Lambda}\mathbf{U}^{*} </math> | |||
where '''U''' is a [[unitary matrix]]. Further, if '''A''' is [[Hermitian matrix|Hermitian]] (<math>A=A^*</math>), which implies that it is also complex normal, the diagonal matrix '''Λ''' has only real values, and if '''A''' is unitary, '''Λ''' takes all its values on the complex unit circle. | |||
===Real symmetric matrices=== | |||
As a special case, for every ''N''×''N'' real [[symmetric matrix]], the eigenvectors can be chosen such that they are real, orthogonal to each other and have norm one. Thus a real symmetric matrix '''A''' can be decomposed as | |||
:<math>\mathbf{A}=\mathbf{Q}\mathbf{\Lambda}\mathbf{Q}^{T} </math> | |||
where '''Q''' is an [[orthogonal matrix]], and '''Λ''' is a diagonal matrix whose entries are the eigenvalues of A. | |||
==Useful facts== | |||
{{Expand section|date=June 2008}} | |||
===Useful facts regarding eigenvalues=== | |||
*The product of the eigenvalues is equal to the [[determinant]] of '''A''' | |||
:<math>\det\left(\mathbf{A}\right) = \prod\limits_{i=1}^{N_{\lambda}}{\lambda_i^{n_i}} \!\ </math> | |||
Note that each eigenvalue is raised to the power ''n<sub>i</sub>'', the [[Eigenvalues_and_eigenvectors#Algebraic_and_geometric_multiplicities|algebraic multiplicity]]. | |||
*The sum of the eigenvalues is equal to the [[Trace (linear algebra)|trace]] of '''A''' | |||
:<math>\operatorname{tr}\left(\mathbf{A}\right) = \sum\limits_{i=1}^{N_{\lambda}}{{n_i}\lambda_i} \!\ </math> | |||
Note that each eigenvalue is multiplied by ''n<sub>i</sub>'', the [[Eigenvalues_and_eigenvectors#Algebraic_and_geometric_multiplicities|algebraic multiplicity]]. | |||
*If the eigenvalues of '''A''' are λ<sub>''i''</sub>, and '''A''' is invertible, then the eigenvalues of '''A'''<sup>−1</sup> are simply λ<sub>''i''</sub><sup>−1</sup>. | |||
*If the eigenvalues of '''A''' are λ<sub>''i''</sub>, then the eigenvalues of ''f''('''A''') are simply ''f''(λ<sub>''i''</sub>), for any [[holomorphic function]] ''f''. | |||
===Useful facts regarding eigenvectors=== | |||
*If '''A''' is [[Hermitian matrix|Hermitian]] and full-rank, the basis of eigenvectors may be chosen to be mutually [[orthogonal]]. The eigenvalues are real. | |||
*The eigenvectors of '''A'''<sup>−1</sup> are the same as the eigenvectors of '''A'''. | |||
===Useful facts regarding eigendecomposition=== | |||
* '''A''' can be eigendecomposed if and only if | |||
:<math>N_{\mathbf{v}}=N \, </math> | |||
*If ''p''(λ) has no repeated roots, i.e. ''N''<sub>λ</sub> = ''N'', then '''A''' can be eigendecomposed. | |||
*The statement "'''A''' can be eigendecomposed" does ''not'' imply that '''A''' has an inverse. | |||
*The statement "'''A''' has an inverse" does ''not'' imply that '''A''' can be eigendecomposed. | |||
===Useful facts regarding matrix inverse=== | |||
*<math>\mathbf{A}</math> can be inverted if and only if | |||
:<math>\lambda_i \ne 0 \; \forall \,i</math> | |||
*If <math>\lambda_i \ne 0 \; \forall \,i</math> '''and''' <math>N_{\mathbf{v}}=N</math>, the inverse is given by | |||
:<math>\mathbf{A}^{-1}=\mathbf{Q}\mathbf{\Lambda}^{-1}\mathbf{Q}^{-1} </math> | |||
==Numerical computations== | |||
{{details|eigenvalue algorithm}} | |||
===Numerical computation of eigenvalues=== | |||
Suppose that we want to compute the eigenvalues of a given matrix. If the matrix is small, we can compute them symbolically using the [[characteristic polynomial]]. However, this is often impossible for larger matrices, in which case we must use a [[numerical analysis|numerical method]]. | |||
In practice, eigenvalues of large matrices are not computed using the characteristic polynomial. Computing the polynomial becomes expensive in itself, and exact (symbolic) roots of a high-degree polynomial can be difficult to compute and express: the [[Abel–Ruffini theorem]] implies that the roots of high-degree (5 or above) polynomials cannot in general be expressed simply using ''n''th roots. Therefore, general algorithms to find eigenvectors and eigenvalues are [[iterative method|iterative]]. | |||
Iterative numerical algorithms for approximating roots of polynomials exist, such as [[Newton's method]], but in general it is impractical to compute the characteristic polynomial and then apply these methods. One reason is that small [[round-off error]]s in the coefficients of the characteristic polynomial can lead to large errors in the eigenvalues and eigenvectors: the roots are an extremely [[ill-conditioned]] function of the coefficients.<ref name=Trefethen>{{Cite book|author1=[[Lloyd N. Trefethen]] |author2= David Bau|title=Numerical Linear Algebra|isbn=978-0898713619|publisher=SIAM|year= 1997}}</ref> | |||
A simple and accurate iterative method is the [[power method]]: a [[random]] vector <math>v</math> is chosen and a sequence of [[unit vector]]s is computed as | |||
: <math>\frac{Av}{\|Av\|}, \frac{A^2v}{\|A^2v\|}, \frac{A^3v}{\|A^3v\|}, \dots</math> | |||
This [[sequence]] will [[almost always]] converge to an eigenvector corresponding to the eigenvalue of greatest magnitude, provided that ''v'' has a nonzero component of this eigenvector in the eigenvector basis (and also provided that there is only one eigenvalue of greatest magnitude). This simple algorithm is useful in some practical applications; for example, [[Google]] uses it to calculate the [[PageRank|page rank]] of documents in their search engine.<ref>Ipsen, Ilse, and Rebecca M. Wills, ''[http://www4.ncsu.edu/~ipsen/ps/slides_imacs.pdf Analysis and Computation of Google's PageRank]'', 7th IMACS International Symposium on Iterative Methods in Scientific Computing, Fields Institute, Toronto, Canada, 5–8 May 2005.</ref> Also, the power method is the starting point for many more sophisticated algorithms. For instance, by keeping not just the last vector in the sequence, but instead looking at the [[linear span|span]] of ''all'' the vectors in the sequence, one can get a better (faster converging) approximation for the eigenvector, and this idea is the basis of [[Arnoldi iteration]].<ref name=Trefethen/> Alternatively, the important [[QR algorithm]] is also based on a subtle transformation of a power method.<ref name=Trefethen/> | |||
===Numerical computation of eigenvectors=== | |||
Once the eigenvalues are computed, the eigenvectors could be calculated by solving the equation | |||
:<math> \left(\mathbf{A} - \lambda_i \mathbf{I}\right)\mathbf{v}_{i,j} = 0 \!\ </math> | |||
using [[Gaussian elimination]] or [[System of linear equations#Solving a linear system|any other method]] for solving [[System of linear equations|matrix equations]]. | |||
However, in practical large-scale eigenvalue methods, the eigenvectors are usually computed in other ways, as a byproduct of the eigenvalue computation. In [[power iteration]], for example, the eigenvector is actually computed before the eigenvalue (which is typically computed by the [[Rayleigh quotient]] of the eigenvector).<ref name=Trefethen/> In the QR algorithm for a [[Hermitian matrix]] (or any [[normal matrix]]), the orthonormal eigenvectors are obtained as a product of the ''Q'' matrices from the steps in the algorithm.<ref name=Trefethen/> (For more general matrices, the QR algorithm yields the [[Schur decomposition]] first, from which the eigenvectors can be obtained by a [[backsubstitution]] procedure.<ref>{{Cite book|url=http://books.google.com/books?id=YVpyyi1M7vUC |publisher=Springer|chapter= section 5.8.2|title=Numerical Mathematics|author=Alfio Quarteroni, Riccardo Sacco, Fausto Saleri|isbn=9780387989594|year=2000}}</ref>) For Hermitian matrices, the [[Divide-and-conquer eigenvalue algorithm]] is more efficient than the QR algorithm if both eigenvectors and eigenvalues are desired.<ref name=Trefethen/> | |||
==Additional topics== | |||
===Generalized eigenspaces=== | |||
Recall that the ''geometric'' multiplicity of an eigenvalue can be described as the dimension of the associated eigenspace, the nullspace of λI − ''A''. The algebraic multiplicity can also be thought of as a dimension: it is the dimension of the associated '''generalized eigenspace''' (1st sense), which is the nullspace of the matrix (λI − ''A'')<sup>''k''</sup> for ''any sufficiently large k''. That is, it is the space of '''generalized eigenvectors''' (1st sense), where a generalized eigenvector is any vector which ''eventually'' becomes 0 if λI − ''A'' is applied to it enough times successively. Any eigenvector is a generalized eigenvector, and so each eigenspace is contained in the associated generalized eigenspace. This provides an easy proof that the geometric multiplicity is always less than or equal to the algebraic multiplicity. | |||
This usage should not be confused with the ''generalized eigenvalue problem'' described below. | |||
===Conjugate eigenvector=== | |||
A '''conjugate eigenvector''' or '''coneigenvector''' is a vector sent after transformation to a scalar multiple of its conjugate, where the scalar is called the '''conjugate eigenvalue''' or '''coneigenvalue''' of the linear transformation. The coneigenvectors and coneigenvalues represent essentially the same information and meaning as the regular eigenvectors and eigenvalues, but arise when an alternative coordinate system is used. The corresponding equation is | |||
: <math>Av = \lambda v^*.\,</math> | |||
For example, in coherent electromagnetic scattering theory, the linear transformation ''A'' represents the action performed by the scattering object, and the eigenvectors represent polarization states of the electromagnetic wave. In [[optics]], the coordinate system is defined from the wave's viewpoint, known as the [[Forward Scattering Alignment]] (FSA), and gives rise to a regular eigenvalue equation, whereas in [[radar]], the coordinate system is defined from the radar's viewpoint, known as the [[Back Scattering Alignment]] (BSA), and gives rise to a coneigenvalue equation. | |||
===Generalized eigenvalue problem=== | |||
A '''generalized eigenvalue problem''' (2nd sense) is the problem of finding a vector '''v''' that obeys | |||
: <math> A\mathbf{v} = \lambda B \mathbf{v} \quad \quad</math> | |||
where ''A'' and ''B'' are matrices. If '''v''' obeys this equation, with some λ, then we call '''v''' the '''generalized eigenvector of A and B''' (in the 2nd sense), and λ is called the '''generalized eigenvalue of A and B''' (in the 2nd sense) which corresponds to the generalized eigenvector '''v'''. | |||
The possible values of λ must obey the following equation | |||
:<math>\det(A - \lambda B)=0.\, </math> | |||
In the case we can find <math>n\in\mathbb{N}</math> linearly independent vectors <math> \{\mathbf{v_1}\ ,\dots, \mathbf{v_n}\} </math> so that for every <math>i\in\{1,\dots,n\}</math>, <math> A\mathbf{v}_i = \lambda_i B \mathbf{v}_i \quad</math>, where | |||
<math>\lambda_i\in\mathbb{F}</math> then we define the matrices '''P''' and '''D''' such that | |||
<math>P= | |||
\begin{pmatrix} | |||
| & & | \\ | |||
\mathbf{v_1} & \cdots & \mathbf{v_n} \\ | |||
| & & | \\ | |||
\end{pmatrix} | |||
</math> | |||
≡ | |||
<math> | |||
\begin{pmatrix} | |||
(\mathbf{v_1})_1 & \cdots & (\mathbf{v_n})_1 \\ | |||
\vdots & & \vdots \\ | |||
(\mathbf{v_1})_n & \cdots & (\mathbf{v_n})_n \\ | |||
\end{pmatrix} | |||
</math> | |||
<math> | |||
(D)_{ij} = | |||
\begin{cases} | |||
\lambda_i, & \text{if }i = j\\ | |||
0, & \text{else} | |||
\end{cases} | |||
</math> | |||
Then the following equality holds | |||
:<math> | |||
\mathbf{A}=\mathbf{B}\mathbf{P}\mathbf{D}\mathbf{P^{-1}} \qquad \qquad | |||
</math> | |||
And the proof is | |||
: | |||
<math> | |||
\mathbf{A}\mathbf{P}= | |||
\mathbf{A} | |||
\begin{pmatrix} | |||
| & & | \\ | |||
\mathbf{v_1} & \cdots & \mathbf{v_n} \\ | |||
| & & | \\ | |||
\end{pmatrix} | |||
= | |||
\begin{pmatrix} | |||
| & & | \\ | |||
A\mathbf{v_1} & \cdots & A\mathbf{v_n} \\ | |||
| & & | \\ | |||
\end{pmatrix} | |||
= | |||
</math> | |||
: | |||
<math> | |||
\begin{pmatrix} | |||
| & & | \\ | |||
\lambda_1B\mathbf{v_1} & \cdots & \lambda_nB\mathbf{v_n} \\ | |||
| & & | \\ | |||
\end{pmatrix} | |||
= | |||
\begin{pmatrix} | |||
| & & | \\ | |||
B\mathbf{v_1} & \cdots & B\mathbf{v_n} \\ | |||
| & & | \\ | |||
\end{pmatrix} | |||
\mathbf{D} | |||
= | |||
\mathbf{B}\mathbf{P}\mathbf{D} | |||
</math> | |||
And since '''P''' is invertible, we multiply the equation from the right by its inverse and '''QED'''. | |||
The set of matrices of the form <math>A - \lambda B</math>, where <math> \lambda </math> is a complex number, is called a ''pencil''; the term ''[[matrix pencil]]'' can also refer to the pair (''A'',''B'') of matrices.<ref name=Bai-GHEP>{{cite book|editor=Z. Bai, [[James Demmel|J. Demmel]], J. Dongarra, A. Ruhe, and H. Van Der Vorst|title=Templates for the Solution of Algebraic Eigenvalue Problems: A Practical Guide|publisher=SIAM|location=Philadelphia|year= 2000|url=http://www.cs.utk.edu/~dongarra/etemplates/node156.html| chapter=Generalized Hermitian Eigenvalue Problems|isbn= 0-89871-471-0}}</ref> | |||
If ''B'' is invertible, then the original problem can be written in the form | |||
: <math> B^{-1}Av = \lambda v \quad \quad </math> | |||
which is a standard eigenvalue problem. However, in most situations it is preferable not to perform the inversion, but rather to solve the generalized eigenvalue problem as stated originally. This is especially important if ''A'' and ''B'' are [[Hermitian matrices]], since in this case <math>B^{-1}A</math> is not generally Hermitian and important properties of the solution are no longer apparent. | |||
If ''A'' and ''B'' are Hermitian and ''B'' is a [[positive-definite matrix]], the eigenvalues λ are real and eigenvectors ''v''<sub>1</sub> and ''v''<sub>2</sub> with distinct eigenvalues are ''B''-orthogonal (<math>v_1^* B v_2 = 0</math>). Also, in this case it is guaranteed that there exists a [[basis (linear algebra)|basis]] of generalized eigenvectors (it is not a [[defective matrix|defective]] problem).<ref name=Bai-GHEP/> This case is sometimes called a ''Hermitian definite pencil'' or ''definite pencil''.<ref name=Bai-GHEP/> | |||
==See also== | |||
*[[Matrix decomposition]] | |||
*[[List of matrices]] | |||
*[[Eigenvalue, eigenvector and eigenspace]] | |||
*[[Spectral theorem]] | |||
*[[Householder transformation]] | |||
*[[Frobenius covariant]] | |||
*[[Sylvester's formula]] | |||
== References == | |||
{{Reflist}} | |||
==Bibliography== | |||
* {{cite book|last= Franklin|first= Joel N. |year=1968|title=Matrix Theory|publisher= Dover Publications|isbn =0-486-41179-6}} | |||
* {{cite book|last1= Golub|first1= G. H. |last2= Van Loan|first2= C. F. |year=1996|title=Matrix Computations|edition=3rd|publisher= Johns Hopkins University Press|location= Baltimore| isbn =0-8018-5414-8}} | |||
* {{cite book|last1=Horn|first1= Roger A. |last2= Johnson|first2=Charles R.|year=1985|title=Matrix Analysis|publisher=Cambridge University Press|isbn= 0-521-38632-2}} | |||
* {{cite book|last1=Horn|first1= Roger A. |last2= Johnson|first2=Charles R.|year=1991|title=Topics in Matrix Analysis|publisher= Cambridge University Press| isbn =0-521-46713-6}} | |||
* {{cite book|last=Strang |first=G. |year=1998|title=Introduction to Linear Algebra|edition=3rd |publisher= Wellesley-Cambridge Press|isbn =0-9614088-5-5}} | |||
== External links == | |||
* [http://people.revoledu.com/kardi/tutorial/LinearAlgebra/SpectralDecomposition.html Interactive program & tutorial of Spectral Decomposition]. | |||
[[Category:Linear algebra]] | |||
[[Category:Matrix theory]] | |||
[[Category:Matrix decompositions]] |
Revision as of 20:30, 21 October 2013
In the mathematical discipline of linear algebra, eigendecomposition or sometimes spectral decomposition is the factorization of a matrix into a canonical form, whereby the matrix is represented in terms of its eigenvalues and eigenvectors. Only diagonalizable matrices can be factorized in this way.
Fundamental theory of matrix eigenvectors and eigenvalues
Mining Engineer (Excluding Oil ) Truman from Alma, loves to spend time knotting, largest property developers in singapore developers in singapore and stamp collecting. Recently had a family visit to Urnes Stave Church.
A (non-zero) vector v of dimension N is an eigenvector of a square (N×N) matrix A if and only if it satisfies the linear equation
where λ is a scalar, termed the eigenvalue corresponding to v. That is, the eigenvectors are the vectors which the linear transformation A merely elongates or shrinks, and the amount that they elongate/shrink by is the eigenvalue. The above equation is called the eigenvalue equation or the eigenvalue problem.
This yields an equation for the eigenvalues
We call p(λ) the characteristic polynomial, and the equation, called the characteristic equation, is an Nth order polynomial equation in the unknown λ. This equation will have Nλ distinct solutions, where 1 ≤ Nλ ≤ N . The set of solutions, i.e. the eigenvalues, is sometimes called the spectrum of A.
We can factor p as
The integer ni is termed the algebraic multiplicity of eigenvalue λi. The algebraic multiplicities sum to N:
For each eigenvalue, λi, we have a specific eigenvalue equation
There will be 1 ≤ mi ≤ ni linearly independent solutions to each eigenvalue equation. The mi solutions are the eigenvectors associated with the eigenvalue λi. The integer mi is termed the geometric multiplicity of λi. It is important to keep in mind that the algebraic multiplicity ni and geometric multiplicity mi may or may not be equal, but we always have mi ≤ ni. The simplest case is of course when mi = ni = 1. The total number of linearly independent eigenvectors, Nv, can be calculated by summing the geometric multiplicities
The eigenvectors can be indexed by eigenvalues, i.e. using a double index, with vi,j being the jth eigenvector for the ith eigenvalue. The eigenvectors can also be indexed using the simpler notation of a single index vk, with k = 1, 2, ..., Nv.
Eigendecomposition of a matrix
Let A be a square (N×N) matrix with N linearly independent eigenvectors, Then A can be factorized as
where Q is the square (N×N) matrix whose ith column is the eigenvector of A and Λ is the diagonal matrix whose diagonal elements are the corresponding eigenvalues, i.e., . Note that only diagonalizable matrices can be factorized in this way. For example, the defective matrix cannot be diagonalized.
The eigenvectors are usually normalized, but they need not be. A non-normalized set of eigenvectors, can also be used as the columns of Q. That can be understood by noting that the magnitude of the eigenvectors in Q gets canceled in the decomposition by the presence of Q−1.
Example
Taking a 2 × 2 real matrix as an example to be decomposed into a diagonal matrix through multiplication of a non-singular matrix .
Then
Shifting to the right hand side:
The above equation can be decomposed into 2 simultaneous equations:
Factoring out the eigenvalues and :
Letting , this gives us two vector equations:
And can be represented by a single vector equation involving 2 solutions as eigenvalues:
where represents the two eigenvalues and , represents the vectors and .
Shifting to the left hand side and factorizing out
Since is non-singular, it is essential that is non-zero. Therefore,
Considering the determinant of ,
Thus
Giving us the solutions of the eigenvalues for the matrix as or , and the resulting diagonal matrix from the eigendecomposition of is thus .
Putting the solutions back into the above simultaneous equations
Solving the equations, we have and
Thus the matrix required for the eigendecomposition of is . i.e. :
Matrix inverse via eigendecomposition
Mining Engineer (Excluding Oil ) Truman from Alma, loves to spend time knotting, largest property developers in singapore developers in singapore and stamp collecting. Recently had a family visit to Urnes Stave Church.
If matrix A can be eigendecomposed and if none of its eigenvalues are zero, then A is nonsingular and its inverse is given by
Furthermore, because Λ is a diagonal matrix, its inverse is easy to calculate:
Practical implications[1]
When eigendecomposition is used on a matrix of measured, real data, the inverse may be less valid when all eigenvalues are used unmodified in the form above. This is because as eigenvalues become relatively small, their contribution to the inversion is large. Those near zero or at the "noise" of the measurement system will have undue influence and could hamper solutions (detection) using the inverse.
Two mitigations have been proposed: 1) truncating small/zero eigenvalues, 2) extending the lowest reliable eigenvalue to those below it.
The first mitigation method is similar to a sparse sample of the original matrix, removing components that are not considered valuable. However, if the solution or detection process is near the noise level, truncating may remove components that influence the desired solution.
The second mitigation extends the eigenvalue so that lower values have much less influence over inversion, but do still contribute, such that solutions near the noise will still be found.
The reliable eigenvalue can be found by assuming that eigenvalues of extremely similar and low value are a good representation of measurement noise (which is assumed low for most systems).
If the eigenvalues are rank-sorted by value, then the reliable eigenvalue can be found by minimization of the Laplacian of the sorted eigenvalues:[2]
where the eigenvalues are subscripted with an 's' to denote being sorted. The position of the minimization is the lowest reliable eigenvalue. In measurement systems, the square root of this reliable eigenvalue is the average noise over the components of the system.
Functional calculus
The eigendecomposition allows for much easier computation of power series of matrices. If f(x) is given by
then we know that
Because Λ is a diagonal matrix, functions of Λ are very easy to calculate:
The off-diagonal elements of f(Λ) are zero; that is, f(Λ) is also a diagonal matrix. Therefore, calculating f(A) reduces to just calculating the function on each of the eigenvalues .
A similar technique works more generally with the holomorphic functional calculus, using
from above. Once again, we find that
Examples
Decomposition for special matrices
Normal matrices
A complex normal matrix () has an orthogonal eigenvector basis, so a normal matrix can be decomposed as
where U is a unitary matrix. Further, if A is Hermitian (), which implies that it is also complex normal, the diagonal matrix Λ has only real values, and if A is unitary, Λ takes all its values on the complex unit circle.
Real symmetric matrices
As a special case, for every N×N real symmetric matrix, the eigenvectors can be chosen such that they are real, orthogonal to each other and have norm one. Thus a real symmetric matrix A can be decomposed as
where Q is an orthogonal matrix, and Λ is a diagonal matrix whose entries are the eigenvalues of A.
Useful facts
Useful facts regarding eigenvalues
- The product of the eigenvalues is equal to the determinant of A
Note that each eigenvalue is raised to the power ni, the algebraic multiplicity.
- The sum of the eigenvalues is equal to the trace of A
Note that each eigenvalue is multiplied by ni, the algebraic multiplicity.
- If the eigenvalues of A are λi, and A is invertible, then the eigenvalues of A−1 are simply λi−1.
- If the eigenvalues of A are λi, then the eigenvalues of f(A) are simply f(λi), for any holomorphic function f.
Useful facts regarding eigenvectors
- If A is Hermitian and full-rank, the basis of eigenvectors may be chosen to be mutually orthogonal. The eigenvalues are real.
- The eigenvectors of A−1 are the same as the eigenvectors of A.
Useful facts regarding eigendecomposition
- A can be eigendecomposed if and only if
- If p(λ) has no repeated roots, i.e. Nλ = N, then A can be eigendecomposed.
- The statement "A can be eigendecomposed" does not imply that A has an inverse.
- The statement "A has an inverse" does not imply that A can be eigendecomposed.
Useful facts regarding matrix inverse
Numerical computations
DTZ gives a comprehensive integrated property and services administration resolution for buyers, corporate house for sale In singapore owners, management firms and occupiers of property whatever their needs with the only goal of optimising and enhancing the investment worth of their property. We at the moment make use of a staff of more than 70 skilled staffs who are well-trained and dedicated to collectively achieving our purchasers' objectives.
Actual estate agency specialising in non-public condos and landed properties island vast. 10 Winstedt Highway, District 10, #01-thirteen, Singapore 227977. Property providers for enterprise relocation. Situated at 371 Beach Street, #19-10 KeyPoint, Singapore 199597. Property agents for homes, town houses, landed property, residences and condominium for sales and rentals of properties. Administration letting services for property homeowners. is there a single authority in singapore who regulates real property agents that i can file a complaint with for unethical behaviour? or is CASE is simply route? The 188 pages of Secrets and techniques of Singapore Property Gurus are full of professional knowledge and life altering wisdom. Asian industrial property market outlook Property Listing Supervisor Property Advertising Services
Should sellers go along with an agent who claims to specialize in your space? His experience might turn out to be useful, but he is probably additionally advertising a number of models within the neighbourhood – and so they're all your rivals. Within the worst-case state of affairs, your house may be used as a "showflat" as house owner YS Liang found. "Weekend after weekend, our agent would convey a stream of individuals to speed-go to our apartment, leaving within minutes. She did not even try to promote our condominium. It felt like we were just one of the many tour stops for her clients," he complains.
Step one in direction of conducting enterprise as an actual property company in Singapore is to include an organization, or if you happen to're going the partnership or sole-proprietorship route, register your Limited Legal responsibility Partnership or sole-proprietorship with the ACRA (Accounting and Company Regulatory Authority of Singapore) Whether or not you might be considering to promote, let, hire or buy a new industrial property, we're right here to assist. Search and browse our commercial property section. Possess not less than 3 years of working expertise below a Singapore licensed real-property agency; Sale, letting and property administration and taxation companies. three Shenton Means, #10-08 Shenton Home, Singapore 068805. Real property agents for purchasing, promoting, leasing, and renting property. Caveat Search
Firstly, the events might take into account to rescind the sale and buy agreement altogether. This avenue places the contracting events to a position as if the contract didn't happen. It's as if the contract was terminated from the start and events are put back into place that they were before the contract. Any items or monies handed are returned to the respective original house owners. As the worldwide real property market turns into extra refined and worldwide real property investments will increase, the ERA real estate network is well equipped to offer professional recommendation and guidance to our shoppers in making critical actual estate decisions. Relocationg, leasing and sales of properties for housing, food and beverage, retail and workplace wants.
Pasir Panjang, Singapore - $5,000-6,000 per 30 days By likelihood one among our buddies here in Singapore is an agent and we made contact for her to help us locate an residence, which she did. days from the date of execution if the doc is signed in Singapore; Be a Singapore Citizen or PR (Permanent Resident); The regulations also prohibit property agents from referring their shoppers to moneylenders, to discourage irresponsible shopping for. Brokers are additionally prohibited from holding or dealing with money on behalf of any party in relation to the sale or purchase of any property situated in Singapore, and the lease of HDB property. - Negotiate To Close A Sale together with sale and lease of HDB and private properties) Preparing your house for sale FEATURED COMMERCIAL AGENTS Property Guides
i) registered as a patent agent or its equal in any nation or territory, or by a patent workplace, specified within the Fourth Schedule; The business-specific tips for the true property agency and telecommunication sectors have been crafted to address considerations about scenarios that particularly apply to the two sectors, the PDPC stated. Mr Steven Tan, Managing Director of OrangeTee real property company, nonetheless, felt that it was a matter of "practising until it becomes part of our knowledge". "After a while, the agents ought to know the spirit behind the (Act)," he stated. Rising office sector leads real property market efficiency, while prime retail and enterprise park segments moderate and residential sector continues in decline Please choose an attendee for donation.
Numerical computation of eigenvalues
Suppose that we want to compute the eigenvalues of a given matrix. If the matrix is small, we can compute them symbolically using the characteristic polynomial. However, this is often impossible for larger matrices, in which case we must use a numerical method.
In practice, eigenvalues of large matrices are not computed using the characteristic polynomial. Computing the polynomial becomes expensive in itself, and exact (symbolic) roots of a high-degree polynomial can be difficult to compute and express: the Abel–Ruffini theorem implies that the roots of high-degree (5 or above) polynomials cannot in general be expressed simply using nth roots. Therefore, general algorithms to find eigenvectors and eigenvalues are iterative.
Iterative numerical algorithms for approximating roots of polynomials exist, such as Newton's method, but in general it is impractical to compute the characteristic polynomial and then apply these methods. One reason is that small round-off errors in the coefficients of the characteristic polynomial can lead to large errors in the eigenvalues and eigenvectors: the roots are an extremely ill-conditioned function of the coefficients.[3]
A simple and accurate iterative method is the power method: a random vector is chosen and a sequence of unit vectors is computed as
This sequence will almost always converge to an eigenvector corresponding to the eigenvalue of greatest magnitude, provided that v has a nonzero component of this eigenvector in the eigenvector basis (and also provided that there is only one eigenvalue of greatest magnitude). This simple algorithm is useful in some practical applications; for example, Google uses it to calculate the page rank of documents in their search engine.[4] Also, the power method is the starting point for many more sophisticated algorithms. For instance, by keeping not just the last vector in the sequence, but instead looking at the span of all the vectors in the sequence, one can get a better (faster converging) approximation for the eigenvector, and this idea is the basis of Arnoldi iteration.[3] Alternatively, the important QR algorithm is also based on a subtle transformation of a power method.[3]
Numerical computation of eigenvectors
Once the eigenvalues are computed, the eigenvectors could be calculated by solving the equation
using Gaussian elimination or any other method for solving matrix equations.
However, in practical large-scale eigenvalue methods, the eigenvectors are usually computed in other ways, as a byproduct of the eigenvalue computation. In power iteration, for example, the eigenvector is actually computed before the eigenvalue (which is typically computed by the Rayleigh quotient of the eigenvector).[3] In the QR algorithm for a Hermitian matrix (or any normal matrix), the orthonormal eigenvectors are obtained as a product of the Q matrices from the steps in the algorithm.[3] (For more general matrices, the QR algorithm yields the Schur decomposition first, from which the eigenvectors can be obtained by a backsubstitution procedure.[5]) For Hermitian matrices, the Divide-and-conquer eigenvalue algorithm is more efficient than the QR algorithm if both eigenvectors and eigenvalues are desired.[3]
Additional topics
Generalized eigenspaces
Recall that the geometric multiplicity of an eigenvalue can be described as the dimension of the associated eigenspace, the nullspace of λI − A. The algebraic multiplicity can also be thought of as a dimension: it is the dimension of the associated generalized eigenspace (1st sense), which is the nullspace of the matrix (λI − A)k for any sufficiently large k. That is, it is the space of generalized eigenvectors (1st sense), where a generalized eigenvector is any vector which eventually becomes 0 if λI − A is applied to it enough times successively. Any eigenvector is a generalized eigenvector, and so each eigenspace is contained in the associated generalized eigenspace. This provides an easy proof that the geometric multiplicity is always less than or equal to the algebraic multiplicity.
This usage should not be confused with the generalized eigenvalue problem described below.
Conjugate eigenvector
A conjugate eigenvector or coneigenvector is a vector sent after transformation to a scalar multiple of its conjugate, where the scalar is called the conjugate eigenvalue or coneigenvalue of the linear transformation. The coneigenvectors and coneigenvalues represent essentially the same information and meaning as the regular eigenvectors and eigenvalues, but arise when an alternative coordinate system is used. The corresponding equation is
For example, in coherent electromagnetic scattering theory, the linear transformation A represents the action performed by the scattering object, and the eigenvectors represent polarization states of the electromagnetic wave. In optics, the coordinate system is defined from the wave's viewpoint, known as the Forward Scattering Alignment (FSA), and gives rise to a regular eigenvalue equation, whereas in radar, the coordinate system is defined from the radar's viewpoint, known as the Back Scattering Alignment (BSA), and gives rise to a coneigenvalue equation.
Generalized eigenvalue problem
A generalized eigenvalue problem (2nd sense) is the problem of finding a vector v that obeys
where A and B are matrices. If v obeys this equation, with some λ, then we call v the generalized eigenvector of A and B (in the 2nd sense), and λ is called the generalized eigenvalue of A and B (in the 2nd sense) which corresponds to the generalized eigenvector v. The possible values of λ must obey the following equation
In the case we can find linearly independent vectors so that for every , , where then we define the matrices P and D such that
Then the following equality holds
And the proof is
And since P is invertible, we multiply the equation from the right by its inverse and QED.
The set of matrices of the form , where is a complex number, is called a pencil; the term matrix pencil can also refer to the pair (A,B) of matrices.[6] If B is invertible, then the original problem can be written in the form
which is a standard eigenvalue problem. However, in most situations it is preferable not to perform the inversion, but rather to solve the generalized eigenvalue problem as stated originally. This is especially important if A and B are Hermitian matrices, since in this case is not generally Hermitian and important properties of the solution are no longer apparent.
If A and B are Hermitian and B is a positive-definite matrix, the eigenvalues λ are real and eigenvectors v1 and v2 with distinct eigenvalues are B-orthogonal (). Also, in this case it is guaranteed that there exists a basis of generalized eigenvectors (it is not a defective problem).[6] This case is sometimes called a Hermitian definite pencil or definite pencil.[6]
See also
- Matrix decomposition
- List of matrices
- Eigenvalue, eigenvector and eigenspace
- Spectral theorem
- Householder transformation
- Frobenius covariant
- Sylvester's formula
References
43 year old Petroleum Engineer Harry from Deep River, usually spends time with hobbies and interests like renting movies, property developers in singapore new condominium and vehicle racing. Constantly enjoys going to destinations like Camino Real de Tierra Adentro.
Bibliography
- 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
My blog: http://www.primaboinca.com/view_profile.php?userid=5889534 - 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
My blog: http://www.primaboinca.com/view_profile.php?userid=5889534 - 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
My blog: http://www.primaboinca.com/view_profile.php?userid=5889534 - 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
My blog: http://www.primaboinca.com/view_profile.php?userid=5889534 - 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
My blog: http://www.primaboinca.com/view_profile.php?userid=5889534
External links
- ↑ One of the biggest reasons investing in a Singapore new launch is an effective things is as a result of it is doable to be lent massive quantities of money at very low interest rates that you should utilize to purchase it. Then, if property values continue to go up, then you'll get a really high return on funding (ROI). Simply make sure you purchase one of the higher properties, reminiscent of the ones at Fernvale the Riverbank or any Singapore landed property Get Earnings by means of Renting
In its statement, the singapore property listing - website link, government claimed that the majority citizens buying their first residence won't be hurt by the new measures. Some concessions can even be prolonged to chose teams of consumers, similar to married couples with a minimum of one Singaporean partner who are purchasing their second property so long as they intend to promote their first residential property. Lower the LTV limit on housing loans granted by monetary establishments regulated by MAS from 70% to 60% for property purchasers who are individuals with a number of outstanding housing loans on the time of the brand new housing purchase. Singapore Property Measures - 30 August 2010 The most popular seek for the number of bedrooms in Singapore is 4, followed by 2 and three. Lush Acres EC @ Sengkang
Discover out more about real estate funding in the area, together with info on international funding incentives and property possession. Many Singaporeans have been investing in property across the causeway in recent years, attracted by comparatively low prices. However, those who need to exit their investments quickly are likely to face significant challenges when trying to sell their property – and could finally be stuck with a property they can't sell. Career improvement programmes, in-house valuation, auctions and administrative help, venture advertising and marketing, skilled talks and traisning are continuously planned for the sales associates to help them obtain better outcomes for his or her shoppers while at Knight Frank Singapore. No change Present Rules
Extending the tax exemption would help. The exemption, which may be as a lot as $2 million per family, covers individuals who negotiate a principal reduction on their existing mortgage, sell their house short (i.e., for lower than the excellent loans), or take part in a foreclosure course of. An extension of theexemption would seem like a common-sense means to assist stabilize the housing market, but the political turmoil around the fiscal-cliff negotiations means widespread sense could not win out. Home Minority Chief Nancy Pelosi (D-Calif.) believes that the mortgage relief provision will be on the table during the grand-cut price talks, in response to communications director Nadeam Elshami. Buying or promoting of blue mild bulbs is unlawful.
A vendor's stamp duty has been launched on industrial property for the primary time, at rates ranging from 5 per cent to 15 per cent. The Authorities might be trying to reassure the market that they aren't in opposition to foreigners and PRs investing in Singapore's property market. They imposed these measures because of extenuating components available in the market." The sale of new dual-key EC models will even be restricted to multi-generational households only. The models have two separate entrances, permitting grandparents, for example, to dwell separately. The vendor's stamp obligation takes effect right this moment and applies to industrial property and plots which might be offered inside three years of the date of buy. JLL named Best Performing Property Brand for second year running
The data offered is for normal info purposes only and isn't supposed to be personalised investment or monetary advice. Motley Fool Singapore contributor Stanley Lim would not personal shares in any corporations talked about. Singapore private home costs increased by 1.eight% within the fourth quarter of 2012, up from 0.6% within the earlier quarter. Resale prices of government-built HDB residences which are usually bought by Singaporeans, elevated by 2.5%, quarter on quarter, the quickest acquire in five quarters. And industrial property, prices are actually double the levels of three years ago. No withholding tax in the event you sell your property. All your local information regarding vital HDB policies, condominium launches, land growth, commercial property and more
There are various methods to go about discovering the precise property. Some local newspapers (together with the Straits Instances ) have categorised property sections and many local property brokers have websites. Now there are some specifics to consider when buying a 'new launch' rental. Intended use of the unit Every sale begins with 10 p.c low cost for finish of season sale; changes to 20 % discount storewide; follows by additional reduction of fiftyand ends with last discount of 70 % or extra. Typically there is even a warehouse sale or transferring out sale with huge mark-down of costs for stock clearance. Deborah Regulation from Expat Realtor shares her property market update, plus prime rental residences and houses at the moment available to lease Esparina EC @ Sengkang - ↑ One of the biggest reasons investing in a Singapore new launch is an effective things is as a result of it is doable to be lent massive quantities of money at very low interest rates that you should utilize to purchase it. Then, if property values continue to go up, then you'll get a really high return on funding (ROI). Simply make sure you purchase one of the higher properties, reminiscent of the ones at Fernvale the Riverbank or any Singapore landed property Get Earnings by means of Renting
In its statement, the singapore property listing - website link, government claimed that the majority citizens buying their first residence won't be hurt by the new measures. Some concessions can even be prolonged to chose teams of consumers, similar to married couples with a minimum of one Singaporean partner who are purchasing their second property so long as they intend to promote their first residential property. Lower the LTV limit on housing loans granted by monetary establishments regulated by MAS from 70% to 60% for property purchasers who are individuals with a number of outstanding housing loans on the time of the brand new housing purchase. Singapore Property Measures - 30 August 2010 The most popular seek for the number of bedrooms in Singapore is 4, followed by 2 and three. Lush Acres EC @ Sengkang
Discover out more about real estate funding in the area, together with info on international funding incentives and property possession. Many Singaporeans have been investing in property across the causeway in recent years, attracted by comparatively low prices. However, those who need to exit their investments quickly are likely to face significant challenges when trying to sell their property – and could finally be stuck with a property they can't sell. Career improvement programmes, in-house valuation, auctions and administrative help, venture advertising and marketing, skilled talks and traisning are continuously planned for the sales associates to help them obtain better outcomes for his or her shoppers while at Knight Frank Singapore. No change Present Rules
Extending the tax exemption would help. The exemption, which may be as a lot as $2 million per family, covers individuals who negotiate a principal reduction on their existing mortgage, sell their house short (i.e., for lower than the excellent loans), or take part in a foreclosure course of. An extension of theexemption would seem like a common-sense means to assist stabilize the housing market, but the political turmoil around the fiscal-cliff negotiations means widespread sense could not win out. Home Minority Chief Nancy Pelosi (D-Calif.) believes that the mortgage relief provision will be on the table during the grand-cut price talks, in response to communications director Nadeam Elshami. Buying or promoting of blue mild bulbs is unlawful.
A vendor's stamp duty has been launched on industrial property for the primary time, at rates ranging from 5 per cent to 15 per cent. The Authorities might be trying to reassure the market that they aren't in opposition to foreigners and PRs investing in Singapore's property market. They imposed these measures because of extenuating components available in the market." The sale of new dual-key EC models will even be restricted to multi-generational households only. The models have two separate entrances, permitting grandparents, for example, to dwell separately. The vendor's stamp obligation takes effect right this moment and applies to industrial property and plots which might be offered inside three years of the date of buy. JLL named Best Performing Property Brand for second year running
The data offered is for normal info purposes only and isn't supposed to be personalised investment or monetary advice. Motley Fool Singapore contributor Stanley Lim would not personal shares in any corporations talked about. Singapore private home costs increased by 1.eight% within the fourth quarter of 2012, up from 0.6% within the earlier quarter. Resale prices of government-built HDB residences which are usually bought by Singaporeans, elevated by 2.5%, quarter on quarter, the quickest acquire in five quarters. And industrial property, prices are actually double the levels of three years ago. No withholding tax in the event you sell your property. All your local information regarding vital HDB policies, condominium launches, land growth, commercial property and more
There are various methods to go about discovering the precise property. Some local newspapers (together with the Straits Instances ) have categorised property sections and many local property brokers have websites. Now there are some specifics to consider when buying a 'new launch' rental. Intended use of the unit Every sale begins with 10 p.c low cost for finish of season sale; changes to 20 % discount storewide; follows by additional reduction of fiftyand ends with last discount of 70 % or extra. Typically there is even a warehouse sale or transferring out sale with huge mark-down of costs for stock clearance. Deborah Regulation from Expat Realtor shares her property market update, plus prime rental residences and houses at the moment available to lease Esparina EC @ Sengkang - ↑ 3.0 3.1 3.2 3.3 3.4 3.5 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
My blog: http://www.primaboinca.com/view_profile.php?userid=5889534 - ↑ Ipsen, Ilse, and Rebecca M. Wills, Analysis and Computation of Google's PageRank, 7th IMACS International Symposium on Iterative Methods in Scientific Computing, Fields Institute, Toronto, Canada, 5–8 May 2005.
- ↑ 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
My blog: http://www.primaboinca.com/view_profile.php?userid=5889534 - ↑ 6.0 6.1 6.2 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
My blog: http://www.primaboinca.com/view_profile.php?userid=5889534