Command Palette

Search for a command to run...

Linear Methods of AI

All Eigenvalues Calculation

QR Method for All Eigenvalues

Using the QR method, you can calculate all eigenvalues of matrix AA. This process is carried out through iterations that gradually change the matrix form, like sharpening a knife repeatedly until it's sharp. Each iteration round makes the matrix increasingly approach a form that makes it easier for us to read its eigenvalues.

QR Algorithm

  1. Initial step is to set A0:=AA_0 := A and k:=0k := 0

  2. Iteration process that is repeated continuously. In each round, perform QR decomposition on matrix AkA_k

    QkRk=AkQ_k \cdot R_k = A_k

    After that, construct a new matrix by multiplying RkR_k and QkQ_k in reverse order

    Ak+1:=RkQkA_{k+1} := R_k \cdot Q_k

    Add one to the value of kk and check whether the iteration has reached a stable state

    maxj=1,,n(Ak)jj(Ak1)jjtolerance\max_{j=1,\ldots,n} |(A_k)_{jj} - (A_{k-1})_{jj}| \leq \text{tolerance}

    The iteration stops when the largest change in diagonal elements is already very small.

Similarity Properties in Iteration

Every matrix AkA_k that appears in the QR iteration has similar properties to the initial matrix AA. This means the eigenvalues do not change during the iteration process.

Like assembling the same puzzle in different ways. The puzzle pieces remain the same, but their arrangement can change. Likewise with our matrix, its mathematical content remains the same even though its structural form changes.

Diagonal Element Convergence

If the condition λ1>λ2>>λn|\lambda_1| > |\lambda_2| > \cdots > |\lambda_n| holds, then the elements on the main diagonal of matrix AkA_k will approach the corresponding eigenvalues

limk(Ak)jj=λj,j=1,2,,n\lim_{k \to \infty} (A_k)_{jj} = \lambda_j, \quad j = 1, 2, \ldots, n

This process is like water flowing to the lowest place. The eigenvalues "fall" and occupy their respective diagonal positions according to their magnitude order.

Non-Diagonal Element Convergence

If matrix AA is symmetric, all elements outside the main diagonal will approach zero when kk \to \infty.

Conversely, if the matrix is not symmetric, only the elements below the main diagonal approach zero, while those above do not. Imagine it like organizing a closet. If the closet is symmetric, all items can be neatly arranged. But if it's not symmetric, some parts remain messy.