For AI agents: use /llms.txt for the Nakafa content index.
The spectral theorem answers the important question of when a matrix can be diagonalized using an orthonormal basis of eigenvectors. Imagine you want to transform a complex matrix into a simple diagonal matrix, but using basis vectors that are mutually perpendicular. The spectral theorem provides the precise conditions when this transformation is possible.
When this condition is satisfied, the basis transformation matrix becomes unitary with the property S−1=SH or orthogonal with the property for the real case. We will start by studying the complex case first.
A complex matrix A∈Cn×n is called normal if it satisfies the commutativity condition with its conjugate transpose:
This condition appears simple, but it has a strong geometric meaning. Matrices that can "exchange places" with their conjugate transpose have special geometric properties.
Normal matrices have interesting properties that arbitrary matrices do not possess. For normal matrices, the null space of the matrix and the null space of its conjugate transpose turn out to be identical.
Let's see why this happens. The null space (kernel) is the set of all vectors x that produce Ax=0. If AHA=AAH and Ax=0, then we can analyze it like this:
From this calculation, we conclude that AHx=0. Therefore, for normal matrices we have KernAH=KernA.
This equality of null spaces brings important consequences for eigenspaces. For every eigenvalue λ∈C, the eigenspaces of A and AH turn out to be identical.
So every eigenvector of the normal matrix A for eigenvalue λ is also an eigenvector of AH with exactly the same eigenvalue. Imagine finding two mirrors that reflect light in exactly the same direction.
Two important types of matrices that are always normal are Hermitian matrices and unitary matrices. Let's understand why both are special.
Hermitian matrices have the property AH=A. Because of the normal definition A⋅AH=AH⋅A, for Hermitian matrices we have A⋅A=A⋅A, which is clearly always true.
Eigenvalues of Hermitian matrices are always real. To understand this, we use the fact that for normal matrices, the eigenspaces of A and AH for the same eigenvalue are identical.
The condition λ=λ means the eigenvalue equals its complex conjugate, which only happens if λ is a pure real number. So all eigenvalues of Hermitian matrices are always real numbers, not complex numbers with imaginary parts.
Unitary matrices have the property AH=A−1. To prove that unitary matrices are also normal, we substitute into the definition and get A⋅AH=A⋅A−1=I=A−1⋅A=AH⋅A.
Eigenvalues of unitary matrices have magnitude 1, meaning they lie on the unit circle in the complex plane. We can show this with the following calculation.
The condition λ⋅λ=1 is mathematically equivalent to ∣λ∣2=1, which means ∣λ∣=1. So all eigenvalues of unitary matrices have modulus exactly equal to 1. This modulus is the distance from the origin in the complex plane. Imagine a spinning wheel, unitary transformations only rotate vectors without changing their length.
