For AI agents: use /llms.txt for the Nakafa content index.
In linear algebra, we recognize two special types of matrices that have very interesting properties. Imagine a mirror that perfectly reflects objects. Symmetric and Hermitian matrices have a similar mathematical "mirror" property.
A real square matrix is called symmetric if it equals its transpose:
Whereas a complex square matrix is called Hermitian if it equals its adjoint:
Let's look at an example to understand this concept more clearly:
Notice that the element at position is the same as the element at position . For example and .
Every real symmetric matrix is actually also a complex Hermitian matrix. Why is that? Because when we consider a real matrix as a complex matrix, the complex conjugate of a real number is the number itself.
Real symmetric matrices are a special case of complex Hermitian matrices.
This means all properties that apply to Hermitian matrices also apply to symmetric matrices. However, symmetric matrices have the additional advantage that all their elements are real.
One interesting property of Hermitian matrices is that all their diagonal elements are always real numbers. Let's see why this happens.
For a Hermitian matrix , we have . This means for every diagonal element:
Because , then for all .
So, even though Hermitian matrices can have complex elements off the diagonal, their diagonal elements are definitely real. This is a direct consequence of the Hermitian definition.
Symmetric and Hermitian matrices have a special feature in terms of quadratic forms. Let's see how they work with vectors.
If we have a symmetric matrix and a vector , then we can form a quadratic function:
For a Hermitian matrix , the result always produces a real number, even though and are complex.
Let's prove why this happens:
Because , then is a real number.
So we get the quadratic form for the complex case:
Before discussing eigenvalues, let's understand the basic properties of vectors that we will use. For a vector or , we have:
This is because:
Both forms are always non-negative and only equal to zero if all vector components are zero.
This is one of the most amazing properties of symmetric and Hermitian matrices. All eigenvalues of symmetric or Hermitian matrices are always real numbers.
Let's look at the proof. Suppose is a Hermitian matrix with . If with , then:
Because , we can conclude that , so .
For real symmetric matrices, since they are also Hermitian matrices, their eigenvalues are also always real.
Eigenvectors corresponding to different eigenvalues in symmetric or Hermitian matrices are always orthogonal to each other. This is a very useful property in various applications.
Let's prove this property. Suppose is a Hermitian matrix with:
We know that because eigenvalues are real. Now:
So . Because , then , which means the eigenvectors are orthogonal.
For real symmetric matrices, we have .
This orthogonality property allows us to diagonalize symmetric and Hermitian matrices using orthogonal or unitary matrices.
