Setup:
Let k∈N, and let Mk,k(R) denote the set of k×k matrices over the field of real numbers.
Let X∈Mk,k(R) be a symmetric, positive definite matrix.
Then X has k positive eigenvalues λ1,…,λk with corresponding eigenvectors v1,…,vk.
The eigendecomposition/spectral decomposition of X is:
X=VΛV−1=VΛV′,
where Λ=diag(λ1,…,λk)∈Mk,k(R) is the diagonal matrix with the k eigenvalues on the main diagonal and V=(v1,…,vk)∈Mk,k(R) is the matrix whose k columns are the orthonormal eigenvectors.
We define the natural matrix logarithm of X, denoted log(X), to be
log(X)=Vlog(Λ)V′,
where log(Λ)=diag(log(λ1),…,log(λk))∈Mk,k(R).
Question:
What, if it can be found, is the analytical form of the [k(k+1)/2]×[k(k+1)/2] Jacobian matrix
∂vec(X)∂vec(log(X))′
where vec(⋅) is the half-vectorization operator that stacks the lower triangular part of its square argument matrix.
(Background: This is a recurring problem in multivariate statistics when one adopts a "log-parameterization" of a covariance or precision matrix, which are both, by definition, symmetric and positive (semi-)definite.)
Answer
Let G=log(X)⟹X=eG
and find the differential of X via the power series of the exponential
dX=deG=d[∞∑i=0Gii!]=∞∑i=11i!i−1∑j=0GjdGGi−j−1
Now apply vectorization
dx=[∞∑i=11i!i−1∑j=0Gi−j−1⊗Gj]dg∂x∂g=∞∑i=11i!i−1∑j=0[Gi−j−1⊗Gj]
To change between vectorization and half-vectorization, multipy by Duplication and Elimination matrices of the appropriate dimensions
Lkdx=Lk[∂x∂g]DkLkdgdx′=Lk[∂x∂g]Dkdg′∂x′∂g′=Lk[∂x∂g]Dk
P.S.
The reason I used G for the log, was because I wanted to use L for the elimination matrix.
In the vectorization of the power series I used the fact that G is symmetric to omit some transpose operations.
No comments:
Post a Comment