/*! This file is auto-generated */ .wp-block-button__link{color:#fff;background-color:#32373c;border-radius:9999px;box-shadow:none;text-decoration:none;padding:calc(.667em + 2px) calc(1.333em + 2px);font-size:1.125em}.wp-block-file__button{background:#32373c;color:#fff;text-decoration:none} Q7.4-9E Question: Find an SVD of each ma... [FREE SOLUTION] | 91影视

91影视

Question: Find an SVD of each matrix in Exercise 5-12. (Hint: In Exercise 11, one choice for U is \(\left( {\begin{array}{*{20}{c}}{ - \frac{{\bf{1}}}{{\bf{3}}}}&{\frac{{\bf{2}}}{{\bf{3}}}}&{\frac{{\bf{2}}}{{\bf{3}}}}\\{\frac{{\bf{2}}}{{\bf{3}}}}&{ - \frac{{\bf{1}}}{{\bf{3}}}}&{\frac{{\bf{2}}}{{\bf{3}}}}\\{\frac{{\bf{2}}}{{\bf{3}}}}&{\frac{{\bf{2}}}{{\bf{3}}}}&{ - \frac{{\bf{1}}}{{\bf{3}}}}\end{array}} \right)\). In Exercise 12, one column of U can be \(\left( {\begin{array}{*{20}{c}}{\frac{{\bf{1}}}{{\sqrt {\bf{6}} }}}\\{ - \frac{{\bf{2}}}{{\sqrt {\bf{6}} }}}\\{\frac{{\bf{1}}}{{\sqrt {\bf{6}} }}}\end{array}} \right)\).)

10. \(\left( {\begin{array}{*{20}{c}}{\bf{3}}&{ - {\bf{3}}}\\{\bf{0}}&{\bf{0}}\\{\bf{1}}&{\bf{1}}\end{array}} \right)\)

Short Answer

Expert verified

The singular value decomposition of \(A\) is, \(A = \left( {\begin{array}{*{20}{c}}{ - 1}&0&1\\0&0&1\\0&1&1\end{array}} \right)\left( {\begin{array}{*{20}{c}}{3\sqrt 2 }&0\\0&{\sqrt 2 }\\0&0\end{array}} \right)\left( {\begin{array}{*{20}{c}}{ - \frac{1}{{\sqrt 2 }}}&{\frac{1}{{\sqrt 2 }}}\\{\frac{1}{{\sqrt 2 }}}&{\frac{1}{{\sqrt 2 }}}\end{array}} \right)\).

Step by step solution

01

The Singular Value Decomposition

Consider \(m \times n\) matrix with rank \(r\) as \(A\). There is a \(m \times n\) matrix \(\sum \) as seen in (3) wherein the diagonal entries in \(D\) are the first \(r\) singular valuesof A, \({\sigma _1} \ge \cdots \ge {\sigma _r} > 0,\) and there arises an \(m \times m\) orthogonal matrix \(U\) and an \(n \times n\) orthogonal matrix \(V\) such that \(A = U\sum {V^T}\).

02

Find the eigenvalues of the given matrix

Let \(A = \left( {\begin{array}{*{20}{c}}3&{ - 3}\\0&0\\1&1\end{array}} \right)\). The transpose of A is:

\({A^T} = \left( {\begin{array}{*{20}{c}}3&0&1\\{ - 3}&0&1\end{array}} \right)\)

Find the product \({A^T}A\).

\(\begin{array}{c}{A^T}A = \left( {\begin{array}{*{20}{c}}3&0&1\\{ - 3}&0&1\end{array}} \right)\left( {\begin{array}{*{20}{c}}3&{ - 3}\\0&0\\1&1\end{array}} \right)\\ = \left( {\begin{array}{*{20}{c}}{10}&{ - 8}\\{ - 8}&{10}\end{array}} \right)\end{array}\)

The characteristic equation for \({A^T}A\) is:

\(\begin{array}{c}\det \left| {{A^T}A - \lambda I} \right| = 0\\\left| {\begin{array}{*{20}{c}}{10 - \lambda }&{ - 8}\\{ - 8}&{10 - \lambda }\end{array}} \right| = 0\\{\left( {10 - \lambda } \right)^2} - 64 = 0\\\lambda = 18,\,\,2\end{array}\)

03

Find the eigenvectors of the given matrix

The eigenvectors of the matrix for \(\lambda = 18\) are:

\(\begin{array}{c}\left( {{A^T}A - \lambda I} \right)\left( {\begin{array}{*{20}{c}}{{x_1}}\\{{x_2}}\end{array}} \right) = 0\\\left( {\begin{array}{*{20}{c}}{ - 8}&{ - 8}\\{ - 8}&{ - 8}\end{array}} \right)\left( {\begin{array}{*{20}{c}}{{x_1}}\\{{x_2}}\end{array}} \right) = 0\end{array}\)

The general solution is:

\(\left( {\begin{array}{*{20}{c}}{{x_1}}\\{{x_2}}\end{array}} \right) = \,\left( {\begin{array}{*{20}{c}}{ - 1}\\1\end{array}} \right)\)

The eigenvectors of the matrix for \(\lambda = 10\) are:

\(\begin{array}{c}\left( {{A^T}A - \lambda I} \right)\left( {\begin{array}{*{20}{c}}{{x_1}}\\{{x_2}}\end{array}} \right) = 0\\\left( {\begin{array}{*{20}{c}}8&{ - 8}\\{ - 8}&8\end{array}} \right)\left( {\begin{array}{*{20}{c}}{{x_1}}\\{{x_2}}\end{array}} \right) = 0\end{array}\)

The general solution is:

\(\left( {\begin{array}{*{20}{c}}{{x_1}}\\{{x_2}}\end{array}} \right) = \,\left( {\begin{array}{*{20}{c}}1\\1\end{array}} \right)\)

04

Find the Eigenvector matrix

Normalize the eigenvector \(\left( {\begin{array}{*{20}{c}}{ - 1}\\1\end{array}} \right)\) is:

\(\begin{array}{c}{{\bf{v}}_1} = \frac{1}{{\sqrt {{{\left( { - 1} \right)}^2} + {1^2}} }}\left( {\begin{array}{*{20}{c}}{ - 1}\\1\end{array}} \right)\\ = \left( {\begin{array}{*{20}{c}}{\frac{{ - 1}}{{\sqrt 2 }}}\\{\frac{1}{{\sqrt 2 }}}\end{array}} \right)\end{array}\)

Normalize the eigenvector \(\left( {\begin{array}{*{20}{c}}1\\1\end{array}} \right)\) is:

\(\begin{array}{c}{{\bf{v}}_2} = \frac{1}{{\sqrt {{1^2} + {1^2}} }}\left( {\begin{array}{*{20}{c}}1\\1\end{array}} \right)\\ = \left( {\begin{array}{*{20}{c}}{\frac{1}{{\sqrt 2 }}}\\{\frac{1}{{\sqrt 2 }}}\end{array}} \right)\end{array}\)

The eigenvector matrix is:

\(\begin{array}{c}V = \left( {\begin{array}{*{20}{c}}{{{\bf{v}}_1}}&{{{\bf{v}}_2}}\end{array}} \right)\\ = \left( {\begin{array}{*{20}{c}}{ - \frac{1}{{\sqrt 2 }}}&{\frac{1}{{\sqrt 2 }}}\\{\frac{1}{{\sqrt 2 }}}&{\frac{1}{{\sqrt 2 }}}\end{array}} \right)\end{array}\)

05

Find the value of \(\Sigma \)

The singular value is the square root of eigenvalues of \({A^T}A\) i.e. \(3\sqrt 2 \) and \(\sqrt 2 \). Thus, the matrix \(\Sigma \) is:

\(\Sigma = \left( {\begin{array}{*{20}{c}}{3\sqrt 2 }&0\\0&{\sqrt 2 }\\0&0\end{array}} \right)\)

06

Find the matrix U

Let \(U = \left( {\begin{array}{*{20}{c}}a&b&c\\d&e&f\\g&h&i\end{array}} \right)\). Consider the following equation:

\(\begin{array}{c}U\Sigma = AV\\\left( {\begin{array}{*{20}{c}}a&b&c\\d&e&f\\g&h&i\end{array}} \right)\left( {\begin{array}{*{20}{c}}{3\sqrt 2 }&0\\0&{\sqrt 2 }\\0&0\end{array}} \right) = \left( {\begin{array}{*{20}{c}}3&{ - 3}\\0&0\\1&1\end{array}} \right)\left( {\begin{array}{*{20}{c}}{ - \frac{1}{{\sqrt 2 }}}&{\frac{1}{{\sqrt 2 }}}\\{\frac{1}{{\sqrt 2 }}}&{\frac{1}{{\sqrt 2 }}}\end{array}} \right)\\\left( {\begin{array}{*{20}{c}}{3\sqrt 2 a}&{\sqrt 2 b}\\{3\sqrt 2 d}&{\sqrt 2 e}\\{3\sqrt 2 g}&{\sqrt 2 h}\end{array}} \right) = \left( {\begin{array}{*{20}{c}}{ - \frac{6}{{\sqrt 2 }}}&0\\0&0\\0&{\frac{2}{{\sqrt 2 }}}\end{array}} \right)\end{array}\)

So, the matrix \(U = \left( {\begin{array}{*{20}{c}}{ - 1}&0&1\\0&0&1\\0&1&1\end{array}} \right)\).

The SVD of A can be written as,

\(\begin{array}{c}A = U\Sigma {V^T}\\ = \left( {\begin{array}{*{20}{c}}{ - 1}&0&1\\0&0&1\\0&1&1\end{array}} \right)\left( {\begin{array}{*{20}{c}}{3\sqrt 2 }&0\\0&{\sqrt 2 }\\0&0\end{array}} \right)\left( {\begin{array}{*{20}{c}}{ - \frac{1}{{\sqrt 2 }}}&{\frac{1}{{\sqrt 2 }}}\\{\frac{1}{{\sqrt 2 }}}&{\frac{1}{{\sqrt 2 }}}\end{array}} \right)\end{array}\)

Hence, the SVD of the given matrix is, \(A = \left( {\begin{array}{*{20}{c}}{ - 1}&0&1\\0&0&1\\0&1&1\end{array}} \right)\left( {\begin{array}{*{20}{c}}{3\sqrt 2 }&0\\0&{\sqrt 2 }\\0&0\end{array}} \right)\left( {\begin{array}{*{20}{c}}{ - \frac{1}{{\sqrt 2 }}}&{\frac{1}{{\sqrt 2 }}}\\{\frac{1}{{\sqrt 2 }}}&{\frac{1}{{\sqrt 2 }}}\end{array}} \right)\).

Unlock Step-by-Step Solutions & Ace Your Exams!

  • Full Textbook Solutions

    Get detailed explanations and key concepts

  • Unlimited Al creation

    Al flashcards, explanations, exams and more...

  • Ads-free access

    To over 500 millions flashcards

  • Money-back guarantee

    We refund you if you fail your exam.

Over 30 million students worldwide already upgrade their learning with 91影视!

One App. One Place for Learning.

All the tools & learning materials you need for study success - in one app.

Get started for free

Most popular questions from this chapter

Suppose A is invertible and orthogonally diagonalizable. Explain why \({A^{ - {\bf{1}}}}\) is also orthogonally diagonalizable.

(M) Orhtogonally diagonalize the matrices in Exercises 37-40. To practice the methods of this section, do not use an eigenvector routine from your matrix program. Instead, use the program to find the eigenvalues, and for each eigenvalue \(\lambda \), find an orthogonal basis for \({\bf{Nul}}\left( {A - \lambda I} \right)\), as in Examples 2 and 3.

38. \(\left( {\begin{aligned}{{}}{.{\bf{63}}}&{ - .{\bf{18}}}&{ - .{\bf{06}}}&{ - .{\bf{04}}}\\{ - .{\bf{18}}}&{.{\bf{84}}}&{ - .{\bf{04}}}&{.{\bf{12}}}\\{ - .{\bf{06}}}&{ - .{\bf{04}}}&{.{\bf{72}}}&{ - .{\bf{12}}}\\{ - .{\bf{04}}}&{.{\bf{12}}}&{ - .{\bf{12}}}&{.{\bf{66}}}\end{aligned}} \right)\)

Question: If A is \(m \times n\), then the matrix \(G = {A^T}A\) is called the Gram matrix of A. In this case, the entries of G are the inner products of the columns of A. (See Exercises 9 and 10).

9. Show that the Gram matrix of any matrix A is positive semidefinite, with the same rank as A. (See the Exercises in Section 6.5.)

Orthogonally diagonalize the matrices in Exercises 13鈥22, giving an orthogonal matrix\(P\)and a diagonal matrix\(D\). To save you time, the eigenvalues in Exercises 17鈥22 are: (17)\( - {\bf{4}}\), 4, 7; (18)\( - {\bf{3}}\),\( - {\bf{6}}\), 9; (19)\( - {\bf{2}}\), 7; (20)\( - {\bf{3}}\), 15; (21) 1, 5, 9; (22) 3, 5.

18. \(\left( {\begin{aligned}{{}}1&{ - 6}&4\\{ - 6}&2&{ - 2}\\4&{ - 2}&{ - 3}\end{aligned}} \right)\)

In Exercises 17鈥24, \(A\) is an \(m \times n\) matrix with a singular value decomposition \(A = U\Sigma {V^T}\) , where \(U\) is an \(m \times m\) orthogonal matrix, \({\bf{\Sigma }}\) is an \(m \times n\) 鈥渄iagonal鈥 matrix with \(r\) positive entries and no negative entries, and \(V\) is an \(n \times n\) orthogonal matrix. Justify each answer.

23. Let \(U = \left( {{u_1}...{u_m}} \right)\) and \(V = \left( {{v_1}...{v_n}} \right)\) where the \({{\bf{u}}_i}\) and \({{\bf{v}}_i}\) are in Theorem 10. Show that \(A = {\sigma _1}{u_1}v_1^T + {\sigma _2}{u_2}v_2^T + ... + {\sigma _r}{u_r}v_r^T\).

See all solutions

Recommended explanations on Math Textbooks

View all explanations

What do you think about this solution?

We value your feedback to improve our textbook solutions.

Study anywhere. Anytime. Across all devices.