Solve the following pair of linear equations: 62x + 37y = 13 37x + 62y = -112

The problem with the row picture of a $2\times 2$ systems of linear equations is that it does not extend very well to larger $m\times n$ systems of linear equations. To extend our ideas of consistent and independent to larger $m\times n$ systems of linear equations, we need to view the same three systems using the column picture . Recall our three $2\times 2$ systems of linear equations

$$\begin{array}{lrcl} \text{1.} & x_1 + x_2 & = &\ \ 3 \\ & x_1 - x_2 & = & -1 \end{array}\qquad \begin{array}{lrcl}\ \ 2. & x_1 - x_2 & = & -1 \\ & x_1 - x_2 & = &\ \ 1 \end{array}\qquad \begin{array}{lrcl}\ \ 3. & x_1 +\ \ x_2 & = & 3 \\ & 3x_1 + 3x_2 & = & 9 \end{array}$$
Let us re-write the first linear system in vector form .

$$1.\ \ \begin{bmatrix} x_1 + x_2 \\ x_1 - x_2 \end{bmatrix} = \begin{bmatrix} x_1 \\ x_1 \end{bmatrix} + \begin{bmatrix}\ \ x_2 \\ -x_2 \end{bmatrix} = x_1\begin{bmatrix} 1 \\ 1 \end{bmatrix} + x_2\begin{bmatrix} \ \ 1 \\ -1 \end{bmatrix} = \begin{bmatrix}\ \ 3 \\ -1 \end{bmatrix}$$
Notice that we start out with a column vector on the left side of the equation

$$\begin{bmatrix} x_1 + x_2 \\ x_1 - x_2 \end{bmatrix}$$
This vector equals the vector on the right side of the equation

$$\begin{bmatrix}\ \ 3 \\ -1 \end{bmatrix}$$
However, we use vector arithmetic, vector addition and scalar multiplication , to write the algebraic expression on the left-hand side of the equation as a linear combination .

$$x_1\begin{bmatrix} 1 \\ 1 \end{bmatrix} + x_2\begin{bmatrix} \ \ 1 \\ -1 \end{bmatrix}$$

A linear combination of vectors, multiplying vectors by scalars and adding them together, is one of the fundamental ideas of this course. You should take the time to recognize a linear combination each time it appears in your notes, the videos, the lectures, or these notes.

This gives us the vector equation

$$x_1\begin{bmatrix} 1 \\ 1 \end{bmatrix} + x_2\begin{bmatrix} \ \ 1 \\ -1 \end{bmatrix} = \begin{bmatrix}\ \ 3 \\ -1 \end{bmatrix}$$
In English this equation says that some unknown linear combination of vectors $\begin{bmatrix} 1 \\ 1 \end{bmatrix}$ and $\begin{bmatrix} \ \ 1 \\ -1 \end{bmatrix}$ gives us the vector $\begin{bmatrix} \ \ 3 \\ -1 \end{bmatrix}$. If we use variables for our vectors, we need to decorate them with a bar above or below the letter, or we type them in bold to indicate that the variable is a vector and not a scalar.

Typical Vector Notations:

  1. Arrows over $$\overrightarrow{v_1},\ \ \overrightarrow{v_2}$$
  2. Underlining $$\underline{v_1},\ \ \underline{v_2}$$
  3. Bold face $$\mathbf{v}_1,\ \ \mathbf{v}_2$$
  4. Hats $$ \hat{\imath},\ \ \hat{\mathbf{x}} $$

Bold face will be preferred in these notes, while arrows over or underlining will be the preferred method for handwritten work. The hatted vectors are typically reserved for special cases, such as the canonical basis vectors $\hat{\imath}$, $\hat{\jmath}$, and $\hat{k}$ or a "changed" or shifted vector $\mathbf{x}\mapsto\hat{\mathbf{x}}$. These will be discussed in more detail when they come up.

If we name our vectors $\mathbf{v}_1$ and $\mathbf{v}_2$, then we have

$$ \mathbf{v}_1 = \begin{bmatrix} 1 \\ 1 \end{bmatrix},\qquad \mathbf{v}_2 = \begin{bmatrix}\ \ 1 \\ -1 \end{bmatrix}$$
We typically name the vector on the right-hand side of the equation $\mathbf{b}$. Our system of equations can now be written

$$ x_1\mathbf{v}_1 + x_2\mathbf{v}_2 = \mathbf{b}. $$

Solve the following pair of linear equations: 62x + 37y = 13 37x + 62y = -112

Since $1\,\mathbf{v}_1 + 2\,\mathbf{v}_2 = \mathbf{b}$, we have $x_1=1$ and $x_2=2$, so our unique solution is the vector

$$\begin{bmatrix} x_1 \\ x_2 \end{bmatrix} = \begin{bmatrix} 1 \\ 2 \end{bmatrix}$$

When there is any linear combination of the two vectors $\mathbf{v}_1$ and $\mathbf{v}_2$ that equals $\mathbf{b}$, the linear system is called consistent .
When the vectors $\mathbf{v}_1$ and $\mathbf{v}_2$ point in different directions; that is they have different slopes, the linear system is called linearly independent .

Let us write the second system of linear equations in vector form.

$$\begin{bmatrix} x_1-x_2 \\ x_1-x_2 \end{bmatrix} = \begin{bmatrix} x_1 \\ x_1 \end{bmatrix} + \begin{bmatrix} -x_2 \\ -x_2 \end{bmatrix} = x_1\begin{bmatrix} 1 \\ 1 \end{bmatrix} + x_2\begin{bmatrix} -1 \\ -1 \end{bmatrix} = \begin{bmatrix} \ \ 1 \\ -1 \end{bmatrix}$$
In this case, $\mathbf{v}_1 = \begin{bmatrix} 1 \\ 1 \end{bmatrix}$ and $\mathbf{v}_2 = \begin{bmatrix} -1 \\ -1 \end{bmatrix} = -\mathbf{v}_1$. In the language of our linear algebra videos, $\mathbf{v}_1$ and $\mathbf{v}_2$ lie on the same span . They point opposite directions but they lie on the same line so that any linear combination of vectors $\mathbf{v}_1$ and $\mathbf{v}_2$ will be on that line with slope $1$ and $y$-intercept $0$.

Solve the following pair of linear equations: 62x + 37y = 13 37x + 62y = -112

These vectors are linear dependent because they are colinear. Since $\mathbf{b}$ is not a vector in their span , there is no linear combination of vectors $\mathbf{v}_1$ and $\mathbf{v}_1$ that will equal $\mathbf{b}$. This system of linear equations has no solution.

When there is no linear combination of our vectors $\mathbf{v}_1$ and $\mathbf{v}_1$ that equals $\mathbf{b}$, the linear system is called inconsistent .

When the vectors $\mathbf{v}_1$ and $\mathbf{v}_1$ belong to the same span , the linear system is called linearly dependent .

Finally, let us write the last linear system in vector form.

$$\begin{bmatrix} x_1 + x_2 \\ 3x_1 + 3x_2 \end{bmatrix} = x_1\begin{bmatrix} 1 \\ 3 \end{bmatrix} + x_2\begin{bmatrix} 1 \\ 3 \end{bmatrix} = \begin{bmatrix} 3 \\ 9 \end{bmatrix} = 3\begin{bmatrix} 1 \\ 3 \end{bmatrix} $$
Notice that $\mathbf{v}_1 = \mathbf{v}_2 = \begin{bmatrix} 1 \\ 3 \end{bmatrix}$, so they are certainly linearly dependent. Notice also that $\mathbf{b} = 3\begin{bmatrix} 1 \\ 3 \end{bmatrix}$. Our vector equation becomes

$$ \left(x_1 + x_2\right)\begin{bmatrix} 1 \\ 3 \end{bmatrix} = 3\begin{bmatrix} 1 \\ 3 \end{bmatrix}$$
Thus we have

$$x_1 + x_2 = 3.$$

Solve the following pair of linear equations: 62x + 37y = 13 37x + 62y = -112

We obtain an equation for $x_1$ and $x_2$ that has infinitely many solutions, $x_1 + x_2 = 3$. We could plot this equation on a Cartesian plane, and the set of solutions is a line with slope $-1$ and $y$-intercept $3$. All of the points $(x_1, x_2)$ on this line gives us a solution to the linear system. This linear system has infinitely many solutions.

When there are infinitely many solutions to a system of linear equations, the system is still called consistent .

When the vectors $\mathbf{v}_1$ and $\mathbf{v}_1$ belong to the same span , the linear system is called linearly dependent .

The column picture is more useful to use because we can apply the same ideas to larger systems of $m$ equations and $n$ unknowns.