Circles Sines and Signals - Complex Numbers

A PEP TALK

IMAGINARY, COMPLEX, AND TRANSCENDENTAL NUMBERS. OH MY!

You only need a cursory understanding of imaginary and complex numbers to be able to understand the Discrete Fourier Transform.¹ While it is true that the output of the DFT is always given in complex numbers, and the formula itself contains a particularly abstruse bit involving the imaginary number i,

$$e^{-\varphi \mathrm{i}}$$

my advice is to not let the presence of i, e, and the complex numbers discourage you. In the next two sections we’ll reacquaint ourselves with imaginary and complex numbers, and see that the exponentiated e is simply an interesting mathematical shorthand for referring to our two familiar friends, the sine and cosine wave. I’m not trying to say that Euler’s formula is just some wacky bit of syntactic sugar. However, for someone who just wants to understand how the DFT works, it’s really not crucially important to have a deep understanding of Euler’s formula.

1. We're only scratching the surface here. If you need a complete refresher, I somewhat weirdly suggest reading John and Betty’s Journey into Complex Numbers. Don't let the illustrations dissuade you. It’s a far better piece of mathematical explication than I could hope to write. You'll need to do some crafty googling to find it!

After that, I suggest listening to this broadcast of In Our Time where an enthusiastic Marcus Du Sautoy will guide you through the history of imaginary numbers. You'll learn all about Gauss, and the two-dimensional representation of complex numbers that was discovered by Gauss and Argand. It's really fun!

THE NUMBER i

IMAGINARY NUMBERS

There are different types of numbers. Most people are accustomed to two common types: positive and negative numbers. We can convert a positive number into its negative counterpart by multiplying it by -1. You can choose to think of this as a horizontal “flip” or rotation of 180° around a pivot which lies at zero. Multiplying a negative number by -1 performs yet another rotation of 180°, flipping the number back onto the positive axis.

Given this geometric interpretation, you might wonder if it’s possible to perform a rotation of less than 180°. At first glance, this notion seems absurd.² Numbers which lie off the horizontal axis have no apparent meaning. What exactly does it mean to rotate a number off of the number line? What happens to the number when it leaves the number line? More confounding is the fact that it’s entirely unclear how we would perform this rotation. What number would we multiply by to perform a rotation of say, 90°?

If you’re thinking of using zero to perform the rotation, that’s a good idea but it wont work. We need to ensure that the number we use to rotate by 90° can also be used to rotate by 180°. In other words, we should be able to rotate 180° by first rotating 90°, and then rotating by 90° again. If we use zero, we cannot perform multiple rotations. Once we multiply once by zero, we can never recover the original number. After ruling out zero, you can try a zillion other “normal” numbers but you’ll never find one that performs this special rotation of 90°. The number simply doesn’t exist. This is where the number i comes in. The number i is an invention. It’s specially constructed to perform this 90° rotation and is defined as,

i² = -1

Since this number is an invention, we call it an imaginary number. If we multiply any real number by an imaginary number, we rotate it by 90° and append an i to the symbolic name. After the multiplication by i it lies on the imaginary axis and becomes an imaginary number. Let’s see what happens when we rotate the real number 5 four times via multiplication with i.

^{Rotate by 90°}
5 × i = 5i

^{Rotate again by 90°}
5i × i = 5 × i² = 5 × -1 = -5

^{Rotate again by 90°}
-5 × i = -5i

^{Rotate again by 90°}
-5i × i = -5 × i² = -5 × -1 = 5

Visually Describing Rotation Using i

2. The Greek mathematician Diophantus found the notion of negative numbers as solutions to algebraic equations absurd. You too would probably find the idea of negative numbers absurd if our society wasn’t so accustomed to the notion of debt.

I think people have such a hard time with imaginary numbers because of their invented nature. Most of us are taught mathematics as a series of truths, not as a toolkit for thought. The idea of adding things to the toolkit or building your own tools is so foreign to most people that the idea induces some strange mixture of mental pain, anxiety, and confusion.

COMPLEX NUMBERS

AND THE COMPLEX PLANE

Figure 1. The Complex Plane
_{Click and Drag to Move the Point}

A complex number is a number which has both a real and an imaginary part. Complex numbers are represented a bit oddly. They look like a sum, where the real part is the first number, and the imaginary part is the second. Click and drag in the visualization to the left to see how different points on the complex plane are represented.

+ +

The magnitude of a complex number is the length of a line which runs from the origin to the point. If you view the whole thing as a right triangle, the magnitude corresponds to the length of the hypotenuse of the triangle. Its length can be calculated using the Pythagorean theorem.²

Magnitude² = Real² + Imag²

The phase of a complex number is usually given in radians. Note that the phase flips to a negative measure when crossing over π (3.14) radians.

2. Recall, A² + B² = C², where C is the length of the hypotenuse and A and B are the lengths of the other two sides of a right triangle.