Group
← Back
Part 2 of 2 · The exponential thread

The exponential thread - Why e is natural

October 8, 2023Math

In Part 1 we put on stage and called it a special constant. We did not say why.

This part does. The question is direct. Out of every possible base for an exponential, why does this strange irrational number get the name "natural"? Why not ? Why not ? What does have that they don't?

The answer is a property so simple it sounds like cheating: is the only exponential function whose slope at every point equals its height at that point. Every other base produces a function whose slope is some constant multiple of its height. Only at does that constant equal exactly .

The rest of this post unpacks that property and shows why it is not an aesthetic preference but a structural fact about calculus itself. is the calibration of the family of exponentials at which the calculus identities lose their correction factors. Every other turns out to be a stretched copy of , and the natural logarithm exists exactly to record how much each exponential differs from this calibration.

Once we see this, an entire family of physical and computational phenomena lights up. Anything that grows or decays at a rate proportional to how much of it there currently is, is in disguise. Carbon dating, capacitor charging, learning-rate schedules, softmax attention, radioactive half-life, drug clearance from the bloodstream: all reach for for the same reason.

The family of exponentials

Look at for a few different bases on the same axes. The curves share a strong family resemblance. They all pass through the point , since for every base. They all stay positive forever. They all grow without bound for . From far away, you cannot easily tell them apart.

Look closer. Each curve leaves at a different angle. The function rises gently. shoots up almost vertically. Somewhere between them, rises at exactly slope . The whole difference between the curves is a single number: the slope at the origin.

yellow: 2x (slope 0.693)·green: ex (slope 1.000)·red: 10x (slope 2.303)

Solid curves: ax. Dashed lines: tangents at (0, 1).

So far this is just an observation. There is no obvious reason to prefer one slope over another. The slope from is no better or worse than the slope from . They are different points on a continuum, and any of them could be called "the natural choice" depending on what we are looking for.

The reason stands out becomes visible only when we ask what happens to the slope away from the origin. That is the question of the next section.

Differentiating an exponential

The argument below uses the slope of an exponential function at a point, made precise. If you have worked with derivatives before, skip the box. If not, the takeaway is: the derivative of a function at a point is the slope of the curve at that one point, found by zooming in until the curve looks like a straight line and reading off the slope of that line.

▸ Show the derivative in three steps

The derivative is the slope of a curve at one specific point, made precise. Three steps build it.

Step 1: lines. A straight line has a constant slope, defined as rise over run. Pick any two points and on the line. The slope is

This is what you would read off the side of a road sign telling you how steep a hill is. The number does not depend on which two points you picked, because every point on a straight line is equally tilted.

Step 2: curves complicate things. A curve does not have one slope. It has a different slope at every point. The function is shallow near and steep out at . The function is rising at and falling at . To talk about "the slope of a curve" you have to specify which point.

Step 3: zoom in until the curve looks straight. Pick a point on the curve and a second point a small distance away. Compute the slope as if those two points were the endpoints of a line:

This is an approximation, since the actual curve between the two points is not really straight. But as gets smaller, the approximation gets better, because over a smaller interval the curve looks more and more like its tangent line. The derivative of at is the value this expression converges to in the limit:

Two pieces of notation are interchangeable. is read "f prime of x". The Leibniz form is read "d f d x" and is meant to evoke the picture of a tiny rise divided by a tiny run . They are different symbols for the same object.

Pick any base and compute the derivative of from the limit definition:

The factor pulled out of the limit because it does not depend on . The limit on the right depends only on .

Look at this limit before going further. is not a function of . The variable is bound by the limit operator, the way the index is bound by the summation symbol in . The whole expression evaluates to a single number for each fixed base , the value the ratio settles into as shrinks toward zero.

Plug in concrete values for :

The values converge to , which is exactly the slope-at-origin entry for in the table from the previous section. The same exercise for would converge to .

This match is not a coincidence. Set in the derivative formula. The left-hand side becomes the derivative of at , which is the slope at the origin by definition. The right-hand side becomes , since . So the slope at the origin and the limit are the same number: two names for the same thing.

The structural argument identifies the limit but does not compute its actual value. The box below builds intuition for what "computing a limit" means in general and explains why our particular limit needs more machinery than algebra to resolve in closed form. The closed-form answer turns out to be , the natural logarithm of the base, with the derivation saved for Part 4. For this is , matching the convergence table above. We return to in the next section.

▸ Show what 'resolving' a limit actually means

Most limits you meet do not need any tricks. If a function is continuous at the target point (no jumps, no kinks, no asymptotes), the limit is just the function's value there:

You "resolve" these by plugging in. They are not the interesting case.

The trouble starts when plugging in produces something undefined. Consider:

At both the numerator and the denominator are . The expression is not defined. But the limit is not ; that is just the form the expression takes at the target point, an indeterminate form that says nothing about the actual value the function approaches. To find the value, you have to do real work. In this case, factor the numerator as and cancel the with the denominator:

The form was an indeterminate , but the value is a clean . The factoring trick was the resolution.

Our limit is the same kind of object: an indeterminate , since both the numerator and the denominator vanish at . The value exists, and we have established it numerically (the table for converges cleanly to ). What it does not allow is the kind of cheap algebraic resolution we just used for : there is no factoring or cancellation that removes the indeterminacy. The function is not a polynomial in , so the trick does not apply.

The proper resolution requires a tool that approximates near in a more subtle way. That tool exists, and we will develop it from scratch in Part 4. For now, the structural argument above is enough. It tells us what the limit is (the slope of at the origin), even without giving us its closed form. The closed form, when Part 4 delivers it, will turn out to be .

Substitute back, and the formula reads:

Read this carefully. Every time you differentiate an exponential, you get back the same exponential, multiplied by a fixed constant. That constant is the slope at the origin.

Differentiate once and you get . Differentiate again and you get . Take the third derivative and you get . The factor keeps showing up in every formula touching .

For , the same story plays out with in place of .

For most bases, the multiplier is some awkward irrational number. It gets baked into every derivative, and into the more elaborate formulas we will meet later in this series.

Among all bases, exactly one gives a multiplier of .

is the unique base for which .

Differentiate and the multiplier is , so the derivative is just itself. Differentiate again: still . Compute any higher derivative: it is all the way down. No multiplicative correction ever appears. The same cleanness extends to other operations on that we will meet in later parts. The differential equation has as its uncluttered solution.

The interactive below lets you find that base by hand. Drag until the slope at the origin reads . The tangent line will turn green, and the slider will be sitting at .

blue: ax·yellow/green: tangent at (0, 1)·green dot: (0, 1)slope at origin = 0.69

Every exponential is a stretched e^x

We just saw that is structurally distinguished as the only exponential whose derivative equals itself, with no multiplicative correction. The next claim is stronger.

Once you have , you do not need any other exponential function. Every can be rewritten as with the input axis stretched by a single factor. The identity is

where is, by definition, the multiplier from the previous section: the slope of at the origin. (It is also the inverse function of , so . The two characterizations agree because of how was defined: the identity is the same statement as " has slope at the origin".)

Read the identity carefully. Here is why it holds.

The natural log is defined as the answer to one specific question: "what power do I raise to in order to get ?" In symbols, is the number for which . A few concrete examples:

  • , since .
  • , since .
  • , since .

So any positive number can be written as .

Now substitute that into :

The last step is the familiar exponent rule : when you raise a power to another power, the exponents multiply.

The intuition is unit conversion. Read as "multiply by a total of times". Each one of those multiplications can be replaced by multiplications by instead, since itself is . So multiplications by does the same work as multiplications by . The natural log is the conversion rate between the two ways of counting.

For : , so one multiplication by equals multiplications by .

For : , so one doubling equals multiplications by .

For : , so nothing to convert.

The picture is direct. Start with the graph of . To read the same curve as , relabel the horizontal axis: put a new tick every units along the -axis, and call those ticks "". The curve itself does not change, only the labels do. With , the new ticks land far apart on the -axis (every units): axis compressed. With , the new ticks land closer together (every units): axis stretched. With , the new ticks coincide with the original -ticks exactly: no change at all.

ln a = 0.693·axis stretched
Blue curve: y = et. The fixed reference. It does not change when you move the slider.
Colored curve: y = at, where a is the slider value. It rises slower than the blue curve when a is smaller than e, faster when a is larger. Color follows: yellow when a < e, green when a = e, red when a > e.
Tick marks below the t-axis: the spots on the t-axis where the labels 1, 2, 3 would sit if you relabeled the horizontal axis using base a instead of base e. They squeeze together when a < e, spread apart when a > e, and line up exactly with the original t-ticks when a = e.

The function is with the input multiplied by . The function is with the input multiplied by . The function is unchanged.

You might wonder if this conversion is special to at all. It is not. The same identity holds for any positive base:

for any . We could write in base , base , or any other base just as well. So why does the article always reach for and ? Because the calculus singles them out, not the algebra. The derivative of is

with the natural log appearing on the right regardless of the base . Only makes this multiplier , since . Even if we stubbornly used base in the conversion, the derivative would still drag back in. Starting from , the derivative works out to . Now by change of base, so , and the derivative simplifies to . We get the same answer either way. The natural log is forced out by the calculus, not chosen by us. is the unique calibration where the algebraic conversion factor and the calculus conversion factor are the same.

So the family of exponentials we plotted at the start is not really a family. It is one function, , viewed at different timescales. The "different bases" we drew side by side are the same curve compressed or stretched along the horizontal axis.

This is the structural reason is the natural base. It is not one exponential among many. It is the exponential that the others are derived from. The natural log is the function that records how each relates back to , and the relationship pins to the place where the relationship is the identity.

When mathematicians say is the "natural" base, this is what they mean. is the unique base at which the derivative of the exponential equals the exponential itself, with no extra factor anywhere. The same cleanness extends to other operations on the exponential and its inverse that we will meet in later parts. Pick any other base and a constant appears in every formula.

The behavioral consequence of all this is one differential equation:

The rate of change of equals . Its solutions are exactly the functions , where is whatever value took at . The generalization

has solutions . Positive gives exponential growth. Negative gives exponential decay. The whole world of "rate of change is proportional to size" lives in this one equation, which is why shows up everywhere it does.

Where e shows up

Here is a tour of the same equation in different domains. Each one has the same underlying pattern: rate of change proportional to current size.

Radioactive decay. In a sample of carbon-, every atom has the same fixed chance of decaying in any given second. So if you have atoms now, the rate of decay is proportional to , and the amount remaining drops exponentially over time. The half-life of carbon- is about years. Carbon dating uses this: a sample with half its expected carbon- stopped exchanging carbon with the air about that long ago.

Capacitor charging. When a battery charges a capacitor through a resistor, the voltage rises quickly at first and slows as the capacitor fills up. The closer it is to "full", the smaller the remaining gap, and the slower the charging. The result is the curve , where is the time constant that sets how fast the charging goes. The same shape lives inside every analog filter and audio compressor.

Newton's law of cooling. A hot cup of coffee in a cool room cools off at a rate that depends on the temperature gap. The hotter the coffee is relative to the room, the faster it loses heat. The gap between coffee and room shrinks exponentially: starting at C in a C room, the temperature follows , approaching C as the gap closes.

Drug clearance. The body removes most drugs from the bloodstream at a rate proportional to the current concentration. So the concentration decays exponentially, just like radioactive material. Dosing schedules are designed around the drug's half-life: take it every half-life, and the residual concentration in the blood stays roughly steady between doses.

Reverb tail of a struck bell. A bell, a guitar string, or a reverberating room loses energy at a rate proportional to how much energy is left, since the loss is dominated by friction and damping. The amplitude therefore decays exponentially. Audio engineers describe a room's reverb by its RT60, the time it takes for the sound level to drop by dB.

Softmax in machine learning. Neural networks turn a list of scores into a probability distribution by exponentiating each score and dividing by the sum:

The exponential is what makes the math behind training come out clean. The derivative of is itself, so when the network's loss function is differentiated, no awkward extra factors clutter the formulas. Every transformer model runs softmax billions of times per training step.

Reinforcement learning's discount factor. An agent collecting rewards over time treats future rewards as worth less than current ones. The discount is exponential: a reward steps in the future is worth of an immediate reward. Same pattern as continuous compound interest, run in reverse.

Diffusion models. Modern image generators work by gradually corrupting a training image with random noise, then teaching a model to undo the corruption step by step. The noise is added on a schedule that lets the original signal fade exponentially toward pure noise. The exponential fade is what makes the reverse process tractable.

All of the above is the real-valued story of : growth and decay, with rate proportional to current size. There is also an imaginary-valued story, where the input to is an imaginary number rather than a real one. That story turns out to be about oscillation, the unit circle, and the surprise return of and . We will get there in Part 5.

A footnote on compound interest

There is a classical route to that does not go through derivatives at all. If you compound interest more and more frequently, yearly to monthly to daily to every microsecond, the resulting amount converges:

This is one of the most-quoted ways to introduce the number, and Bernoulli stumbled into it in looking at compound interest. It is true and charming, but it does not, on its own, explain why is structurally distinguished. The compounding limit produces because compounding is itself a discrete approximation to the differential equation we already met. Money is just one place to encounter the equation.

What's next

Part 3 takes the next step on the climb. Instead of a number that grows, we look at a point that moves on a circle. The functions and track the coordinates of that point, and from the geometry alone the entire trigonometric arsenal (the sum-of-angles formulas, the double-angle identities, the Pythagorean identity) falls out. None of it will look anything like .

Then in Part 5, the connection arrives. When we plug an imaginary number into the Taylor series of , and appear in the result as the real and imaginary parts. The unit circle and the exponential are not separate stories.