Chapter 05
Continuity: Unbroken Curves, Opening the Door to Derivatives
Continuity at a point means the limit exists and equals the function value there. It is the basis for differentiability and for understanding activation and loss functions in deep learning.
Math diagram by chapter
Select a chapter to see its diagram below. View the flow of basic math at a glance.
Left: continuous — the curve passes through with no gap or jump. Right: discontinuous — a hole or jump at that point.
Continuous
lim = f(a)
Discontinuous
f(a) missing or lim ≠ f(a)
Continuity means . On the graph, the curve does not break at that point.
How to read
- Left graph: is continuous at (curve passes through (2, 4) with no break).
- Right graph: if the function value is missing or differs from the limit at , it is discontinuous (hole or jump).
What is continuity?
Continuity is often described intuitively as a graph you can draw in one stroke without lifting the pencil. Mathematically, we need a precise condition: the limit as approaches must exist and equal the function value at . We write .
Three-step checklist for continuity at a point :
(1) Function value exists: must be defined (no hole).
(2) Limit exists: must exist. The left limit (as approaches from below) and right limit (from above) must be equal; if one is 0 and the other 1 (like a step), the limit does not exist and the function is discontinuous.
(3) They match: the limit and must be equal (the path exists but the bridge must not be in the wrong place).
Discontinuity makes prediction unreliable—e.g. a stock at 100 yesterday and 0 today (jump), or missing data (hole). Mathematically, continuity is the promise that if input changes only a little (), output also changes only a little ()—i.e. stability.
It is the prerequisite for differentiation. Differentiation is the slope of the tangent; if the graph is broken, there is no well-defined slope. So we need continuity before we can hope for differentiability. (Note: continuous does not always imply differentiable—a sharp corner is continuous but not differentiable.)
Robustness (avoiding butterfly effects): The AI model must be continuous so that a small amount of noise in the input does not cause a wildly wrong output. If a self-driving car misreads "stop" as "accelerate" because of a tiny scratch on a sign, that would mean the model behaved discontinuously—and that is very dangerous.
It is central to activation function design. ReLU, Sigmoid, Tanh and the like are all continuous, so information flows through the network without breaking. The loss function must be a smooth continuous surface so we can roll the ball (parameters) downhill to find the lowest point (the best answer)—gradient descent.
To check continuity at a point, verify: does exist?, is defined?, and are they equal?
Checklist:
① exists
② exists
③ limit . If any fails, the function is discontinuous at that point.
Example problems and solutions are in the table below.
- ProblemEx 1. Is continuous at ?
- SolutionSolution: , ; they match, so continuous.
- ProblemEx 2. Is continuous at ?
- SolutionSolution: is not defined → discontinuous.
- ProblemEx 3. Is continuous at ?
- SolutionSolution: , ; they match, so continuous.
| Problem | Solution |
|---|---|
| Ex 1. Is continuous at ? | Solution: , ; they match, so continuous. |
| Ex 2. Is continuous at ? | Solution: is not defined → discontinuous. |
| Ex 3. Is continuous at ? | Solution: , ; they match, so continuous. |
Problem types and how to solve
- TypePolynomial limit
- DescriptionContinuous so limit = function value
- How to get the answerSubstitute .
- TypeLinear limit
- DescriptionSame; limit equals function value
- How to get the answerSubstitute .
- TypeContinuous? (1/0)
- Description1 if continuous at that point, 0 if not
- How to get the answerCheck① exists② limit exists③ limit .
- TypeLimit at a hole
- DescriptionLimit at a point where there is a hole
- How to get the answerUse the formula (excluding the point) and let approach that point; if you can substitute, do so.
| Type | Description | How to get the answer |
|---|---|---|
| Polynomial limit | Continuous so limit = function value | Substitute . |
| Linear limit | Same; limit equals function value | Substitute . |
| Continuous? (1/0) | 1 if continuous at that point, 0 if not | Check ① exists ② limit exists ③ limit . |
| Limit at a hole | Limit at a point where there is a hole | Use the formula (excluding the point) and let approach that point; if you can substitute, do so. |
Example (polynomial · limit)
Is continuous at ?
Solution
, ; they match, so continuous. → Continuous
(1)
Example (discontinuous)
Is continuous at ?
Solution
is not defined (division by zero). → Discontinuous (0)
Example (linear · continuous)
Is continuous at ?
Solution
, ; they match, so continuous. → Continuous
(1)