Loss of Significance

Numerical Analysis · Axiom Academy

When subtraction destroys precision When two numbers share many leading digits, subtraction causes massive precision loss: Many common formulas suffer from loss of significance under certain conditions: We can often reformulate expressions to avoid cancellation: Many programming languages provide special functions designed to avoid cancellation:

This is the written version of the interactive lesson above. See the full Numerical Analysis course.