Detecting Outliers

Statistics · Axiom Academy

Learn to identify data points that deviate significantly from the rest of your dataset 1. Visual Inspection of Outliers The first and most intuitive method for detecting outliers is visual inspection. Box plots and scatter plots make outliers immediately apparent as points that lie far from the main cluster of data. What makes a point an outlier? An outlier is a data point that is unusually far from other values in the dataset. It can occur due to: Measurement errors: Equipment malfunction or human error Data entry errors: Typos or incorrect units Natural variation: Legitimate extreme values in the population Experimental conditions: Unusual circumstances during data collection 2. The IQR Method (1.5 × IQR Rule) The Interquartile Range (IQR) method is a robust, widely-used technique for identifying outliers. It's based on the spread of the middle 50% of the data. Calculate Q1 (25th percentile) and Q3 (75th percentile) Determine lower fence: Q1 - 1.5 × IQR Determine upper fence: Q3 + 1.5 × IQR Any data point below the lower fence or above the upper fence is an outlier The z-score method identifies outliers by measuring how many standard deviations a data point is from the mean. This method assumes the data follows a normal distribution. Calculate the mean (μ) and standard deviation (σ) of the data For each data point x, compute its z-score: z = (x - μ) / σ Common threshold: |z| > 3 indicates an outlier Sometimes |z| > 2 is used for a more sensitive detection

This is the written version of the interactive lesson above. See the full Statistics course.