Exploratory Data Analysis

Exploratory Data Analysis refers to a set of techniques originally developed by John Tukey to display data in such a way that interesting features will become apparent. Unlike classical methods which usually begin with an assumed model for the data, EDA techniques are used to encourage the data to suggest models that might be appropriate.

Statpoint Technologies products provide many EDA techniques, scattered throughout the statistical procedures. Some of the most important exploratory data analysis methods include:

Start Using Statgraphics Today!

Procedure Statgraphics Centurion Statgraphics
Sigma express
Statgraphics
stratus
Statgraphics
  Web Services
Stat
Beans
Box-and-Whisker Plots
Stem-and-Leaf Display
Rootogram
Resistant Time Series Smoothing
Scatterplot Smoothing
Median Polish        
Bubble Chart    
Resistant Curve Fitting  
Multi-Vari Chart        

Box-and-Whisker Plots

boxplot

Box-and-whisker plots are graphical displays based upon Tukey's 5-number summary of a data sample. In his original plot, a box is drawn covering the center 50% of the sample. A vertical line is drawn at the median, and whiskers are drawn from the central box to the smallest and largest data values. If some points are far from the box, these "outside points" may be shown as separate point symbols. Later analysts have added notches showing approximate confidence intervals for the median, and plus signs at the sample mean.

More: Box-and-Whisker Plot.pdf, Multiple Box-and-Whisker Plot.pdf

stemleaf

Stem-and-Leaf Display

Stem-and-leaf displays take each data value and divide it into a stem and a leaf. For example, the temperature of the first subject in the data sample to the left had a body temperature of 98.4 degrees. The first two digits (“98”) are called the stem and plotted at the left, while the third digit (“4”) is called the leaf. Although similar to a histogram turned on its side, Tukey thought that the stem-and-leaf plot was preferable to a barchart since the data values could be recovered from the display.

More: One Variable Analysis.pdf

Rootogram

rootogram

A rootogram is similar to a histogram, except that it plots the square roots of the number of observations observed in different ranges of a quantitative variable. It is usually plotted together with a fitted distribution. The idea of using square roots is to equalize the variance of the deviations between the bars and the curve, which otherwise would increase with increasing frequency. Sometimes, the bars are suspending the from the fitted distribution, which allows for easier visual comparison with the horizontal line drawn at 0, since visual comparison with a curved line may be deceiving.

More: Distribution Fitting (Uncensored Data).pdf 

smooth

Resistant Time Series Smoothing

Tukey invented a number of nonlinear smoothers, used to smooth sequential time series data, that are very good at ignoring outliers and are often applied as a first step to reduce the influence of potential outliers before a moving average is applied. These include 3RSS, 3RSSH, 5RSS, 5RSSH, and 3RSR smoothers. Each symbol in the name of the smoother indicates an operation that is applied to the data.

More: Time Series - Smoothing.pdf

Scatterplot Smoothing

lowess

X-Y scatterplots may be smoothed using any of several methods: running means, running lines, LOWESS (locally weighted scatterplot smoothing), and resistant LOWESS. Smoothers are useful for suggesting the type of regresson model that might be appropriate to describe the relationship between two variables.

More: Graphics Options.pdf 

polish_1

Median Polish

The Median Polish procedure constructs a model for data contained in a two-way table. The model represents the contents of each cell in terms of a common value, a row effect, a column effect, and a residual. Although the model used is similar to that estimated using a two-way analysis of variance, the terms in the model are estimated using medians rather than means. This makes the estimates more resistant to the possible presence of outliers.

More: Median Polish.pdf

bubble

Bubble Chart

The Bubble Chart is an X-Y scatterplot on which the value of a third and possibly fourth variable is shown by changing the size and/or color of the point symbols. It is one way to plot multivariate data in 2 dimensions.

More: Bubble Chart.pdf

Resistant Curve Fitting

emedians

Tukey proposed a method for fitting lines and other curves that is less influenced by any outliers that might be present. Called the method of 3 medians, the data are first divided into 3 groups according to the value of X. Medians are then computed within each group, and the curve is determined from the 3 medians.

More: Simple Regression.pdf

multivari

Multi-Vari Chart

A Multi-Vari Chart is a chart designed to display multiple sources of variability in a way that enables the analyst to identify easily which factors are the most important. This exploratory data analysis technique is commonly used to display EDA data from a designed experiment prior to performing a formal statistical analysis.

More: Multi-Vari Chart.pdf

Start Using Statgraphics Today!