This is one of the following four articles on Correlations in Excel
Overview of Correlation In Excel 2010 and Excel 2013
Pearson Correlation in 3 Steps in Excel 2010 and Excel 2013
Pearson Correlation – Calculating r Critical and p Value of r in Excel
Spearman Correlation in 6 Steps in Excel 2010 and Excel 2013
Pearson Correlation
Coefficient r in 3 Steps in
Excel
Pearson’s Correlation Coefficient, r, is widely used as a measure of linear dependency between two variables. Pearson’s Correlation Coefficient is also referred to as Pearson’s r or Pearson’s Product Moment Correlation Coefficient.
r2 is denoted as R Square and tells how well data points fit a line or curve. In simple linear regression, R Square is simply the square of the correlation coefficient between the dependent variable (the Y values) and the single independent variable (the X values). R Square represents the proportion of the total variance of the Y values can be explained by the variance of the X values. R Square takes can assume values from 0 to +1.
Pearson’s Correlation Coefficient, r, can assume values from -1 to +1.
A value of +1 indicates that two variables have a perfect positive correlation. A perfect positive correlation means that one of the variables moves exactly the same positive amount for each unit positive change in the other variable. A scatterplot of linear data having a Pearson Correlation, r, near +1 is as follows:
(Click On Image To See a Larger Version)
An r value of -1 indicates that two variables have a perfect negative correlation. A perfect negative correlation means that one of the variables moves exactly the same negative amount for each unit positive change in the other variable. A scatterplot of linear data having a Pearson Correlation, r, near -1 is as follows:
(Click On Image To See a Larger Version)
An r value near 0 indicates very low correlation between two variables. The movements of one variable have a very low correspondence with the movements of the other variable. A scatterplot of linear data having a Pearson Correlation, r, near 0 is as follows:
(Click On Image To See a Larger Version)
Pearson Correlation’s Six
Required Assumptions
1) The both variables are either interval or ratio data.
2) The Pearson Correlation is most accurate when the variables are approximately normally distribution. Normality is not an absolute requirement for applying the Pearson Correlation though. The text indicates that it is, but that is incorrect. I have uploaded an Excel workbook to the Doc Sharing folder that automatically checks normality by creates a Normal Probability Plot for input data.
3) The relationship is reasonably linear. This can be seen on an X-Y scatterplot.
4) Outliers are removed or kept to a minimum. Outliers can badly skew the Pearson correlation.
5) Each variable has approximately the same variance. In statistical terms, variables with the same variance are said to be homoscedastistic. Variance in data sets can be compared using the nonparametric tests Levene’s Test and the Brown-Forsythe Test. The F Test (available in Excel both as a function and as a Data Analysis tool) can be used to compare variance in data sets but is highly sensitive to non-normality of data.
6) There is a monotonic relationship between the two variables.
Pearson’s Correlation can be applied to a population or to a sample.
Pearson Correlation Formulas
Pearson’s Correlation when applied to a population is referred to as the Population Pearson’s Correlation Coefficient or simply the Population Correlation Coefficient. The Population Pearson Correlation Coefficient is designated by the symbol ρ (Greek letter “rho”) and is calculated by the following formula:
(Click On Image To See a Larger Version)
Pearson’s Correlation when applied to a sample is referred to as the Sample Pearson’s Correlation Coefficient or simply the Sample Correlation Coefficient. The Population Pearson Correlation Coefficient is designated by the symbol r or rxy and is equal to the sample covariance between two variables divided by the product of their sample standard deviations as given by the following formula:
(Click On Image To See a Larger Version)
sxy is the Sample Covariance between variables x and y and is calculated by the following formula:
(Click On Image To See a Larger Version)
sx is the Sample Standard Deviation of variable x and is calculated by the following formula:
(Click On Image To See a Larger Version)
sy is the Sample Standard Deviation of variable y and is calculated by the following formula:
(Click On Image To See a Larger Version)
Example of Pearson Correlation
in Excel
Pearson Correlation Step 1 – Create a Scatterplot of the Data
Before calculating the Pearson Correlation between two variables, it is a good idea to create an X-Y scatterplot to determine if there appears to be a linear relationship between the two. Following is an example of creating an Excel scatterplot of a sample of X-Y data. The chart type in Excel is an X-Y scatterplot with only markers using Chart Layout 3, Style 2. A Least-Squares Line is created using Chart Layout 3.
The chart appears as follows:
(Click On Image To See a Larger Version)
The scatterplot chart shows a strong linear relationship between the two variables X and Y. The Pearson correlation would be the correct choice to determine the correlation between the two variables.
Pearson Correlation Step 2 – Calculate r in Excel With One of Three Methods
The Pearson Sample Correlation Coefficient, rxy, can be calculated using any of the three following methods in Excel:
1) Data Analysis Correlation Tool This tool can also be used to create a correlation matrix between more than two variables. An example of this will be performed later in this section.
2) Correlation Formula The correlation formula which is the following:
CORREL(array1, array2)
3) Covariance Formula The sample covariance between two variables divided by the product of their sample standard deviations as given by the following formula:
COVARIANCE.S(array1, array2)*STDEV.S(array1)* STDEV.S(array2)
These three methods are implemented in Excel as follows:
(Click On Image To See a Larger Version)
Pearson Correlation Step 3 - Determine Whether r Is Significant
After calculating the Pearson Correlation Coefficient, r, between two data sets, the significance of r should be checked. If r has been calculated based upon just a few pairs of numbers, it is difficult to determine whether this calculated correlation really exists between the two sets of numbers or if that calculated r is just a random occurrence because there are so few data pairs.
On the other hand, if the r is calculated from a large number of data pairs, the certainty level is much higher the calculated correlation r really does exist between the two sets of numbers.
There are two equivalent ways to determine whether or not the calculated r should be considered significant at a given α. These two methods are the following:
a) Calculate the p value and compare it to the specified α
b) Calculate r Critical and compare it to r
The blog article that followings this one will perform calculations a) and b) to determine whether r is significant.
Performing Correlation Analysis
On More Than 3 Variables
As mentioned, the Data Analysis Correlation tool can be used to create a correlation matrix if there are more than two variables. An example of creating a correlation matrix between three variables is shown as follows:
(Click On Image To See a Larger Version)
Each r must be evaluated separately to determine if that r is significant. A correlation coefficient r is significant if its calculated p Value is less than alpha or, equivalently, if the r is greater than r Critical. The p value and r Critical are calculated in the same way as before with the following formulas:
(Click On Image To See a Larger Version)
(Click On Image To See a Larger Version)
Excel Master Series Blog Directory
Statistical Topics and Articles In Each Topic
- Histograms in Excel
- Bar Chart in Excel
- Combinations & Permutations in Excel
- Normal Distribution in Excel
- Overview of the Normal Distribution
- Normal Distribution’s PDF (Probability Density Function) in Excel 2010 and Excel 2013
- Normal Distribution’s CDF (Cumulative Distribution Function) in Excel 2010 and Excel 2013
- Solving Normal Distribution Problems in Excel 2010 and Excel 2013
- Overview of the Standard Normal Distribution in Excel 2010 and Excel 2013
- An Important Difference Between the t and Normal Distribution Graphs
- The Empirical Rule and Chebyshev’s Theorem in Excel – Calculating How Much Data Is a Certain Distance From the Mean
- Demonstrating the Central Limit Theorem In Excel 2010 and Excel 2013 In An Easy-To-Understand Way
- t-Distribution in Excel
- Binomial Distribution in Excel
- z-Tests in Excel
- Overview of Hypothesis Tests Using the Normal Distribution in Excel 2010 and Excel 2013
- One-Sample z-Test in 4 Steps in Excel 2010 and Excel 2013
- 2-Sample Unpooled z-Test in 4 Steps in Excel 2010 and Excel 2013
- Overview of the Paired (Two-Dependent-Sample) z-Test in 4 Steps in Excel 2010 and Excel 2013
- t-Tests in Excel
- Overview of t-Tests: Hypothesis Tests that Use the t-Distribution
- 1-Sample t-Tests in Excel
- 1-Sample t-Test in 4 Steps in Excel 2010 and Excel 2013
- Excel Normality Testing For the 1-Sample t-Test in Excel 2010 and Excel 2013
- 1-Sample t-Test – Effect Size in Excel 2010 and Excel 2013
- 1-Sample t-Test Power With G*Power Utility
- Wilcoxon Signed-Rank Test in 8 Steps As a 1-Sample t-Test Alternative in Excel 2010 and Excel 2013
- Sign Test As a 1-Sample t-Test Alternative in Excel 2010 and Excel 2013
- 2-Independent-Sample Pooled t-Tests in Excel
- 2-Independent-Sample Pooled t-Test in 4 Steps in Excel 2010 and Excel 2013
- Excel Variance Tests: Levene’s, Brown-Forsythe, and F Test For 2-Sample Pooled t-Test in Excel 2010 and Excel 2013
- Excel Normality Tests Kolmogorov-Smirnov, Anderson-Darling, and Shapiro Wilk Tests For Two-Sample Pooled t-Test
- Two-Independent-Sample Pooled t-Test - All Excel Calculations
- 2- Sample Pooled t-Test – Effect Size in Excel 2010 and Excel 2013
- 2-Sample Pooled t-Test Power With G*Power Utility
- Mann-Whitney U Test in 12 Steps in Excel as 2-Sample Pooled t-Test Nonparametric Alternative in Excel 2010 and Excel 2013
- 2- Sample Pooled t-Test = Single-Factor ANOVA With 2 Sample Groups
- 2-Independent-Sample Unpooled t-Tests in Excel
- 2-Independent-Sample Unpooled t-Test in 4 Steps in Excel 2010 and Excel 2013
- Variance Tests: Levene’s Test, Brown-Forsythe Test, and F-Test in Excel For 2-Sample Unpooled t-Test
- Excel Normality Tests Kolmogorov-Smirnov, Anderson-Darling, and Shapiro-Wilk For 2-Sample Unpooled t-Test
- 2-Sample Unpooled t-Test Excel Calculations, Formulas, and Tools
- Effect Size for a 2-Independent-Sample Unpooled t-Test in Excel 2010 and Excel 2013
- Test Power of a 2-Independent Sample Unpooled t-Test With G-Power Utility
- Paired (2-Sample Dependent) t-Tests in Excel
- Paired t-Test in 4 Steps in Excel 2010 and Excel 2013
- Excel Normality Testing of Paired t-Test Data
- Paired t-Test Excel Calculations, Formulas, and Tools
- Paired t-Test – Effect Size in Excel 2010, and Excel 2013
- Paired t-Test – Test Power With G-Power Utility
- Wilcoxon Signed-Rank Test in 8 Steps As a Paired t-Test Alternative
- Sign Test in Excel As A Paired t-Test Alternative
- Hypothesis Tests of Proportion in Excel
- Hypothesis Tests of Proportion Overview (Hypothesis Testing On Binomial Data)
- 1-Sample Hypothesis Test of Proportion in 4 Steps in Excel 2010 and Excel 2013
- 2-Sample Pooled Hypothesis Test of Proportion in 4 Steps in Excel 2010 and Excel 2013
- How To Build a Much More Useful Split-Tester in Excel Than Google's Website Optimizer
- Chi-Square Independence Tests in Excel
- Chi-Square Goodness-Of-Fit Tests in Excel
- F Tests in Excel
- Correlation in Excel
- Pearson Correlation in Excel
- Spearman Correlation in Excel
- Confidence Intervals in Excel
- z-Based Confidence Intervals of a Population Mean in 2 Steps in Excel 2010 and Excel 2013
- t-Based Confidence Intervals of a Population Mean in 2 Steps in Excel 2010 and Excel 2013
- Minimum Sample Size to Limit the Size of a Confidence interval of a Population Mean
- Confidence Interval of Population Proportion in 2 Steps in Excel 2010 and Excel 2013
- Min Sample Size of Confidence Interval of Proportion in Excel 2010 and Excel 2013
- Simple Linear Regression in Excel
- Overview of Simple Linear Regression in Excel 2010 and Excel 2013
- Complete Simple Linear Regression Example in 7 Steps in Excel 2010 and Excel 2013
- Residual Evaluation For Simple Regression in 8 Steps in Excel 2010 and Excel 2013
- Residual Normality Tests in Excel – Kolmogorov-Smirnov Test, Anderson-Darling Test, and Shapiro-Wilk Test For Simple Linear Regression
- Evaluation of Simple Regression Output For Excel 2010 and Excel 2013
- All Calculations Performed By the Simple Regression Data Analysis Tool in Excel 2010 and Excel 2013
- Prediction Interval of Simple Regression in Excel 2010 and Excel 2013
- Multiple Linear Regression in Excel
- Basics of Multiple Regression in Excel 2010 and Excel 2013
- Complete Multiple Linear Regression Example in 6 Steps in Excel 2010 and Excel 2013
- Multiple Linear Regression’s Required Residual Assumptions
- Normality Testing of Residuals in Excel 2010 and Excel 2013
- Evaluating the Excel Output of Multiple Regression
- Estimating the Prediction Interval of Multiple Regression in Excel
- Regression - How To Do Conjoint Analysis Using Dummy Variable Regression in Excel
- Logistic Regression in Excel
- Logistic Regression Overview
- Logistic Regression in 6 Steps in Excel 2010 and Excel 2013
- R Square For Logistic Regression Overview
- Excel R Square Tests: Nagelkerke, Cox and Snell, and Log-Linear Ratio in Excel 2010 and Excel 2013
- Likelihood Ratio Is Better Than Wald Statistic To Determine if the Variable Coefficients Are Significant For Excel 2010 and Excel 2013
- Excel Classification Table: Logistic Regression’s Percentage Correct of Predicted Results in Excel 2010 and Excel 2013
- Hosmer- Lemeshow Test in Excel – Logistic Regression Goodness-of-Fit Test in Excel 2010 and Excel 2013
- Single-Factor ANOVA in Excel
- Overview of Single-Factor ANOVA
- Single-Factor ANOVA in 5 Steps in Excel 2010 and Excel 2013
- Shapiro-Wilk Normality Test in Excel For Each Single-Factor ANOVA Sample Group
- Kruskal-Wallis Test Alternative For Single Factor ANOVA in 7 Steps in Excel 2010 and Excel 2013
- Levene’s and Brown-Forsythe Tests in Excel For Single-Factor ANOVA Sample Group Variance Comparison
- Single-Factor ANOVA - All Excel Calculations
- Overview of Post-Hoc Testing For Single-Factor ANOVA
- Tukey-Kramer Post-Hoc Test in Excel For Single-Factor ANOVA
- Games-Howell Post-Hoc Test in Excel For Single-Factor ANOVA
- Overview of Effect Size For Single-Factor ANOVA
- ANOVA Effect Size Calculation Eta Squared in Excel 2010 and Excel 2013
- ANOVA Effect Size Calculation Psi – RMSSE – in Excel 2010 and Excel 2013
- ANOVA Effect Size Calculation Omega Squared in Excel 2010 and Excel 2013
- Power of Single-Factor ANOVA Test Using Free Utility G*Power
- Welch’s ANOVA Test in 8 Steps in Excel Substitute For Single-Factor ANOVA When Sample Variances Are Not Similar
- Brown-Forsythe F-Test in 4 Steps in Excel Substitute For Single-Factor ANOVA When Sample Variances Are Not Similar
- Two-Factor ANOVA With Replication in Excel
- Two-Factor ANOVA With Replication in 5 Steps in Excel 2010 and Excel 2013
- Variance Tests: Levene’s and Brown-Forsythe For 2-Factor ANOVA in Excel 2010 and Excel 2013
- Shapiro-Wilk Normality Test in Excel For 2-Factor ANOVA With Replication
- 2-Factor ANOVA With Replication Effect Size in Excel 2010 and Excel 2013
- Excel Post Hoc Tukey’s HSD Test For 2-Factor ANOVA With Replication
- 2-Factor ANOVA With Replication – Test Power With G-Power Utility
- Scheirer-Ray-Hare Test Alternative For 2-Factor ANOVA With Replication
- Two-Factor ANOVA Without Replication in Excel
- Randomized Block Design ANOVA in Excel
- Repeated-Measures ANOVA in Excel
- Single-Factor Repeated-Measures ANOVA in 4 Steps in Excel 2010 and Excel 2013
- Sphericity Testing in 9 Steps For Repeated Measures ANOVA in Excel 2010 and Excel 2013
- Effect Size For Repeated-Measures ANOVA in Excel 2010 and Excel 2013
- Friedman Test in 3 Steps For Repeated-Measures ANOVA in Excel 2010 and Excel 2013
- ANCOVA in Excel
- Normality Testing in Excel
- Creating a Box Plot in 8 Steps in Excel
- Creating a Normal Probability Plot With Adjustable Confidence Interval Bands in 9 Steps in Excel With Formulas and a Bar Chart
- Chi-Square Goodness-of-Fit Test For Normality in 9 Steps in Excel
- Kolmogorov-Smirnov, Anderson-Darling, and Shapiro-Wilk Normality Tests in Excel
- Nonparametric Testing in Excel
- Mann-Whitney U Test in 12 Steps in Excel
- Wilcoxon Signed-Rank Test in 8 Steps in Excel
- Sign Test in Excel
- Friedman Test in 3 Steps in Excel
- Scheirer-Ray-Hope Test in Excel
- Welch's ANOVA Test in 8 Steps Test in Excel
- Brown-Forsythe F Test in 4 Steps Test in Excel
- Levene's Test and Brown-Forsythe Variance Tests in Excel
- Chi-Square Independence Test in 7 Steps in Excel
- Chi-Square Goodness-of-Fit Tests in Excel
- Chi-Square Population Variance Test in Excel
- Post Hoc Testing in Excel
- Creating Interactive Graphs of Statistical Distributions in Excel
- Interactive Statistical Distribution Graph in Excel 2010 and Excel 2013
- Interactive Graph of the Normal Distribution in Excel 2010 and Excel 2013
- Interactive Graph of the Chi-Square Distribution in Excel 2010 and Excel 2013
- Interactive Graph of the t-Distribution in Excel 2010 and Excel 2013
- Interactive Graph of the t-Distribution’s PDF in Excel 2010 and Excel 2013
- Interactive Graph of the t-Distribution’s CDF in Excel 2010 and Excel 2013
- Interactive Graph of the Binomial Distribution in Excel 2010 and Excel 2013
- Interactive Graph of the Exponential Distribution in Excel 2010 and Excel 2013
- Interactive Graph of the Beta Distribution in Excel 2010 and Excel 2013
- Interactive Graph of the Gamma Distribution in Excel 2010 and Excel 2013
- Interactive Graph of the Poisson Distribution in Excel 2010 and Excel 2013
- Solving Problems With Other Distributions in Excel
- Solving Uniform Distribution Problems in Excel 2010 and Excel 2013
- Solving Multinomial Distribution Problems in Excel 2010 and Excel 2013
- Solving Exponential Distribution Problems in Excel 2010 and Excel 2013
- Solving Beta Distribution Problems in Excel 2010 and Excel 2013
- Solving Gamma Distribution Problems in Excel 2010 and Excel 2013
- Solving Poisson Distribution Problems in Excel 2010 and Excel 2013
- Optimization With Excel Solver
- Maximizing Lead Generation With Excel Solver
- Minimizing Cutting Stock Waste With Excel Solver
- Optimal Investment Selection With Excel Solver
- Minimizing the Total Cost of Shipping From Multiple Points To Multiple Points With Excel Solver
- Knapsack Loading Problem in Excel Solver – Optimizing the Loading of a Limited Compartment
- Optimizing a Bond Portfolio With Excel Solver
- Travelling Salesman Problem in Excel Solver – Finding the Shortest Path To Reach All Customers
- Chi-Square Population Variance Test in Excel
- Analyzing Data With Pivot Tables
- SEO Functions in Excel
- Time Series Analysis in Excel
- VLOOKUP
No comments:
Post a Comment