## Tuesday, May 27, 2014

### Paired t-Test – Test Power With G-Power Utility

This is one of the following seven articles on Paired (2-Sample Dependent) t-Tests in Excel

Paired t-Test in 4 Steps in Excel 2010 and Excel 2013

Excel Normality Testing of Paired t-Test Data

Paired t-Test Excel Calculations, Formulas, and Tools

Paired t-Test – Effect Size in Excel 2010, and Excel 2013

Paired t-Test – Test Power With G-Power Utility

Wilcoxon Signed-Rank Test in 8 Steps As a Paired t-Test Alternative

Sign Test in Excel As A Paired t-Test Alternative

# Power of the Paired t-Test With Free Utility G*Power

The Power of a t-Test is a measure of the test’s ability to detect a difference given the following parameters:

Alpha (α)

Effect Size (d)

Sample Size (n)

Number of Tails

Power is defined by the following formula:

Power = 1 – β

Β equals the probability of a Type 2 Error. A Type 2 Error can be described as a False Negative. A false Negative represents a test not detecting a difference when a difference does exist.

1 – β = Power = the probability of a test detecting a difference when one exists.

Power is therefore a measure of the sensitivity of a statistical test. It is common to target a Power of 0.8 for statistical tests. A Power of 0.8 indicates that a test has an 80 percent probability of detecting a difference.

The four variables that are required in order to determine the Power for a one-sample t-Test are Alpha (α), Effect Size (d), Sample Size (n), and the Number of Tails. Typically alpha, Effect Size, and the Number of Tails are held constant while sample size is varied (usually increased) to achieve the desired Power for the statistical test.

Manual calculation of a test’s Power given Alpha, Effect Size, Sample Size, and the Number of Tails are quite tedious. Fortunately there are a number of free utilities online that will readily calculate a test’s statistical Power. A widely-used online Power calculation utility called G*Power is available for download from the Institute of Experimental Psychology at the University of Dusseldorf at this link:

http://www.psycho.uni-duesseldorf.de/abteilungen/aap/gpower3/

Screen shots will show how use this utility to calculate the Power for this example and also to provide a graph of Sample Size vs. Achieved Power for this example as follows:

As mentioned, the four variables that are required in order to determine Power for a one-sample t-Test are Alpha (α), Effect Size (d), Sample Size (n), and the Number of Tails.

Bring up G*Power’s initial screen and input the following information:

Test family: t-Tests

Statistical test: Difference between two dependent means (matched pairs)

Type of power analysis: Post hoc – Compute achieved power –given α, sample size, and effect size

Number of Tails = 1

Effect Size (d) = 0.523

Alpha (α) = 0.05

Sample Size (n) = 17

The completed dialogue screen appears as follows:

(Click On Image To See Larger Version)

Clicking Calculate would produce the following output:

(Click On Image To See Larger Version)

The Power achieved for this test is 0.6624. This means that the current one-tailed paired t-Test has a 66.24 percent chance of detecting a difference that has an effect size of 0.523 if α = 0.05 and n = 17.

Excel Master Series Blog Directory

Statistical Topics and Articles In Each Topic

• Histograms in Excel
• Bar Chart in Excel
• Combinations & Permutations in Excel
• Normal Distribution in Excel
• t-Distribution in Excel
• Binomial Distribution in Excel
• z-Tests in Excel
• t-Tests in Excel
• Hypothesis Tests of Proportion in Excel
• Chi-Square Independence Tests in Excel
• Chi-Square Goodness-Of-Fit Tests in Excel
• F Tests in Excel
• Correlation in Excel
• Pearson Correlation in Excel
• Spearman Correlation in Excel
• Confidence Intervals in Excel
• Simple Linear Regression in Excel
• Multiple Linear Regression in Excel
• Logistic Regression in Excel
• Single-Factor ANOVA in Excel
• Two-Factor ANOVA With Replication in Excel
• Two-Factor ANOVA Without Replication in Excel
• Randomized Block Design ANOVA in Excel
• Repeated-Measures ANOVA in Excel
• ANCOVA in Excel
• Normality Testing in Excel
• Nonparametric Testing in Excel
• Post Hoc Testing in Excel
• Creating Interactive Graphs of Statistical Distributions in Excel
• Solving Problems With Other Distributions in Excel
• Optimization With Excel Solver
• Chi-Square Population Variance Test in Excel
• Analyzing Data With Pivot Tables
• SEO Functions in Excel
• Time Series Analysis in Excel
• VLOOKUP