Tuesday, May 27, 2014

Paired t-Test – Test Power With G-Power Utility

This is one of the following seven articles on Paired (2-Sample Dependent) t-Tests in Excel

Paired t-Test in 4 Steps in Excel 2010 and Excel 2013

Excel Normality Testing of Paired t-Test Data

Paired t-Test Excel Calculations, Formulas, and Tools

Paired t-Test – Effect Size in Excel 2010, and Excel 2013

Paired t-Test – Test Power With G-Power Utility

Wilcoxon Signed-Rank Test in 8 Steps As a Paired t-Test Alternative

Sign Test in Excel As A Paired t-Test Alternative

 

Power of the Paired

t-Test With Free Utility

G*Power

The Power of a t-Test is a measure of the test’s ability to detect a difference given the following parameters:

Alpha (α)

Effect Size (d)

Sample Size (n)

Number of Tails

Power is defined by the following formula:

Power = 1 – β

Β equals the probability of a Type 2 Error. A Type 2 Error can be described as a False Negative. A false Negative represents a test not detecting a difference when a difference does exist.

1 – β = Power = the probability of a test detecting a difference when one exists.

Power is therefore a measure of the sensitivity of a statistical test. It is common to target a Power of 0.8 for statistical tests. A Power of 0.8 indicates that a test has an 80 percent probability of detecting a difference.

The four variables that are required in order to determine the Power for a one-sample t-Test are Alpha (α), Effect Size (d), Sample Size (n), and the Number of Tails. Typically alpha, Effect Size, and the Number of Tails are held constant while sample size is varied (usually increased) to achieve the desired Power for the statistical test.

Manual calculation of a test’s Power given Alpha, Effect Size, Sample Size, and the Number of Tails are quite tedious. Fortunately there are a number of free utilities online that will readily calculate a test’s statistical Power. A widely-used online Power calculation utility called G*Power is available for download from the Institute of Experimental Psychology at the University of Dusseldorf at this link:

http://www.psycho.uni-duesseldorf.de/abteilungen/aap/gpower3/

Screen shots will show how use this utility to calculate the Power for this example and also to provide a graph of Sample Size vs. Achieved Power for this example as follows:

As mentioned, the four variables that are required in order to determine Power for a one-sample t-Test are Alpha (α), Effect Size (d), Sample Size (n), and the Number of Tails.

Bring up G*Power’s initial screen and input the following information:

Test family: t-Tests

Statistical test: Difference between two dependent means (matched pairs)

Type of power analysis: Post hoc – Compute achieved power –given α, sample size, and effect size

Number of Tails = 1

Effect Size (d) = 0.523

Alpha (α) = 0.05

Sample Size (n) = 17

The completed dialogue screen appears as follows:

paired t-test, t-test, t test, excel, excel 2010, excel 2013, statistics,test power,paired t test(Click On Image To See Larger Version)

Clicking Calculate would produce the following output:

paired t-test, t-test, t test, excel, excel 2010, excel 2013, statistics,test power,paired t test(Click On Image To See Larger Version)

The Power achieved for this test is 0.6624. This means that the current one-tailed paired t-Test has a 66.24 percent chance of detecting a difference that has an effect size of 0.523 if α = 0.05 and n = 17.

 

Excel Master Series Blog Directory

Statistical Topics and Articles In Each Topic

 

Posted by at

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)