Friday, September 3, 2010

Correctable Reasons Why Your Data is Not Normally Distributed

Correctable Reasons

Why Your Data Is

Not Normally Distributed


In the ideal world, all of your data samples are normally distributed. In this case you can usually apply the well-known parametric statistical tests such as ANOVA, the t Test, and regression to the sampled data.


What can you do if your data does not appear to be normally distributed?

You can either:

- Apply nonparametric tests to the data. Nonparametric tests do not rely on the underlying data to have any specific distribution

- Evaluate whether your “non-normal” data was really normally- distributed before it was affected by one of the seven correctable causes listed below:


The Biggest 7 Correctable Causes of Non-Normality in Data Samples

1) Outliers – Too many outliers can easily skew normally-distributed data. If you can identify and remove outliers that are caused by error in measurement or data entry, you might be able to obtain normally-distributed data from your skewed data set. Outliers should only be removed if a specific cause of their extreme value is identified. The nature of the normal distribution is that some outliers will occur. Outliers should be examined carefully if there are more than would be expected.

 2) Data has been affected by more than one process – It is very important to understand all of the factors that can affect data sample measurement. Variations to process inputs might skew what would otherwise be normally-distributed output data. Input variation might be caused by factors such as shift changes, operator changes, or frequent changes in the underlying process. A common symptom that the output is being affected by more than one process is the occurrence of more than one mode (most commonly occurring value) in the output. In such a situation, you must isolate each input variation that is affecting the output. You must then isolate the overall effect which that variation had on the output. Finally, you must remove that input variation’s effect from output measurement. You may find that you now have normally-distributed data.


3) Not enough data – A normal process will not look normal at all until enough samples have been collected. It is often stated that 30 is the where a “large” sample starts. If you have collected 50 or fewer samples and do not have a normally-distributed sample, collect at least 100 samples before re-evaluating the normality of the population from which the samples are drawn.


4) Measuring devices that have poor resolution – Devices with poor resolution may round off incorrectly or make continuous data appear discrete. You can, of course, use a more accurate measuring device. A simpler solution is to use a much larger sample size to smooth out sharp edges.

 5) A different distribution describes the data – Some forms of data inherently follow different distributions. For example, radioactive decay is described by the exponential distribution. The Poisson distribution describes events event that tend to occur at predictable intervals over time, such as calls over a switchboard, number of defects, or demand for services. The lengths of time between occurrences of Poisson-distributed processes are described by the exponential distribution. The uniform distribution describes events that have an equal probability of occurring. Application of the Gamma distribution often based on intervals between Poisson-distributed events, such as queuing models and the flow of items through a manufacturing process. The Beta distribution is often used for modeling planning and control systems such are PERT and CPM. The Weibull distribution is used extensively to model time between failure of manufactured items, finance, and climatology. It is important to become familiar with the applications of other distributions. If you know that the data is described by a different distribution than the normal distribution, you will have to apply the techniques of that distribution or use nonparametric analysis techniques.


6) Data approaching zero or a natural limit – If the data has a large number of value than are near zero or a natural limit, the data may appear to be skewed. In this case, you may have to adjust all data by adding a specific value to all data being analyzed. You need to make sure that all data being analyzed is “raised” to the same extent.


7) Only a subset of process’ output is being analyzed – If you are sampling only a specific subset of the total output of a process, you are likely not collecting a representative sample from the process and therefore will not have normally distributed samples. For example, if you are evaluating manufacturing samples that occur between 4 and 6AM and not an entire shift, you might not obtain the normally-distributed sample that a whole shift would provide. It is important to ensure that your sample is representative of an entire process.

If you are unable to obtain a normally-distributed data sample, you can usually apply non-parametric tests to the data.



If you would like to create a link to this blog article, here is the link to copy for your convenience:

Correctable Reasons Why Your Data Is Not Normally Distributed

Normality Test - Nonparametric test - statistical test in excel
Please post any comments you have on this article. Your opinion is highly valued!

 
If You Like This, Then Share It...
Normality Test - Nonparametric test - statistical test in excel Normality Test - Nonparametric test - statistical test in excel Delicious Normality Test - Nonparametric test - statistical teet in excel Normality Test - Nonparametric test - statistical test in excel Buzz it Normality Test - Nonparametric test - statistical test in excel

Excel Master Series Blog Directory

Statistical Topics and Articles In Each Topic

Posted by at
Labels: , , , , , , , ,

3 comments:

  1. AnonymousNovember 23, 2011 at 9:22 AM

    This is a good summary thanks

    ReplyDelete
  2. vé máy bay từ canada về việt namSeptember 22, 2021 at 7:15 PM

    Mua vé máy bay tại Aivivu, tham khảo

    Ve may bay di My

    vé máy bay từ los angeles về việt nam

    bay từ đức về việt nam mấy tiếng

    vé máy bay từ nga về tphcm

    giá vé máy bay từ anh về hà nội

    máy bay từ pháp về việt nam

    chuyến bay chuyên gia trung quốc

    ReplyDelete
  3. YongMakaoOctober 14, 2026 at 8:24 AM

    One thing that makes adjustment of status appealing is the possibility of completing the green card process without leaving the United States, but that convenience does not mean every applicant who is physically present in the country can use this route. Eligibility still depends on the immigration category, the person’s history, and whether the underlying petition supports filing Form I-485. In many family- or employment-based cases, there is an immigrant petition that establishes the legal basis for permanent residence. Depending on the category and visa availability, that petition may already be approved before Form I-485 is submitted, or the two filings may sometimes be made together. This is why I would not look at the I-485 as a completely separate application. It is usually tied to a qualifying immigrant category, and the timing between the petition and adjustment filing can matter. A green card lawyer https://consultantlm.com/services/applying-for-a-green-card can be especially helpful before filing when the person’s immigration history is not perfectly clean. Unauthorized employment is one issue that should be reviewed carefully because the consequences can differ depending on the category. The same applies to status violations, periods of overstay, or times when someone remained in the United States after their authorized stay expired. Previous entries are another area I would examine closely. How the applicant entered the country, what visa or admission category was used, and whether inspection occurred can affect adjustment eligibility. Someone who has entered several times should probably reconstruct the history using passports, visas, I-94 records, and any previous immigration paperwork rather than relying on memory. Earlier removal proceedings can make things even more complicated. If someone previously appeared in immigration court, received a removal order, or had a case administratively closed or terminated, I would want to understand exactly what happened before submitting anything new. A pending or old court matter can affect which agency has jurisdiction and what procedural steps are available. The advantage of adjustment of status is obvious for eligible applicants: they can often remain in the United States while the permanent residence application is processed. Depending on the case, they may also seek related employment or travel authorization. The downside is that filing too quickly without reviewing prior violations can create problems that might have been identified in advance. For me, the most sensible approach would be to create a complete immigration timeline first, confirm the underlying green card category, and only then decide whether adjustment is actually appropriate. Has anyone here worked with a green card lawyer who found an old entry, overstay, or status issue that changed whether the I-485 could be filed?

    ReplyDelete

Subscribe to: Post Comments (Atom)