Skip to content
Interactive Decision Tool for Authors

Statistical Test Selector for Researchers

Determine the correct statistical test for your research paper, verify core mathematical assumptions, and copy peer-reviewed manuscript reporting templates directly into your Methods section.

Statistical Test Selector

Answer a few questions about your study and data, and get the right statistical test — with its assumptions, non-parametric alternative, software commands, and an example write-up.

Runs entirely in your browser. Nothing you select is uploaded or stored.
Step 1
A guide to help you choose and justify a test — always confirm your assumptions on your own data before running it. Terminology follows common conventions (SPSS / R / Python).
Want a statistician to run or check your analysis? See our statistical analysis service.

Tip: not sure whether your data are normally distributed? Choose “Not sure” and the selector shows you both the parametric test and its non-parametric alternative, so you’re covered either way.

The basics

What is the Statistical Test Selector?

The Statistical Test Selector is a free, browser-based decision tool that tells you which statistical test to use for your research question. Instead of scrolling through textbooks or guessing, you answer a short sequence of questions — your analysis goal, the type of outcome variable, how many groups you’re comparing, whether they’re independent or paired, and whether your data are normally distributed — and it returns the correct test along with everything you need to run and report it.

It’s built for researchers, graduate students, dissertation and thesis writers, and anyone preparing a manuscript for publication who needs to choose the right statistical test quickly and defend that choice to a supervisor, examiner, or peer reviewer. Every recommendation comes with the test’s key assumptions, its non-parametric alternative, the exact SPSS, R, and Python commands, and a fill-in-the-blank example results write-up. Nothing you enter is uploaded or stored — the entire decision tree runs locally in your browser.

The method

How to choose the right statistical test in 5 questions

Choosing a statistical test comes down to the shape of your data and what you’re trying to find out. Work through these five questions — they’re the same ones the selector asks — and you’ll land on the correct test almost every time.

What is your research goal?

Are you comparing groups or conditions (e.g. treatment vs control), measuring a relationship between two variables (correlation), predicting or modelling an outcome from one or more predictors (regression), or assessing agreement or reliability (raters, repeated measures, scale consistency)? Your goal narrows the whole family of possible tests.

What type is your outcome (dependent) variable?

The measurement level of your outcome is the single biggest factor. Is it continuous (blood pressure, test score, reaction time), ordinal (a Likert 1–5 rating, a stage or grade), nominal / categorical (yes/no, blood type), a count (number of admissions), or time-to-event (survival data, possibly censored)? A continuous outcome points toward t-tests, ANOVA, or regression; categorical outcomes point toward chi-square or logistic regression.

How many groups, and are they related?

Count your groups or conditions — one, two, or three or more — and decide whether they’re independent (different participants in each group) or paired / repeated (the same participants measured more than once, such as pre vs post). Two independent groups call for an independent-samples t-test; two paired measurements call for a paired-samples t-test; three or more groups move you to ANOVA or its rank-based equivalent.

Are your data normally distributed?

This decides parametric vs non-parametric. Check normality with a histogram, a Q–Q plot, or a Shapiro–Wilk test. If a continuous outcome is roughly normal, use the parametric test (t-test, ANOVA, Pearson). If it’s skewed, has outliers, or is ordinal, use the non-parametric alternative (Mann–Whitney U, Kruskal–Wallis, Spearman). Not sure yet? The selector shows both so you can decide after checking.

Any special structure — counts, survival, or agreement?

Count outcomes use Poisson or negative binomial regression; time-to-event data use Kaplan–Meier and the log-rank test or Cox regression; rater and scale reliability use Cohen’s or Fleiss’ kappa, the intraclass correlation coefficient (ICC), or Cronbach’s alpha. The selector routes these automatically once you pick the matching goal.

Quick reference

Statistical test selection cheat sheet

Use this table as a fast reference for the most common research scenarios. It maps your goal, data type, and design to the recommended statistical test and its non-parametric alternative. Bookmark it — or better, run your exact case through the selector above to get assumptions and software commands too.

Your goalOutcome / data typeDesignRecommended testNon-parametric alternative
Compare two groupsContinuousIndependentIndependent-samples t-testMann–Whitney U test
Compare two conditionsContinuousPaired / repeatedPaired-samples t-testWilcoxon signed-rank test
Compare 3+ groupsContinuousIndependentOne-way ANOVAKruskal–Wallis H test
Compare 3+ conditionsContinuousRepeatedRepeated-measures ANOVAFriedman test
Compare to a known valueContinuousOne sampleOne-sample t-testWilcoxon signed-rank (one sample)
Compare two groupsCategorical (nominal)IndependentChi-square test of independenceFisher’s exact test (small counts)
Compare two conditionsBinaryPairedMcNemar test
Measure a relationshipTwo continuousPearson correlationSpearman’s rank correlation
Measure a relationshipTwo ordinalSpearman’s rank correlationKendall’s tau
Measure a relationshipTwo categoricalChi-square test of independenceCramér’s V (effect size)
Predict / modelContinuous outcomeLinear regression
Predict / modelBinary outcomeBinary logistic regression
Predict / modelCount outcomePoisson regressionNegative binomial (if overdispersed)
Compare survivalTime-to-eventTwo or more groupsLog-rank test (Kaplan–Meier)Cox proportional-hazards regression
Assess agreementTwo raters, categoricalCohen’s kappaWeighted kappa (ordinal)
Assess reliabilityMulti-item scaleCronbach’s alphaMcDonald’s omega

Always confirm each test’s assumptions on your own data before running it. This table is a starting point, not a substitute for checking normality, variance, and cell counts.

Key decision

Parametric vs non-parametric tests: which do you need?

This is the choice that trips up most students. Parametric tests (t-tests, ANOVA, Pearson correlation) assume your continuous data are approximately normally distributed and meet a few other conditions; when those hold, they’re more powerful. Non-parametric tests (Mann–Whitney U, Kruskal–Wallis, Spearman) work on ranks, make fewer assumptions, and are the safer choice for skewed data, ordinal scales, small samples, or data with outliers.

QuestionParametric testNon-parametric alternative
Two independent groupsIndependent t-testMann–Whitney U test
Two paired measurementsPaired t-testWilcoxon signed-rank test
Three or more groupsOne-way ANOVAKruskal–Wallis H test
Repeated measurements (3+)Repeated-measures ANOVAFriedman test
Correlation between variablesPearson’s rSpearman’s rho / Kendall’s tau

Rule of thumb: if your outcome is continuous and passes a normality check, start parametric. If it’s ordinal, clearly skewed, or your sample is small, use the non-parametric alternative. When in doubt, run both — if they agree, report the parametric result; if they disagree, the non-parametric result is usually the more defensible one.

Use cases

Who uses a Statistical Test Selector

Dissertations & theses

Choose and justify the analysis for your methods chapter — and be ready when your committee asks why you picked that test.

Journal manuscripts

Match your test to your design before submission so reviewers can’t reject you on statistical grounds.

Clinical & health research

Handle group comparisons, categorical outcomes, survival data, and inter-rater reliability with the correct test each time.

Psychology & social science

Get the right approach for Likert-scale, ordinal, and repeated-measures data that rarely meet normality.

Student lab reports

Learn the logic of test selection with plain-language explanations and assumption checklists.

Peer-review responses

Re-check a reviewer’s “wrong test” comment and switch to the defensible alternative fast.

FAQs

Frequently asked questions

How do I know which statistical test to use?

Match the test to four things: your goal (compare, relate, predict, or assess agreement), the type of your outcome variable (continuous, ordinal, nominal, count, or time-to-event), the number of groups and whether they’re independent or paired, and whether your data are normally distributed. The selector above walks you through exactly these questions and returns the correct test.

What is the difference between parametric and non-parametric tests?

Parametric tests (t-test, ANOVA, Pearson correlation) assume your continuous data are approximately normally distributed and are more powerful when that holds. Non-parametric tests (Mann–Whitney U, Kruskal–Wallis, Spearman) work on ranks, make fewer assumptions, and are the right choice for skewed data, ordinal scales, small samples, or data with outliers.

Which test compares two groups?

For two independent groups with a continuous, normally distributed outcome, use an independent-samples t-test (non-parametric alternative: Mann–Whitney U). For two paired measurements — the same participants measured twice — use a paired-samples t-test (non-parametric alternative: Wilcoxon signed-rank). For a categorical outcome, use a chi-square test or Fisher’s exact test.

What test should I use for Likert-scale data?

Likert responses are ordinal, so non-parametric methods are usually the safest choice: Mann–Whitney U or Kruskal–Wallis to compare groups, and Spearman’s rho or Kendall’s tau for correlations. Some researchers treat multi-item Likert scales as continuous when the scale is well-validated, but single items should be analysed as ordinal.

Do I need to check assumptions before running the test?

Yes. Every recommended test lists the assumptions you must verify — such as normality, independence of observations, equal variances, or minimum expected cell counts. Check them on your own data (histograms, Q–Q plots, Levene’s test, Shapiro–Wilk) before you trust and report the result.

Is the statistical test selector free, and is my data private?

Yes on both counts. The tool is completely free with no sign-up, and the entire decision tree runs locally in your browser. You only select descriptions of your data — no dataset is uploaded — and nothing you choose is stored or sent anywhere.

Can this tool run the test for me?

No — it identifies the right test and gives you the SPSS, R, and Python commands to run it yourself. If you’d like an expert to run the analysis, verify assumptions, and write up the results, our statistical analysis service can do that for you.

Which statistical software does it support?

Each recommendation includes the menu path for SPSS and the equivalent one-line command for R and Python (SciPy and statsmodels). The test itself is the same across software — you just use whichever package you have.

Need a statistician to run or double-check your analysis?

The selector points you to the right test — but if you’d rather have an expert run the analysis, verify your assumptions, or write up the results to journal standard, our team does exactly that. We handle everything from choosing the test to interpreting the output and drafting a publication-ready results section.

Get a Custom Quote

Tell us a bit about your project and we’ll get back to you within 24 hours.