Permutation test

A nonparametric randomization test for two groups or paired samples.

Runs locally in your browser. Input data is not uploaded. Copy URL shares settings only.

Other languages: ja | en | es

How to use (3 steps)

  1. Paste data for two groups (A/B) or paired samples.
  2. Choose statistic and settings (auto picks Exact or Monte Carlo).
  3. Run, review the p-value and null distribution, then download a report.

Permutation / randomization test

Permutation test tool

This tool helps you compare two groups without assuming normality. Results depend on your test design and chosen null model.


α is for reference only. Avoid over-interpreting a single threshold.

Results

Null distribution

The red line marks the observed statistic. The bars show the null distribution from permutations/sign flips.

FAQ

What does the p-value mean?
It is the probability (under the null) of seeing a statistic at least as extreme as the observed one. It does not prove causality or security.
Exact vs Monte Carlo?
Exact enumerates all permutations when feasible. Monte Carlo approximates with random permutations.
Is my data uploaded to a server?
No. Everything runs locally in your browser.
Does a large p-value mean “random”?
Not necessarily. A large p-value only means your data is not surprising under the chosen null model. It does not prove randomness or correctness.

Related tools

Related calculators