Themis evaluates every submission against four established fairness frameworks used by researchers, regulators, and AI ethics practitioners.
Demographic Parity
Positive outcome rates should be equal across demographic groups.
A loan approval model should approve loans at similar rates for different racial groups, given similar creditworthiness.
Equalized Odds
True positive and false positive rates should be equal across groups.
A medical diagnosis model should miss cancer at equal rates across demographic groups — not worse for minorities.
Individual Fairness
Similar individuals should receive similar predictions.
Two candidates with identical qualifications but different names/backgrounds should receive the same hiring recommendation.
Counterfactual Fairness
A decision is fair if it would be the same in a world where the individual belonged to a different demographic group.
If you changed only an applicant's name from 'Mohammed' to 'Michael', the AI's recommendation should not change.