§Product
An audit file that answers the next question too.
A compliant impact-ratio table is where Isonomy starts. Each module below answers the question a reviewer asks after the last one: who is affected, why, since when, and what would fix it.
§ 01Impact ratios
The table the law asks for, done carefully.
For a pass/fail tool, Isonomy computes each category’s selection rate; for a scoring tool, the share scoring above the median. Each rate is divided by the most-selected category’s rate to give the impact ratio, in the layout NYC Local Law 144 requires.
- 95% intervals on every rate and ratio
- Fisher exact tests, Holm-adjusted across groups
- Small categories reported but excluded from ratios, as the rules allow
- Unknown-category counts disclosed, never silently dropped
| Category | Assessed | Selection rate | Impact ratio | Status |
|---|---|---|---|---|
| Black | 1,741 | 22.6% | 0.66 | Adverse impact |
| Hispanic / Latino | 1,996 | 24.2% | 0.71 | Adverse impact |
| Two or more races | 418 | 26.6% | 0.78 | Adverse impact |
| Asian | 1,220 | 33.1% | 0.97 | Pass |
| White | 6,315 | 34.2% | 1.00 | Reference |
| Native American | 148 | 25.7% | — | Too small |
| Pacific Islander | 44 | 36.4% | — | Too small |
| Women | Men | All | |
|---|---|---|---|
| White | 0.81 | 1.00 | 1.00 |
| Asian | 0.88 | 0.89 | 0.97 |
| Hispanic / Latino | 0.64 | 0.66 | 0.71 |
| Black | 0.56 | 0.64 | 0.66 |
| Two or more races | n<2% | n<2% | 0.78 |
| All races | 0.85 | 1.00 |
§ 02Intersectional analysis
Every combination, not just every column.
Isonomy audits each protected attribute and every combination of them. When an intersectional group fails while each attribute on its own passes, it raises a hidden disparity alert; when the gap compounds, it reports by how much.
In the sample audit the lowest single-attribute ratio is 0.66, while Black women sit at 0.56.
§ 03Proxy detection
Find the inputs that stand in for race or sex.
Removing the race column doesn’t remove race from a model. Isonomy measures how strongly each input is tied to each protected attribute and to the decision, and how well all inputs together can predict the attribute (cross-validated AUC).
In the sample, ZIP region is the channel for racial disparity, exactly the proxy Illinois’s HB 3773 now names.
§ 04Explanation fairness
Not only whether the model treats groups differently. Why.
With per-decision attributions such as SHAP values, Isonomy compares how the model reasons for each group: which features drive its decisions, how consistent those explanations are, and how many points each feature costs each group.
Here ZIP region costs Black applicants 2.2 points more than the average applicant: a specific, fixable cause.
§ 05Drift monitoring
A yearly audit is a photograph. Models change monthly.
Send decisions with a date and Isonomy tracks every impact ratio by period, flags regressions, and lines them up against your release history.
In the sample, the Hispanic applicant ratio fell from 0.82 to 0.55 after a single model update.
§ 06Fairer alternatives
Show the fix, with the evidence that it still works.
The mitigation lab retrains candidate models (dropping each proxy, reweighing training data, and projecting protected information out of the feature space), selects the same share of people as today, and ranks them on significant adverse impact, worst impact ratio and validity against a job-related outcome.
- No group-specific cut-offs or score adjustments, ever
- No protected attributes used when a decision is made
- Training-time use of protected data clearly labelled for counsel
- Prefers the simplest defensible change
§ 07Inputs and outputs
One export in. One audit file out.
No integration to start. A CSV with one row per person assessed is enough; each optional column unlocks a module.
| Column | Needed for | Example |
|---|---|---|
| Decision or score | Everything | advanced = Yes, score = 72.5 |
| Protected categories | Everything | sex, race_ethnicity |
| Model inputs | Proxy detection, alternatives | years_experience, zip_region |
| Date | Drift monitoring | application_date |
| Attributions (SHAP) | Explanation fairness | shap_zip_region |
| Job-related outcome | Alternatives (validity) | performance rating, 12-month retention |
You receive
- A print-ready audit report with LL144 summary tables
- Ranked findings with the evidence behind each
- Machine-readable results (JSON) for your own records
- A walkthrough call with the person who ran it
See it before you share anything
The sample report is a complete audit of a synthetic resume screener with planted bias: every table, finding and alternative.