Try it first with everything switched on. Later you can come back here, turn off Gender, and retrain, to see whether that's enough to make the model fair.
03
Train the model
Let the AI learn the patterns in the data
04
Examine the consequences
What did the model learn, and is it fair?
The Fairness Test
240 new applicants with identical merit distributions
The model's learned weights
what the model weighs in its decision
The Twin Test
two identical candidates, are they judged the same?
Start over from the beginning
The training data: Teknova AB's history
Rows highlighted in red show people who were qualified but not hired. Because the data is constructed for this lab, we know the true suitability. In reality no such ground truth exists, which is exactly what makes the problem hard to detect.
The Bias Lab
The company Teknova AB is about to let an AI system sort its job applications. The model will be trained on the company's earlier hiring decisions. You carry out the investigation of what it learns.
1
Train and review. Let the model learn from the history, then examine how it judges two identical CVs where only gender differs.
2
Try to fix it. Hide the applicants' gender from the model and investigate whether that is enough to make it fair.
All the data in this lab is made up, but this type of bias occurs in real AI systems.
The Fairness Test
240 new applicants with identical merit distributions were run through the newly trained model.