· Plan and Design:
1 At the initial stages of setting out the purpose of the AI system, the design team shallcollaborate to pinpoint the objectives and how to reach them in an efficient and optimizedmanner. Planning the design of the AI system is an essential stage to translate the system’sintended goals and outcomes. During this phase, it is important to implement a fairness awaredesign that takes appropriate precautions across the AI system algorithm, processes, andmechanisms to prevent biases from having a discriminatory effect or lead to skewed andunwanted results or outcomes.
2 Fairness aware design should start at the beginning of the AI System Lifecycle with a collaborative effort from technical and non technical members to identify potential harm andbenefits, affected individuals and vulnerable groups and evaluate how they are impacted bythe results and whether the impact is justifiable given the general purpose of the AI system.
3 A fairness assessment of the AI system is crucial, and the metrics should be selected at this stage of the AI System Lifecycle. The metrics should be chosen based on the algorithm type (rule based, classification, regression, etc.), the effect of the decision (punitive, selective, etc.), and the harm and benefit on correctly and incorrectly predicted samples.
4 Sensitive personal data attributes relating to persons or groups which are systematically or historically disadvantaged should be identified and defined at this stage. The allowed threshold which makes the assessment fair or unfair should be defined. The fairness assessment metrics to be applied to sensitive features should be measured during future steps.
Published by SDAIA in AI Ethics Principles, Sept 14, 2022