Correlation coefficient between models and the ratio of differential performance for a different pair of demographic groups

Each row shows the correlation coefficient between months and the ratio of differential performance for a different pair of demographic groups. A negative correlation (in red) shows that differential performance is being reduced over time, while a positive correlation (in blue) shows increasing differential performance. For example, Sensetime’s positive values (in blue) indicate an increase in differential performance for all three ratios, illustrating increased bias in race, gender and age. ROC’s and Idemia’s negative values demonstrate an overall decrease in bias for all three cases. This table shows all eight high-performing companies with at least four versions of their FRT evaluated. Sensetime and ROC are shown in Figure 8 to illustrate changes over time.