MORE THAN A GLITCH

A sharp rebuke of technochauvinism.

Broussard brings her perspective as a multiracial woman, data journalist, and computer scientist to an eye-opening critique of racism, sexism, and ableism in technology. She decries technochauvinism, which she defines as “a kind of bias that considers computational solutions to be superior to all other solutions.” Examining the use of AI programs in areas such as facial recognition, learning assessment, and medical diagnosis, Broussard argues persuasively that algorithmic systems “often act in racist ways because they are built using training data that reflects racist actions or policies.” Moreover, these systems have been developed by “able-bodied, white, cis-gender, American men” who test programs on a similar pool. Racial bias is blatant when facial recognition programs are instituted in policing, leading to harassment and false arrests. “Facial recognition is known to work better on people with light skin than dark skin,” she writes, “better on men than on women, and it routinely misgenders trans, nonbinary, or gender nonconforming people.” Broussard explains clearly how data sets limit the efficacy of AI in predictive policing—“a strategy that uses statistics to predict future crimes”—as well as in medical diagnostics: “The skin cancer AIs are likely to work only on light skin because that’s what is in the training data.” The author draws on her own experience with breast cancer to point out the inadequacy of an AI assessment that missed her disease. Fortunately, her experienced doctor did not even consult the AI results. Broussard highlights the work of the Algorithmic Justice League, the Surveillance Technology Oversight Project, and other groups involved in algorithmic auditing. “If we are building AI systems that intervene in people’s lives,” she warns, “we need to maintain and inspect and replace the systems the same way we maintain and inspect and replace bridges and roads.”

An informed analysis of one of the insidious elements of technology.