Algorithmic bias is a term used to describe “systematic and repeatable errors in a computer system that create unfair outcomes, such as privileging one arbitrary group of users over others.“
Algorithmic bias can be extremely harmful for a variety of reasons. The world continually adapts algorithms to make crucial decisions. Algorithms exist to help businesses decide whether or not to offer people loans, evaluate job candidates for the next stage of the hiring process, and even in assessing sentence lengths for people who have been convicted of crimes.
With the use of such algorithms comes an assumed impartiality, because these tasks are being carried out by computers. About “40% [of Americans] feel it is possible for computer programs to make decisions that are free from human bias.” We know that computers aren’t scheming against the public, nor do they have racial or socioeconomic biases — they’re just computers. However, algorithmic bias occurs when the datasets used to train such algorithms leave certain groups within a population unaccounted for.
For example, Facebook users can have their posts flagged and taken down if they violate Facebook’s community guidelines. The social media website trains its sensors to remove content that is potentially harmful to protected categories, which are defined by “race, sex, gender identity, religious affiliation, national origin, ethnicity, sexual orientation and serious disability/disease.”
However, more leniency is leveraged to users who write about subsets of these protected categories. Content against White men would be flagged, because being White and being a man both fall into protected categories. Writing harmful content about Black children or women drivers, however, would be allowed, because age and driving are not protected categories, so these populations are considered subsets. As a result of algorithms like these, a U.S. Congressman, in regards to “radicalized Islamic suspect[s],” was able to post “[h]unt them, identify them, and kill them. Kill them all. For the sake of all that is good and righteous. Kill them all.” This is because radicalized Muslims (or “Islamic suspects”) are considered a subset of Muslims.