Overcoming the Technocratic Paradigm: AI Bias in Healthcare by Bridgitte Chan.
We currently live in a world that is driven by the technocratic paradigm. This worldview highly values the use of technology for problem-solving and decision-making; everything around us is seen as a problem waiting to be solved through scientific knowledge and technological power. Although the technocratic paradigm has proven itself to be useful in the past, it contains many pitfalls. Most importantly, it perpetuates the false dichotomy between STEM and humanities.
The technocratic paradigm ultimately devalues the humanities and disregards the mutually reinforcing relationship between the two fields. It promotes this notion that science and math are inherently more legitimate because they are objective truths, in comparison to humanities, which is considered to be more subjective and open to interpretation. This is wrong for two main reasons. First and foremost, humanities fields also rely on empirical evidence and call for rigorous analysis and research; just because the data interpreted is typically more culturally based, does not make it any less factual than math and science. Secondly, it ignores the broader social and ethical contexts that impact the field of STEM, this intrinsically dehumanizes decision-making and reduces people to mere data points. The technocratic paradigm treats the human body as a machine and uses the white, male form as its standard; this poses some very obvious problems. As we begin to think about the ways humanities have historically been ignored in the field of science, the harmful implications of doing so become resoundingly clear.
I am passionate about implementing the humanities and arts into the field of STEM. In other words, I am an advocate for the conversion of STEM into STEAHM because it forces us to question the narratives and ethics behind the things we have been taught to accept as undeniable facts. This shift has become even more vital with the emergence of AI. Artificial intelligence has made significant advancements in recent years and as AI continues to grow at a rapid rate, so does its ability to impact the lives of every human on this planet. AI replicates the world as it exists and makes decisions based solely on mathematics, unaware of any ethical and moral nuances. It is evident that AI has exposed society’s current biases in how it performs when identifying human faces. Not only do facial recognition algorithms work better on male faces than female, but it sometimes fails to detect darker skin tones altogether and there are instances that go beyond this. For example, Amazon tried to use AI to speed up its hiring process and it automatically rejected women because technological jobs and positions of power have not been traditionally held by women. If this is how AI performs when trying to hire people, what could this mean for the future of AI within our medical system?
AI is a direct reflection of our world because it is based on the data it is fed. It would be naive to believe the current medical data and knowledge we have is devoid of misconceptions–predominantly derived from problematic Western worldviews. Whether it is a conscious decision or not, people inevitably embed their own biases into technology mainly because the data being used is largely skewed. Since our history is filled with inequalities, the data currently being used to train AI frequently excludes and can even work against BIPOC as well as other marginalized groups. When we look at the ways the American healthcare system has violently mistreated Black people, especially Black women, it is only logical to assume AI would worsen these disparities. If we do not take swift action to fix this, further disparities will be created and a new form of injustice, known as algorithmic injustice, will run rampant.
It is crucial for us to illuminate the biases that exist within these algorithms so we can actively combat them and ensure that the future applications of AI are accurate, equitable, and ethical–especially in the realm of healthcare and medicine. AI has the potential to bring about a multitude of advantages and enhance the way we live, but there is a lot of work that needs to be done beforehand. It is time for developers to cultivate an improved version of AI that is inclusive and created with diverse populations in mind. This can only be done if we unite the fields of humanities and STEM. We must be willing to further our cultural competencies and embrace the ideologies more exclusively taught in humanities. We must be cognizant of who is developing the technology and whom, or what, they are developing AI for. Does it serve the public interest? Or is it being built for profit? Is it ethical? Are the people in charge aware of the social responsibilities that come with creating artificial intelligence? Asking these questions is the first step in achieving algorithmic justice and it is our duty to challenge and overcome the discriminatory practices brought about by the technocratic paradigm; only then can we truly reap the benefits of AI.