Will Shapiro, vice president of data science at Flatiron Health, explains the different ethical challenges associated with various forms of artificial intelligence models used in oncology care.
Ethical challenges in artificial intelligence (AI) models include regulatory oversight, authority, and bias, according to Will Shapiro, vice president of data science, Flatiron Health.
Transcript
What are some challenges around the proper use and ethics of AI in oncology?
I mean, there's a ton of challenges around using generative AI right now in practice. And absolutely, ethics and safety are hugely important considerations. I think it's an interesting time right now. In contrast to something like workflow automation or business intelligence—these are areas that have been around for a long time and that people kind of understand how to evaluate the quality and how to think about the outputs.
Generative AI is very early. When you see companies like OpenAI and Sam Altman [CEO of OpenAI] in particular, demanding and asking for regulators to come up with frameworks to think about the appropriate use of generative AI and guardrails, there's a lot to pay attention to.
Hallucinations are very real, and generative AI algorithms come from a place of technological authority. So, even if what they're saying is complete nonsense, it still has the sheen of authority. I think it's very pernicious.
And then, of course, with any machine learning or AI algorithm, bias is incredibly important to think about. GPT [generative pretrained transformer architecture] has already been demonstrated to be biased in several different ways. If we’re using these tools, we want to make sure that they make things better for everyone, not just for the select few, and don't perpetuate inequalities across health care.
For me, a lot of that comes down to having high-quality ground truth data that you trust and that you can use to validate the output of models against.
At Flatiron, we've been abstracting data from medical charts for a decade and are very proud of the labels that we have. What that gives us is an amazing way to validate the quality of ML [machine learning] models. So that's something I think a lot about and I’m very lucky to be able to work with that kind of label data.
IgE Mediation in Pediatric Atopic Dermatitis, Concurrent Immune Disorders: Amy Paller, MD
August 4th 2025Amy Paller, MD, pediatric dermatologist and clinical researcher at Northwestern Medicine's Feinberg School of Medicine, discussed the potential impact of reducing immunoglobulin E (IgE) levels in pediatric patients with atopic dermatitis.
Read More
LLMs Show Promise, But Challenges Remain in Improving Inefficient Clinical Trial Screening
July 31st 2025Large language models (LLMs) such as GPT-3.5 and GPT-4 may offer a solution to the costly and inefficient process of manual clinical trial screening, which is often hindered by the inability of structured electronic health record data to capture all necessary criteria.
Read More
Legal Navigation Services Key to Addressing Disparities in Cancer Care
July 31st 2025A significant number of patients with cancer, caregivers, and health care professionals face significant disparities in legal issues, with the most common needs revolving around health insurance, finances, employment, and disability insurance.
Read More