Host:
Eyal Heldenberg
Duration:
11:41
Release Date:
November 30, 2025

11
The conversation explores the cautious integration of technology, particularly AI, into healthcare, emphasizing the need for human oversight and the challenges posed by the complexity of patient interactions.
00:00 Introduction to Care Culture Talks
01:03 Navigating AI Hallucinations and Documentation Accuracy
β
Aurelio Muzaurieta (00:10)
A central tenant in medicine and part of the Hippocratic oath that we take when we become physicians is first do no harm. And so the implementation of new technologies into healthcare inherently must be more conservative than in other industries where you want to first disrupt and shake up everything and break things. This is much harder in a healthcare setting because we're dealing with people's health.
And I think that that's appropriately that worry and those concerns are appropriately placed. With respect to bringing new technologies like AI into the clinical space, think, well, what's most important is that there continue to be a significant amount of human oversight on the, on the rollout of these, of these technologies and, and,
And I can tell you that in practice there continues to be a need for this human oversight because as the technology is able to help remove some of the administrative tasks, we want to maintain precision and accuracy in that documentation. And AI is still in its nascent state of trying to take, for example, an interaction between a patient and a physician in a noisy emergency department to...
be represented in a few paragraphs what that conversation was and hallucinations occur. Sometimes a surgery or a medical procedure that you think that did not happen in a patient is.
comes up into the chart as something that happened and you have to look at it, read everything carefully and ensure that what the AI has interpreted as your interaction with this patient is indeed accurate. And that still falls on the physician or the medical, medical provider to, ensure is, is true. And I've, and I've fallen, this, this Swiss cheese model, it's, have, I have made mistakes and said, that, was not a surgery that happened.
Then one of my colleagues will remind me so that's something that all medical providers who are starting to adopt these technologies should be aware of. And as...
ambient scribe technology and other tools come into the clinical space. The question always becomes who will take liability for mistakes that surround this and in the current system, it's the physician using it. So while it can help take away some of the impersonal interaction of taking notes, for example, next to a patient on your own,
and not looking them eye to eye. That's the traditional model right now. I love that the ambient technology is allowing me to spend more time face to face looking at the patient and hearing this. The problem here is that now there's another kind of task, I guess, on the physician to make sure that what the AI creates is in fact true.
Sometimes that can actually take more time than doing it yourself. So there's a bit of a value proposition there that needs to continue to be had. And as the technology improves, I think that will get better. I'm pretty optimistic around it, but as it states now, you know, if the AI writes that a surgery happened or that I did a particular part of the physical exam that I didn't do, you know, that falls on the provider, so.
That's one thing that I'm concerned about and people should definitely know is as we take on these technologies that have great potential. But in turn, and the other thing I think is data. And I will say that
what is critical that everybody must do from is informing all the parties involved that recording an AI technology is in fact occurring in this clinical interaction. And I will say in my experience, most patients are totally okay with this. I often start my interactions where I'm gonna be using AI scribe technology.
And the way I kind of approach it with patients is the following. Hello, Mrs. Jones. Good afternoon. It's wonderful to meet you. I see you have your husband here in the room. I use an AI scribe technology that records our conversations and helps me with my documentation so I can focus less on the computer and more on you. And I will say most patients are pretty happy to have the doctor have
more attention focused on them as a patient than on the computer screen, typing away and not really seeing and looking and feeling in that human interaction. So that's really helpful and I find it great.
Eyal Heldenberg (04:06)
Yeah.
Along those lines, one of the things that I think we see is that, as scribes come and basically say, hey, we're gonna help you with operational thing, Documentation. And in the medical interpretation field where we operate, it's kind of an existing thing, right? You have
human interpreter over iPad and now, you know, coming this AI medical interpreter. And sometimes, we think about what if the, the model performs better than human, like, or maybe kind of in a general statement. If we have a better workflow, theoretically, we have a better workflow, let's say whatever English to Spanish translation in real time that let's assume it's better, more accurate, timely and others than existing workflow that is 30, 40 years or so. Because many times I'm thinking like what health systems should, look at the specific existing workflow that maybe is not safe enough or not accurate enough, or maybe there is other way to get it more, more accurate. So
β
Eyal Heldenberg (05:26)
I think it's a bit different from...
Aurelio Muzaurieta (05:27)
I think this is a great point. I think what's interesting here is we're, I would say the current workflow around medical interpretation in most healthcare systems is safe enough, but not ideal and certainly not optimized to be the best that it can be. And I think
for what it's worth, it's wonderful when we have in-person medical interpreters for particular interactions that are difficult with patients, hard of hearing patients, the elderly can be difficult to use technology. We also have iPads that call in people live. And the quality of these interpretations can really vary depending on the day, the time of day, the clinical setting. And so...
All of the folks, and I'm very thankful for all medical interpreters who take their time, whether it's in the virtual or in-person space, to provide this invaluable service. My excitement around AI interpreting is the possibility of raising the...
quality and raising the bar for many of the interactions that little bit.
less important that it be in person for the day to to relieve the burden on the interpreting services that exist to be more focused on the more difficult cases and that. And when we're looking at AI, I think that there is a lot of data now that's showing that they can outperform what our current workflow is in particular clinical scenarios and settings, as we know, and there's many different types of clinical settings.
Settings, there's ambulatories, clinic settings, there's the emergency setting, there's out in pre-hospital setting. I all of these different opportunities that where patient communication is so key and that's that workflow as it states is, we always, I think we owe it to our patients to be honest with the quality of the interaction that's occurring provide them with the best service that exists at the most reasonable cost for all parties involved. I think that anybody who, who would deny technology that is better from
accuracy and precision perspective than what we currently have to a patient for a less expensive cost would not be doing right by that patient and by the health system. So I'm pretty optimistic about where we're going. I don't think we're 100 % there yet and we have a lot of things to move through, but overall that's what I see as opportunities around improving this interaction with patients with limited English.
Eyal Heldenberg (07:55)
Maybe llast question, your thoughts or projection on 2026 and let's say AI in healthcare in 2026. Where are we going with that? Are we going all in? Still kind of cautious? How do see next year?
Aurelio Muzaurieta (08:10)
Hmm. I think that, well, AI and healthcare in particular, I think is a little bit behind from AI and the rest of the different, workforce. and overall there's a larger, maybe a bubble is soon to be bursting around the excitement around, AI and a lot of sectors.
I think we've barely scratched the surface when it comes to opportunities existing within the healthcare sector and particularly medical services as a subsection of healthcare that we, that opportunities I think are very, very high. One of the reasons is because our healthcare system is extremely convoluted and difficult to navigate. And so as it stands now, any incremental improvement is actually a huge value add in this. So β I'm optimistic that the companies that are trying to enter
into the healthcare sector to improve workflows, particularly when it comes to the patient-physician or patient-provider interaction, are going to see more and more people see the value of AI and integrating that into their medical practice with their patients. It's happening on the daily basis already.
And one of the things I'm very excited about is the adoption of, we are very lucky at large academic centers that have a ton of resources from research and clinicians and people at the top of their game to have access to
so much knowledge to be able to give our patients, but we forget about all of the other venues that patients receive care that aren't necessarily as well-resourced and what AI has done from open evidence to AI scribes is allowed healthcare systems that aren't as well-resourced or
whether they're public or private and in the smaller kind of clinical scenarios to have access, more easily available access to knowledge and to better patient care. So there's this huge amount of folks that if they don't have access to the top academic centers in the United States can still get better care because of what AI technology has provided for.
That's provided for the physicians and the providers that are working with that technology. So I think that that's already begun. And now it's kind of, because there has been this rollout at Yale, I will say that there's already so much more of a willingness to adopt these technologies and to try them out because so much good has already come out of them.
Eyal Heldenberg (10:46)
Amazing. I'm sharing this optimism for 2026. I'm kind of thinking along those lines where different environments would probably have more, I would say, benefits from implementing those kind of latest and greatest tech to help them to manage the workflow, give a better patient care, and hopefully do some cost saving and cost-effective workflow I would say. So I totally share this optimism. All right, so thank you very much, Aurelio It was really fun to talk to you this time.
Aurelio Muzaurieta (11:22)
Thanks for taking the time. Until next time.
Eyal Heldenberg (11:24)
Thank you.