Beyond the Algorithm: Human-in-the-Loop, Organizational Buy-In, and the Discipline of Knowing a Model's Limits
About this session
Healthcare AI's biggest risk usually isn't the model itself, it's everything around it. As organizations rush to deploy AI into clinical and operational workflows, responsible innovation comes down to three things: keeping humans meaningfully in the loop, understanding a model's caveats before it touches patient care, and bringing the organization along, starting with leadership. Drawing on real-world experience leading data science and AI initiatives in healthcare, this talk moves past theoretical governance frameworks into the practical work of responsible deployment. We'll discuss why human-in-the-loop is a design philosophy, not a checkbox — determining where clinicians and domain experts remain decision-makers rather than passive reviewers. We'll cover the organizational trust-building this requires, and why leadership buy-in is non-negotiable: executives must not only sponsor responsible AI principles but visibly model the right behavior themselves, setting the tone for how teams engage with AI day to day. Finally, we'll dig into the discipline of understanding model caveats, the edge cases and limitations that don't show up in a validation report but matter enormously when AI output influences real patient care. Attendees will leave with a practical mental model for AI readiness — one centered on human oversight, leadership modeling, and honest reckoning with what a model can and cannot tell you.
Speaker
Key takeaways
- Human-in-the-loop is a design decision, not a safeguard bolted on later. Decide upfront where humans must remain decision-makers, not just reviewers.
- Leadership buy-in means visible behavior, not just sponsorship. If leaders don't model caution and curiosity, teams won't either.
- Responsible AI is an organizational discipline, not a technical feature. Trust is built through consistent behavior, not a governance document.