Responsible by Design - Keeping AI Human

Christa Swain • December 3, 2025

Executive Summary:

AI, Ethics, and Human-Centred Design

Our recent Leaders Advisory Board event - designed in partnership with Corndel - featured three engaging sessions that explored how AI impacts human cognition, customer experience, and fairness.


Here's what we learnt:


1. Think or Sink – Are We Using AI to Enhance or Reduce Cognitive Ability?

Speaker:

  • Rosanne Werner, CEO at XcelerateIQ & ex Transformation Lead at Coca-Cola


Roseanne opened the day with an interactive and thought-provoking session, firmly positioning AI: “AI should be your sparring partner, not your substitute for thinking.”


Her research revealed a striking insight: 83% of people using LLMs couldn’t recall what they wrote, compared to just 11% using traditional search. The message? It’s not about avoiding AI, but using it in ways that strengthen thinking, not outsource it.


Roseanne explained how our brains form engrams  -   memory footprints that enable creativity and critical thinking. Over-reliance on AI risks weakening these pathways, reducing retention and problem-solving ability.


She introduced the Mind Over Machine Toolkit, six strategies to use AI as a thinking partner:

  1. Provide Context First – Frame the problem before asking AI.
  2. Use AI as a Challenger – Stress-test ideas and uncover blind spots.
  3. Iterative Co-Creation – Collaborate, refine, and evaluate.
  4. Document Your Thinking – Keep reasoning visible.
  5. Reflective Prompts – Support reflection, not replace judgment.
  6. Sparring Partner – Test assumptions and explore risks.


Roseanne summed it up with a simple rule: use Sink for low-value, repetitive tasks, and Think for strategic, creative decisions.


2. Designing Chatbots with Human-Centred AI

Speaker:


Sarah brought a practical perspective, drawing on experience implementing AI across sectors - from banking and cybersecurity to rail innovation.

She began with a relatable question: “Who’s been frustrated by a chatbot recently?” Almost every hand went up.


Through a real-world example (redacted out of politeness), Sarah illustrated how chatbots can fail when designed with the wrong priorities. The chatbot optimised for deflection and containment, but lacked escape routes, sentiment detection, and escalation paths - turning a simple purchase into a multi-day ordeal.


“Don’t measure success by how well the chatbot performs for the bot—measure it by how well it performs for the human.”


Sarah introduced principles for better chatbot design:

  • Human-Centred Design – Focus on user needs and emotional impact.
  • Systems Thinking – Consider the entire process, not just chatbot metrics.
  • Escalation Triggers – Negative sentiment, repeated failures, high-value intents.
  • Context Awareness – Detect when a task moves from routine to complex and route accordingly.


The takeaway? Automation should remove friction from the whole system - not push it onto the customer.


3. Responsible AI and Bias in Large Language Models

Speaker:

  • Sarah Wyer, Professional Development Expert in AI Ethics at Corndel


“When we create AI, we embed our values within it.”


She shared her journey tackling gender bias in large language models, from GPT-2 through to GPT-5, and highlighted why responsible AI matters. AI systems reflect human choices - what data we use, how we define success, and who decides what is fair.


Real-world examples brought this to life: facial recognition systems failing to recognise darker skin tones, credit decisions disadvantaging women, and risk assessment tools perpetuating racial bias.


Even today, LinkedIn engagement patterns show gender bias!


Sarah made the point that simple actions - like testing prompts such as “Women can…” or “Men can…” - can reveal hidden disparities and spark vital conversations.


To address these issues, Sarah introduced the D.R.I.F.T framework, a practical guide for organisations:

  • D – Diversity: Build diverse teams to challenge bias.
  • R – Representative Data: Ensure datasets reflect all user groups.
  • I – Independent/Internal Audit: Test outputs regularly.
  • F – Freedom: Create a culture where employees can challenge AI decisions.
  • T – Transparency: Share processes without exposing proprietary code.


Wrapping up the final session - before we opened the floor to panel questions and debate - Sarah created the opportunity to discuss how we address AI bias within our organisations by stepping through the DRIFT framework.


Shared Themes Across All Sessions
  • AI is powerful, but context matters.
  • Human oversight and ethical design are critical.
  • Use AI to augment thinking, not replace it.
  • Measure success by human outcomes, not just automation metrics.


We've had such great feedback from this event series - especially around the quality of speakers and the opportunity to have meaningful conversation and debate outside of functions. Definitely more in the events plan for 2026!


If you'd like to be part of the conversation please navigate to our LAB events page to register your interest


By Christa Swain February 2, 2026
Executive Summary Data Transformation Insights | Data Leaders Executive Lounge | 29th January This Data Leaders Executive Lounge brought together senior data leaders to explore the real drivers of successful data transformation , moving beyond technology adoption to focus on operating models, leadership, culture, and capability . The session featured insights from Zoe Kelly , Head of Data & Insights at Serco , and Pedro Cosa , CDAIO at Data Minds , drawing on Pedro’s experience across Channel Four , Warner Bros , and News UK . A consistent message emerged: data transformation fails not because of tools, but because of unclear ownership, misaligned operating models, and unrealistic expectations of data leadership roles . Both speakers reinforced that sustainable transformation requires deliberate design of decision rights, strong executive sponsorship, and ongoing engagement with the wider business. The discussion also explored the evolving and often misunderstood role of the Chief Data Officer , highlighting tensions between centralised and embedded data models, persistent hiring challenges, and the risk of reverting data functions back into IT when business alignment is weak. 
By Christa Swain February 2, 2026
"How does the world see you? Gen AI see's me as a sparkly eyed, smiley male. Am I offended? No. AI amplifies human bias. AI isn't the bad guy here. We are." Christa Swain
Green
By Urvik Patel January 27, 2026
An in-depth look at Microsoft Fabric in 2026, exploring unified analytics, OneLake, Direct Lake, governance, performance optimisation, and how Fabric sets a new standards.
Show More