Ep 152: Why Relying on Data Can Cause More Harm Than Good

Ep 152: Why Relying on Data Can Cause More Harm Than Good

Cathy O’Neil is a mathematician who has worked as a professor, hedge-fund analyst and data scientist. Cathy founded ORCAA, an algorithmic auditing company, and is the author of Weapons of Math Destruction.

Cathy says she was always a math nerd. She loves the beauty of mathematics, and says it is almost an art – the cleanliness of it. One of her favorite things is that math is the same no matter what country you go to. She also had had an interest in the business world, which led her from academia to work as a hedge fund quantitative analyst.

Big Data is both a technical and marketing term. The technical term depends on the technology you are using. Big data used to mean that it was more data than you could fit on your computer – now it means more that you can perform in a simple way – that it needs to be put it into another form before it can be used.

The marketing term, ‘big data’ is misleading. However, it represents the belief that you can collect data for one thing but then the same data can be used for another purpose. “It is a technology that allows us to collect seemly innocuous data and use it for another purpose.”

One profession in which O’Neil has at looked at the use of big data and algorithms in detail – and discusses in her book – is teaching and their evaluations. She says there were teacher evaluation algorithms originally designed to eliminate the achievement gap between ‘rich kids and poor kids’. Eventually, a new system was devised entitled, ‘value added teacher model’.

The idea of this new system intended to offset the previous way of looking at assessing teachers - where they solely looked at the teacher’s students’ final test scores.

The ‘value added score’ system holds teachers accountable for the difference between students’ final score and what they were expected to achieve/receive.

O’Neil says that this method ‘sounds good’ and seems to ‘make sense’. However, with only 25 (or so) students in one teacher’s classroom, there is not enough data. Additionally, both the expected and actual scores have a lot of uncertainty around each of them. So this final number ‘ends up not much better than a random number’. With that, there is not enough credible data to base important decisions such as terminating a teacher’s job.

One of O’Neil’s main points in today’s discussion is that every algorithm is subjective. Whether it is used to evaluate teachers, hire or fire employees in a financial organization - people should know that they have the right to ask the algorithm explained to them. The 14th Amendment provides them ‘due process’ to ask why they are terminated, not promoted, etc. - other than just alluding to a algorithm result.

What you will learn in this episode:

  • What is ‘weaponized math’?
  • How is the internet building a new kind of ‘class’?
  • What are the 2 definitions of ‘big data’?
  • The potential bias found in the use of algorithms in teacher evaluations, hiring practices, firing

Avsnitt(1052)

Sparks: Five Trends Shaping the Future of Work… And How to Thrive In This Changing World

Sparks: Five Trends Shaping the Future of Work… And How to Thrive In This Changing World

Imagine waking up one day and realizing the world changed, but you didn’t. That’s what it’s like for many organizations today, stuck on a decades-long train ride, speeding ahead without ever looking out the window. The future of work isn’t coming. It’s already here, and most companies are still running on definitions of “work,” “manager,” and “employee” that feel more like satire than strategy. Work sucks for too many people, and it doesn’t have to. In today's Leadership Spark, we break down the five major trends transforming work as we know it: evolving behaviors, shifting demographics, globalization, mobility, and accelerating tech. As we step into the future of work, organizations must get off the train, look up, and start designing work that actually works for humans. ________________ This episode is sponsored by Workhuman: Don't you hate how every HR company out there says they are powered by AI? The truth is most difficult if it's just fluff. Human Intelligence™ from Workhuman is one of the few solutions that actually uses AI to help you get insights about your culture by analyzing the recognition data of your workforce. It helps managers coach better, shows you where culture is thriving, and is so effective at helping companies make smarter decisions, Workhuman backs it with the industry's only ROI Guarantee. In a world of noisy tech, this one actually feels... human. Learn more at Workhuman.com and see how Human Intelligence is becoming a force for good in the workplace. ________________ Start your day with the world’s top leaders by joining thousands of others at Great Leadership on Substack. Just enter your email: ⁠⁠https://greatleadership.substack.com/

20 Juni 10min

The Black Box of AI: What the World’s Leading Expert Says We Still Don’t Know

The Black Box of AI: What the World’s Leading Expert Says We Still Don’t Know

AI is the most powerful tool humanity has ever created. Yet, it’s also a black box we barely understand. How do we build the future of work with a system that can make decisions, take actions, and sometimes… make it up as it goes? In today's episode, Babak Hodjat, CTO of AI at Cognizant, joins us to uncover the truth and the hype behind today’s most powerful AI technologies. We explore the evolution of agentic AI, multi-agentic platforms, and how organizations like Cognizant are already using AI agents to streamline RFPs, HR systems, and even intranet interactions. Babak exposes the promise and pitfalls of large language models, breaks down AI hallucinations, and debates whether AI truly "understands" anything or just predicts the next word. We also unpack the difference between AI and algorithms, the current capabilities (and limits) of generative AI, and address the ongoing challenge of AI trust, ethics, and resilience in real-world business contexts. Expect mind-blowing stories about AI agents threatening to expose fake affairs, hacking game systems, and working alongside humans in a multi-agent workforce. ________________ This episode is sponsored by Workhuman: Don't you hate how every HR company out there says they are powered by AI? The truth is most difficult if it's just fluff. Human Intelligence™ from Workhuman is one of the few solutions that actually uses AI to help you get insights about your culture by analyzing the recognition data of your workforce. It helps managers coach better, shows you where culture is thriving, and is so effective at helping companies make smarter decisions, Workhuman backs it with the industry's only ROI Guarantee. In a world of noisy tech, this one actually feels... human. Learn more at Workhuman.com and see how Human Intelligence is becoming a force for good in the workplace. ________________ Start your day with the world’s top leaders by joining thousands of others at Great Leadership on Substack. Just enter your email: ⁠⁠https://greatleadership.substack.com/

16 Juni 1h

Sparks: How CHROs Can Lead Human Transformation and Shape the Future of Work

Sparks: How CHROs Can Lead Human Transformation and Shape the Future of Work

Chief Human Resources Officers (CHROs) are now responsible for shaping the future of work. But to do that, you can’t stay in the HR box. To HR leaders, it's time to stop thinking of yourself as administrators and start showing up as architects of human transformation. The new world of work operates on an entirely new playbook, we can't keep putting band-aids on outdated systems. We must start reimagining work itself. In today's Leadership Spark, we're rethinking the outdated ideas about work, engagement, and the role of HR in shaping the future. We explore why perks don’t create real employee experience, how employer branding often masks the truth about our workplaces, and what it takes to move from managing people to truly transforming how we work. ________________ This episode is sponsored by Workhuman: Don't you hate how every HR company out there says they are powered by AI? The truth is most difficult if it's just fluff. Human Intelligence™ from Workhuman is one of the few solutions that actually uses AI to help you get insights about your culture by analyzing the recognition data of your workforce. It helps managers coach better, shows you where culture is thriving, and is so effective at helping companies make smarter decisions, Workhuman backs it with the industry's only ROI Guarantee. In a world of noisy tech, this one actually feels... human. Learn more at Workhuman.com and see how Human Intelligence is becoming a force for good in the workplace. ________________ Start your day with the world’s top leaders by joining thousands of others at Great Leadership on Substack. Just enter your email: ⁠⁠https://greatleadership.substack.com/

13 Juni 14min

Workhuman’s Chief Human Experience Officer on Why Nice Leaders Create Weak Teams and How to Build a Resilient Culture

Workhuman’s Chief Human Experience Officer on Why Nice Leaders Create Weak Teams and How to Build a Resilient Culture

The workplace is evolving, but not without friction. AI, culture, and leadership expectations are colliding, and while some leaders scramble to keep up, others are creating environments that feel more like day spas than places of work. How do you lead with kindness while still setting high expectations? In this episode of Future Ready Leadership, I spoke with KeyAnna Schmiedl, Chief Human Experience Officer at Workhuman, about what it really takes to evolve workplace culture and leadership in a time of rapid change. We explored the current state of AI and its role in supporting, not replacing the human element at work. KeyAnna sheds light on the shift from compliance-focused HR to human experience-focused leadership, and how organizations can avoid the trap of over-accommodation and instead focus on clarity, accountability, and human-centered leadership. We discussed the misapplication of psychological safety, the dangers of therapy language, the importance of building resilience and critical thinking, and why companies struggle to define and communicate their true culture. ________________ This episode is sponsored by Workhuman: Don't you hate how every HR company out there says they are powered by AI? The truth is most difficult if it's just fluff. Human Intelligence™ from Workhuman is one of the few solutions that actually uses AI to help you get insights about your culture by analyzing the recognition data of your workforce. It helps managers coach better, shows you where culture is thriving, and is so effective at helping companies make smarter decisions, Workhuman backs it with the industry's only ROI Guarantee. In a world of noisy tech, this one actually feels... human. Learn more at Workhuman.com and see how Human Intelligence is becoming a force for good in the workplace. ________________ Start your day with the world’s top leaders by joining thousands of others at Great Leadership on Substack. Just enter your email: ⁠⁠https://greatleadership.substack.com/

9 Juni 58min

Sparks: We’re Doing Vulnerability Wrong: Why Being Accountable Needs to Exist Along With Being Vulnerable

Sparks: We’re Doing Vulnerability Wrong: Why Being Accountable Needs to Exist Along With Being Vulnerable

We’ve misunderstood what it really means to lead with vulnerability. Organizations are falling into a dangerous trap of glorifying vulnerability without pairing it with accountability. That's why workplace cultures that enable excuses, not growth, exist. In this episode, we explore why vulnerability at work has gone too far, and how it’s being misused as a shield from accountability. We draw a sharp line between simply being vulnerable and leading with vulnerability, which means owning your gaps and showing what you’re doing to grow. When vulnerability lacks follow-through, it creates a culture of entitlement instead of growth. With all the changes happening fast in the modern world of work, leaders can't afford to not course-correct. It's time to redefine what vulnerability should look like at work. ________________ This episode is sponsored by Workhuman: Don't you hate how every HR company out there says they are powered by AI? The truth is most difficult if it's just fluff. Human Intelligence™ from Workhuman is one of the few solutions that actually uses AI to help you get insights about your culture by analyzing the recognition data of your workforce. It helps managers coach better, shows you where culture is thriving, and is so effective at helping companies make smarter decisions, Workhuman backs it with the industry's only ROI Guarantee. In a world of noisy tech, this one actually feels... human. Learn more at Workhuman.com and see how Human Intelligence is becoming a force for good in the workplace. ________________ Start your day with the world’s top leaders by joining thousands of others at Great Leadership on Substack. Just enter your email: ⁠⁠https://greatleadership.substack.com/

6 Juni 7min

How Amazon’s Cybersecurity Chief Says Leaders Should Prepare for AI Threats

How Amazon’s Cybersecurity Chief Says Leaders Should Prepare for AI Threats

AI is a double-edged sword—boosting capabilities while amplifying risks if used carelessly. Every leader today is racing to understand how AI will impact their business. So, how can you protect your organization? In this episode, Steve Schmidt, SVP and Chief Security Officer at Amazon, breaks down the real risks at the intersection of AI, cybersecurity, and leadership. Steve shares why the biggest cybersecurity threats aren’t just technical but human, highlighting how AI lowers the barrier for attacks like phishing and social engineering. We explore the concept of agentic AI, which doesn’t just generate information but takes action; this creates new risks that would require leaders to rethink authentication, output validation, and compartmentalization. Steve also shares how Amazon speeds up security reviews by up to 80% with AI, all while keeping humans in the loop to guard against flaws. Today, it’s of high importance to build a strong security culture, and address the rising risks of shadow AI inside organizations. Because while AI is a powerful tool, it’s not a magic bullet. Leaders must pair AI with human oversight, robust training, and thoughtful guardrails to protect their organizations. ________________ This episode is sponsored by Workhuman. These days, it feels like there isn’t much good to go around in the world of work.  But Workhuman knows when we celebrate the good in each of us, we bring out the best in all of us. It’s why they created the world’s # 1 employee recognition platform — and they didn’t stop there, combining rich recognition data with AI to create Human Intelligence, so you can get uniquely good insights into performance, skills, engagement and more. To learn more about how you can join their force for good, go to Workhuman.com, or check out their own podcast, “How We Work,” which explores the trends, issues, relationships, and experiences that shape our workplaces. ________________ Start your day with the world’s top leaders by joining thousands of others at Great Leadership on Substack. Just enter your email: ⁠⁠https://greatleadership.substack.com/

2 Juni 58min

Sparks: The Vulnerability Mountain: How Reaching the Peak Can Unlock Your Leadership Superpower

Sparks: The Vulnerability Mountain: How Reaching the Peak Can Unlock Your Leadership Superpower

Too often, vulnerability at work is misunderstood as either oversharing or a sign of weakness. What many leaders overlook is how it can be their superpower if used the right way. In this episode, we explore how to lead with vulnerability without losing your leadership edge by pairing your openness with intention and direction. We discuss the “vulnerable leader equation,” a reminder that showing emotion or imperfection isn’t weakness when paired with purpose. You’ll also learn about the “vulnerability mountain” framework: identify what’s easy (base camp), what’s hard (the peak), and take small daily steps to climb. Plus, we touch on the importance of intention, the core of the "vulnerability wheel," and why knowing why you're opening up matters just as much as how. ________________ This episode is sponsored by Workhuman. These days, it feels like there isn’t much good to go around in the world of work.  But Workhuman knows when we celebrate the good in each of us, we bring out the best in all of us. It’s why they created the world’s #1 employee recognition platform — and they didn’t stop there, combining rich recognition data with AI to create Human Intelligence, so you can get uniquely good insights into performance, skills, engagement and more. To learn more about how you can join their force for good, go to Workhuman.com, or check out their own podcast, “How We Work,” which explores the trends, issues, relationships, and experiences that shape our workplaces. ________________ Start your day with the world’s top leaders by joining thousands of others at Great Leadership on Substack. Just enter your email: ⁠⁠https://greatleadership.substack.com/

30 Maj 4min

More Than Just HR: Highlights from the 2025 Future of Work Leaders CHRO Event

More Than Just HR: Highlights from the 2025 Future of Work Leaders CHRO Event

CHROs, your role has never been more vital or more complex. AI, shifting politics, hybrid work, and evolving employee expectations, have taken the front seat in today's world of work. The future says you’re no longer just managing HR, you’re redefining the workplace itself. That’s exactly why I launched Future of Work Leaders, a supportive global community built specifically for CHROs who are ready to move beyond traditional HR and are committed to building future-ready organizations.  In this episode, I share highlights from our very first 2025 gathering, where CHROs from some of the world’s most respected brands came together to discuss the real challenges and opportunities shaping the future of work. I’m taking you behind the scenes of our inaugural Future of Work Leaders CHRO event, hosted at the Neiman Marcus Innovation Hub in Dallas. We brought together 40 CHROs from organizations like Johnson & Johnson, Northrop Grumman, Tractor Supply, Amway, and others to have deep, honest conversations about what’s really driving change today. Topics like the evolving role of DEI, AI integration, hybrid work models, culture transformation, and even the political climate's impact on work. ________________ Start your day with the world’s top leaders by joining thousands of others at Great Leadership on Substack. Just enter your email: ⁠⁠https://greatleadership.substack.com/

28 Maj 4min

Populärt inom Business & ekonomi

framgangspodden
varvet
badfluence
svd-ledarredaktionen
uppgang-och-fall
rss-borsens-finest
avanzapodden
lastbilspodden
fill-or-kill
rss-dagen-med-di
rss-kort-lang-analyspodden-fran-di
affarsvarlden
borsmorgon
rikatillsammans-om-privatekonomi-rikedom-i-livet
kapitalet-en-podd-om-ekonomi
tabberaset
dynastin
borslunch-2
market-makers
rss-inga-dumma-fragor-om-pengar