Ideas worth spreading

1,577,597 views | Cathy O'Neil • TED2017

L'ère de la confiance absolue dans le Big Data doit prendre fin

Les algorithmes déterminent qui peut obtenir un prêt, un entretien, une assurance ou beaucoup d'autres choses encore -- mais ce n'est pas pour ça qu'ils rendent les choses équitables. Cathy O'Neil, mathématicienne et scientifique de données, a inventé un nom pour les algorithmes qui sont secrets, importants et dangereux : « armes de destruction math-ive ». Apprenez-en plus sur les intentions cachées derrière les formules.

Become a TED Member

Want to hear more great ideas like this one? Sign up for TED Membership to get exclusive access to captivating conversations, engaging events, and more!

This talk was presented at an official TED conference. TED's editors chose to feature it for you.

Learn more about Data & Society, a research institute that covers a wide range of topics related to social issues posed by big data.

Attend Fairness, Accountability, and Transparency in Machine Learning, an annual event that brings together researchers and practitioners dedicated to ensuring “non-discrimination, due process, and understandability in decision-making” in machine learning.

Learn more about AI Now, a multi-disciplinary NYC-based initiative working to understand the social impacts of artificial intelligence.

Les algorithmes déterminent qui peut obtenir un prêt, un entretien, une assurance ou beaucoup d'autres choses encore -- mais ce n'est pas pour ça qu'ils rendent les choses équitables. Cathy O'Neil, mathématicienne et scientifique de données, a inventé un nom pour les algorithmes qui sont secrets, importants et dangereux : « armes de destruction math-ive ». Apprenez-en plus sur les intentions cachées derrière les formules.

This talk was presented at an official TED conference. TED's editors chose to feature it for you.

Learn more about Data & Society, a research institute that covers a wide range of topics related to social issues posed by big data.

Attend Fairness, Accountability, and Transparency in Machine Learning, an annual event that brings together researchers and practitioners dedicated to ensuring “non-discrimination, due process, and understandability in decision-making” in machine learning.

Learn more about AI Now, a multi-disciplinary NYC-based initiative working to understand the social impacts of artificial intelligence.

About the speaker

Mathematician, data scientist

See speaker profile

Data skeptic Cathy O’Neil uncovers the dark secrets of big data, showing how our "objective" algorithms could in fact reinforce human bias.

ProPublica | Explore

"Machine Bias"

ProPublica has collected 32 news articles from the past couple years, all spotlighting different ways that algorithms and data systems have reinforced discrimination, from Amazon and Facebook algorithms to car insurance premiums. The featured story focuses on discrimination within future criminal software.

Michelle Alexander | The New Press, 2012 | Book

The New Jim Crow: Mass Incarceration in the Age of Colorblindness

Although this book doesn’t focus on the big data side of injustice, it lays a historical foundation for the structural, racial injustices that have only been magnified by the introduction of algorithms and data systems.

Richard Rothstein | Liveright, 2017 | Book

The Color of Law: A Forgotten History of How Our Government Segregated America

Rothstein focuses on “redlining” and how present-day racial segregation patterns flow from de jure discrimination in housing.

Douglas A. Blackmon | Anchor, 2009 | Book

Slavery by Another Name: The Re-Enslavement of Black Americans from the Civil War to World War II

Blackmon unpacks America’s seldom-recognized racist history between the Civil War and WWII.

Anat Admati and Martin Hellwig | Princeton University Press, 2014 | Book

The Bankers' New Clothes: What's Wrong with Banking and What to Do About It

Admati and Hellwig pry open the claims used by bankers, politicians, and regulators to rationalize the lack of reform in the banking system.

Adam Benforado | Broadway Books, 2016 | Book

Unfair: The New Science of Criminal Injustice

Weaving together historical examples, scientific studies, and compelling court cases, Benforado shows how our judicial processes fail to uphold our values and protect society’s weakest members.

Jordan Ellenberg | Book

How Not to Be Wrong: The Power of Mathematical Thinking

Ellenberg's is a friendly introduction to the power of mathematical thinking.

Leila Schneps and Coralie Colmez | Basic Books, 2013 | Book

Math on Trial: How Numbers Get Used and Abused in the Courtroom

Mathematicians Leila Schneps and Coralie Colmez describe ten trials spanning from the nineteenth century to today, in which mathematical arguments were used — and disastrously misused — as evidence.

Learn more