Ideas worth spreading

빅 데이터에 대한 맹신의 시기는 끝나야만 합니다

1,654,013 views |

캐시 오닐 (Cathy O'Neil) |

TED2017

• April 2017

알고리즘은 은행에서 누가 돈을 빌릴 수 있는지, 누가 면접을 볼 수 있는지, 그리고 누가 보험에 가입할 수 있는지나 혹은 더 많은 것을 결정하지만 그렇다고 그게 자동으로 세상을 공정하게 만들지는 않습니다. 수학자이자 데이터 과학자인 캐시 오닐은 비밀스럽고, 중요하면서도 해를 끼칠 수 있는 알고리즘을 "대량 수학 살상 무기"라고 명명했죠. 이들 공식에 숨겨진 목적에 한 층 더 가까이 다가가 봅시다.

알고리즘은 은행에서 누가 돈을 빌릴 수 있는지, 누가 면접을 볼 수 있는지, 그리고 누가 보험에 가입할 수 있는지나 혹은 더 많은 것을 결정하지만 그렇다고 그게 자동으로 세상을 공정하게 만들지는 않습니다. 수학자이자 데이터 과학자인 캐시 오닐은 비밀스럽고, 중요하면서도 해를 끼칠 수 있는 알고리즘을 "대량 수학 살상 무기"라고 명명했죠. 이들 공식에 숨겨진 목적에 한 층 더 가까이 다가가 봅시다.

This talk was presented at an official TED conference. TED's editors chose to feature it for you.

Learn more about Data & Society, a research institute that covers a wide range of topics related to social issues posed by big data.

Attend Fairness, Accountability, and Transparency in Machine Learning, an annual event that brings together researchers and practitioners dedicated to ensuring “non-discrimination, due process, and understandability in decision-making” in machine learning.

Learn more about AI Now, a multi-disciplinary NYC-based initiative working to understand the social impacts of artificial intelligence.

About the speaker

Cathy O'Neil

Mathematician, data scientist

See speaker profile

Data skeptic Cathy O’Neil uncovers the dark secrets of big data, showing how our "objective" algorithms could in fact reinforce human bias.

ProPublica | Explore

ProPublica has collected 32 news articles from the past couple years, all spotlighting different ways that algorithms and data systems have reinforced discrimination, from Amazon and Facebook algorithms to car insurance premiums. The featured story focuses on discrimination within future criminal software.

Michelle Alexander | The New Press, 2012 | Book

The New Jim Crow: Mass Incarceration in the Age of Colorblindness

Although this book doesn’t focus on the big data side of injustice, it lays a historical foundation for the structural, racial injustices that have only been magnified by the introduction of algorithms and data systems.

Richard Rothstein | Liveright, 2017 | Book

The Color of Law: A Forgotten History of How Our Government Segregated America

Rothstein focuses on “redlining” and how present-day racial segregation patterns flow from de jure discrimination in housing.

Douglas A. Blackmon | Anchor, 2009 | Book

Slavery by Another Name: The Re-Enslavement of Black Americans from the Civil War to World War II

Blackmon unpacks America’s seldom-recognized racist history between the Civil War and WWII.

Anat Admati and Martin Hellwig | Princeton University Press, 2014 | Book

The Bankers' New Clothes: What's Wrong with Banking and What to Do About It

Admati and Hellwig pry open the claims used by bankers, politicians, and regulators to rationalize the lack of reform in the banking system.

Adam Benforado | Broadway Books, 2016 | Book

Unfair: The New Science of Criminal Injustice

Weaving together historical examples, scientific studies, and compelling court cases, Benforado shows how our judicial processes fail to uphold our values and protect society’s weakest members.

Jordan Ellenberg | Book

How Not to Be Wrong: The Power of Mathematical Thinking

Ellenberg's is a friendly introduction to the power of mathematical thinking.

Leila Schneps and Coralie Colmez | Basic Books, 2013 | Book

Math on Trial: How Numbers Get Used and Abused in the Courtroom

Mathematicians Leila Schneps and Coralie Colmez describe ten trials spanning from the nineteenth century to today, in which mathematical arguments were used — and disastrously misused — as evidence.

Learn more

This talk was presented at an official TED conference. TED's editors chose to feature it for you.

Learn more about Data & Society, a research institute that covers a wide range of topics related to social issues posed by big data.

Attend Fairness, Accountability, and Transparency in Machine Learning, an annual event that brings together researchers and practitioners dedicated to ensuring “non-discrimination, due process, and understandability in decision-making” in machine learning.

Learn more about AI Now, a multi-disciplinary NYC-based initiative working to understand the social impacts of artificial intelligence.