Khan Academy founder Sal Khan on AI and the future of education (Transcript)

Listen along

ReThinking with Adam Grant
Khan Academy founder Sal Khan on AI and the future of education
August 15, 2023

[00:00:00] Adam Grant:
Hey everyone, it's Adam Grant. Welcome back to ReThinking, my podcast on the science of what makes us tick. I'm an organizational psychologist, and I'm taking you inside the minds of fascinating people to explore new thoughts and new ways of thinking.

My guest today is Sal Khan. He's the founder of Khan Academy, the nonprofit education platform that makes knowledge freely available to hundreds of millions of people around the globe. Sal has been named one of TIME's 100 Most Influential People, and he's a pioneer in using technology to accelerate learning. So I was excited to talk with him about AI and the future of education. Earlier this year, he gave a TED Talk on it.

[00:00:44] Sal Khan:
It can answer the age-old question: why do I need to learn this? And it asks Socratically, “Well, what do you care about?” And let's say the student says, “I want to be a professional athlete,” and it says, “Well, learning about the size of cells, which is what this video is at, that could be really useful for understanding nutrition and how your body works,” et cetera.

[00:01:07] Adam Grant:
Sal, great to meet you.

[00:01:08] Sal Khan:
Likewise, Adam.

[00:01:10] Adam Grant:
I’d love to hear just a little bit of origin story. When did you first start to dream about reinventing education?

[00:01:16] Sal Khan:
I would say it's pretty far back in life. You know, there were these moments, I would say starting in middle school and high school, and probably some of it just comes from a little bit of rebelliousness where you either reflect on your own boredom or other students in the class and you're like, “There's gotta be another way to do this.”

And I knew that I was interested in learning, and I knew other students were, but it just felt like in certain classes it was actively being suppressed in certain ways. I was the president of the math club. Might not be a surprise for a lot of folks. As part of that, we ran this tutoring program for peers, and it actually became pretty official. The high school forced any student in the school who had a C or lower in their math class to go to this student-run tutoring program. And what I saw, there were a lot of students who thought they didn't like, especially math, but other subjects as well, but especially math, and if they just got a little bit of support, had a chance to fill in their gaps, uh, that a lot of them, some of them ended up joining the math club. They ended up liking it so much.

And so that was one of the first eye-openers, uh, that, you know, if, if you're doing well in, in a, in a subject, especially in something like math, you can tell one of two narratives to yourself. One is, “Oh, I'm just gifted, and other people aren't. And that's just the way the world works.”

But the other narrative is “I have a good foundation here. And because of that strong foundation, it allows me to engage at a deep level with the math. And other folks just didn't have that foundation.”

And so they disengaged to protect their self-esteem. And I saw that in high school, but I didn't really know what form that would take in my life. In college, I was fascinated by the intersection of software and education, and I worked on several projects there, but once again, not thinking this was going to be what I would do for my life. I went into tech, then I go to business school, then I'm out of business school.

I'm working at a hedge fund at this point. It's 2004. I just got married. My family from New Orleans is visiting me in Boston, which is where I was at the time, and it just came outta conversation that my 12-year-old cousin Nadia was having trouble in math. Because of that, they put her into a slower math track.

And I then offered to tutor Nadia, and she agreed. And part of me was I really just wanted to help her 'cause I thought her situation was pretty serious. Uh, but I also just like to geek out on some of this subject matter. Go back to my days of being a tutor, and I used to tell folks when I worked at the hedge fund that I was gonna work at a hedge fund long enough so that eventually I could start a school on my own terms.

So this was always in the back of my mind that I wanted to do something like that. It was with tutoring Nadia, and I saw the same thing with Nadia, that I saw a lot of those peers in high school that she just had gaps in her knowledge and her confidence was shot. But by having one-on-one support, not only did she get caught up with her class, she got ahead of her class.

At that point, I became what I call a Tiger Cousin, and I called up her school. I said, “You know, I think Nadia should be able to retake that placement exam.” And they let her and, and she was put to an advanced track. So I was hooked. I started tutoring her younger brothers. Word spreads in my family that free tutoring is going on. So before I know it, there's 10.

[00:04:19] Adam Grant:
Be careful what you wish for.

[00:04:20] Sal Khan:
It was fun. Good fun. 10 or 15 cousins, family friends. And it was, it was, I was really enjoying myself and I started writing software for them to give them more practice. That was Khan Academy. That was 2005, 2006. A friend suggested that I make videos to supplement the software.

I thought it was a silly idea. Videos seemed very low-tech to me, but I, I gave that a shot and, and then that also took a life of its own. My cousins famously told me they liked me better on YouTube than in person. It was a significant hobby for many years. It had kind of overtaken my life. 50 to 100,000 folks were using it on a monthly basis, and I set it up as a not-for-profit mission: free world-class education for anyone, anywhere.

And my wife and I looked at our finances. We were saving for a down payment on a house, but we figured that maybe we could take a, a leap here. I could take a leap and live off of this for a little bit and see if this could turn into something.

[00:05:10] Adam Grant:
It's amazing to look back 15 years and say there was a time when there wasn't a Khan Academy. People couldn't learn on YouTube. They had to sit through whatever education was available in their local environment, and that was it. We're in the, the midst of obviously a major sea change as all of a sudden the world wakes up to the impact of AI. I wasn't sure where you would come down on this.

You've been a, a strong proponent of the importance of human engagement in education. You've enabled people to connect to even a teacher far away in ways that students often struggle to do in their own classrooms. And so you can imagine my surprise, when you came out and said, “AI is going to make education better.” What's your case?

[00:05:57] Sal Khan:
Well from the beginning, when folks saw Khan Academy and they said, “Oh, there's on-demand video. There's a software that lets students practice at their own time or pace.” Some folks built a narrative saying, “Oh, this could replace teachers.” And some people liked that narrative

[00:06:12] Adam Grant:
As, as a teacher, I hated that narrative, but go on.

[00:06:14] Sal Khan:
I would cringe when I saw that narrative. And there were some teachers who would, to some degree, go after us, and they would say things like, “Oh, well this isn't real teaching. What I do in the classroom is real teaching,” and, uh, I agree with them. What we've always advocated for is never putting technology first.

There's always some pedagogical goal. The pedagogical goal that I've become a real believer in is can we personalize things more for students? Can we make it really student-centered? Can we always give students an opportunity and the incentive to master anything that they haven't mastered before? And can we free up more time for human-to-human interaction?

Those are my objective, true notes when we think about education, and then we should think, “Okay, cool. What are the tools to do it?” So from, even from the beginning of Khan Academy, we always said, “Look, the, the whole point of the videos is to just to take the lecture off the table.”

I don't think the videos are even necessary to watch. I don't think lectures are necessary. The idea is, is that now when you go to a classroom, you can actually do more active learning, whether it's doing problem sets, whether it's engaging in group problem solving, or Socratic dialogue or a project, whatever it might be.

And then similarly, if you're a teacher with 30 students, yes. When you went to ed school, they set to differentiate, but it's awfully hard to differentiate when you have 30 kids in the room, and pre-pandemic, the data I've seen is that your average American classroom had three grade levels of students in any given classroom, and now those numbers are five to six grade levels of students in any classroom.

And so even well before AI, we said, “Look, use us as a tool,” and half of our usage is teachers using us on their own. Allow students to work at their own time and pace. Will give the teachers more information than they had before. They can know how the students are faring before a quiz, before a test. Kids are getting immediate feedback. They're getting other supports if the teacher can't get to them.

But ideally, the teacher uses that information to do focus interventions with the students. So that was pre-AI. So, uh, when OpenAI reached out to us last summer, and we went under NDA and they showed us GPT-4, we've always had this science fiction-ish ideal that Khan Academy could approximate, one day, a teaching assistant and/or a tutor. And a teaching assistant in a classroom would do things like write lesson plans or grade papers or write progress reports, but they would also support the teacher and being able to support the students when the teacher can't get to those students. And we said, “Hey, this, this actually seems plausible now.”

And so we started working on it pretty intensely, secretly until March of this past year in, uh, 2023, and then we launched what we call Khanmigo. But it's really the same idea that we are just providing more supports for students, more supports for teachers, uh, so that, especially from the teacher point of view, they have more time and energy for themselves.

[00:09:07] Adam Grant:
In principle, I think this makes a lot of sense. It tracks with a wealth of evidence on flipped classrooms and how if we can give students access to learn the content on their own time and then bring them into the classroom to engage with the teacher and their classmates and do more active and interactive learning, that leads to deeper processing, better retention, more growth. All good.

I also wonder, though, about some complications. So I'm thinking for example, about a physics experiment done a couple years ago where students learn more when they did active learning as opposed to just attended a lecture, but they enjoyed it less. I guess there's an opportunity here for AI to be helpful there. So, talk to me a little bit about Khanmigo and how it works.

[00:09:48] Sal Khan:
I've definitely observed that. We run a lab school out here in Northern California, and I've gotten complaints even from maybe a few of the students in my own family who said, “Well, why can't we just sit and listen to a lecture like kids at other schools do?”

It doesn't take as much energy as active learning, but most of the evidence is the active learning is going to be a lot, a lot better for you. And so Khanmigo is really just trying to drive that active learning and, and it does start to mix these ideas of active and, and say lecture, uh, together in a little way.

So, as I said, our objective here is a teaching assistant for every teacher, a tutor for every student. From a student point of view, we all know Chat-GPT introduced these ideas that it could cheat, it might introduce bias, it can hallucinate. It wasn't very good at math. So we aim to directly address a lot of those issues.

So if the student says, “Just tell me the answer to this problem,” it will not tell them the answer. They'll say, “Hey, I'm your tutor. I'm here to support you.” It'll say, “Well, what do you think the next step would be?” Or, “Can you explain your reasoning?” Or, “How do you think you could do that a different way?”

And then there's a bunch of things that we've done on the safety side that we think are important, at least in this stage for under 18 users of generative AI, which is all of the conversations are logged. If you're an under-18 user, you have to have either a parent or a teacher attached to your account, and they have access to all of the conversations.

We have a second AI that observes and moderates the conversations, and if it judges that conversations are going into a unconstructive place, it will actively notify the parents or the teachers. And then there's a, a ton of work we've done on trying to minimize the hallucinations and making the math as accurate as possible.

The hallucinations, it's anchored on the videos, the articles, the exercises that we already have. And so it won't make up things outside of that when it's anchored on that, but it does a lot beyond just traditional tutoring. It can simulate literary characters. The students can talk to Eeyore or Winnie the Pooh, or the Great Gatsby.
It can simulate historical characters. People can talk to George Washington or Harriet Tubman. We've introduced a whole series of activities where it doesn't write the essay for the student, and it will not. It’ll refuse to write the essay for the student, but it will write with the student and it, it’ll act as a writing coach.

It'll highlight parts of the passage or part of the essay and give them feedback on their logic or grammar or their style. I just got a Slack message from a team member where we have a prototype now of, uh, the AI now having memory and it takes notes for itself on what your interests are, ways that you like to engage types of tone, so it has memory across conversations so that it can get to know you over time and hopefully customize even more. But expect in this coming year, there's going to be probably 20 to 100,000 students in real school districts and universities using Khanmigo in a, in a formal setting.

[00:12:37] Adam Grant:
It sounds extremely cool in a lot of ways. There's also, there's a part of me that feels like it's a little bit creepy. Like I don't know how much I want an AI assistant to know about me. I don't want it to stimulate human connection. I just want it to be helpful when I need a resource.

[00:12:53] Sal Khan:
We wanna give the user, the agency to decide. So for example, this new feature that we're launching, we're calling it AI Insights. But let's say you're watching a video, and you can just ask Khanmigo in the middle of the video, like, “Why should I even care about this?”

And Khanmigo will typically say, “Well, what do you care about?” And then the student will, you know, “I like soccer,” or “I wanna make a lot of money,” or whatever the student cares about, it'll try to make a connection between whatever's in the, the content to whatever the student at least said they care about.

Now with this insights functionality, Khanmigo is going to write, “This student really cares about making money.” So in the future, it might automatically say, “Hey, well you know, last time we talked about how this might affect the stock market. Let's think about that again.” But what we have made it is students can turn that functionality on or off if they don't like it, and even if it's on, there's a place where they can see what all of the notes are that the AI has taken about them, and they can delete it. They're like, “I'm not into soccer anymore,” or, “No, that was—”

[00:13:52] Adam Grant:
Oh, that's good.

[00:13:53] Sal Khan:
That was an inference that the AI made. That is just not true. I was just playing with it at that time, so, so that gives 'em choice.

[00:14:00] Adam Grant:
So relieved to hear that. Yeah, I mean, first of all, it's, it's great that you're opening the black box so that there's not some, you know, secretive AI version of a medical or government record being kept on students. But more importantly, the fact that, that students can delete allows them to evolve. I think one of my fears as a psychologist is that, you know, the AI learns that you wanna make a lot of money because you said that when you were nine and you come from an impoverished family, and then you all of a sudden don't get to evolve your values. I would hate to see any kind of tool that's supposed to be a resource for students start to stifle their growth.

[00:14:32] Sal Khan:
A hundred percent. We were just brainstorming today about what's the best way of even getting this type of information? Obviously, it can happen implicitly with random conversations, but we might have like a icebreaker session with students in the AI and maybe encourage them to do it on a semi-regular basis.

So obviously they can go and they can edit the AI's insights, but it allows them to refresh. Snd, and, and I think there's something powerful about that, that kind of reflection that unfortunately, a lot of students don't really get to do until they apply to college, and they have to write all these essays.

[00:15:03] Adam Grant:
Yeah.

[00:15:03] Sal Khan:
And usually, they’re so stressed that they're not really reflecting. But if they can do that every, every few months or so, that could be pretty nice.

[00:15:10] Adam Grant:
I wonder if there's an opportunity here too, to, to leverage their peers. There's a lot of evidence and personality psychology suggesting that the people who know us well in certain ways know us better than we know ourselves. And so I'd love to see an annual update from you get to pick three or four classmates to talk to your AI assistant about what your interests are.

And that way, you know, your friends are gonna make you aware of patterns you can't see in yourself. And then also, you're inevitably gonna have different peers each year, and so they're gonna be new inputs coming in on a regular basis.

[00:15:40] Sal Khan:
I love that idea. We are right now also brainstorming how we can leverage Khanmigo not to just facilitate interactions with the AI, where you talk to a historical character or you get into a debate with the AI, but how it could act as a facilitator for human-to-human interactions.

And it's interesting, separately. I was even telling our head of HR that we could use Khanmigo for things like 360 reviews, where you say, “Hey, here are the five people I've worked with most closely this past year.” It can interview them. And then it can anonymize it and then it can give you the insights. In most companies, that's a very expensive process.

And, and because it is, it normally doesn't happen or doesn't happen well. But what I love your idea, 'cause we never even connected those two dots. We were thinking about using the 360 in a, in our work setting and then in, in the classroom setting. We’re like, “Oh, it could be some nice student-to-student interactions.” This could be incredibly powerful if you could have on a regular basis, you could ping your classmates or your teachers for, uh, just some good feedback.

[00:16:35] Adam Grant:
I would love to see that happen. It probably would help students build the muscle of, of feedback seeking. Right? And, and learning to learn about themselves through the eyes of others, which I think is a skill we all know is vital to learning, but a lot of us don't get enough opportunity to practice growing up.

[00:16:50] Sal Khan:
And feedback giving, which I'm still learning. The, the skill of, of doing it. Well, absolutely.

[00:16:58] Adam Grant:
There's another benefit I see of, of having the AI tutor and our audience knows that both as a psychologist who cares about people and a social scientist who loves data, I’m a little bit skeptical on all things AI, but one of the, the things that first intrigued me about it was I, I guess back in 2016, there's a big story about a Georgia Tech computer science professor, Ashok Goel, who, without telling his CS students, students had made one of the TAs for the class an AI.

You went the whole semester emailing one of the TAs and getting pointers and feedback and suggestions on homework, not knowing it wasn't a person. And even in 2016, it, it not only fooled them all, but then once the AI's identity was revealed, if I remember correctly, students were more comfortable reaching out to the AI with basic questions because nobody's worried about looking like an idiot when they're talking to a computer.

It's being judged by a human that's potentially embarrassing or mortifying. And so I wonder if you've seen that kind of dynamic play out already with Khanmigo, that maybe there's a lot of psychological safety to ask questions that might feel ignorant or stupid.

[00:18:04] Sal Khan:
We’ve just started rolling it out into mainstream school districts. One of them is in Newark, New Jersey, and we've definitely gotten anecdotal reports from teachers saying, “Those kids weren't even asking me that question. But they clearly had that gap in their knowledge.” And yeah, they, they felt more comfortable. And this does harken back to the early days of Khan Academy.

If they were in algebra and they forgot how to divide decimals, they were a little embarrassed. Even though I tried to be as non-judgmental as possible, they were embarrassed to admit that in front of their cousin, who is this math superstar and blah, blah, blah, blah, blah. But now they could just watch a video about it.

[00:18:38] Adam Grant:
I was intrigued by the Great Gatsby example in your TED Talk recently.

[00:18:42] Sal Khan:
We run an online high school with Arizona State University called Khan World School, and we have a student who attends that online school, uh, based in India, her name is Saanvi, and she was doing a report on the Great Gatsby. And when she was reading The Great Gatsby, Jay Gatsby keeps looking at the green light off into the distance, and she's like, “Well, why does he do that?”

She did some web searches and people have obviously studied this and commented about the symbolism of that, but none of it was really resonating with her. And then she realized that she had Khanmigo and that she could talk to Jay Gatsby himself. And so, ah, splendid choice, ol’ sport. I'm now Jay Gatsby, the en-enigmatic millionaire from F. Scott Fitzgerald’s classic.

And so why do you keep staring at the green light? Ah, the green light, old sport. It's a symbol of my dreams and desires. You see. It's situated at the end of Daisy Buchanan's dock across the bay from my mansion. I gaze at it longingly as it represents my yearning for the past and my hope to reunite with Daisy, the love of my life.

And what was cool is Saanvi had said, “I had this long conversation.” She called him Mr. Gatsby, and at the end, she actually apologized for taking his time, which I thought was very polite of her.

[00:19:53] Adam Grant:
And I, I wondered if this is a route to rescuing the classics. In high school, I remember probably the low point of probably my entire educational experience in high school was when my English class assigned us to read The Grapes of Wrath.

I don't think I've ever been more academically depressed in my life. Like as a kid who loved to read, like I just could not stand the story, the family, the plot, the characters. All of it just I found extremely difficult to engage with. And I watched your talk and I thought, “Okay, so you gimme a chance to maybe interact with Tom Joad, whose name I remember 'cause that's how much I hated him. You gimme a chance to interact with him and maybe I think it's cool at first, but isn't there a risk that I hate the family even more as I learn more about their perspective?”

How do you think about navigating the challenges of just the inherent material students are engaging with not being connected to their curiosity or their values as opposed to they haven't found the right connection point yet?

[00:21:01] Sal Khan:
I suspect in the not-too-far future, you're gonna be able to have actual conversations, like with voice with them. You're gonna be able to even video conference with them. You're going to be able to eventually be in a virtual world. You're gonna be able to visit their world. So all of that stuff's going to be very, very cool.

But you're absolutely right. It might just be that their world is not a world right at that moment in your life that you're especially keen to get into. I fear that sometimes we're having the exact opposite effect on students when we're, when we're forcing it on them.

[00:21:27] Adam Grant:
I’m thinking about going back into the classroom this fall for the first time since we've had generative AI, and I'm wondering if the essay is dead. It seems impossible to manage the cheating problem unless we treat it like a math test and have it written live, which I don't know a lot of people who write that effectively under time pressure or on command in one setting unless it's a student who's procrastinated until the last minute and is pulling it all-nighter. Do you have hope for students learning to write but also us being able to evaluate the quality of their writing?

[00:21:59] Sal Khan:
Yes, and this is actually something we're actively working on. To your point, in a just pure Chat-GPT world, you have two options as a professor. Either proctor the writing in class, which has limited scope, or you just say, “Yeah, you're gonna use whatever you're gonna use, but I'm gonna expect more of you.”

And I think both of those things are going to happen. Your colleague, uh, Ethan Mollick has obviously been embracing Chat-GPT in all of its forms in his work with the students. What we're working on with Khanmigo is a way that a professor or a teacher can assign a writing assignment, actually can develop the assignment with the AI.

It can develop the rubric. It can develop the prompt. It could even develop, you know, what some of the reading connected to it might be, if there is any. And then the student gets the assignment. And imagine the student essentially has, like a Google Doc or Word, Word doc on the left-hand side. And they're working with the AI. The, the AI says, “Well, your professor says, uh, wants you to reflect on how growth mindset has improved or not improved your life,” or, I don't know, whatever the essay prompt is. “And so, before we even start the essay, let's just talk about it a little bit. You and me, the AI and the student.”

Okay. Let's outline. So, okay, so it sounds like you believe the following. You think that could be a good thesis, and so it talks through it and you can outline a little bit and then you can start to write it. But you always have this helper who's not doing it for you, but is acting as a writing coach and can give you feedback, and it knows the rubric by which you're about to be graded, and then at the same time can report back to the teacher. What's cool about this is students get more support, more practice, and more feedback, which will make them, I think, better writers.

Teachers will know not just the final outcome but will know the process. And they also will not have to, like, from scratch, have to grade every paper according to the rubric. They're going to get support there. But I think if you do that, and you make it about the process, it's actually pretty hard to cheat it in that world, and it's gonna be better for everyone.

[00:23:48] Adam Grant:
This is really clever. I like it. You're not only creating a world that makes it harder to cheat, you're also helping students elicit their own thoughts and learn to express them in a way that's more compelling than what an AI would produce for them.

[00:24:01] Sal Khan:
A hundred percent right. And you know, going back to our example of how sometimes in, say, a literature class in high school, you lose your love for literature because it just feels like this task you have to do.

Same thing happens in writing. Everyone likes to argue. Everyone likes to communicate. But if we can bring that out a little bit more, and students can just recognize that, okay, writing is just putting that down on paper in a way that other people can understand your point? That’s fun.

[00:24:24] Adam Grant:
That’s a future I would welcome if it exists.

[00:24:25] Sal Khan:
And the AI obviously is another level of that where it, it can directly address your questions without fear of judgment of your cousin.

[BREAK]

[00:24:42] Adam Grant:
Let’s go to a lightning round. First one, what's the worst advice you've ever gotten?

[00:24:46] Sal Khan:
The flavor of advice where people are cynical about the world and think other people are out there to get you and they, they tell that to you.

[00:24:53] Adam Grant:
Wow, you've been told that other people are out to get you?

[00:24:55] Sal Khan:
In some way, shape, or form. There’s definitely people in my life who've said, “Oh, don't be naive, Sal. People are just out there for themselves.” The not mainstream advice I get, I get a lot of positive advice too, but that's the one that over time I just ignore.

[00:25:11] Adam Grant:
It's the exception, not the norm in my data. Which character from literature would you most love to have a conversation with?

[00:25:17] Sal Khan:
I’ll go to one of my other favorite books. I would say Hari Seldon from the Foundation Series.

[00:25:24] Adam Grant:
Huh, that’s a fair choice. All right. My dream for the future of math is to cancel trigonometry and replace it with statistics. What is yours?

[00:25:33] Sal Khan:
My dream is that in the not-too-far future in our lifetimes, people view advanced mathematics, including trigonometry and statistics and calculus, as somewhat intuitive.

[00:25:49] Adam Grant:
What's something you've recently rethought or reconsidered?

[00:25:52] Sal Khan:
My management style. I used to be very hands-off and tried to support wherever someone was, which sounds great, but I think where I am now is realizing that when you're trying to get folks to go in a direction, especially a direction that other folks might not have gone before, it's very important to be clear about what we're trying to do and to have alignment around it, and to be very open and clear with folks around this is what we're doing, and if that's not what you wanna do, that's okay. We can support you as you find the thing that you actually wanna do in life, but it's probably not going to be this. And so that's, that's a muscle I've built to just be a little bit more blunt. I, I think I had problems with confrontation in the past.

[00:26:42] Adam Grant:
And this, this may be a sequel in some ways, but what is a question you have for me as an organizational psychologist?

[00:26:49] Sal Khan:
My experience with almost any organization that grows past a certain scale is that there's just a lot of cynicism and bureaucracy and wasted effort happening. Do you think that's inevitable? Or do you think there are organizations that have scaled to, say, thousands of people that have pulled off not doing that?

[00:27:12] Adam Grant:
Oh, that's such an interesting question. There was a Stanford professor, Hal Levitt, who spent most of his career studying organizations, and at the very end of his career, he wrote half a century of evidence accumulated, lots of patterns analyzed. He just documented all the things that get worse as an organization grows: less human connection, more bureaucracy, less personal attachment to the mission.

And the list goes on and on. And I don't think those are inevitable problems, but they're probabilistic problems. We've probably talked ad nauseum at this point in social science culture about the limitations to the number of humans that you can actually maintain a relationship with, and whether you think it's 150 or a little bit more or a little bit fewer. It’s probably not 10,000.

What I've seen effective organizations do to try to minimize those growing pains is to try to build subcultures and say, “Look, there's certain values [usually three to five principles] that are non-negotiable that everybody in this organization has to stand for, and ideally everyone exemplifies them. It's unacceptable if people violate them.”

Past those values, we should be open to creativity and innovation when it comes to what our daily norms and practices are so that people can feel connected to a smaller unit that they actually have a say in and a part of. And. I, I don't wanna call out any organizations that I think are great at that because as soon as I do, they're gonna fail. Then, then I'm gonna be disappointed.

But, um, a lot of people worry that having subcultures means that you've abandoned a strong culture. And for me it's more often a sign that you're trying to give people a local point of influence, knowing that it's really hard to change the culture of a big company, but improving the culture of your team or your department, that's doable. Where do you come down on all this?

[00:28:55] Sal Khan:
We've been talking a, a, a little bit about the pivot, so to speak, that Khan Academy's been going through. We are about, let's call it 250 folks in the United States, and I think this would've been a very hard pivot had we been, you know, 250,000 folks for sure, but even 25,000 or 2,500 folks.

I think over the last decade, especially in Silicon Valley, people have so many opportunities to work so many different places. The employer should just do whatever it takes to retain that person. And I think over the last couple years I've realized that that's actually not doing anyone a favor. What you should be doing is clearly stating what you're here for, including your values. And you used the word unacceptable. Like there's certain guardrails that like if you're really not for this journey, the leader shouldn't bend over backwards to either convince you or pretend that you are on this journey. You’re not on this journey. And then we should have an honest conversation. And that's usually good for the person. 'Cause the person is usually somewhat miserable. We've been able to do this and it's been really good. I've never actually never seen the organizational health better than what we're seeing right now, at least when we've been at this scale.

I don't envy some of these folks who run these organizations that have tens of thousands or hundreds of thousands of people. And especially because of generative AI, they're having to do some real introspection and potentially really change how they operate, and I don't think it's going to be easy.

[00:30:20] Adam Grant:
No, I don't either. And I do really appreciate that there are leaders like Yvonne Chouinard in the world who paused and asked, “Do I need to dominate my sector? Do we need to be a company of a hundred thousand or 10 million people, or should we stay small and keep doing what we do well?” The quest for world domination might be as overrated in business as it is in politics.

I wanna talk a little bit about some other questions in the future of education. So I thought your previous TED talk on teaching for mastery as opposed to teaching for test scores was such a compelling idea. It's a big part of why I wanted to become an educator.

I love the experience of gaining knowledge and feeling like I understand something, and I also found great joy in trying to create that experience for other people. The American education system has not made that easy for teachers, so how are we gonna fix that in the coming decades?

[00:31:10] Sal Khan:
Well, it goes back to what teachers are taught. The gold standard is to differentiate for your students, and differentiation can take many different forms. It could be differentiation of interest. Some kids like this, some kids like that. Can you customize the curriculum for each of these kids? Most teachers wish they could replicate themselves and be a one-on-one tutor for all 30 students in the classroom, and, and it's not the teacher's fault at all.

If we go pre-industrial revolution, you did not have mass public education, but the few people who got educations, they got very good ones, usually through tutors. Then you had mass public educations. People had to make this compromise for economic reasons. 30 kids in a classroom, batch them together at a set pace.

But what had to happen is the teacher delivers the standards, delivers the lectures, and some students get it, some students don't. You usually discover that after a week or two when you give 'em a quiz or a test. The whole class moves on to the next concept. Usually, a concept that builds on, on those gaps that you just identified in that last test, and that process keeps going year after year after year. Kids keep accumulating gaps, and they start learning slower and slower and slower.

[00:32:15] Adam Grant:
One of the things that really appeals to me about your focus on mastery is it seems like a slight shift away from just a pure emphasis on growth mindset and effort, which my read of the evidence on is yes, better to teach students growth mindsets than fixed mindsets.

Especially beneficial if they're learning in environments where they typically haven't had people believe in them or they haven't had opportunity. That being said, I feel like I've seen a perversion of that in the last couple years with my students at Wharton where I'll send out grades, having bent over backward to give everybody an opportunity to excel, and I'll see a growing number of students say, “My grade does not reflect the effort I put into this course.”

I'm like, “Well, first of all, like this was a week-long class in some cases. It was not that much hard work. Secondly, you do not get graded on effort. You get graded on mastery, and you misunderstood three concepts that if you had read the article that they were based on, you wouldn't have lost points on.”

I'm curious about your reaction to that and whether you think that sort of our, I guess our almost, um, maniacal focus on growth mindset and just encouraging students to work hard has actually obscured their focus on mastery being the ultimate reflection of education.

[00:33:30] Sal Khan:
Yeah, it's fascinating, the example you just gave, because even the growth mindset literature doesn't just say, “Only value effort.” The whole point of growth mindset is you, you praise effort so that someone is willing to keep trying until they get to mastery. That when they get something wrong—

[00:33:47] Adam Grant:
When they struggle or fail. Yeah.

[00:33:49] Sal Khan:
Exactly. They don't just give up, or they don't just say, “Oh, I'm dumb.” Or when they get it right. They don't just say, “Oh, I'm smart and I don't wanna revisit that again because maybe the second time I do it, I'll discover that I’m, quote, ‘not smart.’”

And the last TED talk that you, you talked about, I, I talked about how mastery learning and growth mindset are two sides of the same coin. It's very in vogue right now for teachers to say, “Oh, mastery learning? I'm gonna praise effort. Your brain is like a muscle. The more you use it, the stronger it gets. Your brain grows when you get things wrong.”

But then students get a test. Some kids get a 70%, they get a big C or D, and then it moves on to the next test. And if you really were into growth mindset, you would allow for mastery learning. You would say, “Okay, you’re 70%. You haven't learned this yet. Keep working on it. I'm gonna give you opportunities and incentives for you to get that level of mastery.”

I know it's difficult, you only know 70% of the material right now, but it's really important for you to put in the effort and step out of your comfort zone and tackle the things that you're right now struggling with.

That's what a growth mindset is about. So I think your students got it half right. It's great they're putting in effort. You should praise that effort and you say, “Because you put that in effort, I wanna give you more opportunities for effort. It might be a little bit uncomfortable. If you want, here’s what you can do to get that 70 to an 80 or an 80 to a 90, because I really want you to master this concept.”

[00:35:15] Adam Grant:
I think you just articulated exactly the point I was trying to make, which is one of the concepts that some of these students misunderstood was growth mindset. And so ironically, they demonstrated their lack of mastery of that concept in their grade-grubbing techniques.

[00:35:31] Sal Khan:
We're trying to put this into practice. You know, we have Khan Lab School that I helped start, and then there's a Khan World School that we do with Arizona State University, which is an online high school where we're trying to address exactly what you're talking about by giving students some choice. We essentially list out a lot of these classics, but students don't have to read all of them or in the same order or at the same time necessarily. Students, number one, should learn to enjoy at least some of the classics. It's better to learn to enjoy some of them than to hate all of them.

[00:36:03] Adam Grant:
Is there anything else that you're hoping to see in the future of education?
[00:36:06] Sal Khan:
The urgency around leveraging these tools to upskill students even further has never been more serious because the reality is most kids leaving, not just high school, honestly, most students leaving even college are actually operating at like, a late middle school, early high school level in both their critical thinking, their math skills, but also their, uh, their writing and their reading comprehension. But now we know generative AI can do all of that stuff probably a lot better.

And so, I'm a believer that the future is going to be for the folks who can go one level above the generative AI and be even a better writer so that they can edit the AI and they can refine it, be creative enough so that they don't depend on the AI, but they can riff with the AI and then their combined creativity is gonna be that much better.

It's imperative, you know, that the 50th percentile isn't operating at a middle school level, that the 50th percentile actually operates at a level that they can, they can really leverage the tools that we're about to be given. We're getting the tools that really do seem like magic or like the tools of God if you were to go back a few hundred years ago and we need educated gods.

[00:37:13] Adam Grant:
Wow. Well, sign me up for a world in which people can communicate at a middle school level when relevant, but still think at a college level.

[00:37:22] Sal Khan:
That’s right.

[00:37:22] Adam Grant:
This has been a real treat. Thank you for joining today.

[00:37:25] Sal Khan:
Thanks for having me, Adam.

[00:27:36] Adam Grant:
As an educator, I've often thought about my job as challenging wrong intuitions, but Sal reminded me that education is also about building better intuitions. That's not just limited to Trig or Calculus. A mark of mastery of any subject is understanding it so well that it no longer seems foreign or counterintuitive.

ReThinking is hosted by me, Adam Grant, and produced by TED with Cosmic Standard. Our team includes Colin Helms, Eliza Smith, Jacob Winik, Aja Simpson, Samiah Adams, Michelle Quint, BanBan Cheng, Hannah Kingsley-Ma, Julia Dickerson, and Whitney Pennington-Rodgers. This episode was produced and mixed by Cosmic Standard.

Our fact-checker is Paul Durbin, original music by Hansdale Hsu and Allison Leyton-Brown.

[00:38:22] Sal Khan:
Students number one should learn to enjoy at least some of the classics if you're gonna. It's better to learn to enjoy some of them than to hate all of them.

[00:38:31] Adam Grant:
Yes, please.