[0:00:10] Hi, everyone. I'm Jennifer Ocker, the General Atlantic professor at Stanford Graduate School of Business. And I'm Michael McDowell, a producer here at the GSB. And today we're live from the GSB. That's right. You're about to hear a conversation between my friend and colleague, John Levin, president of Stanford University, and Demis Hassabis, CEO and co-founder of Google DeepMind.
[0:00:35] Jennifer, I think it's fair to say that you made this conversation happen. So tell me why you invited Demis to the GSB. So many reasons. But honestly, the thing that drew me the most isn't AI itself. It's Demis. Before DeepMind, before AlphaGo, his dissertation explored the neurological relationship between memory and imagination.
[0:01:00] He showed that patients with hippocampal damage lost not only the ability to recall the past, but to construct any rich mental scene moving forward. To imagine, you have to have lived. This was a big breakthrough back in 2007, and it raises a pretty profound question given what Demis went on to build. It really does. If AI increasingly handles planning, remembering, scenario building,
[0:01:29] What happens to human imagination? What capacities do we most want to preserve, deepen, and expand? Yeah, it's not just what we might lose, but what becomes possible. Absolutely. I'm thinking about scientific advancement, economic empowerment, creative potential, expanded agency, and ultimately fuller human lives.
[0:01:54] At the micro level, I think of this as flourishing, which means feeling fully alive, creative, connected, and purposeful. And if we're able to accomplish that, really exciting things start to happen at the macro level across organizations, communities, and society. I keep thinking about something Demis said, which you're all about to hear, which is that the future is still unwritten. None of this is inevitable.
[0:02:22] I think Demis is asking many of the same questions I am and understands maybe better than anyone how the choices we make now may alter not only our future, but the nature of human existence. And that's why I was so excited to bring him here to Stanford, the place where big ideas meet real application. On that note, thank you so much, Jennifer. Thank you, Michael. Here's Demis Hassafus in conversation with Jonathan Levin.
[0:02:51] Demis, it's great to have you here at Stanford. It's fantastic to be here. Thanks everyone for coming. Really appreciate you doing this. So we're going to, I'm going to ask you some questions. We'll have some questions from students and looking forward to hearing your thoughts. Maybe we would, you've been chronicled a lot recently, a movie, a book. So many people have heard about your trajectory. It is quite remarkable.
[0:03:21] Chess prodigy, video game developer, scientist, tech entrepreneur and leader, Nobel laureate. That's just the first half of your career. So if you were going to try to draw a through line through all those different things that you've done, what would it be? Well, I think...
[0:03:46] There's several through lines actually with what seems maybe somewhat unconnected subjects. First of all, I've always really enjoyed working at the intersection of creativity and technology.
[0:03:58] Thank you.
[0:04:22] Really an amazing time. In fact, some of the most fun times I've had in my career was early in the 90s. The chess and the neuroscience I did.
[0:04:32] All of those things I've tried to, I had from this idea of working on AI and AGI being the most important thing one could, and most interesting one thing one could spend your career working on, also from a very early age. So as a teenager, probably I read too much science fiction, reading things like Gödel, Escher, Bach, these types of books and biographies of some of my scientific heroes, you know, Turing and Feynman and so on. So all of these were serving to inspire me to try and understand the world around us.
[0:05:01] in a really deep way. And then building AI was my expression of that mission to try and build the ultimate tool for science.
[0:05:09] And I've tried to, because life's short, I've tried to reuse and repurpose every experience I've had in service of that bigger North Star mission that I've had for more than 30 years. So my chess training is the way that I think about business and organizing things and planning and how I think I've been able to break down very ambitious plans into smaller, more manageable steps. That all comes from kind of chess thinking, I would say. And then using games, first of all,
[0:05:38] Building games, learning about engineering projects at scale, running companies, startups, and then fusing this creativity with engineering. Actually, it's what we do today with AI. It's an engineering science. So you're fusing creative work, scientific work, with very hardcore, cutting-edge engineering. So that will serve together. And then finally, on games, as everyone knows, we used games in the early days of DeepMind as the perfect proving ground for testing out algorithmic ideas.
[0:06:07] When you went into AI professionally in 2010 or so, you started DeepMind. You had this very ambitious vision. You were going to solve intelligence and then solve everything else. How's it going?
[0:06:38] Let me expand a little bit. What has gone according to plan and sort of what has been off plan? Well, the broad arcs of it have gone, I mean, unbelievably well, perhaps. You know, when we started DeepMind in 2010, that's, can you imagine, we used to go to, try to go to VCs.
[0:06:59] In the UK, which there weren't very many. And with that as the business plan, it was literally step one, solve intelligence. Step two, use it to solve everything else. And people were quite confused. But we really meant it. And actually, we may go back to exactly using that mission statement. Because by solve intelligence, we meant build AGI.
[0:07:21] Ideally, also understand the nature of intelligence on the way to building AGI and perhaps using AGI to help us understand our own brains and minds better. You know, things like the nature of consciousness, what is creativity, dreaming, all of these deep mysteries of the mind. And one of the reasons I studied neuroscience was try to learn from what we understood about the brain as inspiration for algorithmic ideas. And sort of, so step one was to try and build AGI and then...
[0:07:50] We always had in mind what sort of happened, which is that, of course, it's a general purpose technology, maybe the general purpose technology. And if it was built in the right way, so it was a learning system that was very general, what would be the limit of what it could be applied to? It's not, you know, it could be applied to almost anything, was the dream. And I think that's what's borne out. I had specifically in mind for that step two, advancing science and medicine.
[0:08:18] So that's what I meant by using it to solve everything else. I meant the big questions in science, all of them. I wanted to, you know, I was fascinated by all of them, the nature of time, the nature of reality. Maybe that's the most fundamental one. And I loved physics when I was at school. That was my favorite subject. And I think when you're interested in the big questions, you end up doing physics probably. But the reason I...
[0:08:43] I decided that there were too many interesting big questions. So how was one to, you know, try and tackle all of that in a lifetime? And that meant, in my view, building new tools and to aid us, the best scientists, the best experts, to make much faster progress in the fields that they were tackling and the big questions and important questions that they were tackling. And then, of course, AI in itself is also a fascinating artifact in itself, scientific.
[0:09:11] Sort of object, one could call, worthy of study itself. It's almost a new field. So this is sort of, to me, the most fascinating and most important thing to spend one's life on. And I would have been doing it even if it hadn't worked out. I would have found some way to be doing this, you know, in academia or wherever. This is what I would always plan to spend my life working on. And all those things I did earlier were...
[0:09:37] Different expressions gathering the experience and I suppose the knowledge to be able to attempt something like DeepMind in 2010 when we were sort of, I felt, we felt that we were ready to make fast progress.
[0:09:49] And of course, the second part of that, use it to solve everything else, is now much broader than just science and medicine, although that's where I've tried to personally do my work in, as well as running the overall organization. But obviously, it's going to be amazing for productivity and many other things in the world outside of just science and medicine. As you've been building these different models at DeepMind, you started with games and then you went into science.
[0:10:19] Were there particular moments where that, I mean, you started with a lot of conviction, but I'm curious if there were sort of particular moments where you sort of saw this is actually going to work. Yeah. AlphaGo and playing Move Third. Yeah, there were many moments where I thought it wasn't going to work, put it that way. So some of the ones I remember really well are...
[0:10:43] We started with games because they're self-contained. They obviously were designed by other humans to be challenging or fun for other humans to play. I love games. They're often microcosms of a lot of real-world scenarios. If you think of Go or poker or chess, I often thought one of the courses I'd have in an MBA or business school course would be a games module.
[0:11:10] to study those types of games, diplomacy. They all have really interesting aspects of the best games of real life. And you can obviously practice many times in a kind of safe scenario. That's what I think games are really useful for. And that applies to AI systems that are learning too. They're neat environments, they're challenging, and they have clear objective functions, which also was very important for our early days of reinforcement learning. Almost no one had used...
[0:11:39] And so we started with, I would say, the most famous set of most basic games that had become, you know,
[0:12:03] World popular, which were Atari games from the 70s. And we started with the simplest game of all, which was Pong. You know, there's just the bat and the ball, just two bats and a ball. And there's an inbuilt AI system, an inbuilt system that controls your opponent and uses all the information that the game has about where the ball is and so on to move the bat around. And what we wanted to do was, could you play Pong just from the pixels on the screen?
[0:12:32] So the raw data, the raw visual input, and no other information, no privileged information about, no access to the insides of the program about where the ball is or the speed of it and so on, which obviously the program knows. But we didn't give the DQN system, as it was called, our Atari system, any of that information. It just got the 20,000 pixels on the screen. And 20,000 pixels, I mean, seems sort of trivial now, but back in 2010, that was...
[0:12:59] Enormous amount of input data. No one had ever dealt with something that complex and then multiplied by all the frames that you were doing. And for about, it felt like six months, maybe it was only two months, but we couldn't win a single point at POP.
[0:13:12] So it was jerking the bat around. It was like, oh, is it ever going to even be able to control the bat? And of course, he had no notions of any of these things. It was just losing 21-0 to the inbuilt AI. And I did think, and we had a couple of different ways of trying to attack this, and we had almost no money. You know, the runway, you know, the couple of...
[0:13:35] A million dollars of funding that we had, which wouldn't even cover an intern these days, which is good for all of you students, was our entire funding. And we were taking no salary, and it was running out, the money. And I was like, oh, well, maybe it turns out, maybe we are still 10 years too early. Maybe we're 20 years too early. And then magically, it got a point.
[0:14:01] And it was like, oh, maybe it was just luck. And then it started winning a lot of points and then it started winning the games. And then it was like, okay, we have liftoff now. So now, and those of you working in machine learning will know this, if you get a foothold, you can usually...
[0:14:15] He'll climb your way out of that. That's been the history of AI, I would say. Once you have something working, there's usually a way of optimizing it more. And that's what turned out with Atari. So that was our first big result. And our first Nature paper was really the first deep reinforcement learning model, certainly at scale. Combining deep learning to learn the domain and deal with the perceptual inputs and the complexity of the inputs, find the patterns in it, and then reinforcement learning.
[0:14:44] Built on top of that to kind of make the decisions and do the planning. And then, of course, that culminated in AlphaGo, which was always our aim. Dave Silva and I, who was head of that project, we were friends as undergrads at Cambridge, and we were discussing it since our undergrad about...
[0:15:01] We were there in the mid-90s. The Deep Blue Kasparov match happened while we were at college. Of course, I was fascinated by it both from the chess and the AI point of view, but I was more impressed with Kasparov's brain than I was with Deep Blue because Kasparov, with his incredible mind, still one of the biggest chess geniuses there's been of all time, he was able to...
[0:15:24] Basically compete on an equal footing with this supercomputer brute force machine next to him. But of course, he could do all the other things with his mind. Speak five languages, do his politics, drive cars, all the rest of the things humans can do. To me, that was incredible. That's much more impressive. So there was something missing from the Deep Blue system. And obviously, those techniques, those expert system techniques, where you hand curate the heuristics and then you use brute force search on top, which is still how a lot of traditional chess programs work today.
[0:15:53] That works for chess, but it's never worked for Go. Because Go's too esoteric a game. It hasn't got material. Every piece is worth the same. It's all about patterns and intuition. Even the top Go players, that's how they play it. So we realized, we sort of thought, okay, if someone could actually get to world champion level at Go.
[0:16:10] It's not just about really that was an aside getting to that level. It was more about the approach you would have taken would probably be a really interesting algorithmic approach and maybe and hopefully would generalize to other domains. And that's what turned out with AlphaGo. And then it went beyond our wildest dreams really because not only did it win the match against Lisa Dole in 2016, it also created...
[0:16:36] New, famously new strategies that had never been seen before, even though we've played Go. Go is the oldest game humanity has invented. It's 2,000 years old, 2,000 plus years old, and been played professionally for hundreds of years.
[0:16:50] We hadn't discovered those strategies. So I was sort of, that was sort of double whammy for me. I was waiting for that moment that AI was able to come up with something novel. And we, you know, it's not, there's more levels of creativity than that, but beyond that, but at least it was a novel idea. And then that was for me, was what I was waiting for to then start using AI for science. So the moment we got back from Seoul, we started the AlphaFold project. Now, when you went, so that's,
[0:17:17] Talk about the science a bit, because then you went into the protein folding problem. And again, you picked a problem where there was data and where there was a clear objective function in terms of thinking about protein folding. And it worked. I mean, you actually managed to solve this longstanding problem of predicting protein structure. You did something very interesting when you came up with AlphaFold, which was...
[0:17:47] It was obviously a huge Nobel-worthy scientific breakthrough, probably also of commercial value. And you just gave it away for free. I'm curious, how did you come to that decision? Did you think about other ways of going about it? Why give it away?
[0:18:05] Yeah, so we picked the protein folding problem. I had my kind of eye on that since also, you know, my undergrad days at Cambridge. Just when I first came across it, I had a few biologist friends who were obsessed with the protein folding problem. And actually, they ended up becoming structural biologists, of course, in their career. And one specifically, I remember he was, you know, every time we were in the pub playing table football or something, he would be talking about, obsessively, how this was the most important problem in biology.
[0:18:35] And more importantly, I think of it as a root note problem. Like if you could unlock that and find the structures of proteins, that would unlock whole new avenues of research. Things like drug discovery, obviously we're trying to ex-push that, but also fundamental biology and disease understanding. So this was...
[0:18:54] This was a problem worth really spending a lot of attention and time on because of the downstream effects that it would have. It also felt to me, it was a fascinating problem. It felt to me like the ultimate puzzle.
[0:19:06] You know, 3D puzzle of how does this sort of, you know, amino acid sequence, you can think of it as genetic sequence, fold up into this 3D structure. It's amazingly interesting, intricate thing. And the more I looked into proteins, the more incredible my respect and wonder is for biology. Like these unbelievable little bio nanomachines, you know, everything on life obviously depends on proteins. And as you start looking at their structure, you start understanding their function. So this is fascinating to me as a science question.
[0:19:35] And then, yes, there was the clear objective. It's sort of like minimizing the free energy in the system. Presumably this is how physics is doing. It's why the body, you know, these proteins fold in milliseconds in your body, you know, billions of times a second. So somehow physics has solved this. And it can't be, there must be some topology, let's say, that you could learn, maybe with a deep learning system, that would guide the search.
[0:20:01] Just like we've done with AlphaGo to find a great move in Go, a great strategy out of the more possibilities than there are atoms in the universe in Go. And protein folds are even larger search space than that. But there's some way to narrow that down in a sensible way. You learn a kind of heuristic using the deep learning models to then guide your search for that to become tractable. And it felt like a really analogous problem in science to what we'd solved in Go.
[0:20:28] Sort of applying some of those same approaches, those same theories to this domain. And then the other thing was there was obviously 50 years worth of painstaking crystallography, structural biology work by many great labs and people. And after all of that effort, there was about 100...
[0:20:48] 150,000 structures in the PDB, the main database, which isn't a lot actually. Obviously, it's a huge amount of effort that's gone into that, but there's 200 million proteins. And 150,000 also for machine learning systems is a very small amount of data. So most people thought it was at least 10, 20 years away before we would have enough data and the right types of algorithms to tackle that. But we felt that using every...
[0:21:14] Technically, we knew in the end that we could make progress with that. And it turned out to be the case. And then when we decided to, well, how would we make the maximum impact with this? It was obvious to me that...
[0:21:27] We should fold all the proteins so that, because not only was AlphaFold accurate, it was extremely fast. It could fold a protein in a matter of seconds. And then collaborate with, in the end, European Bioinformatics Institute in Cambridge, which hosts many of the biggest databases, biology databases scientists use, and just host the entire 200 million protein structures on their database and just allow it to be as simple as a kind of Google search to just...
[0:21:54] Find your protein structure, along with the confidence intervals the machine learning system had about which parts of the protein structure it was confident on, which is very important for biologists to know. So we put that all together.
[0:22:07] And it was, of course, could have been very valuable. I don't know how many billions of dollars or whatever. I mean, it depends how you calculate it. To do that experimentally would be incalculable cost. But it would have been hugely valuable to keep proprietary. But for us, it felt like we would only be able to scratch the surface of the downstream impact that putting all those structures out in the world could have on our own.
[0:22:30] Because, you know, there's three million researchers around the world that use AlphaFold pretty much every day. Almost every biologist, medical researcher in the world. There's no way one organization could have done that. So it was obviously the right thing to do. We also had depended on public data to train the first versions of AlphaFold. So it only felt right to give back to that community, the structural biology community, this amazing resource that was amplifying the resource they had mistakenly built.
[0:22:59] And so it was just, it wasn't even a question for me. And, you know, it was great that also the executives at Google also, you know, love science and totally got that. I don't think all companies would have made that decision. So I give them a lot of kudos on that too. That was an easy discussion. And then we've tried to ourselves push that downstream with Isomorphic Labs, an alphabet spin out that is building, you can think, several more type of alpha fold level breakthroughs, putting them together.
[0:23:29] We'll be back with more of Demis and John after this. Stanford GSB Executive Education is designed for professionals at an inflection point, ready to pause, reflect, and reimagine what effective leadership looks like today.
[0:24:09] In our programs, you'll engage directly with Stanford GSB faculty, learn alongside an accomplished peer group, and apply cutting edge insights to real world challenges. Find your next step at grow.stanford.edu slash programs. I want to turn for a minute to something you said earlier this week. You were in the news this week because at a big Google event, you said,
[0:24:49] That were in the foothills of the singularity. Yes, it got quite a lot of pickup, that line. It got a lot of pickup. And I understand that maybe the Google press team might not have been so thrilled about it. But since you're out there saying that, what did you mean by that? Yeah, so the full thing I said that sort of closed the conference with was when we look back at this time,
[0:25:19] I think that, you know, maybe I'm thinking sort of 10 years from now, I think we will realize that we were standing in the foothills of the singularity now. What I mean by that and the reason I chose that word is that, so there's the technology, which is AGI. We've been calling AGI this next version of really general artificial intelligence. I believe that we're only a few years away from that, maybe like 20, 30 plus or minus a year, which is astounding to think really. And then the era,
[0:25:48] I think that will be such an enormous transformative technology, it's going to effectively be a new human era. And that's what I'm meaning by the singularity is that, and what many science fiction writers have written about that, is that it's sort of the, it's describing the era that we will be in, in and around when the advent of AGI happens.
[0:26:08] So, and I think we can feel this year, I would say, even though I've been working towards this for 30 years, I think this year with the way the agents are working and tool use, it started to become really useful for, you know, still early days of it, but genuinely useful in people's workflows. And we can sort of see what extra things that need to be done. And all of us, the leading labs are working on that.
[0:26:31] I think this is the beginnings of that, but the foothills. I still think there's a lot more work and it's just the beginnings. And it's not any one thing. It's several different technologies, several use cases that I see, several things that I thought were maybe a bit further out turned out to be now that are coming together that make me feel that in aggregate and to the extent that I wanted to say that. Because I think society needs to hear that because we don't have long to prepare.
[0:27:00] For what that means. And it's going to be enormously profound, I think. And the future, in my view, is still to be written. But these next few years are going to be very critical as to which way that will go and how we collectively want that to look like. If you look at surveys of how people perceive AI in this country in particular, it's very negative right now.
[0:27:28] And maybe more negative here than even in other countries. And there's probably lots of things driving that, concerns about privacy or state control or the size of the tech companies or jobs. I mean, you're running one of the leading labs. And how do you think about that public concern about the technology?
[0:27:57] The public's right to be concerned. I think that there are things that, and I'm concerned about several aspects of what the technology is. It's a dual purpose technology. It's something this profound. You know, I sometimes describe it, quantify it as 10 times the impact the industrial revolution was, 10 times faster. And so, you know, it's taking place over a decade instead of a century. So that's like 100x.
[0:28:22] of the industrial revolution. And it's probably an underestimate, to be honest, but that's probably enough for us to try and comprehend, right, and deal with. And so, of course, I think there are, it's super exciting. There's going to be amazing things that are going to happen. Like we're trying to do that with solving all disease. I think, you know, a lot of the other challenges facing society today from climate to energy to disease will be helped by AI.
[0:28:49] I'm sure of it. And in fact, I'd be much more worried about those challenges if I didn't think something like AI was coming down the line. But it's going to cause a lot of change and disruptions and actually both on the technical side, economic, and philosophical. And I think we've got to...
[0:29:09] And I think one of the reasons it's negative here is that...
[0:29:29] Specifically, because it's different in other countries. For example, when I go to, we came back from the summit in India, it's hugely popular with the youth of India because they see the opportunities that it's going to democratize for them, having access to basically the same tools that you would have needed to go to Silicon Valley for. You know, the world, we're in an amazing moment in that everyone can access pretty much what's going on in the frontier labs, but only, you know, with a delay of just a few months, right? That's unheard of, really, if you think about that. So there's incredible things.
[0:29:59] I think it's also partly the way some of my peers are articulating. I think they're being very careful with their communication and understanding. They're being way too certain, I would say, with some of their pronouncements, where I think actually there's just huge uncertainty, and that is worrying in itself, but it also means that nothing is decided.
[0:30:19] In my opinion, I think it's kind of unknown. And I think anyone who says that, I think directionally, I could tell you some things, but I think a lot of it really depends on the actions taken in the next few years. And also what the youth of today, the many students in the room today, you're going to be forming, you're the first generation to kind of grow up in AI native, should we say, like I did, computer native.
[0:30:43] Just like every generation, you'll master these technologies, become super productive with them. And I actually think over the next 10 years, at least, hard to predict beyond that, you'll almost be super powered.
[0:30:56] If you use them in the right way, the amount of creativity and projects you can do and the amount an individual will be able to do. But maybe that will change the nature of jobs. There'll be more entrepreneurial, small entrepreneurial things rather than big companies. I don't know. It's going to change a lot. And I think part of that is for society to come together and really take this exponential seriously, not just the technologists.
[0:31:19] Economists and others need to take this seriously right now and start charting out what does that look like? If we're in a post-scarcity world, for example, how does everyone benefit from that? You know, a lot of it's about how does, you know, it's obviously not correct for just a few people or even a few companies or even a few nations to be benefiting from this technology. It needs to be...
[0:31:41] It's going to affect all of humanity. It has to broadly accrue the benefits to everyone. But how is that going to be done? A lot of us have been talking about this for a while, but we really need answers now and concrete things and actions to be taken. And I plan to do my bit on that. I've been thinking a lot about this over the years and planning.
[0:32:02] And building sort of influence on this. And I will do what I can. Obviously, we're an important actor, but we're only one actor in this space. But I hope, I know that the good news is, I know that all of the sort of leading labs and the leaders of those labs, although they disagree on a lot of things, they do worry about these sorts of issues coming down the line.
[0:32:25] We need more forums to allow them to, you know, for us to come together to discuss these things more candidly. And I think that's what probably the public is detecting is just sort of slightly skewed discussions about what's going to happen and maybe there's some ulterior motives behind some of that messaging, you know, raising money, other things. But I think we need to get to, you know, use the scientific method, be really rigorous and thoughtful about this, you know, critical moment in history. And then maybe the final thing I would say is...
[0:32:55] I would love to see, I think it's incumbent on the industry and the field to show more unequivocally what the benefits are and not just talk about them, but demonstrate them. So in health, in medicine, in science, these things are all, in my view, are sort of unequivocal goods, right? Like alpha fold. But there aren't enough examples. There should be 20 alpha folds, right? And there should be, you know, we got to like stop talking sort of in the hypothetical about curing cancer and actually cure cancer, right? And so this...
[0:33:23] These are the things that I think are going to be needed to demonstrate to the public why are those of us who are excited about it, and many of us are in this room, why are we excited about this? Why have we spent our whole life building towards this? And also, how are we going to concretely mitigate the risks while enabling all of the amazing things that we would like to see and I think society needs? I think a lot of great points there that if there were
[0:33:51] If there were some tangible benefits that were realized because of AI breakthroughs, say, to human health or drug discovery, that might change people's perception in some ways. And I love the suggestion of sort of trying to think farther out about a world that might look very different in terms of productivity and so forth. It's hard, actually, to do that. Rarely in social science people get out of the current frame they're in and actually project
[0:34:21] Way forward, I think of Keynes' great article during the Depression when he looks out the economic lives of our grandchildren. It's a rare case that you were saying we need another Keynes right now. Maybe there's someone in the audience who will do that. Let me ask, one of the things you've talked about for a lot of years is the need for the frontier labs to...
[0:34:46] To, in a sense, regulate themselves. That is to sometimes sort of not release certain kinds of technologies that might be threats to safety and so forth. Right now, it's pretty clear that the labs are just at a breakneck competition. They're investing everything. They're going all out. Do you still feel the labs ought to be self-regulating? Do you think the government ought to step in and regulate?
[0:35:16] AI in some way. How do you see the current dynamic relative to the way you've talked about it in the past? Well, look, first of all, just to give some historical context to this, this is not what... In terms of what we talked earlier about how the technology's gone, I think the technology has gone amazingly and maybe even on the better side of what I imagined 20 years ago. But the environment it's kind of been birthing in is not the ideal. Far from it, right? I was very worried about...
[0:35:45] 15 years ago, 10 years ago, about this race dynamic happening as more and more people, more and more companies, more and more ambitious tech leaders realize what I had known for 20 plus years of how important this technology was going to be. And we talked about some of this in the room about the dangers of this kind of race dynamic. And unfortunately, we've ended up, because of the way the technology's gone, so if I could have waved a magic wand, what I would have done was,
[0:36:15] Build AGI, the general technology, more in a research.
[0:36:18] Maybe all the best minds helping critique each other's ideas and making sure we were rigorous with the scientific method and the testing of it and understanding each step that we took. But then we wouldn't have to wait for that. Of course, that means AGI would arrive later, maybe 10 years later. But we wouldn't need to wait for that to get the benefits, societal benefits of it. Because at the same time, we would break off bits of that and use it for specialized systems like more alpha.
[0:36:48] AlphaFold is a specialized hybrid system. It uses a lot of the ideas that general purpose systems use, but it's specialized to protein folding. So that was actually my, and you can see that was my vision for it because that's what we were doing. But then chatbots changed that because effectively, and that was probably the only surprise to me over the last sort of 15 years on the science side is,
[0:37:13] How effective transformers ended up being for language and the fact that you could separate language and sort of learn it just from the internet without having to act in the world.
[0:37:23] Either robotics or simulations. You know, it's kind of very interesting. And that would be a whole other topic, why that was. And I have some theories on that. You know, language is more grounded than linguists probably thought. There's some grounding coming from the reinforcement learning feedback that the human testers are doing, because obviously we're grounded in the real world. So when we say yes, no to certain things, our grounding is then ending up in a very low bandwidth way, but still ending up modifying what the foundation model understands.
[0:37:52] So there was these sort of unexpected things, I would say, that happened. And then that made it a commercial, very important commercial technology that could be scaled with engineering and money and so on, which is what you see today. And that changed the dynamic and then has created what we see today, which is probably the most ferocious competitive environment I would say there's ever been. I mean, certainly in the tech industry, tech era, maybe ever.
[0:38:17] Maybe other historians here from the business school will tell me otherwise. But it feels unbelievably intense being in the middle of it. And it feels like that for all of the participants. And then on top of that, you layer the geopolitical complexities. So there's also, this is a double race going on. There's the race between the companies, and it's pretty life or death for them. And then there's the US-China dynamic and others, the geopolitical dynamic. And there's a race there.
[0:38:46] So it's a double-layered one, very tricky. Now, I still have hope that there can be some cooperation and coordination between, we certainly discussed this as lab leaders, on the safety elements and the security elements. Everybody wants that. Nobody wants something catastrophic.
[0:39:06] The problem is we're in a kind of prisoner's dilemma where anyone who, by definition, if you take more time to release something or make something safer, that's harder than just putting it out there.
[0:39:18] And letting it see what happens. So a defector has some advantage. And this is the classic problem with the race to the bottom dynamic. And we've got to change that somehow, and I think urgently. And I think part of that is some form of government involvement. The hard part there, of course, is that anything to do with regulation, it's too slow.
[0:39:41] Every week, there's something new. If we were to regulate something two years ago, it'd be just like, it's like ancient history now. So it would almost be, you know, almost certainly the wrong thing. So whatever is designed, and I have some ideas in this, and I'll probably be talking about this later this year, is like, it needs to be dynamic, which is, doesn't go, usually that word doesn't go with regulation, right? So it's got to be like, fleet-footed and able to inform by the, you know, latest developments so that it can adapt to where,
[0:40:10] Where the actual risk is rather than some kind of perceived risk that turns out not to be the case or not the critical thing many years before. It's just not going to work for AI. And even today...
[0:40:23] The leading scientists wouldn't necessarily agree on a short list. In fact, I know they definitely wouldn't agree on a short list of what checks and balances are needed. And that's because the science isn't settled. And that's partly the speed, but also the pace of the...
[0:40:40] Progress is running ahead of the understanding of it. That's just how it is. It's part of the race dynamic. But we need to kind of somehow rebalance that. And I think some form of really almost smart regulation is required that is dynamic and can adapt with the times very quickly and probably informed by the leading labs because they're seeing what's actually at the coalface.
[0:41:11] All right, that opened, I think there's so much more to discuss there in terms of the prospects of how you set up a regulatory system for AI and do it in a way that didn't prevent some of the breakthroughs, positive breaks you're talking about. Exactly. To the geopolitics. We want all that innovation, right? We want to solve the disease. So exactly, how do you enable the good use cases and mitigate the bad? I'm looking forward to when you bring out your plan for that this year. I think that'll be...
[0:41:40] Fantastic. And that'll give us a lot to talk about here on campus and everywhere. We've got a couple of student questions. I want to give a chance for some student questions. Hi, Demis. I'm Aaron's second year at the business school. My question is, how do you balance pushing the frontier of AI with ensuring that the health and scientific dividends is evenly distributed?
[0:42:12] We think about that a lot, actually, and that goes back to one of some examples that I can give is back to the AlphaFold question, where...
[0:42:31] We folded all the proteins. We put that out on databases you could access from anywhere around the world. So these 3 million researchers come from 190 countries, just to be clear. It's pretty much every country, every researcher.
[0:42:45] And it means that they, and what was great, what we did actually in the early days of seeding some collaborations, what you could do with AlphaFold, we worked with the DNDI, Drugs for Neglected Disease, part of the WHO in Switzerland, which work on diseases in the poor places of the world that don't have good healthcare systems. And some of those diseases are neglected, as you know, because the big pharma can't make money by, you know,
[0:43:14] So what we were able to do in collaboration with this institute and many actual universities on the ground is...
[0:43:31] Jump them straight to not needing to try to figure out like malaria virus or the structures of Zika virus or something like that, which they would have had to do all the painstaking structural biology. They can just start that as a given and work straight away on the drugs.
[0:43:45] So that allows to speed up massively the whole process. They can sort of take the structure of interest and move forwards from there. Same with crop resilience affected by climate change. We work with Jennifer Doudna's institute and many others on these things because lots of plant proteins were not...
[0:44:09] We didn't know what the structures were of them because obviously most of the structural work has gone into human proteins. So if it's animals or plants, there's a lot less data out there. So it's even more differentially impactful in those types of areas. And then the final thing I would say is if we can, and I think this is where...
[0:44:30] The capitalist engine can actually work for good here is if we can make the drug discovery platform that we're working on at Isomorphic as efficient as I'm talking about, you know, down from years to months. So instead of it costing billions of dollars, it costs...
[0:44:47] Tens of millions of dollars, maybe single millions of dollars. Then suddenly, what I'm hoping we'll be able to do with isomorphic is we cure all these terrible diseases that maybe affect the richer parts of the world. That makes money and that fuels it, fuels the engine. But then we can do sort of philanthropically, the company could find cures to diseases where we don't need to make any return because it's fast enough and it's cheap enough that it can just be done.
[0:45:14] And in a short amount of time. So I think that's sort of my dream for how I can make isomorphic help the whole world. Hi, Demise. Thank you so much for taking the time to talk to us. My name is Miki. I'm a senior in the Doar School of Sustainability. And you've described extensively how AGI could be humanity's most transformative technologies. And I'm just curious.
[0:45:41] The responsibility or how you think about the societal impacts alongside this intellectual pioneering and productivity that AGI presents, particularly when thinking about how is this going to redefine and reshape people, the challenges that we're trying to solve today, but kind of the downstream effects that that could bring.
[0:46:05] Thank you. Yeah, thanks for your question. I think about this all the time and have done from the beginning because we were planning for success, right? So even though it seemed very improbable back 15, 20 years ago. And I think...
[0:46:21] This is why I like doing talks like this and meeting folks in these kinds of places. It is a bit of a call to arms now. It's very urgent that we really think about the second order consequences. And I think many of you in the room and many of you in the humanity subjects, it's now's your time, in my opinion. Because, okay, we've got to get the technology right. But then if we do that...
[0:46:48] Then there's the economics question. And if we get that right, there's the philosophical questions about the human condition. And I'm very excited about, and I'm a big believer, I'm very optimistic. Obviously, I'm a cautious optimist is the way I would say it. I'm very optimistic that we're going to get this right. And I'm a big believer in human ingenuity, especially when the pressure's on. I think humanity's always figured it out when the chips are down, and they are now. But we do really need to start...
[0:47:17] I think the technologists are taking it seriously, but the other parts of society need to as well. Economists, I'm always a little bit astounded when I talk to economists about...
[0:47:27] What's happening? And it's sort of, they're pretty skeptical. Where's it coming in the GDP? And it's like, look, it's 10 times the Industrial Revolution. Can we start planning for that now? Like, you know, and we'll be in a world where we do need some giants of these fields like Keynes was for now. Like, why would that hold in a post-scarcity world? We're going to be in a world for the first time if we get the technology right, where we're non-zero sum.
[0:47:51] How can that not need a new type of economic system? It has to. And I don't think it's any of the ones we've tried because they were all done under the guise of zero sum and a limited, a scarce world. And I'm talking about traveling to the stars and utilizing...
[0:48:14] All the resources that are out in the solar system, not just the limited ones on Earth. And I think that really is going to happen if we get the technology right in the next 10, 20, 30 years. And then, after all of that, there's the even harder question of how do we want to evolve our society and what is virtuous, what is meaning, what is purpose. And I think that's going to need lots of great philosophers. So that would be my appeal to people in those fields.
[0:48:40] Now, in my view, could not be more of an exciting time if you're working on those types of projects, as long as you understand and really viscerally sort of understand and lean into what's actually happening here. That's a good charge to a university. Okay, one more student question. Hi, Dennis, I'm Janai. I'm a second-year MBA student. My question to you is, what do you not want AI to touch in this lifetime, and what do you hold secret from your perspective? Thanks.
[0:49:10] Yeah, that's a great question. Look, AI is going to be, in terms of the scientific world of things, it's a fully general technology, right? You can think of it as a Turing machine. That's the way I think about it. It's my favorite course at college. And I think our minds are actually fully general. So we're kind of approximate Turing machines. So as Turing showed, anything that's computable, a Turing machine can compute.
[0:49:40] Most things we know about in the universe, non-quantum things, are computable. So that's a pretty large set of general things that we can turn our minds to. Hence, we built modern civilization, which is miraculous if we stop to think about it. And I don't think we wonder enough. We don't keep our sense of wonder for long enough about that. But it also means these systems that we're building, they're also going to be sort of Turing powerful as well.
[0:50:04] One thing I would say is that there are very big questions to come that I think it would be better if we took more time over. So one example that's pretty topical right now is consciousness. And it's not a very well-posed problem from philosophy and neuroscience still, although I think we all have intuitions as to what are the important aspects of that. My feeling is the current systems don't exhibit any.
[0:50:29] But others disagree. What I would recommend, though, in terms of what areas should AI not touch is that we build our first systems as tools, intelligent tools. That's enough of a challenge already, in my opinion, because that's already AGI. And then using those tools, I think we should study neuroscience and other things like that and philosophy and actually come up.
[0:50:53] with a more rigorous definition of things like consciousness. I think that is possible. And then test things against that. And then maybe society decide if we want to cross the second Rubicon of trying to make entities that at least seem like conscious to us. So we may not want to make that decision. I think that intelligence and consciousness are dissociable. So I don't think you have to do that to have an intelligent system. I think it's a choice. Some of our...
[0:51:20] And so you can probably feel that when you use some of the leading chatbots. There's differences in opinion that come through. And my view is it'd be better to take that as two steps. They're both enormous for humanity rather than conflate the two. Demis, we've got an auditorium with many students in it. If you were back in school, how would you be thinking about, what would you be studying?
[0:51:49] What would be your advice on how they should be thinking about to study in their careers? Well, look, I would be really excited if I was back at college now. My recommendation would be those of you doing science and STEM subjects and mathematics and computer science still do those things. I think you'll be able to take better advantage of these tools if you understand how they are put together.
[0:52:17] I think that's going to be true for the next period, the next 10 years at least. And I would also lean in, though, to not wish it away. The genie's not going back in the bottle. Like, lean into what these tools can do. I can tell you that the leading labs are so busy making the tools.
[0:52:38] We probably only scratched the surface of, not even probably, of what they can actually do, even today's tools. Sometimes people call it capability overhang. There's so much potential these things can do if you figure out how to pair them with other things or pair it with another domain you're expert in, build it into your workflow in an interesting way.
[0:53:00] Those tools, they're the most powerful tools anyone's got. You have them in the palm of your hand. There's so much more you can do as an individual. I think it should unleash creativity, like those of you studying humanities or product or business, maybe you didn't have coding skills before, but you can produce a lot of what's in your mind now using these tools. But I think also the coders, the people who are expert at that, could do 100x more.
[0:53:28] Like the terms of the size of project you can do if you're expert at coding. So I think it enables both the democratization and the people that are specialized in those areas. So I think it's an amazing time, but it's also, I get it's also worrying because everything's going to change. So that's the only thing I can tell you for sure. Everything is going to change in the next 10 years, probably more than people assume. But that also, in any time there's enormous change like that, there's enormous opportunities. There has to be.
[0:53:54] And the world's sort of your oyster, really. And I kind of envy some of you now because you're the first generation that will be AI native, just like my generation was computer and internet native. And it's going to be in your hands in the end, the students in the room, like how that future world gets built.
[0:54:13] I think it's a very exciting time if you think about it in the right way, from the right angle, and with a lot of imagination and creativity. But I think that's always been true. And maybe it's more so now in periods of enormous change like this that accentuates it. We were saying in a period of a lot of change where you don't quite know what the future holds, but you have to be able to be adaptable and have...
[0:54:41] Broad domain of knowledge. It's going to be a golden era for liberal education. I think, I mean, the main thing is to just make sure you double down your own agency. The future's still to be written, I would say. So don't listen to anyone who says it's not. Demis, thank you for joining us. It was amazing. This podcast is a production of Stanford Graduate School of Business. Thanks so much for listening.