[0:00:04] Good morning and welcome to Dev Day. It is great to have everyone here and everyone joining us online. Thank you for coming. I think this is going to be our best Dev Day yet. We have shipped a lot since last Dev Day and you all have built amazing things with it. You find uses for these models that we hadn't thought of. You've also helped make all of our products better. You have sent us thousands of requests, mostly on Twitter, with ideas for what we can improve. We try to read all of them and we work through them as fast as we can.
[0:00:51] You asked us to bring Codex to Linux, so we did that. Yeah. Wow, a lot of people liked that one. You asked us to work across multiple folders in one Codex project, so now you can do that too. And you asked for Codex on your phone, so we brought it there. It gives us a lot of joy to build things that you find really helpful. And the next thing is one of the things that you've all asked for the most. It's something we've been quite excited about too, so let's get into it.
[0:01:26] We're kicking off today with a product that we believe is going to feel like a whole new way to work with AI. This is the real-deal version of AI that we've always imagined for ourselves. It's like an AI helper that always has your back, inspired by the cool versions of what we all watched in movies growing up. It can hugely magnify your ability and expand your potential, working 24-7 to take on things that you don't want to do so you can focus on higher-level work. Now...
[0:01:51] Now, you may have seen early signs of what this could look like in virtual assistants that help you book a reservation or buy a plane ticket. And these things are useful to hand off, but they are trivial relative to what the technology can do. And so we wanted to be way more ambitious. Think about that AI from the future that you imagined. It knows what's going on. It knows what matters to you. You don't have to tell it every little thing to do. We want AI to feel like that.
[0:02:20] We want it to feel like magical things that it just does for you without you having to ask. So today, we're introducing DOTS. DOTS are remarkably capable, always-on agents built to handle really anything you can think of. They bring AI into a whole new form factor to work and give you more time and attention so you can do the things that you care about. Let's meet DOTS. Hey, I'm your DOT. I'm new in ChatGBT. I'll be here to handle everything that comes your way.
[0:03:12] Ready to jump in when you need me. I'm going to call you Alfred. You got it. I'm Alfred. I'll keep things moving and check in when something important needs your approval. Love it. Let's get to work. I've been getting your website ready for the full launch using your approved designs. Okay, perfect. The latest consumer experience numbers came in on Teams. I've been updating your board meeting deck. Sounds good. So I cut the app migration in your Google Meet notes.
[0:03:40] I've already mapped out the changes. Get it started, but make sure you first check every flow against the current product before I review. Also, update on wedding planning. Bad news, the cake vendor cancelled. Good news, I already found a backup. Lifesaver, when can we do a tasting? Saturday at 11am works for both of you. Hey there, your website's updated with the new designs for the fall drop. Check it out. Nice, I like that.
[0:04:18] Just swap the first and third photo and then you can publish the site. Done. You're live. Your board meeting deck is ready. Product pieces climbing and revenues up 51% year over year. Okay, this looks good except for change it so that the consumer experience is first and then get into the growth numbers. How's it looking? The rebuild is faster and testing with no regressions found so far. The preview and results are in the PR. Amazing. Share the results with the team on Slack and get the stage rollout ready for my approval.
[0:04:49] I'll flag anything that changes. Also, I booked the kids after school lessons as soon as registration opened. They'll love that. Thank you. Tomorrow's finance review just got moved to the same time as your daughter's recital, so I'm going to see if we can reschedule. Okay, yes, please. I can't miss that recital. All set. I'll start prepping your notes now. What feels new about my dot is that it gets to know how I like to work over time and where I want to focus my attention. It can do things like review what came in overnight.
[0:05:31] And ping me in the morning with anything urgent before I start my day. I've been really surprised at what a difference this makes to my life. I feel like I've finally gotten some of my attention back. I no longer feel quite as addicted to my phone in the same way. It's the way I've always wanted to work with AI. Of course, Dots can take care of the small things like those plane tickets or the time for dinner or help with the home renovation that you've been putting off. But because Dots are powered by Astra and a lot of other things we've built around them, you can delegate ambitious pieces of work.
[0:05:58] The way you would to a high agency engineer or a chief of staff that you work with. You just give DOTS a responsibility like monitor incoming bug reports, test and fixes and draft PRs, kick off next year's budget planning cycle and keep all the teams on track. Find out what's slowing down our app, build a fix and show me how much faster it runs. And your DOTS will just get to work and keep working. So here's a good example for DOTS. Get our app off this legacy API before it shuts down. That is a difficult problem.
[0:06:28] The API might be used all over a code base, and it's not obvious what's going to break as you start making changes. But DOTS can trace those dependencies and figure out everything that needs to change. They can write the code, run the tests, and bring our team pull requests to review. Think about how you would have done that the old way. How many people would have been involved? How much time would it have taken them? What else could they have done instead? Now, imagine having DOTS do that for everything you can think of. DOTS on board with everything they need to get to work.
[0:06:58] They follow your access, they have their own computer in the cloud, their own browser, and they can write and test code as needed. You'll be able to start with one dot today, and in the future, if you'd like, you can work with a whole team of dots. You also don't need to be in ChatGPT to talk to your dot. Coming soon, you'll be able to send it a text message, it'll text you back, it can text you updates, flag when something's changed, or ask you to weigh in on a decision. You can even give your dot a call and talk with it directly.
[0:07:27] DOTS also work with more than 4,000 apps across ChatGPT. When you onboard your DOT, it gets to use the same plugins you've already connected. It can just follow along with your work wherever it happens. Through all of this, of course, you stay in control. DOTS are powered by Astra, our most aligned model, and they have built-in protections and safeguards. You can set the boundaries on app and computer use, and you can customize instructions for any actions your DOT takes.
[0:07:54] So this allows you to trust your DOT with as much responsibility as you're comfortable with. Okay, so that's DOTS. DOTS are very deeply tied to you, your context and your workflows and your desire to get things done. But you also need a space to collaborate with your team and their DOTS. And the problem here is that almost all productivity software was not built for AI and people to work well together. So we're changing that too. Next up, we're introducing ChatGVT Space. This is a place where you
[0:08:25] Your teammates and your agents can all work together. Space starts with a page, like the one here you see on the screen. You can write a plan, do research, create images, generate data, or build something new. Dots can work alongside you directly in the page. You can bring in a dot and ask it to track dependencies just like you would with a senior engineer. You can tag a dot in a comment, and it'll jump in and get to work. Your pages and files all live together in a space, like they would in a drive.
[0:08:54] But spaces feel alive. You can give the page specific instructions like check the API platform Slack channel and update it daily with findings here. Coming soon, we're introducing a new way to build presentations right inside space too. So you'll be able to share a presentation with your team, collaborate together with your dot and their dots right inside ChatGPT. This will be a version of slides that could be easily read and modified by agents. So at this point,
[0:09:21] I'd like to welcome Holly on stage to show you a demo of how this all works together. Thank you, Holly. I'm Holly, and I'm on the product team here at OpenAI. So Dots have changed how we work and even how we built the product itself. So today, I'm going to show you how teams at OpenAI use Dots via a fictional music app we're calling Blossom. So this is Blossom Music. It's a fictional, cool app for creating playlists. And this is my Dot, Dotty.
[0:09:58] So DOTS have all of your connectors. You can add them to Slack. They can orchestrate your codecs. And so DOTI is truly indispensable to me. It's a second set of eyes across everything I give it access to. And more importantly, a second set of hands to actually take work off my plate. So let's say we're gearing up to launch Blossom Music. It's tomorrow, okay? Things are chaotic. But DOTI has my back. This morning, it proactively caught a bunch of things for me to look at.
[0:10:26] Our launch review moved earlier, it already updated my calendar. We shipped some new features to test users last night, and it's already looked at the feedback. And it looks like design landed a last-minute rev on our home screen, and Dottie's not only spotted this, but actually sent me the design to take a look at right here. So this is all context I'd normally have to piece together myself, or worse, things I would have missed entirely, but Dottie has it. So let's take a look at this new design.
[0:10:55] Okay, I like it, but this close to launch, I really want to be able to play with it, right? And because Dottie has access to this laptop and its dev tools, I'm just going to say, go build it. And no pressure, Dottie, we'll check back on this later. So here's my personal favorite part of working with Dots, voice. My teammates make fun of me because I'm always holed up in a phone booth talking to Dottie, but talking helps me think.
[0:11:24] I like to riff, brainstorm ideas, and because Dottie already knows who I am, what I'm working on, and why, I can get straight to the point. It's like talking to a second brain. So let's say I'm walking into the office, and I just need to catch up on last night's alpha. Good morning, Holly. Nice to hear from you. Hey, so I'm just walking in. Can you catch me up on just user testing from last night? Checking that now. How's it going?
[0:12:10] Still checking. All right. I think maybe Dottie is having kind of a slow morning. I might ask it to, hey, I'm going to review with the go-to-market leads later. Do you want to just drop an FAQ into the page? Sure. I'll take care of that. Okay. Thank you. So I love voice. I love jamming with Dottie one-on-one. But sometimes we know that the best ideas are developed together. One second. So.
[0:12:44] We've added a brand new place to collaborate with your team inside of ChatGPT called Space. Awesome. So when I hit slash here, you can see all of the different things that you can build. Interactive charts, sheets, live prototypes, anything you need to bring your ideas to life. And your team and your dots can actually join you in here. So let me show you what I mean. I can just tag in
[0:13:15] I can tag in teammates like Reni or Rishabh, but I can also tag in Dotty itself and say, hey, can we actually turn this into a bar chart, please? And the visualizations in here are completely dynamic. I can filter by feedback types and I can inspect these data points. And my Dot can keep this up to date every single hour.
[0:13:45] Now here's the FAQ that we just asked Dottie to drop in. And because Dottie has all my context, I can actually just, you know, hand it off things that would really slow me down. Like, hey, let's add in that stat about onboarding from that one engineer in my Slack DMs. And Dottie can find it. Or maybe something like, hey, let's incorporate more of Laura's feedback. Okay.
[0:14:14] So space is a place where DOTS and your team can jam together and stay in sync. But where DOT has really changed how we work is Slack. All of us are getting tagged all day, and sometimes an innocuous ask like reconciling launch specs can turn into a whole project. Now I can forward the thread to DOTI. I can just delegate and say, hey, can you take this?
[0:14:43] And as you can see, my DMs are full of these little handoffs. I get to decide what needs my attention and what my dot can take care of. And by giving dots their own identity, they become extensions of our team. So here's something we totally didn't expect at OpenAI. People started treating their dots like their delegates. And now we bring our dots into group chats from the get-go. So here, Gabe and Patrick are handing off tasks to their dots. When the dots come back with the results,
[0:15:14] Everyone stays in the loop. And our engineers are taking this one step further. So here someone's dropped in a session ID and a user bug into a feedback channel somewhere, but Gabe's DOT picks it up, investigates it right away, and opens a PR with a fix. And this is a real example. Our engineers have their DOTs fixing dozens of bugs a day in this way. It's been amazing to see how much DOTs were built by DOTs.
[0:15:44] So by now I've delegated a lot of different things to my DOT and it's freed up my time to brainstorm, spend time with the team. This is a live demo and it looks like earlier there was a little bit of an error throwing up this Codex thread. So I'm going to try it again. And what's happening here is that DOTI can actually use Codex on my laptop to build the app and launch it in the iPhone simulator. Now, this might take a bit.
[0:16:16] But the amazing thing is we can start with the mock on my phone, run local execution, and get it to be a working app here, and then I can even ask Dottie to just run with it and ship the PR, all while I'm here with you. So, dots are extensions of us. We can give them our own, all of our context and memory, and they can take work off of our plates.
[0:16:46] They can filter the noise, and when you add all of this together, dots really become extensions of you. It's not just about getting the same work done faster. Here at OpenAI, we've actually felt this firsthand. The dots are changing what we feel capable of taking on. And when this scales to everyone, imagine what you could build together. So I can't wait to see what you do with this. Thank you. I have personally been waiting for this product for years, and we can't wait to hear the feedback from you all on how you're going to use it.
[0:17:22] Both Dots and Space will be available to all ChatGPT Pro, Business Premium, and Enterprise users today. And your Dot is included in your plan and conversations don't eat into your usage. You can always work with your Dot. It's available 24-7. One more thing for Enterprise users, we're also previewing specialist Dots today. These are like virtual teammates set up by your company that will work alongside your whole team.
[0:17:55] They can help scale intensive work like accounting, marketing, legal, much more. You can give them goals and contexts, review what they produce, give them feedback to improve, and that'll be shared across your whole company. We've been testing these inside of OpenAI, and they have been remarkably effective in many different roles. So for our enterprise customers, we'd love to work with you to get them set up and make sure they're really great. We're also working with Microsoft to integrate specialist dots into Agent 365. So this means businesses can manage their dots
[0:18:25] Through the Microsoft tools that they already use. We believe that things like DOTS along with our models will give people a whole new set of superpowers. You can get so much more done than you thought. Whether you're using AI to expand a small business, create more accessibility, or finding new ways to fight infection. We want people to discover that they can do things with AI they never thought possible. So that brings us to the second big part of today. We want to support you all with a powerful platform for building whatever you can dream of.
[0:18:57] There are three parts to this that we're really going to talk about. Models, we want you to have the best access to the best intelligence at the speed and the cost you need. Second, better tools. We want you to have the same tools we use inside of OpenAI, the freedom to build and run your products wherever it makes sense for you. And third, distribution. We want people, we want to help people discover what you build and connect you with new customers. So first, let's start with the model. We launched Astra a few weeks ago.
[0:19:28] It's the most capable and aligned model in the market, but people keep asking us for two things. Make it cheaper and make it faster. And we really didn't want to disappoint you. So first, we are launching GPT 6.1 Sol. You don't even know what it is yet. We got to tell you why it's good first. This is a powerful model. It has a great balance of cost and capability. It gives you very near astral level intelligence at a fifth of the price to help you code and build.
[0:20:04] It's extremely affordable to run. In fact, the cash input costs are a 95% discount on standard input. So this makes it much cheaper for agents to reuse context, iterate on solutions, and work through longer tasks. We think you will really love this model that is smarter than Astra in some ways, and it will become your daily workhorse. So we're very excited to get 6.1 Sol launched today. But sometimes, you just want the highest intelligence at an absurdly fast speed. So today,
[0:20:33] We're launching UltraFast across the API, ChatGPT, and Codex. And we think you are really going to love this and not want to go back. Fast already gives you twice the speed at twice the price of standard, but UltraFast takes that to eight times the speed at six times the price of standard. An incredible 300 tokens per second. You know what? It's worth it. Let me show you, actually. So this is the same task side by side. We gave both models the same prompt.
[0:21:08] Create and launch a rocket with the Dev Day colors. On the left here you have ultra-fast, on the right you have regular. You can see how much faster this builds. The ultra-fast rocket is already taken off and the regular rocket is not even close to being finished. There is nothing like this on the market today. You can use ultra-fast now with Astra and soon we're going to offer it for 6.1 Sol as well. So here's what these improvements mean for your Pro subscription. We're introducing Pro 500 with our highest usage limits.
[0:21:38] We are also reopening the Pro 200 subscription today. Pro 200 will continue to have access to all of our frontier models. And with GPT 6.1 Sol, you will have a model close to Astra quality that you can use a lot as your daily driver. Our goal is to give you the best combination of intelligence,
[0:22:07] We're going to talk about the capabilities and capability at every price point in the whole market. One more exciting speed update. Today we're previewing our new Decisions API. The Decisions API lets the model respond in a fraction of a second. It's so fast, so it really feels almost instant to interact with. You can see here at using a computer and how quickly it's moving through these steps, this is not sped up. This works by giving our Luna model a predefined set of options to choose from, like routing a request,
[0:22:43] Classifying image, deciding what agents should do next. And by focusing the model on that choice, we can make it extremely fast while keeping capabilities like image understanding, broad language support, and safety protections. We're very excited to see what you'll all build with this. So, thank you. So OpenAI now offers leading models across intelligence, price, speed, voice, images, frontier models in every category. We want to be a one-stop shop where you can build.
[0:23:17] I'm really proud of our research team for getting the models to be this good, usable at this kind of scale, available at these price points, into the hands of developers everywhere. Now, there's a question of how the researchers can do all of this. Last year around this time, Jakob and I made a somewhat bold prediction on a livestream saying that we would see the first AI research intern in the next year. To say the world did not have a lot of confidence in that prediction at the time was an understatement. A few weeks ago,
[0:23:47] We announced that we hit that goal. We now have an AI research intern, a system that can take on a clearly defined research task that would take a skilled researcher a lot of time and effort to complete. And we want to show you what that looks like and how capable these models have become. So for that, I'd like to bring up one of the researchers working on these models. Please welcome Tejal. Thanks, Sam. Hi, I'm Tejal. I'm a research lead for post-training.
[0:24:20] I'm excited to share how these models are changing the way we do research here at OpenAI. Astron-related models are great for math, coding, and computer use, and all of these matter a lot for research. Being able to use a great model for research helps us train even better and more aligned models in the future so we can bring capabilities that are more useful to you.
[0:24:41] For example, my collaborators and I work on computer use, and our models help make Astra a step change improvement for the industry in speed, performance, and safety for desktop and browser navigation. Here are some examples, not sped up, of the model helping with legal tasks, designing assets for a video game, making a dashboard, or even filling in your taxes. And our models help make this improved training possible. One way this happened is our models actually helped optimize the harness we use for computer use.
[0:25:10] So here, you have latency on the x-axis. We want latency to go down. And we have performance on the y-axis. And we actually had the models run in a continuous loop to find wins in the harness that would improve latency and performance. And then we pulled these into the real prod harness and post-trained on them. And this has resulted in already a more than 2x latency win that we've shipped to all of you. Even more importantly, and I'm very proud of this one,
[0:25:39] Our models help make Astra much safer at computer use by improving our monitoring and our model behavior training to improve refusals in unsafe scenarios. And this has helped us achieve industry-leading performance on computer use stress tests. So our models are much less likely to make a mistake when navigating a desktop or browser and much more likely to be aligned with user intent, which should really matter for all your dots. Beyond computer use, our models are accelerating our research program.
[0:26:08] Our team tracks token use within research, and you can see, especially after this summer, token use really skyrocketed internally. And we're seeing returns on this investment. For example, we track how often a model can carry out a task in research. And in January, the models were pretty successful on short, less than 15-minute tasks, but failed the vast majority of times on a task that took a day or longer.
[0:26:33] But as of July, and with that good, good ultra-fast, our models have taken on over a third of day-long research tasks with no intervention required. So what does this mean? The mission of OpenAI is to ensure that AGI benefits all of humanity, and we want our models to help tackle some of the most complex challenges we are facing. Models like Astra have already helped solve over 100 math problems that were open for decades, and they're also helping accelerate creating new antibiotics for drug-resistant infections, studying ancient languages and history,
[0:27:04] Developing better renewable energy and improving energy efficiency and accelerating industrial robotics and manufacturing. We believe our models will help make developers and users make very strong progress on some of the most important and ambitious problems for humanity. And we're excited to see what you discover and build next. Thank you and back to you, Sam. Thanks, Tejal. That was awesome. We have a lot more stuff. So that brings us to the second part of supporting developers. Giving you the tools to build what comes next.
[0:27:37] We want you to have access to the same foundations that we have at OpenAI. This starts with the Codex harness. It powers Codex, Work, and now Dots. We have put a lot of effort into making this harness very efficient so that you get accurate results at the fastest speed with the fewest tokens possible. And it's open source, so you can look under the hood, thank you, and build it yourself. To power products like ChatGPT, we built this harness to run at scale for billions of users, and that same scale is there to support your products too.
[0:28:08] Next up, we're making all of this available in the cloud. This is something I know you all have been waiting for. Codex is now fully in the cloud. So this means you can start a task on your phone, pick it up on your browser or your desktop, right where you left off, no more lost threads. You don't have to worry about closing your laptop in the middle of a run. Your agents just keep working wherever you are. This cloud harness unlocks a lot of new possibilities. And one important example that we think you're going to love is our new Codex Security Cloud that we're launching today.
[0:28:45] We wanted to give defenders a better set of tools to harden their infrastructure. We see what's coming. And the new Codex Security Cloud runs in cloud environments. It continuously finds vulnerabilities and prepares verified fixes for you to review. We've added some highly requested new features like automatic deduplication, scheduled scans, a new interface, and you can start using it today. Next up, we're launching a new agents API to make all of this available to you. The agents API includes great core components,
[0:29:15] Like the harness, hosting, memory, multi-agent controls, and much more. This is the same technology that powers Codecs, Dots, and all our agents. And it is now available in public beta so you can start building. And we're bringing computer use to Agents API. This gives your agents a whole new set of powers. We want to show you a demo of what this looks like. So say you're building an agent that tests websites. This agent can now use a computer to open the browser, click through the pages, and test the flow.
[0:29:47] We also want to support you on your infrastructure of choice. It's been great to see how quickly our partnership with AWS has grown. We've worked together with them on bedrock managed agents powered by OpenAI. You can build OpenAI agents in AWS right alongside your existing applications and data. AWS customers can access our frontier models and use Codex and ChatGPT work too. Okay, here's a big one. When you build these agents, they need to work safely and protect your data.
[0:30:18] So today we're previewing OpenAI private intelligence to give you stronger controls over your data while using the most advanced capabilities of our models. ZDR with private safety processing delivers frontier model safety without storing your content on our servers at all. And with private inference, we can even provide privacy at the time of inference. Together, we think these set a new standard for privacy and frontier AI. We've worked closely with some of our largest customers to design privacy and safety systems
[0:30:47] All of this and everything you're building needs both speed and reliability. We've been hard at work on this. We've seen 100x growth in the responses API in the last year, 100x in the last year, and we have still kept more than 99% reliability. We've now cut the time to first token by 45%.
[0:31:13] And we have sped up tool calls and workflows by more than 30%. We will keep going on this. But these improvements make this the most performant and reliable API available anywhere in the market today. So, thank you. That's a lot of new things for developers to build with, and it wouldn't be Dev Day without a demo from Roman. So, let's bring him on stage to show all the new ways you can build with these new tools. Thanks, Sam. I'm just taking a few photos of the waterfront. I'll be right there. Hey, Codex, can you help me? Sure, I can help.
[0:31:54] Tell me what you need. Can you welcome everyone and share a fun fact about Fort Mason? I'll be coming shortly from the left door, so get my demo ready. Thanks. Let me get that ready. Hello, Dev Day. Great to have you here at Fort Mason. And hello to everyone watching around the world. Fun fact, at San Francisco's 1915 World's Fair, visitors could hear voices all the way from New York over the telephone. Today, you've got an AI on the mic, a room full of amazing developers, and a few new tools to play with.
[0:32:25] Oh, there's Romain. All right. Good morning, everyone. I love how we can keep building with Codex even when we're not on our laptops and kick off a task like this one from anywhere. Last year, we did not even have an app for Codex. Now, I don't have enough time today to show you half of the things we're shipping. So let's dive right in. It's been awesome to see how all of you have been creating 3D worlds with Astra the past few weeks. And I took a few basic photos of the venue to kind of recreate the same thing here. So let's take a look.
[0:32:59] What I really wanted to try is how we could change it together in real time with ultra fast. So let's dive in. Taking a second to start here. Let's try again. Live demos. All righty. Interesting. We might have to type this time. It's okay. Okay. You know what? I'll just simply tell it. Fly me to the stage. All right.
[0:33:51] So what's interesting here is that I can interact with the room with ultrafast. So what I'll do instead here, if we have a little difficulties with the voice chat, I'll go back here and let's do something else with this room now. It feels a little empty, so I'll say, why don't you fly the dots to their seats, for instance. It would be nice. It feels a little empty so far. Time to bring the dots, and here they are. So we're just changing this world in real time as we go.
[0:34:19] Pretty cool. Maybe we can do something a bit more risky now. And why don't we just turn the camera to the room, to the audience, and I'll say, put the live stream on the big screen. And let's see what happened there. There we go. Wow. So if you want to wave at the audience, for those of you watching on YouTube, thank you for tuning in. Great to have you.
[0:34:48] So with Ultrafast, you can build and really kind of change a world like this or build anything almost as fast as you can think. But there are so many different ways to build with Codex now. I want to show you a few of my favorite ones today. So let's switch to a terminal for a minute. Now, we have completely refreshed the Codex CLI with tons of improvements you've been asking for. So let's start with this empty project here in React on the right side. So let's see if I can start voice here.
[0:35:20] We might have some voice difficulties at the moment, which is pretty unfortunate, but it's okay. You know what? We're going to do ultra-fast anyway, but this time we'll do it with simply the command line. So we'll say, build an app that picks three attendees at random. I want to give them free tickets for next year. So let's see what happens there. So here, obviously, it would be even faster and better with voice.
[0:35:50] But we've really brought bi-directional audio in the terminal. I wish I could show it to you, but we have all of this powered by GPT Live, so the same as in the app. So this is not typically dictation. You could just react in real time with all of this. Now, a few seconds in the making here, and boom, our app is now ready with ultra-fast. Now, let's do something more interesting here, and let's try to switch things up a little bit. I'll say, you know what? Make it six attendees. Why not?
[0:36:21] Don't blink, it should be fast, and boom, it's already changed, right? So, okay, let's bring this full screen, and should we click on this button? All right, let's do it. Let's see who's coming back to Dev Day 2027 now. All right, we have six winners. Congrats. My dot will take it from here and email you the details later. All right, so that was ultra-fast and bi-die audio.
[0:36:55] We've added a ton of other new features too, but let's go back to the app. Now, I want to show you something cool here, but before we do so, I will actually just start this project right now. We'll go back to it in a second. I want to tell you how Astra Adventures came together. It's a simple idea to build a game with Astra where you could fly into space in 3D, and it all started from this sketch on paper. Now, if you take a look after a couple of turns,
[0:37:27] We got someplace, but as you can tell, the graphics were a little rough. And that's where having great models across all modalities is so helpful. So as you can see, it was easy then to, after a few turns, get to a place where we have these amazing graphics and go from a sketch to something that is very textured, very beautiful, that you can use then in a real game. So from here, all we had to do was kind of refine the game dynamics a little bit, and it should now be waiting for us. So let's take a look here.
[0:37:57] Now, instead of playing this game, what I'll say is like, show us how you play the game. What's interesting here is that now we're instantiating a browser use connection. So that means that Astra will figure out how to control the game and learn how to play it in real time. So in a second, it should be able to like start the game.
[0:38:18] Choose a ship on its own. And if you take a look at the screen here, on the left, you'll see the decisions that the model is making. And on the right, on the very far right of the screen, you'll see the keys it's pressing on the keyboard to figure out how to play this game. And obviously, it's a very beautiful game, but I love watching Astra actually figure out a game that was designed for us humans, but then figuring out how to play it. Pretty cool, right? So you get the idea. I'll just pause it right here. Awesome.
[0:38:48] Now, you've seen browser use, but Astra is also incredible at using any other app on your computer. In fact, let me show you. If I bring a different project over here, and let's say I bring this app on the front screen, what I can do is take an app shot. And using an app shot, I'll just dictate a quick prompt here, audit my app across screen sizes and take screenshots along the way. I'll send this prompt. Nice.
[0:39:23] So now that I sent this prompt, let's go back to the app here. I'm learning to fly, so this is just a little personal project I made for my weekend lessons to track them. Now, if you look at what's happening, I love app shots. They kind of bring all of the context.
[0:39:39] And in this case, it now teaches Codex to navigate the computer and in this app. So here, what you see on the screen, it's like it's starting to click on the simulator, opening the new app, figuring out the different features, also kind of opening the phone, taking screenshots, and trying everything. It's really fascinating to watch live, but of course, as you're working on something else, you can just move on and let it run in the background. Okay, so now you've seen the app, the CLI, and Codex Remote.
[0:40:08] I'm also really excited about how we've completely reimagined Codex in the cloud. It's fast. It works with all the same tools as Codex on your laptop, including plugins and computer use. And you can now send your most ambitious tasks to Codex in the cloud without having to keep your laptop open. You know, we've seen too many of us do that for the past year. So for this example here, let's say I'm going to create a new task. But instead of doing it on my computer, I'll choose the cloud. And with this environment here,
[0:40:37] And I'll send a prompt like, rewrite the entire backend in Rust. Why not? Now, this one will obviously take a while, but that's great. I know it will get done in the cloud, and I can just check on it later. I can basically send other ideas from my phone along the way and do this seamless handoff. It's been a very popular feature from so many of you, so I'm so excited that we're finally shipping it today. All right, that was a lot. So zooming out of Codex.
[0:41:08] We now have incredible models across text, audio, image generation, and visual understanding. What's exciting is that we build the products like DOTS and Codex using the exact same tools as what we expose to you all in the API. So before I go, I wanted to show you one last demo that brings all of these modalities together. Our friends at Hugging Face kindly loaned us an early preview of their new programmable robot, Microdoc. And that one's name is Lavender.
[0:41:38] Now last night I asked Codex to wire everything up here. So let's take a look if we can connect to it. All right. Let's see now if Baidai can work over here. Look at the audience and make a cool drawing. All right. You're in this picture. Let's see what happens. It's just incredible what you can now accomplish with Codex in just a few hours. We'll give a moment, of course, for this to generate. But I added Vision with Astra.
[0:42:17] I added image generation with GPT image 2.5. I also added voice intelligence with GPT Live 1 here to interact with this little robot in real time and already give it dozens of capabilities and so much more that we could add. So let's try a couple more. Hey, Lavender, can you quack if you can hear me? Are you excited to be at Dev Day? Definitely excited. And here is the photo of all of you that he just made.
[0:42:57] Of course, the legal doc can walk around and Astra can teach you so many new things, but I'm running out of time to show you more. So now, the key takeaway here is that this was just a quick demo. But what I was talking about with a friend in robotics is that he was telling me he's so excited about using our APIs with hardware.
[0:43:16] With the new Decisions API in particular, which is able to process vision inputs, they will now be able to do things like helping robots take fast actions based on what they see in near real time. So come simulator if you want to see that in action on this little Microdot. We think this will unlock a brand new way to interact with AI in the real world. What an amazing time to be a builder. You can bring your incredible ideas to life faster than ever before. So I can't wait to see what you'll do with all of these new tools. Thank you so, so much. Have a great day and back to you, Sam.
[0:43:54] Thanks, Roman. That was awesome. It's really amazing what you can build with these new models and these new tools. So that brings us to the third part of how we want to empower you all. We want to help people find what you build and help you build a business. Around 1.2 billion people use ChatGPT every week. It's a big platform now, and we want to enable you to build a business with it.
[0:44:17] We have tried versions of this before, admittedly with some mixed results, but I feel good about our approach this time because we are giving you the same tools we use to build ChatGPT ourselves. First, we're making it possible for people to bring their ChatGPT subscription to the products you build. So with signing with ChatGPT, they can sign into your app and use the tokens included in their ChatGPT plan. Yeah.
[0:44:52] This makes it easier for people to try your product. They're already paying for an AI subscription and now you don't have to cover their token cost to get them going. We're starting with these 16 launch partners today and we're going to expand very quickly. Next, we're launching plugin extensions. We are making it so that developers can now build plugins that are essentially entire applications that feel native to ChatGPT and distribute through us. With plugin extensions, you can build an editor, a dashboard, a whole workspace.
[0:45:22] All of this directly into ChatGPT and Codex, so let's look at a couple of examples. Here's our new meetings app built with plugin extensions. You can see your upcoming meetings from your calendar right inside ChatGPT. You can just click take notes in ChatGPT. The page becomes a new space where your teammates and dots can work together on the follow-up action items. Here's another example of how Figma is bringing more of its existing product into ChatGPT. You can open a design, see your team's comments, and you can ask ChatGPT to make a revision.
[0:45:51] You can work on your designs right alongside your conversation. Here's another example from Adobe where you can use your favorite Photoshop feature right inside of ChatGPT. Adobe and Figma are part of dozens of launch partners building new plugin extensions. We are very excited to see what you all build. And you can bring these same plugins into ChatGPT sites now too. We've already seen millions of sites of all types get built just within a few months of launch, but now your site can support connected plugins and data.
[0:46:23] You can share a site with your team and they can log in with their own credentials and bring their own agent. And you can see how the experience changes based on the user. It makes it easy to create personalized software experiences for anyone visiting the site. Next up, we want to make it easy for users to discover what you build. So people can search the plugin library in all the normal ways you'd expect, of course, but now we're making it so that plugins can get discovered in the flow of a conversation. When someone asks the question, thank you.
[0:46:54] ChatGPT will recognize if your plugin can help, and they can connect it right there. We've also heard your feedback about the plugin submission process, and we're going to simplify that. You'll be able to track review, see what needs fixing, request a human review, and update your plugin's tools without starting the whole submission over. So finally, with all of this together, we want to make it easier to sell your product to more businesses. So today we're launching the OpenAI Marketplace.
[0:47:21] We have 30-plus launch partners today, including CodeRabbit, Notion, Vercel, and more. And our enterprise customers can now use part of their existing OpenAI commitment to buy your products. This gives you another way to reach customers already working with us. And of course, if you have an OpenAI commitment yourself, you can spend it in the marketplace too. Through our partnership with Base10, you can even access open source models in the marketplace starting today. So, thank you. We shipped a lot of stuff this morning. New ways to work with AI, with thoughts in space.
[0:47:58] New models with GPT 6.1 Sol and UltraFast, the Decisions API, the Agents API, Codecs in the Cloud, lots of new ways to help you build a business, drive consumers to you, and a bunch of other things. It's a big day for us, and we're excited to see what you're going to do with all of this. But we wanted to end with what makes us so optimistic about this next phase of AI, and that's all of you. Every day, we hear stories about how you're using this technology
[0:48:28] To do things that last year would have felt out of reach. Working to understand the immune system. Making education more accessible. Building tools that help other people create. And we want to show you a quick video of some of these people that are actually here with us at Dev Day today. So let's meet them. Lights on. Cameras rolling. Here's to you. The builders. The new artists. The makers of our time. The momentum generation.
[0:49:06] You're not just writing code. You're rewriting what's possible. Expanding the collective. Letting intuition guide the way. You help dream up new businesses and upcycle old ones. You're opening the doors of learning and decoding the immune system. What you create, it lives. It changes. It moves with us. Here's to you, the builders, the makers of our time.
[0:50:02] We get to build AI every day and that's awesome, but still one of the coolest things about what we all get to do is to see you all succeed. It is really amazing to see what you create and it makes us so happy to bring you these tools. We have a great rest of the day planned. We hope you really enjoy it. Peter will be here on the main stage for a special session on how we're continuing to invest in the open source community, including our new OpenClaw Enterprise harness. And we have a bunch of other great sessions going deeper on what we ship today. And then at the end of the day,
[0:50:29] Teebo, Tejal, and I will be back here for a live Q&A. We're also running a Codex game studio session today where you can build your own retro game with Codex. And I'm sure a lot of you have already tried something like this, but we wanted to give you a special way to play what you build. So everyone here today is going to take home a limited edition dev day only chromatic. It's very cool. I think you're really going to like it. You can pick yours up in the merch shop and you can join the game studio session if you want to do that. We hope you enjoy it. Okay.
[0:51:08] Finally, with all of the new things we shipped today, because we want you all to build, we figured you might need another banked reset. So we have actually done so many of these that Thibaut has been campaigning to rename us the Reset Company. I think he has even made swag, but more importantly, I think he is out here in the audience somewhere. Can we find him? Oh, there. Okay.
[0:51:43] Tebow, I think it would be really nice if we could do like a low-key reset for everybody here. Like no confetti cannons or anything, just maybe we could do it. Can you do it? Is that a real thing? What do you think? Should we just press it? Yeah, I think so. Does it just work like that? We just press it and it happens? I don't know. Let's see what happens. I didn't make this thing. I am very excited to press this. I have my laptop ready to go as soon as I can. Let's do a little countdown. Ready for a countdown? Yeah. All right, let's go. Three.
[0:52:14] Thank you for that. That's obviously for everyone in the world, not just people here at Dev Day. Before we wrap up, I want to share one more thought. People often talk about AI as a new industrial revolution. I find that quite off-putting. The best version of AI is not about making people cogs in a giant machine ever worrying faster and faster. There are some parts of life that we cannot and should not automate. I believe that the future
[0:52:53] AI, if we get this right, can be much more like a new renaissance than a new industrial revolution. AI should be about giving people more power over their own lives, more tools to create, learn, discover, expand knowledge. And with everything we launch today and the incredible creative spirit that you all bring, we hope that we're going to get to that future. That is the future we are excited to build with you all. So thank you all very much for all you do. Thank you for coming to San Francisco. Thank you for watching online. Hope you enjoy the rest of Dev Day.