koray kavukcuoglu

Announcing a major milestone achieved by my team @GoogleDeepMind: we have proven key security properties of the machine code underlying the Signal messaging protocol. This is the first time the actual production code of a widely deployed protocol has been formally verified – by any method, with or without AI – and at this depth. More than a research breakthrough, it’s a prime example of how frontier AI can be a force multiplier to counter the speed and scale of modern cyber threats. Formal verification offers a higher standard of security; however, it’s extremely complex and time consuming, which is why in many cases it’s considered to be impractical. Similar efforts could take teams decades of combined effort. We did it in a month’s time. Using AlphaProof Code, Google DeepMind's new agentic framework for formal verification that runs on LLMs including Gemini Carbon, we verified the Signal protocol down to the actual code running on devices.  This milestone lays the groundwork for a future in which vital systems, from medical device firmware to power grid software, ship with mathematical proof that their protections work. Reaching that future will take continued research from our community. In that spirit, we're open-sourcing our formal specifications and verification artifacts so others can build on this work. On a personal note, this moment is of deep significance to me. I started my own research journey more than two decades ago as an intern working on checking the consistency of complex software systems. Seeing this grand challenge made practical with modern AI is extraordinary. I'm extremely proud of my team members: Swarat Chaudhuri, Andrew Ferraiuolo, Anton Kovsharov, Tej Chajed, Sam Schlesinger,  Karn Seth, Jonathan Katz, and Charles Sutton for taking on this grand challenge and delivering, and grateful to the Signal team for their partnership. deepmind.google/blog/formal-…

New: I spoke with @sundarpichai about Google's commitment to the AI frontier, how close we are to RSI, balancing DeepMind's compute needs vs. Google Cloud profits, and much, much more. Full Big Technology Podcast episode here --> Chapters: 0:00 Introduction 1:14 Google’s Frontier AI Strategy 3:47 Do Frontier Models Really Matter? 6:35 The Future of AI Agents 7:39 Recursive Self-Improvement 12:58 World Models and the Path to AGI 14:56 Google’s Compute Dilemma and AI Infrastructure 19:36 Is AI Overbuilt? 23:35 The Future of the AI Interface 31:42 Google’s Answer to Muse and Dots 35:03 Apple, Space Data Centers, and AI Coding 41:42 Optimism and AI’s Future

Importantly Argon has frontier safeguards and we are rolling it out responsibly - it’s with the US gov’t and going to a set of trusted cyber defenders through our Fairwind Program today. We’re going to make it available as soon as we can and as safely as we can. So hold tight, lots more coming, and you’re going to see us iterating rapidly. blog.google/innovation-and-a…

@koraykv and I just had a wide ranging conversation at @theinformation AI Summit in his first interview since running all of DeepMind and I can’t wait to share the video with all of you. What struck me (and these are based on scribbles while interviewing him) - Gemini 4 coming soon and body language suggested def before end of year. He is positive and says Google is “certainly at the frontier.” - Doesn’t see a slowdown as necessary because says you always build safety in lockstep. I pushed him on this especially with new techniques like looped transformers and he went into the chain of thought work on some depth - believes big in Google’s continued hardware advantage with TPUs and discussed how new generations are designed alongside his team. Says not a problem to give those to competitors like Anthropic because it helps with scale and improving - talked a bit about the role of agents in coding and what has changed in last six months and how he thinks about RSI - pushed back on AGI as the goal and called it not the right conversation. The best framework is continually improving intelligence. - seemed nonplussed about distillation and happy to call out that Google invented it (he said) - Didn’t get a clear sense how compute could or could not be a challenge. He rejected my personal hypothesis that Gemini in gmail isn’t good enough because they need more data centers :). - a lot is made of the arms race but on narrative, I am really struck by how google, meta and Microsoft all are striking one tone and Anthropic and OpenAI a very different one. In many examples, he rejected the narrative out there in favor of a different one. People can decide whether that is good or bad for google in the long run but struck by the difference. More to come

My conversation with @koraykv, the lead for Google DeepMind, about the path to AGI, progress with 3.7 Flash, why we are laser focused on the frontier, and more!

Excited to announce I am joining Google DeepMind! I started my AI career in the Google Brain Residency class and am excited to rejoin. I am going to be working on RL and Post-Training – excited to announce more soon. Google has all the ingredients to continue to be incredibly successful in the AI space and am excited to be part of that mission.

1B+ people are now using @Geminiapp every month to spark new ideas and get things done. It’s our fastest growing product ever, and our 14th to hit the 1B-user mark. Kudos to @JoshWoodward & the entire Gemini team, and thank you to everyone who has been on this journey with us - much more to come!

Just shared some changes we’re making to the teams at @GoogleDeepMind. @DemisHassabis is stepping up to become Chair of @GoogleDeepMind & Chief Scientist of Alphabet, in addition to leading @IsomorphicLabs. He’ll be able to dedicate his time and focus on shaping the future of AGI and scientific discovery. It’s work that is vitally important to Alphabet and humanity, and I can’t imagine a better person than Demis to do it. He’ll stay closely connected to Koray and the GDM teams. @Koraykv will become the SVP, @GoogleDeepMind, responsible for all aspects of model development, GDM research, and @Geminiapp & dev teams. Koray has been at GDM for 13 years and is a world-renowned expert in the field, starting our deep learning team and driving breakthroughs like WaveNet & DQN. GDM is in great hands! Excited for this next chapter. You can read my note along with the message Demis sent to @GoogleDeepMind here: blog.google/company-news/ins…

“In 2016, [@SundarPichai] had declared Google would be an “AI-first company,” and began cultivating a series of projects—custom chips, Cloud, YouTube, and deep AI research—that seemed to have nothing to do with Google’s core search product. All of these bets have paid off, and then some.” — @TIME in their new #TIME100Companies cover story on Alphabet and AI → time.com/collection/time100-… 📷: Daniel Dorsa