OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil (CPO at OpenAI, ex-Instagram, Twitter) | Lenny's Podcast: Product | Growth | Career | Podwise
This episode explores the rapid advancements in AI and their implications for product development, focusing on the experiences of Kevin Weil, Chief Product Officer at OpenAI. Against the backdrop of the recent viral success of OpenAI's image generation model, the conversation delves into the unique challenges and opportunities presented by the constantly evolving AI landscape. More significantly, Weil emphasizes the importance of "evals"—tests to measure model capabilities—as a core skill for product managers and developers alike, highlighting how understanding model accuracy levels (e.g., 60% vs. 99.5%) fundamentally shapes product design. For instance, the development of OpenAI's "deep research" product involved parallel design of evals and product features, showcasing an iterative approach. The discussion then pivots to the future of AI, addressing concerns about job displacement and the potential for superintelligence, while emphasizing the potential for positive impact through personalized education and reskilling. Finally, Weil shares his perspective on the importance of "model maximalism"—building products that push the boundaries of current model capabilities, knowing that rapid advancements will soon render limitations obsolete—and offers advice for startups seeking to navigate the competitive AI ecosystem.
