The Cognitive Revolution is a podcast about AI where hosts Nathan Labenz and Erik Torenberg interview the builders on the edge of AI and explore the dramatic shift it will unlock over the next decades. If you love The Cognitive Revolution, head over to Moment of Zen (https://www.youtube.com/@MomentofZenPodcast) for weekly episodes from Erik Torenberg, Dan Romero, Antonio Garcia Martinez, and a revolving slate of guests talking tech, business, and AI.
Continual learning remains a critical hurdle for artificial intelligence, as current models struggle with catastrophic forgetting and rigid knowledge cutoffs. Ali Behrouz, a researcher at Google and Cornell, introduces "Nested Learning" and "Language Models Need Sleep" as transformative architectural paradigms. These a...
Reinforcement learning (RL) provides a superior alternative to supervised fine-tuning for large language models by optimizing within existing latent pathways rather than overwriting them. Algorithms like GRPO avoid catastrophic forgetting by targeting critical decision points in reasoning traces, yielding higher perfor...
Follow this podcast in Podwise
Sign in to get AI summaries, transcripts and mind maps for any episode, including new ones.
