
How Agents Decide: Goodfire's Eric Bigelow on Critical Tokens, Phase Shifts, & In-Context Learning
Large Language Models (LLMs) make decisions primarily through stochastic sampling during the generation process, rather than through a pre-determined internal logic. Mechanistic interpretability research, specifically the "Forking Paths" experiment, demonstrates that models undergo sharp phase transitions where reasoni...



















