In this recap of the NeurIPS 2024 Latent Space LIVE! podcast, Professor Graham Neubig shares insights into the progress and hurdles facing Large Language Model (LLM) agents this year. He highlights how these agents are integrated into his work through three practical examples: data analysis, software development, and enhancements to existing applications. Neubig then identifies eight major challenges in developing these agents, touching on aspects like agent-computer interactions, human-agent interfaces, LLM selection, planning methods, and evaluation techniques. To wrap up, he offers his thoughts on the future of LLM agents, stressing the importance of making open-source solutions accessible and affordable.