Today's Episode

What makes AI agents different from chatbots?

That’s the question we break down from every angle with today’s guest.

Armand Ruiz, VP of AI Platform at IBM, who has been in AI for 16 years and has become one of the most-followed AI voices on LinkedIn.

Armand leads AI platforms at IBM, building the building blocks for enterprises to build AI agents securely. He spends his time meeting with CIOs from the biggest brands who all have AI as their number one priority - and agents as one of their core components.

In our conversation, he breaks down:

* How AI agents differ from the chatbots we know

* The four-step framework every agent needs

* Why RAG systems power 90% of enterprise AI

* How product management changes when agents do the work

----

Check out the conversation on Apple, Spotify and YouTube.

Brought to you by:

* Kameleoon: AI experimentation.

* The AI Evals Course for PMs & Engineers: You get $800 with this link

* Vanta: Automate compliance, manage risk, and prove trust

* Amplitude: Try their 2-min assessment of your company’s digital maturity

* Product Faculty: Product Strategy Certificate for Leaders (Get $550 off)

----

Timestamps

00:00 Intro

02:39 What Makes AI Agents Special

04:40 The Four Steps of AI Agents

07:14 AI Agent Development Frameworks

12:59 RAG Explained

16:55 ADS

18:46 Common RAG Mistakes

26:48 Managing Multiple AI Agents

31:39 ADS

33:57 How AI Changes Product Management

37:43 Problem Investigation vs Feature Factory

41:22 Roadmap to Build AI Agents

43:30 Can Open Source AI Win?

51:39 IBM's AI Strategy

59:32 Career Journey: Intern to VP

1:02:36 Building 200K LinkedIn Followers

1:08:18 Outro----

Key Takeaways

1. AI Agents vs Chatbots: Chatbots respond to queries while agents execute complete workflows. The difference between getting suggestions and getting finished work.

2. Four-Step Agent Framework: Every agent needs Thinking (reasoning), Planning (task breakdown), Action (system execution), and Reflection (learning from outcomes).

3. RAG Dominates Enterprise: 90% of enterprise AI uses RAG to connect LLMs to proprietary data. Success requires 95%+ accuracy through sophisticated evaluation.

4. Vision RAG Unlocks Value: Most business data lives in charts and tables that traditional text-only RAG completely misses.

5. Framework Selection Matters: Use coding frameworks (LangGraph, CrewAI) for complex systems. Use no-code tools (Lindy, n8n) for rapid prototyping.

6. PM Ratios Transform: Traditional 1:6-10 PM-to-developer ratios become 1:2-30 when agents handle research and documentation.

7. Prototypes Beat PRDs: Show working systems instead of 20-page documents teams misinterpret. AI enables functional demos.

8. Open Source Wins: Despite closed-source capabilities, enterprises choose open source for licensing control and infrastructure flexibility.

9. Technical Literacy Essential: Understanding agents, RAG, and frameworks becomes baseline knowledge for everyone, not just developers.

10. Implementation Reality: Enterprise RAG needs heavy data engineering. Teams underestimate accuracy requirements and engineering complexity.

----

Related Content

Podcasts:

We Built an AI Agent to Automate PM in 73 mins

We Built an AI Employee in 62 mins

5 AI Agents Every PM Should Build

Newsletters:

AI Agents: The Ultimate Guide for PMs

AI Evals for Agents

Step-by-Step RAG

----

P.S. More than 85% of you aren't subscribed yet. If you can subscribe on YouTube, follow on Apple & Spotify, my commitment to you is that we'll continue making this content better.

----

If you want to advertise, email productgrowthppp at gmail.

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.news.aakashg.com/subscribe

AI Agents for PMs in 69 Minutes — Masterclass with IBM VP

The Growth Podcast