Why We Need New AI Benchmarks, Which Industries Survive AI, and Recursive Learning Timelines | #218 | Moonshots with Peter Diamandis

The podcast explores the imperative for companies to integrate AI by 2026, examining which sectors face the most significant disruption and how businesses can adapt. It highlights the uneven impact of AI across industries, noting that media, legal services, and business process outsourcing will experience substantial changes, while sectors like oil and gas or real estate will remain relatively stable. Matt Fitzpatrick, CEO of Invisible Technologies, emphasizes the importance of custom benchmarks and data quality for successful AI implementation. The discussion also covers the balance between human expertise and AI automation, with varying perspectives on the future of human involvement in AI-driven processes. Examples include AI's application in sports analytics with the Charlotte Hornets and in healthcare with LifeSpanMD.

Outlines

Part 1: AI Impact, Adoption, and Implementation

Part 2: Strategy, Benchmarking, and Data

Part 3: Industry Case Studies

Part 4: Data Management and Optimization

Part 5: Human-in-the-Loop and Training Models

Part 6: Corporate Structure and Automation

Part 7: Specialized Use Cases and 2026 Predictions

Part 8: Future of Work and Society

Part 9: Conclusion and Invisible’s Mission

Sign in to continue reading, translating and more.

Continue

Why We Need New AI Benchmarks, Which Industries Survive AI, and Recursive Learning Timelines | #218

Moonshots with Peter Diamandis

Part 1: AI Impact, Adoption, and Implementation

00:00AI's Uneven Impact: Disruptive Sectors and the Hype Around Oil & Gas

AI's Uneven Impact: Disruptive Sectors and the Hype Around Oil & Gas

05:59Expertise and Implementation: The Core Competency Challenge for AI Adoption

Expertise and Implementation: The Core Competency Challenge for AI Adoption

10:08Establishing Baselines: Validating AI Implementation in Legal and Other Sectors

Establishing Baselines: Validating AI Implementation in Legal and Other Sectors

12:08Klarna's AI Experiment: The Importance of Human-in-the-Loop in Contact Centers

Klarna's AI Experiment: The Importance of Human-in-the-Loop in Contact Centers

15:20Klarna's AI Rollback: PR Exercise or Exception Handling Issues?

Klarna's AI Rollback: PR Exercise or Exception Handling Issues?

Part 2: Strategy, Benchmarking, and Data

17:43Implementing AI: Focus, Skills, and Third-Party Vendors

Implementing AI: Focus, Skills, and Third-Party Vendors

20:07Benchmarking AI: Custom Evals and the Need for Specific Metrics

Benchmarking AI: Custom Evals and the Need for Specific Metrics

23:53Proprietary Data Sets: Bloomberg's GPT and the Limits of Internal Data

Proprietary Data Sets: Bloomberg's GPT and the Limits of Internal Data

27:00Post-Training: The Long-Term Future of Internal Data Sets and Benchmarks

Post-Training: The Long-Term Future of Internal Data Sets and Benchmarks

Part 3: Industry Case Studies

28:37Basketball Analytics: Custom Computer Vision Models for Draft Prep

Basketball Analytics: Custom Computer Vision Models for Draft Prep

31:38Concierge Medicine: HIPAA-Compliant Data Integration for Personalized Healthcare

Concierge Medicine: HIPAA-Compliant Data Integration for Personalized Healthcare

34:32Talk to Your Defect: AI-Driven Insights in Healthcare and Beyond

Talk to Your Defect: AI-Driven Insights in Healthcare and Beyond

Part 4: Data Management and Optimization

36:22Data as the Starting Point: Avoiding Fragmented AI Implementations

Data as the Starting Point: Avoiding Fragmented AI Implementations

38:51Tactical Data Focus: Avoiding the Data Lake Trap and Leveraging Non-Structured Data

Tactical Data Focus: Avoiding the Data Lake Trap and Leveraging Non-Structured Data

Part 5: Human-in-the-Loop and Training Models

41:38The Future of RLHF: Data Efficiency and the Need for Human Feedback

The Future of RLHF: Data Efficiency and the Need for Human Feedback

44:06Accuracy vs. Hallucinations: The Enduring Importance of Human-in-the-Loop

Accuracy vs. Hallucinations: The Enduring Importance of Human-in-the-Loop

46:09Recursive Self-Improvement: Timelines and the Bottleneck in Corporate Adoption

Recursive Self-Improvement: Timelines and the Bottleneck in Corporate Adoption

48:57Generalizability vs. Hyperspecificity: The Balance in AI Training

Generalizability vs. Hyperspecificity: The Balance in AI Training

50:37The Bitter Lesson: Will Specialized Skills Be Subsumed by Generalist Models?

The Bitter Lesson: Will Specialized Skills Be Subsumed by Generalist Models?

Part 6: Corporate Structure and Automation

52:26Stock Picking and Data Privacy: Navigating the Trade-Offs in AI Adoption

Stock Picking and Data Privacy: Navigating the Trade-Offs in AI Adoption

55:51Automating Functionality: Reimagining Business Processes with AI

Automating Functionality: Reimagining Business Processes with AI

1:00:02Clean Data, Benchmarks, and Organizational Structure: Key Steps for AI Implementation

Clean Data, Benchmarks, and Organizational Structure: Key Steps for AI Implementation

1:02:37Innovation on the Edge: Launching AI-Native Startups in Adjacent Industries

Innovation on the Edge: Launching AI-Native Startups in Adjacent Industries

Part 7: Specialized Use Cases and 2026 Predictions

1:04:32Underwater Drones and Inventory Forecasting: Diverse AI Use Cases

Underwater Drones and Inventory Forecasting: Diverse AI Use Cases

1:06:37Multi-Agent Teams, Multimodal Leap, and Mirror Worlds: 2026 Predictions

Multi-Agent Teams, Multimodal Leap, and Mirror Worlds: 2026 Predictions

Part 8: Future of Work and Society

1:09:27The Future of Human Expertise: What Roles Will Be the Last to Disappear?

The Future of Human Expertise: What Roles Will Be the Last to Disappear?

1:10:15Media Entrepreneurs and Digital Ecosystem Jobs: The Changing Nature of Work

Media Entrepreneurs and Digital Ecosystem Jobs: The Changing Nature of Work

1:12:30Human Interaction and Physical Work: The Enduring Value of Human Touch

Human Interaction and Physical Work: The Enduring Value of Human Touch

1:14:26Government Automation: Streamlining Permitting and Infrastructure Deployments

Government Automation: Streamlining Permitting and Infrastructure Deployments

Part 9: Conclusion and Invisible’s Mission

1:16:02Video Footage and Avatar Training: The Future of Matt Fitzpatrick

Video Footage and Avatar Training: The Future of Matt Fitzpatrick

1:17:52Invisible's Mission: Making AI Work for Mid-Cap and Enterprise Companies

Invisible's Mission: Making AI Work for Mid-Cap and Enterprise Companies

1:19:12Meta Trends and the Decade Ahead: A Newsletter for Disruptive Companies

Meta Trends and the Decade Ahead: A Newsletter for Disruptive Companies