The AI Models That Are 100x Cheaper
29 min
•Aug 4, 202622 days agoSummary
The hosts discuss the strategic value of open-weight AI models, which offer 25-100x cost savings over frontier models like OpenAI and Anthropic, and how marketers should allocate AI spend across model tiers. They explore the unresolved challenge of measuring AI ROI, with most companies seeing cost savings but not revenue growth. The episode also covers M&A strategy for agency acquisition and Jensen Huang's open letter supporting open-weight AI models.
Insights
- A tiered AI model strategy makes financial sense: reserve ~5% of AI workloads for frontier models, ~15% for subscriptions, and ~80% for open-weight models to achieve 25-100x cost savings.
- Most enterprises still cannot clearly measure AI ROI, with no consensus on the right metric — revenue per employee paired with growth rate is emerging as a practical proxy.
- AI is raising customer expectations faster than it reduces costs, meaning service businesses may need more headcount, not less, to meet growing demand.
- For M&A in services businesses, founder retention for at least 3 years is critical — knowledge transfer and client relationships are too risky to lose in early post-acquisition periods.
- Open-weight models like GLM 5.2 and Kimi K3 are now close to frontier quality, and companies should consider forking them to build proprietary models trained on their own client data.
Trends
Open-weight AI models approaching frontier quality, enabling enterprise-grade performance at a fraction of the costAI sovereignty concerns driving demand for self-hosted and regionally compliant model deploymentsRevenue per employee emerging as a key AI productivity metric, with some firms doubling from $600K to $1.2MEnterprises shifting AI narrative from cost-cutting headcount to using AI for top-line revenue growthModel Context Protocols (MCPs) maturing into enterprise-ready infrastructure enabling multi-agent, high-volume workflowsCompanies beginning to fork open-source models and fine-tune them on proprietary data to build competitive moatsGoogle and Microsoft expected to commoditize AI by bundling cheap or free models into existing ecosystemsAI implementation in agencies evolving from tooling to outcome-based pricing modelsCEOs backtracking on AI-driven headcount reduction strategies after poor resultsPersonal brand influence increasingly tied to product relevance rather than content volume, as evidenced by Jensen Huang's 64M-view first post
Topics
Open-weight AI model cost optimization for marketing workflowsAI ROI measurement frameworks for enterprise marketing teamsTiered AI model allocation strategy (frontier vs. open-weight)Model Context Protocol (MCP) upgrades and marketing applicationsAgency M&A strategy and founder retention requirementsRevenue per employee as an AI productivity metricBuilding proprietary LLMs by fine-tuning open-source modelsAI sovereignty and enterprise restrictions on Chinese-origin modelsGoogle Gemini vs. frontier models for financial analysis accuracyJensen Huang's open letter on open-weight AI and industry co-signingOutcome-based pricing for AI implementation servicesGlobal RFP geography and international agency expansion strategyAI agent support burden and managed services evolutionToken cost management and API usage optimizationAnthropic MCP v2 capabilities for SaaS and marketing tools
Companies
Anthropic
Discussed as a frontier model provider that did not co-sign Jensen Huang's open-weight letter; also launched new MCP ...
OpenAI
Mentioned as a frontier model provider; ChatGPT cited for image generation quality and financial analysis accuracy te...
Nvidia
Jensen Huang's open letter supporting open-weight AI models benefits Nvidia as it sells chips regardless of which mod...
Google
Discussed as likely to undercut AI market with free/cheap Gemini bundling; Gemini outperformed rivals in cost segrega...
Microsoft
Predicted to commoditize AI by bundling cheap models into its ecosystem, leveraging core business revenue to undercut...
NP Digital
Neil's global digital marketing agency, mentioned as working with publicly traded companies with AI tool restrictions.
Ubersuggest
Neil Patel's SEO tool, cited as a candidate for enhanced MCP integration to expand agent-driven capabilities.
Answer the Public
Acquired by Neil; founders did not stay post-acquisition, used as a case study in M&A founder retention strategy.
Search Guru
Asia Pacific agency acquisition where checked-out founders and guaranteed earnout created a cautionary M&A lesson.
HubSpot
Hosts spoke at HubSpot conference where MCPs were first publicly called out as important emerging infrastructure.
Cursor
Cited as example of a company that forked Kimi K3 to build a proprietary coding model (Composer) using its own data.
Single Brain
Eric's AI agent product currently in pilot, deploying managed marketing agents inside Slack for customer organizations.
ClickFlow
Content optimization tool used as example of how Anthropic's new MCP capabilities enable mid-process agent approvals.
Carrot
LinkedIn account-based marketing ad tool cited as MCP use case for bulk personalized ad generation with human approval.
X (Twitter)
Platform where Jensen Huang's first post received 64 million views, illustrating product-driven personal brand reach.
People
Jensen Huang
Published an open letter on X supporting open-weight AI models, co-signed by Satya Nadella and Sam Altman but not Ant...
Satya Nadella
Co-signed Jensen Huang's open letter supporting open-weight AI models.
Sam Altman
Co-signed Jensen Huang's open letter in support of open-weight AI models.
Jack Dorsey
Mentioned as releasing Buzz, an open-source model, as an example of open-weight tools marketers should explore.
Neil Patel
Co-host discussing AI cost optimization, M&A strategy, and enterprise AI ROI measurement challenges.
Quotes
"5% of your strongest strategic thoughts that you have should go to the frontier models. 15% goes to maybe you're paying subscriptions, and then maybe 80% goes to these open weights."
Eric Siu
"I believe the majority of organizations who have used AI and see financial ROI have seen it from cost savings, not necessarily revenue growth. And that's the harder one to tackle."
Neil Patel
"Nobody really had good answers. You shouldn't manage like token usage — measuring people on token usage is stupid. But nobody has a clear model right now."
Eric Siu
"Gemini was off by $3, so 3%. Chat GPT and Claude — one of them was off by 30 something percent, the other one was off by 50 something percent. And we're talking millions of dollars."
Neil Patel
"If you're in services right now, I don't care what service you're in, if you have the AI augmentation piece, there's going to be more demand for your stuff."
Eric Siu
Full Transcript
2 Speakers