Thoughts on the Market

AI’s Shift From Thinking to Taking Action

5 min
May 5, 202629 days ago
Listen to Episode
Summary

Sean Kim from Morgan Stanley's technology team explains the shift from generative AI to agentic AI—systems that don't just answer questions but autonomously take actions across workflows. This fundamental shift changes computing bottlenecks from GPUs to CPUs and memory, with significant implications for infrastructure investment through 2030.

Insights
  • Agentic AI represents a paradigm shift from passive question-answering to active, autonomous task execution across multiple workflows and digital tools
  • Memory becomes the critical differentiator in agentic AI, creating a 'context flywheel' where persistent memory enables personalization and increases switching costs
  • Computing infrastructure bottlenecks are shifting from GPUs (thinking) to CPUs (orchestration) and memory systems, fundamentally changing hardware demand
  • Persistent memory and active retrieval are essential for serious agentic work, addressing the fixed context window limitations of current LLMs
  • Supply chain opportunities exist across memory, foundry, substrates, CPU interfaces, capacitors, and sockets through 2027 due to content growth and capacity constraints
Trends
Shift from generative AI to agentic AI as the next evolution in AI capabilityCPU becoming the new computing bottleneck as agentic systems require orchestration and task coordinationMemory and persistent context as competitive moats in AI systemsEstimated $60 billion incremental CPU TAM by 2030 within broader CPU market expansionUp to 70% incremental DRAM bit shipment growth tied to agentic AI adoptionSupply chain consolidation and pricing power in memory, foundry, and semiconductor substrate sectorsCapacity constraints in semiconductor manufacturing extending through 2027Long-term state and behavioral grounding becoming essential AI system featuresContext flywheel effects creating switching costs and customer lock-inInfrastructure investment prioritization shifting from model development to execution systems
Topics
Agentic AI architecture and capabilitiesGenerative AI vs. Agentic AI distinctionGPU vs. CPU computing requirementsLarge language model context windowsPersistent memory in AI systemsAI workflow orchestrationContext flywheel effectsCPU total addressable market expansionDRAM demand growthSemiconductor supply chain implicationsMemory as competitive moatAI system personalizationMulti-task AI automationInfrastructure bottlenecks in AISemiconductor capacity constraints through 2027
Companies
Morgan Stanley
Host Sean Kim is head of Morgan Stanley's Europe and Asia technology team, providing institutional investment perspec...
People
Sean Kim
Host discussing the shift from generative to agentic AI and its market implications for infrastructure investment
Quotes
"Now, imagine a system that does not just respond, but acts. It remembers what you asked last week, understands your preferences, works across digital tools, plans a workflow, and adapts as circumstances change."
Sean Kim~1:30
"That is a shift from Gen.AI to Agentic.AI. From AI that helps with thinking to AI that helps with doing."
Sean Kim~2:00
"Memory is also continuity. When an AI system can use past experiences memory becomes a long-term state, shared knowledge, and behavioral grounding."
Sean Kim~5:30
"An agent that knows your preferences, documents, tone, and task history becomes more useful over time. That creates a context flywheel."
Sean Kim~4:45
"In the agentic era, the next big AI leap may be less about the prompt, but more about the processor."
Sean Kim~11:00
Full Transcript
Welcome to Thoughts on the Market. I'm Sean Kim, head of Morgan Stanley's Europe and Asia technology team. Today, a foundational shift in the development of AI and its broad market implications. It's Tuesday, May 5th at 3pm in London. Think about the last time you asked a chatbot to write a summary or a draft, or maybe answer a query. It was probably useful, but you were also still driving the interaction, asking, refining, copying, checking, and moving the work forward. Now, imagine a system that does not just respond, but acts. It remembers what you asked last week, understands your preferences, works across digital tools, plans a workflow, and adapts as circumstances change. That is a shift from Gen.AI to Agentic.AI. From AI that helps with thinking to AI that helps with doing. Gen AI is mostly passive. It takes a prompt and produces an answer. Agentic AI is active less a co for one task but an autopilot for multi workflows The distinction is key because computing requirements are changing In Gen AI, large language models and GPUs handle much of the thinking. GPUs, or graphics processing units, process many calculations in parallel, making them central to modern AI models. In agentic AI, CPU becomes more important. CPUs, or central processing units, coordinate tasks and connect systems to the broader digital infrastructure. Agentic AI also depends on three stacks. The brain, or the large language model. Orchestration, where the CPU manages the doing. And knowledge, which is memory. Memory may be the most important layer. An agent that knows your preferences, documents, tone, and task history becomes more useful over time. That creates a context flywheel. The more context it collects, the more personalized it becomes and the harder it is to leave Typically in computing we think of memory as storage mainly We need to rethink this Memory is also continuity When an AI system can use past experiences memory becomes a long-term state, shared knowledge, and behavioral grounding. And that matters because LLMs have fixed context windows. Once a conversation exceeds that window, all the contents falls off. For simple questions, that may be fine. but for a coding agent working across a large code base over days or weeks, it is a major limitation. Serious work requires persistent memory, short-term orientation, and active retrieval, remembering prior decisions, understanding changed files, and finding relevant codes without the user pointing to every dependency. For investors, the implication is clear. A genetic AI changes the bottlenecks. We see CPUs as a new bottleneck, with memory seeing the highest content increase. We estimate as much as 60 or billion of incremental CPU total addressable market by 2030 within a total CPU market of more than billion We also estimate up to 70 of incremental DRAM bid shipment tied to this theme That makes us more positive on the supply chain, including memory, foundry, substrate, CPU and memory interface, and capacitors and CPU sockets. These areas benefit from content growth, pricing power, and capacity constraints into 2027. As AI moves from answering questions to taking actions, investors should watch the infrastructure behind the shift. Because in the agentic era, the next big AI leap may be less about the prompt, but more about the processor. Thanks for listening. If you enjoyed the show, please leave us a review wherever you listen and share thoughts on the market with a friend or a colleague today. the preceding content is informational only and based on information available when created it is not an offer or solicitation nor is it tax or legal advice it does not consider your financial circumstances and objectives and may not be suitable for you