Future of Product #4 · Amsterdam

AI Agents:
Beyond the Demo.

Margot Schipper · Senior Account Executive · Cloudflare
The shift

We moved from training AI, to running it.
Now we let it act.

01
Training
02
Inference
03
Automation
ReasoningExecution
What an agent is

And what it is not.

Chatbot
Answers your questions.
Co-pilot
Helps you do the work.
Workflow
Runs a fixed script.
Agent
Decides and does the work itself, adapting as it goes.
brainstepstools
Context window

Context windows are finite.
Real tasks are not.

Actual Context Window 1M
Tool Definitions2.5M
System Prompt2K
Task
Conversation8K
Tool definitions alone exceed the entire window.
Tool calling

Post-mortem injection

Tool use is bolted on after the model is trained. It never actually learned these APIs, so it guesses.

Functional overlap

When tools expose similar schemas, the model blends them and invents parameters that do not exist.

11
placeholder image · swap later
But LLMs are very good at one thing: writing code.
The pivot

They are bad at calling tools. They are great at one thing: writing code.

Calling tools directly
modelcharge_invoice({…})
✕ wrong parameter, the task breaks
Writing code
// charge every overdue invoice
const overdue = await db.query("due < now() AND !paid")
for (const inv of overdue) {
  const r = await billing.charge(inv)
  if (!r.ok) await retry(inv)
}
✓ runs, retries, completes
  • Deterministic: loops, conditions, retries, error handling.
  • One program does what dozens of brittle tool-calls could not.
  • The tools stay out of the context window.
So where does all of this run, for hours or even days?

An agent is a durable identity, not a process.

wakes on
Message
Webhook
Scheduled alarm
Human approval
Reasoning
Built-in memory that survives restart, hibernation, deploys
Models
one model gateway: cost, caching, fallback
Tools & systems
called as code, through MCP, governed
It mostly waits, then wakes on demand.
For enterprises

Security is not a bolt-on. It is the prerequisite.

Shadow MCP

Unmanaged servers become governed, OAuth-scoped endpoints.

Zero Trust

Every agent request authenticated. Revoke, it stops instantly.

AI Gateway

One layer for cost, caching, and compliance on every model call.

Beyond the demo

Each answer leads to the next.

Context windows overflow. Tool calls break.
Have the model write code.
A durable execution environment: sandboxes and state.
Code must run somewhere. The agent must remember.
Now it can reach your tools and internal systems.
Zero Trust and MCP governance.
“I know what hyperscalers will look like in 10 years: exactly the same as they do now. I'm looking to Cloudflare to define what the next generation cloud looks like.
Mark Smith · Head of Infrastructure · Discord
Questions?
Come find me, I would love to chat.
Come find meMargot Schipper · Cloudflare
Ready to start building?cloudflare.com/startups
01 / 09