Cleoby Axcelner
← All posts
Cleo Field Notes

What is an AI product engineer, really?

The Cleo Team··9 min read

Most AI-native teams don’t need another planning tool. They need an engineer, a working layer that watches production continuously (agent traces, metrics, performance), finds the one fix that matters, ships it through the team’s coding agents, and then measures the metrics afterward to prove it worked. That working layer is what we call an AI product engineer, and this post is the working definition.

The category, in one sentence

An AI product engineer is software that runs the full closed loop end to end (watch production, find what to fix, ship it through your coding agents, prove the impact) grounded in source signal and instrumented so the loop never ends at a handoff.

That’s a long sentence. Three things make it different from the adjacent categories most readers will pattern-match on.

1. It is not a feedback aggregator

Tools like Canny, Productboard, and Feedbear end at categorization. They take feedback in, group it by feature request, and surface a ranked list. Useful, but the decision is still on the human, and the downstream work (spec, ticket, launch copy, follow-up) is too.

An AI product engineer keeps going. It finds the fix, ships it through your coding agents, and then measures the production metrics afterward to prove the change actually moved the number.

2. It is not a generic AI assistant

Generic LLM wrappers can summarize feedback, but they don’t have durable state. They forget last week’s call, can’t cite the trace that drove the decision, and can’t tell you whether the thing you shipped two weeks ago moved the metric. An AI product engineer keeps a grounded signal store, watches the production metrics after every ship, and holds an auditable history of every fix it has shipped and every impact it has measured.

3. It is not a roadmap tool

Roadmapping software (Aha!, ProductPlan, airfocus) is a planning surface. It models the quarter. An AI product engineer runs the loop. It’s the layer below the roadmap, not the roadmap itself.

What the AI product engineer actually does

The job description, if you wrote one for a human:

  1. Watch production. Continuously read agent traces, metrics, performance, errors, latency, cost, and conversion across every surface that touches the user. Cluster what you see into named opportunities.
  2. Find what to fix. Pick the single bet that matters most right now, with a confidence score and a paragraph explaining why, grounded in the traces and metrics that produced it. Pick what to defer. Be willing to say kill.
  3. Ship it.Turn the bet into a thin spec and ship the change through the team’s coding agents (Cursor, Claude Code, Devin, Cline). Keep everything linked back to the source so anyone can audit the reasoning.
  4. Prove the impact. After the change lands, measure the production metrics that should have moved (latency, error rate, adoption, cost, conversion) and report honestly on whether they did.
  5. Repeat. Feed the measured outcome back into the next bet. The loop closes and starts again.

Why this is a category and not a feature

Marty Cagan’s Silicon Valley Product Grouphas written for years about the difference between “feature teams” and “empowered product teams.” The empowered version makes decisions grounded in customer evidence, not stakeholder requests. That model assumes the team has the time, the headcount, and the rigor to do continuous discovery. Teresa Torres’ Product Talk work is the canonical playbook.

Early-stage teams don’t have that headcount. A two-person founding team can’t run a full continuous-discovery practice and ship every week and answer the Intercom inbox. So either the rigor slips, or the cadence slips, or both. The AI product engineer is what closes that gap: it doesn’t replace the founder’s judgment, but it removes the “there’s too much production signal to watch” failure mode, and it carries the work all the way through to a shipped change and a measured result.

What “grounded” really means

The single most important property of an AI product engineer is that every claim it makes is auditable to source. When the system says “Approval friction is blocking mid-market expansion,” the founder should be able to click through to the 23 specific customer messages that produced that conclusion. Without that, you get the classic LLM failure: confident, articulate, wrong. With it, you get a working artifact you can trust enough to actually ship from.

This is also the bar that AI search engines apply when they pick what to cite. Pages and tools with auditable, source-linked claims get surfaced; pages full of confident assertion without sources don’t.

When you don’t need one

An AI product engineer is not a fit for every situation. Skip the category if:

  • You don’t yet have meaningful customer-signal volume. Five beta users on Slack is not enough signal to synthesize.
  • You are in a regulated vertical that needs on-prem deployment of every system in the stack.
  • Your team’s real bottleneck is engineering capacity, not prioritization clarity.

Where this is going

The bet underneath this category is that the next decade of product management looks less like better roadmap tools and more like an engineer that runs the loop for you while you focus on the calls only a human can make. We think founders and small product teams adopt this first. They feel the cost of unwatched production most acutely, and they can move without a procurement cycle.

Cleo is one implementation of the category. There will be others, and that’s healthy. Categories with one player are usually features. If this is a real shift, expect three or four credible AI product engineers within 18 months, each leaning on a different opinionated loop.

Want to see what an AI product engineer looks like running on your own production? Book a walkthrough →

Try it on your data

See Cleo run this loop for you.

Book a 30-minute walkthrough. We’ll plug Cleo into your real product signal (or a sample dataset) and run the loop live, from signal to a sourced bet to a context bundle for your coding agents.

Book a walkthrough →