Every Amazon seller paying an agency has had the same quiet worry at 11pm: the invoice cleared, the dashboard looks busy, but sales are flat and nobody can explain why. The monthly call is full of activity. Bids were adjusted. Listings were "refreshed." A new A+ module went live. None of it ties back to a number that moved.
This is the gap between motion and management. Motion is easy to manufacture and easy to report. Management means someone is making decisions based on what the account is telling them, and those decisions show up in your contribution margin, not just your to-do list.
Here is how to tell which one you are paying for.
The Reports That Look Like Progress But Aren't
Most agency reports lean on lagging, easy-to-pull numbers: total sales, total ad spend, overall ACoS, impressions, a screenshot of a rank tracker. These are not useless, but they describe what already happened. They do not tell you why it happened or what changes next week.
Watch for reports built around activity instead of outcomes: "We optimized 12 listings this month" without naming what changed on each one and what result it produced. "We launched 3 new campaigns" without a target ACoS tied to each product's actual margin. A vague reference to "improving conversion" with no A+ Content test, no image change, no data behind the claim.
If a report reads like a list of chores, it is a receipt for hours worked, not evidence of strategy. The agencies actually managing your account can point to specific levers: which search terms they promoted or negated last week and why, which ASIN's target ACoS changed and what triggered it, which listing element they tested and what the before-and-after conversion rate showed.
The Metrics That Actually Show Someone Is Managing Your Account
Real management shows up in a small set of leading indicators, not a wall of vanity metrics. If your agency cannot walk you through these, they are not watching your account closely enough to be running it.
Contribution margin per ASIN, not top-line revenue. Revenue can climb while your best-selling product quietly loses money to freight, storage fees, and an ACoS that crept past what the product can support. Any agency worth the retainer should be able to tell you, product by product, what is actually profitable and why. This is the whole argument behind calculating contribution margin per ASIN instead of managing to revenue: it is the only number that tells you what to actually do next.
Search term hygiene, tracked weekly, not quarterly. Wasted spend hides in your search term report, and it compounds every week it goes unaddressed. If your agency cannot show you a recent harvest of new keywords and a matching list of negatives, ask what they have actually reviewed. The discipline behind reading a search term report like a strategist is one of the clearest tells of whether PPC is being managed or just left to run on autopilot.
Target ACoS set per product, from margin, not copied from last month. A single blanket ACoS target across your whole catalog is a red flag. Products at different lifecycle stages and different margins need different targets, and that number should move as costs and competition move.
Leading indicators over lagging ones. Sales and ACoS tell you what already happened. Click-through rate on new creative, conversion rate on a specific traffic source, sell-through velocity against your inventory plan: these tell you what is about to happen. The metrics that actually predict Amazon growth are rarely the ones featured on a glossy monthly dashboard, because they take more work to track and require the agency to actually understand your business, not just your ad account.
A report that only tells you what happened is a receipt, not a strategy.
The Questions That Expose the Difference
You do not need to audit spreadsheets to find out which kind of agency you have. A handful of direct questions will do it.
Ask what your target ACoS is for your top three products, and why that number, specifically. If the answer is a shrug or a single figure applied everywhere, the account is not being managed at the product level.
Ask what changed in your search term report in the last two weeks and what they did about it. Real management produces a specific, recent answer. Busywork produces a general one.
Ask which of your listings has the weakest conversion rate right now and what the plan is to fix it. If a listing has been sitting untouched because "it's performing fine," that is often the first place conversion is quietly slipping without anyone noticing until sales drop.
Ask how PPC, listings, and inventory decisions are coordinated. If the ad team, the content team, and inventory planning operate as separate lanes that never talk to each other, you are paying for three vendors wearing one invoice. Growth compounds when PPC, listings, creative, and operations run as one coordinated system instead of four disconnected projects, and it stalls out fast when they do not.
What Good Coordination Actually Looks Like
A well-run account has a rhythm to it. Bid changes get made because a search term report surfaced a shift, not on a fixed schedule regardless of the data. A new A+ module gets tested because a specific objection kept showing up in reviews or Q&A, not because it was the team's turn to touch that ASIN. Inventory decisions inform PPC pacing, so budget does not get pushed hard into a product that is about to go out of stock.
None of this requires exotic tooling. It requires someone actually looking at your numbers every week and making a call based on what they see. That is the entire difference between an agency and a task list with a login.
What to Do This Week
Pull your last three monthly reports and count how many specific decisions, tied to a specific number, they actually contain. If most of the content is activity without outcome, bring the four questions above to your next call and see how concrete the answers are. The response will tell you more about your agency in five minutes than another quarter of invoices will.