How to Evaluate an SEO Agency Without Getting Taken for a Ride

Most SEO agencies know how to talk. They know how to pitch. They know how to close. That is not the same as knowing how to help.

A slick deck is easy to build. A clean report is easy to generate. A “custom strategy” is easy to recycle. What is harder is knowing what matters, explaining why it matters, doing the work well, and tying it back to real business results. That gap is where buyers get burned.

Truth be told, the whole sales-driven, cold-calling agency model is a big part of why I started RicketyRoo in the first place. I got tired of watching businesses I respected get taken in by a pitch that sounded great and delivered a whole lot less.

This guide is for two kinds of buyers: people comparing SEO agencies right now, and people who already hired one and are trying to figure out whether that agency is actually helping.

Start Here: A Quick Filter for Vetting an SEO Agency

Before you sit through another discovery call or slog through another 47-slide proposal, run the agency through these five questions. If they get fuzzy on three or more, keep shopping.

1. Can they explain the first 90 days without hiding behind “it depends”?

Of course, some things depend on your site, your market, and your goals. That’s normal. What is not normal is an agency that can’t tell you upfront, in plain English, what they would likely assess first, what they would likely prioritize next, and what would determine the order and how all of that connects back to and drives your business goals.

You can’t expect to get a crystal ball. Trust us—we know firsthand that sometimes you don’t know what’s going on until you pop the hood of a business’s online presence. But you can reasonably expect at least a point of view on the work to come.

2. Can they tell you why those priorities come first?

A list of tasks is not a strategy. “Technical cleanup, content optimization, authority building, performance improvements.” Cool. We do some of those things at RicketyRoo, too. Why first? Why in that order? Why for your business? Why now?

If they can’t connect priorities to your particular situation, you are not looking at a strategy that’s going to serve your goals.

3. Can they explain reporting in normal language?

At a minimum, reporting should make four things obvious: what got done, why it mattered, what changed, and what happens next.

That’s pretty much it. Don’t get me wrong. We love data, and you’ll have plenty of it to work with in your custom Looker Studio dashboard. But if reporting is all charts and no judgment, it’s not legitimate transparency.

4. Can the SEO company connect its work to business outcomes?

Not every SEO task ties directly to revenue. That is true. It’s also true that a good agency should still be able to explain how the work supports actual business goals: calls, booked jobs, qualified demos, stronger non-brand visibility, better local performance, or better conversion from organic traffic.

If all they can talk about is “visibility,” that ain’t enough.

5. Can they tell you when SEO is not the answer?

This is one of the biggest trust signals in the whole buying process. A serious agency should be willing to say, “That is probably a CRO issue before it is an SEO issue,” or “Your sales process is leaking,” or “You need dev support before this gets easier,” or “This can work, but not on the timeline you want.”

You want a partner, not a yes machine.

I should say that many agencies are interdisciplinary. In fact, at RicketyRoo, we do a lot more than SEO “proper.” Still, straight-shooting, telling it like it is, and not just shoving everything under the guise of an “SEO plan” goes a long way.

Smart Buyers Still Get Burned with SEO

SEO is a weird thing to buy because the work often shows up before the payoff does. That makes it easy for weak agencies to hide behind language like “we’re building momentum,” “we’re laying the foundation,” or “we’re improving visibility.”

Maybe they are. But what if they’re not?

And that’s what the whole issue comes down to, isn’t it? Too many buyers are expected to take it on faith. You shouldn’t have to. You should be able to ask specific questions about the work being done to improve your online visibility and receive concrete answers.

What You’re Actually Hiring an SEO Agency to Do

You are not hiring an agency to “do SEO.” You are hiring them to diagnose what is actually holding growth back, prioritize the work that matters most, explain why those priorities matter, execute competently, measure honestly, and adjust when the facts change.

That is the job.

A lot of agencies can talk tactics. Fewer can explain sequencing. Fewer still can connect the work to business impact without sounding like they swallowed a dashboard. That is why the next section matters so much.

A Few More Questions to Ask Before You Sign

If an agency clears the first filter, good. That doesn’t mean you’re vetting. It just means they’ve earned a few deeper questions. These are the questions that help you figure out whether the relationship will actually work once the contract is signed and real life shows up.

1. What do you need from our team for this to work?

This one matters more than many buyers realize because agencies don’t work in a vacuum. Not good ones anyway.

• Maybe they will need dev help
• Maybe they will need approvals
• Content reviews
• CRM access
• Sales feedback
• Brand guardrails
• Location-level input
• A whole host of other things!

A weak agency pretends it can handle everything alone. A good agency tells you where success depends on your side too.

If you are dealing with a multi-location brand, a franchise system, or an internal team with lots of stakeholders, vague ownership turns into problems fast.

2. What kinds of clients are the best fit for you?

A mature agency knows where it wins. A mature agency also knows where it does not.

• If you are a local lead-gen business, you need a team that cares about calls, forms, booked jobs, and revenue.
• If you are a franchise or multi-location brand, you need a team that can manage scale without turning the whole thing into a quagmire.
• If you are enterprise or in-house, you may need a partner who can justify priorities and work inside existing workflows instead of stomping all over them.

If an agency says they are the perfect fit for literally everyone, then it’s pretty clear they don’t know what they don’t know.

3. What could slow this down or make it fail?

This is a trust question. A good answer won’t sound dressed up, and that’s kinda the point.

You want to hear about things like weak conversion paths, slow approvals, dev bottlenecks, poor site foundations, unrealistic timelines, messy analytics, limited content support, and competitive markets. You are not looking for fear here. You are looking for honesty.

What a Good SEO Agency Sounds Like

Once you have heard it a few times, you can feel the difference.

• A good SEO agency sounds clear. Not dumbed down. Clear. They can explain the work in normal language without making it sound smaller or softer than it is.
• A good SEO agency also sounds specific. They don’t hide behind generalities that could apply to any website in any industry. They talk about priorities, tradeoffs, constraints, and likely outcomes in a way that helps you decide.
• A good SEO agency sounds calm. Not sleepy. Not timid. Calm. They are not pitching a miracle. They are telling you the truth about what is hard, what takes time, what matters first, and what depends on other factors.

They are also willing to say no.

No, that page idea probably is not the move. No, SEO is not the first problem I would solve here. No, I would not split this into 80 city pages. No, I would not chase that vanity term first.

You do not need a cheerleader with an Ahrefs subscription (no shade @ Ahrefs, BTW; we 🧡 them). You need a real partner with some grit to tell it like it is.

Already Have an SEO Agency? Here’s How to Tell If It’s Actually Working

Sometimes the problem is not “who should we hire?” Sometimes the problem is: Are we already paying for something that sounds better than it is?

Here is a more useful way to judge that.

In the first 60 to 90 days, you should see from your SEO company:

• A clearer understanding of your business
• Sensible priorities
• Explained recommendations
• Cleaner communication
• More confidence in what is being worked on and why

Notice what is not on that list. I did not say you should be ranking number one by month three. That may or may not be reasonable. (Dare I say, it depends? 🙃)

But you should absolutely be getting more clarity, not less.

A few months in, you should start seeing:

• Movement in the right topic areas
• Better non-brand visibility
• Better local visibility if local matters
• Stronger pages, not just more pages
• Improved quality of organic traffic
• A sharper connection between SEO work and business results

Not every campaign moves at the same speed. That’s real. Still, the work should be getting easier to understand over time, not harder.

Signs you’re getting managed instead of helped

This is the ugly list:

• Lots of activity, little explanation
• The same priorities every month
• Reports full of motion and empty of meaning
• Deliverables with no clear theory behind them
• Every setback blamed on Google (not the mysterious algo gods!)
• No one can answer “what changed and why?”
• No one can answer “what happens next?”

A lot of weak agency relationships survive on the appearance of momentum. There are updates. There are graphs. There are deliverables. On paper, plenty is happening. The real question is whether any of it is actually helping your business.

Use This SEO Agency Scorecard

Use this in calls. Use it after calls. Use it when you are comparing two agencies that both sound decent, and you are trying to separate “impressive” from “actually useful.” Score each agency from 1 to 5.

Here is the quick read on each one:

• Clarity: Do they explain things in normal language?
• Strategy: Do they show real prioritization, or just a bucket of tactics?
• Fit: Do they sound right for your business model, team, and goals?
• Communication: Do you know who you will talk to and how often?
• Reporting: Will you understand what happened, what changed, and what matters?
• Honesty: Do they admit tradeoffs, constraints, and uncertainty?
• Proof: Can they point to relevant work, not just generic wins?
• Confidence Without Nonsense: Do they sound steady, or just slick?

One rule for using this scorecard: Don’t pick the agency that sounds the most impressive. Pick the one that makes the work easiest to understand and hardest to fake.

How We’d Want You to Vet Us

So here is how we’d want you to vet RicketyRoo:

• Ask us what we would do first.
• Ask us what we think is actually in the way.
• Ask us what is probably not worth doing.
• Ask us what depends on your team.
• Ask us how we report.
• Ask us what success would realistically look like.
• Ask us where we might tell you no.
• Ask us who we are best for.

We don’t need to be the right fit for everyone. We’d rather be direct about where we can help than sell you a polished version of maybe.

And if you already have an agency or an in-house team and just need a second set of eyes, that’s totally fair, too.

That is how this should work: straight answers, clear expectations, no fog.

You Shouldn’t Have to Buy SEO on Faith

SEO should never feel like a black box.

By the time you sign with an SEO agency, you should know what you’re buying. Not every last technical detail, but enough to understand how they think, what they plan to do, how they’ll report on it, and how that work is supposed to help your business. That’s the bar.

If you want a candid conversation about your options, get in touch with us at RicketyRoo. We’ll talk through what makes sense, what doesn’t, and whether we’re the right fit to help you grow. Even if you just want a second set of informed eyes on your proposal, we’re glad to help.