SEO Agency Scorecard

Choosing the wrong SEO agency is expensive. A bad hire costs you time, budget, and often rankings that can take months to recover. The problem is that most agency evaluation processes rely on proposals, sales calls, and gut feel – none of which reliably predict whether an agency can actually do the work. This scorecard gives you a structured, consistent framework to evaluate any SEO provider against 30 criteria across the five areas that actually determine whether they’ll deliver.

It works equally well for businesses evaluating agencies before hiring, and for agencies vetting subcontractors or white-label SEO partners before bringing them into client engagements.

Why Use Our SEO Agency Scorecard?

  • 30 criteria across five weighted categories: Strategy & Research, Technical SEO, Content Quality, Reporting & Analytics, and Communication & Commercial Fit.
  • Category weights are adjustable – prioritise what matters most for your specific situation.
  • 1-5 scoring scale with N/A option for criteria that don’t apply.
  • Weighted overall score out of 100 with a clear Shortlist / Consider / Pass recommendation.
  • Covers E-E-A-T, AI content policy, GA4, Core Web Vitals, AI search awareness, and more.
  • Printable summary to share with stakeholders or keep on file.

How to Use the Scorecard:

  1. Enter the agency name and your name at the top (optional, for record-keeping).
  2. Adjust the category weights if some areas matter more to you than others.
  3. Score each criterion from 1 (poor) to 5 (excellent) – use N/A to skip criteria that don’t apply.
  4. Review the weighted overall score and the verdict in the results section.
  5. Print or save the completed scorecard for your records.

SEO Agency Scorecard

Score an SEO agency or subcontractor across five key areas. Adjust category weights to reflect what matters most to you.

Scoring: 1 - Poor 2 - Below average 3 - Acceptable 4 - Good 5 - Excellent N/A - Skip this criterion
1

Strategy & Research

How well does the agency understand your market, keywords, and competitive landscape?

/ 5
Keyword Research Depth Goes beyond head terms - includes long-tail, question-based, and intent-segmented keywords relevant to your business.
Search Intent Understanding Can explain and apply the four intent types (informational, navigational, commercial, transactional) when selecting and mapping keywords.
Competitor & Gap Analysis Identifies content and keyword gaps versus real organic competitors, not just brand competitors.
Topic Cluster & Entity Strategy Understands pillar pages, topic clusters, and entity-based SEO - not just individual keyword targeting.
AI Search Awareness Aware of how AI Overviews, SGE, and generative search results affect keyword strategy and content planning.
Business & Market Knowledge Demonstrates genuine understanding of your industry, target audience, and commercial context - not just generic SEO advice.
Category Score -
2

Technical SEO

Can the agency identify, explain, and fix technical issues that affect crawling, indexing, and performance?

/ 5
Crawlability & Indexation Understands robots.txt, XML sitemaps, canonical tags, noindex directives, and crawl budget management.
Core Web Vitals Can assess and advise on LCP, CLS, and INP - not just cite the metrics, but explain what causes poor scores and how to fix them.
Structured Data & Schema Can implement or brief appropriate schema types (Article, FAQ, Product, LocalBusiness, etc.) and explain their value for rich results.
Site Architecture & Internal Linking Understands how URL structure, internal linking, and siloing affect crawl equity and topical authority.
Mobile & Page Experience Knows the requirements for mobile-first indexing and can audit for mobile usability issues.
Technical Audit Quality Delivers audits that prioritise issues by business impact - not just a raw export from a crawl tool.
Category Score -
3

Content Quality

Does the agency produce content that earns rankings, demonstrates expertise, and serves the user?

/ 5
E-E-A-T Signals Understands Experience, Expertise, Authoritativeness, and Trust - and actively builds these into content through author credentials, sourcing, and editorial standards.
Depth & Originality Content goes beyond surface-level summaries - includes original analysis, examples, data, or genuine expertise. Not AI-spun filler.
AI Content Policy & Transparency Has a clear, defensible position on AI-assisted content - how it's used, how it's reviewed, and how quality is maintained.
On-Page Optimisation Applies keyword placement, heading structure, meta tags, and internal links as a matter of course - not as an afterthought.
Brief & Ideation Quality Content ideas are backed by search data, mapped to funnel stages, and clearly explained - not just a list of topics.
Writing Quality & Polish Deliverables are well-written, proofread, and formatted for the web - no obvious errors, unclear sentences, or unprofessional presentation.
Category Score -
4

Reporting & Analytics

Can the agency measure what matters, tell the story behind the numbers, and demonstrate ROI?

/ 5
GA4 Proficiency Works fluently in GA4 - not still relying on Universal Analytics thinking. Can build custom explorations, events, and attribution reports.
Google Search Console Insight Uses GSC beyond basic rank checking - identifies crawl issues, impression gaps, CTR anomalies, and indexing problems.
KPI Definition & Clarity Sets clear, measurable KPIs at the outset and ties reporting back to agreed objectives - not just traffic and rankings.
Data Storytelling Reports explain the "so what" - context, trends, and recommendations - not just a dashboard of numbers.
Attribution Understanding Can discuss SEO's role in multi-touch attribution and explain organic's contribution without overclaiming or underselling.
Reporting Tool Competence Produces clean, readable reports in Looker Studio, GA4, or equivalent - formatted for the audience, not just exported raw data.
Category Score -
5

Communication & Commercial Fit

Is this a provider you can work with - reliably, professionally, and over the long term?

/ 5
Responsiveness & Reliability Responds promptly, meets deadlines, and flags problems early rather than going quiet when things slip.
Proactivity Brings ideas, flags opportunities, and raises issues without always being asked - acts like a partner, not a task-taker.
Transparency & Honesty Sets realistic expectations, admits limitations, and doesn't oversell results or hide bad news.
Capacity & Scalability Can handle increased scope without quality dropping - has the team or processes to scale.
Value for Money Pricing is fair and transparent relative to the quality and scope of work delivered.
Ethical Practices Uses only white-hat tactics - no PBNs, purchased links, cloaking, or other practices that put your site at risk.
Category Score -

Overall Scorecard Result

Weighted Score - / 100

A few notes on using this scorecard well. First, score based on evidence – ideally after reviewing the agency’s actual work samples, a test brief, or a detailed pitch rather than just their website claims. Second, if a category is genuinely not relevant (for example, you’re not evaluating content quality because you’re handling that in-house), reduce its weight rather than leaving everything at the default. Third, treat the scorecard as a decision-support tool, not a pass/fail test – a score in the 60s with a specific weakness in one area you can manage in-house is a very different situation to a score in the 60s with weaknesses across the board.

Frequently Asked Questions

What scoring threshold should I use?

The scorecard uses three verdict bands: 75 and above is Shortlist, 50–74 is Consider with caution, and below 50 is Pass. These thresholds reflect the proportion of maximum possible marks and are designed to be reasonably demanding – a score of 75+ requires consistently good (4/5) performance across most criteria, which is a realistic bar for a capable agency.

How do category weights work?

Each category has a weight from 1 to 5. A higher weight means that category contributes more to the overall score. For example, if technical SEO is critical for your site and you set it to weight 5, it will count significantly more than a category weighted at 2. The default is 3 for all categories, which treats them equally. Adjust weights to reflect your specific priorities.

Can I use this to evaluate multiple agencies and compare them?

Yes – fill in the scorecard for each agency separately and note their overall scores and category breakdowns. Because the weights stay consistent across evaluations, the scores are directly comparable. This makes it useful for shortlisting when you’re reviewing 3–5 agencies simultaneously.

What if I don’t have enough information to score some criteria?

Use N/A for criteria you genuinely can’t assess – these are excluded from the average rather than dragging the score down. However, if you find yourself marking many criteria N/A, it may indicate you need more information from the agency before completing the evaluation. A thorough scorecard based on solid evidence is more valuable than a quickly completed one with many gaps.

Should I tell the agency I’m using a scorecard?

That’s up to you. Some evaluators prefer to share the scorecard criteria in advance as it sets clear expectations and prompts better preparation from the agency. Others prefer to keep it internal to get a more natural read of the agency’s real capabilities. Either approach is valid – what matters is that you apply the same criteria consistently across all agencies you evaluate.