Basic keyword lists don’t move the needle anymore. Modern search is driven by intent, entities, SERP features (PAA, snippets, local packs), and multi-platform demand (YouTube, Amazon, SGE). Agencies that treat keyword research as strategic intelligence – not just a list of head terms win bigger, faster, and with clearer ROI.
Quick overview – the methods covered
-
Search-intent mapping & intent scoring
-
SERP feature & page-level analysis (PAA, snippets, zero-click)
-
Entity & topic modelling (semantic SEO / entity SEO)
-
Competitor gap + branded/opportunity harvesting
-
Cross-platform & channel keyword expansion (YouTube, Amazon, Bing)
-
Data-driven prioritization (traffic × intent × business value)
-
Scalable workflows & automation for agencies
1) Search-intent mapping & intent scoring (the foundation)
-
Classify every candidate keyword into informational, navigational, commercial, transactional (and micro-intents like “compare” or “how-to”). This prevents wasting conversion budget on purely informational pages.
-
Assign an intent score (0–100) combining: query wording, SERP result types, and historical CTR for similar queries. Use this to map which content type (blog, product, category, comparison) should target the keyword.
-
How agencies apply it: build a spreadsheet template with columns: keyword, volume, intent, intent score, current ranking, target page type, expected conversion action. Use this sheet as the single source of truth for content briefs.
Sources / reading: Ahrefs beginner→advanced guides and Moz intent resources.
2) SERP feature & page-level analysis – don’t just look at volume
-
Why: Today’s Page 1 is fractionated: featured snippets, PAA boxes, image packs, video, news, local packs. Ranking positions alone are insufficient; you must target SERP features.
-
Tactical steps: for each keyword, capture the SERP snapshot (top 10 URLs + feature types). Log whether snippet, PAA, or videos dominate. Prioritize keywords where featured snippets or PAA can be captured with short, structured content (lists, tables, Q&A).
-
Tools: use live PAA tools (AlsoAsked, AnswerThePublic) and SERP scraping from Ahrefs/SEMrush to detect feature opportunities.
3) Entity & topic modelling – move from keywords to concepts
-
What is entity SEO? Search engines increasingly understand concepts/entities (people, products, places) and their relationships. Optimizing for entities helps ranking across synonyms, long-tail variants, and LLM-driven answers.
-
How to do it: extract key entities from top-ranking pages (people, product names, models, use-cases), then build topical graphs linking pillar pages to supporting pages (entity ↔ attribute ↔ question). Use structured data (schema.org) to reinforce entities.
-
Agency play: audit clients for missing entity coverage (FAQ pages, definition pages, regional names, canonical product IDs) and draft a cluster map that shows entity relationships.
4) Competitor gap analysis & branded opportunity harvesting
-
Keyword gap: identify which keywords competitors rank for but the client does not. Prioritize low-difficulty, high-intent gaps using tools like Ahrefs/SEMrush.
-
Branded & competitor-branded terms: for many clients, capturing competitor-branded queries (comparison pages, “X vs Y”) is a quick win — especially with high-quality comparison content. Moz and Ahrefs recommend this as an underrated approach.
5) PAA & question mining – own the micro-intent
-
People Also Ask (PAA) boxes are high-intent, high-visibility slots. Crawl and map PAA trees for your seed keywords (tools: AlsoAsked, PAA scrapers). Build short answer blocks and structured Q&A pages to capture these.
-
Tactic: create a “question cluster” for each pillar page: 8–12 user questions with short answers (50–120 words) and a “see full guide” internal link.
6) Cross-platform & channel keyword expansion
-
Don’t only research Google. Users search on YouTube, Amazon, Instagram, and Bing – each has different intent signals. For product clients, Amazon keyword demand can drive content and product page language. Ahrefs’ keyword generator and platform-specific datasets help expand coverage.
-
Quick wins: create video scripts from high-volume How-To keywords, optimize product descriptions using Amazon phrasing, and repurpose FAQ answers as short video clips.
7) Data-driven prioritization: traffic × intent × business value
Build a scoring model and rank keywords by:
-
Business value (lead value, conversion rate estimate)
-
Intent multiplier (transactional > commercial > informational)
-
Volume & trend (use Google Trends for seasonality)
-
Difficulty & competitor strength (tool estimate)
Calculate a final priority score (e.g., Score = Value × Intent × (Volume / Difficulty)). This keeps the team focused on keywords that move revenue, not just traffic.
8) Scalable agency workflows & automation
-
Templates: client intake keyword brief, intent mapping sheet, content brief generator, SERP snapshot template.
-
Automation examples: use Google Search Console API + BigQuery to pull queries, combine with tool API (Ahrefs/SEMrush) for difficulty & traffic, then surface gaps programmatically.
-
Reporting: track the 5-10 highest value keywords per client (not 500) and report movement into SERP features and conversions — these are what clients care about.
Example one-page workflow (agency plug-and-play)
-
Client intake → define 3 business outcomes (leads, sales, awareness).
-
Seed list generation → competitor + brand + customer interviews + social listening.
-
Expand with tools → Ahrefs/SEMrush + AnswerThePublic + AlsoAsked + YouTube/Amazon.
-
Intent & SERP analysis → intent score + SERP feature capture.
-
Prioritize → business value model.
-
Content brief → title, intent, top competitor snippets, entities to mention, FAQ (PAA), internal links.
-
Publish & measure → GSC, GA4, rank tracker; iterate monthly.
Checklist: What to deliver in each keyword research report
-
Top 20 prioritized keywords with intent & score
-
SERP snapshot for each target keyword (features, top URLs)
-
Topic cluster map (pillar → supporting pages)
-
10 PAA questions + recommended short answers
-
Cross-platform expansions (YouTube, Amazon)
-
Quick recommendations: schema to add, internal linking plan, content types
Advanced tools & resources
-
Ahrefs (keyword/gap/serp data).
-
Moz (advanced methods, whiteboard tips).
-
AlsoAsked, AnswerThePublic (question mining).
-
Google Search Central & Google Trends (guidance + seasonality).
-
Search Engine Land / SurferSEO / Inlinks (entity SEO and topic clustering).
Measuring ROI (what to track)
-
Organic conversions from prioritized keywords (link GSC queries → GA4 goals).
-
Share of SERP features captured (snippets, PAA).
-
Rankings for high-value keywords (not all keywords).
-
New topical authority signals: internal links, entity mentions, cross-links, and backlinks to pillar pages.
Closing / agency action plan (first 30 days)
Week 1: client intake + seed list + competitor gap
Week 2: SERP & PAA mapping + intent scoring
Week 3: content briefs for top 5 priority keywords + entity map
Week 4: publish 1 pillar + 3 supporting pages, measure initial movement
Sources (for DigitalGuide)
- Ahrefs — How to Do Keyword Research for SEO (guide). Ahrefs
- Moz — Advanced SEO Keyword Research Tips & Use Cases (blog & Whiteboard Friday). Moz+1
- Google Search Central — SEO Starter Guide & best practices. Google for Developers
- Search Engine Land — Entity SEO & People Also Ask coverage. Search Engine Land+1
- SurferSEO / Inlinks — Entity SEO, topic clusters, and modern topic modelling. SurferSEO+1
- AlsoAsked & AnswerThePublic — question mining tools (practical PAA / question lists). AlsoAsked+1